CN103024397A - Method and device for determining time domain motion vector predictor - Google Patents

Abstract

A method for determining a time-domain motion vector predictor is provided, which can improve the effect of obtaining a time-domain motion vector predictor of a currently processed image block. The method includes: according to image information of a reference image of the current image block, selecting , to determine the corresponding image of the current image block, wherein the image information includes any of the following information: image type, the image sequence number POC relationship with the image of the current block, the layer it belongs to in layered coding or the In multi-view encoding, the image type is divided into long-term type and short-term type. The POC relationship is divided into POC same and POC different. The layer is divided into base layer and enhancement layer. Depending on the view; or according to the image information of the corresponding image of the current image block, from the image set, determine the reference image of the current image block; determine the corresponding image block of the current image block in the corresponding image; according to the reference image and For the corresponding image block, determine the time-domain motion vector predictor of the current image block.

Description

Method and device for determining temporal motion vector predictor

technical field

The present invention relates to the field of video, and more particularly, to a method and apparatus for determining temporal motion vector predictors.

Background technique

At present, a known image processing method is to find the corresponding block corresponding to the current block in the reference image according to the motion vector (MV, Motion Vector:) of the currently processed image block (hereinafter referred to as the current block), according to the Corresponding to the block, determine the motion vector predictor (MVP, Motionvector predictor) of the current block. At the encoding end, the MVP is subtracted from the MV of the current block to obtain a difference, and the difference is encoded. At the decoding end, the code stream is decoded to obtain the difference, and the MV of the current block is determined according to the difference and the MVP.

MVP includes the temporal motion vector predictor (TMVP, Temporal MV Predictor), that is, the MVP obtained according to the temporal reference image block (also called corresponding block or corresponding image block) of the current block, the so-called temporal domain refers to the current The picture where the block is located and the picture where the corresponding block is located are at different time positions on the time axis of the video sequence, and the position is represented by a picture order number (POC, Picture Order Count). The temporal distance of the MV refers to the distance between the reference image and the image where the current block is located, that is, the difference of the image POC.

In the process of obtaining the TMVP, if the temporal distance of the MV of the current block and the temporal distance of the MV of the corresponding image block of the current block may be different, scaling of the MV is involved. This scaling process is shown in Equation 1 below:

currMV=d/D*colMV Formula 1

D=POC(currRefPic)-POC(currPic)

d=POC(colRefPic)-POC(colPic)

Here, currMV represents the TMVP of the current block to be obtained, and colMV represents the TMV of the time domain reference block of the current block, and the time domain reference block is also called the corresponding block (colBlock, co-located Block). D represents the temporal distance of the MV of the current block (currBlock, current Block), and D is equal to the POC difference between the reference image (currRefPic, current Reference Picture) of the current block and the current image (currPic, current Picture) where the current block is located. d represents the time-domain distance of the MV of the corresponding block, and d is equal to the POC difference between the reference image (colRefPic, co-locatedReference Picture) pointed to by the MV of the corresponding block (ie colMV) and the image where the corresponding block is located. Here, the image where the corresponding block is located is called a corresponding image (colPic co-located picture). FIG. 1 shows a schematic diagram of the relationship among a current image, a corresponding image, a reference image of the current image, and a reference image of the corresponding image.

In the prior art, reference images are divided into two types: long-term and short-term.

If the reference image types of colRefPic and currRefPic are both short-term, then perform MV scaling to obtain TMVP, that is, currMV=d/D*colMV. If the reference image types of colRefPic and currRefPic are both long-term, then currMV=colMV, and the zoom factor is 1 at this time. If the reference image types of colRefPic and currRefPic are different, currMV cannot be obtained.

For example, if the reference picture type of colRefPic is short-term and the reference picture type of currRefPic is long-term, then d/D is a small value (close to zero), therefore, the TMVP of the current block obtained has no reference value.

For another example, if the reference image type of colRefPic is long-term, and the reference image type of currRefPic is short-term, then d/D is a large value (approaching infinity). Similarly, the obtained TMVP of the current block does not reference value.

Contents of the invention

Embodiments of the present invention provide a method, device, and device for determining a time-domain motion vector predictor, which can improve the effect of obtaining the time-domain motion vector predictor of a currently processed image block.

In the first aspect, there is provided a method for determining a temporal motion vector predictor, the method comprising: determining a corresponding image of the current image block from an image set according to image information of a reference image of the current image block, wherein the Image information includes any of the following information: image type, image sequence number POC relationship with the image to which the current block belongs, the layer to which it belongs in layered coding, or the view to which it belongs in multi-view coding. The image type is divided into Long-term type and short-term type, the POC relationship is divided into POC same and POC different, the belonging layer is divided into base layer and enhancement layer, and the belonging view is divided into basic view and dependent view; or according to the image of the corresponding image of the current image block Information, from the image set, determine the reference image of the current image block, where the image information includes any of the following information: image type, image sequence number POC relationship with the image to which the current block belongs, and layered The layer to which the image belongs in encoding or the view to which it belongs in multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, and the belonging layer is divided into basic layer and enhancement layer, The belonging view is divided into a base view and a dependent view; determining a corresponding image block of the current image block in the corresponding image; determining a temporal motion vector predictor of the current image block according to the reference image and the corresponding image block.

In a possible implementation manner, the current image block is a dependent view image, and the image set includes an image of a base view corresponding to the dependent view, or the current image block is an image block in an enhancement layer image, and the image The set includes images of the base layer corresponding to the enhancement layer image.

With reference to the first aspect and the first possible implementation manner, in a second possible implementation manner, according to the image information of the reference image of the current image block, from the image set, the corresponding image of the current image block is determined, including : According to the image type of the reference image of the current image block, determine the corresponding image of the current image block from the image set, so that the image type of the corresponding image is different from the image type of the reference image; or according to the current image block From the set of images, determine the corresponding image of the current image block, so that the POC relationship between the corresponding image and the image to which the current block belongs It is different from the POC relationship between the reference image and the image to which the current block belongs; or according to the layer to which the reference image of the current image block belongs, from the image set, determine the corresponding image of the current image block, so that the The layer to which the corresponding image belongs is different from the layer to which the reference image belongs; or according to the view to which the reference image of the current image block belongs, determine the corresponding image of the current image block from the image set, so that the view to which the corresponding image belongs Different from the owning view of this reference image.

With reference to the first aspect, the first possible implementation manner, and the second possible implementation manner, in a third possible implementation manner, the image set includes at least two first candidate images, wherein the first The type of the candidate image is different from the image type of the reference image, or the POC relationship between the first candidate image and the image belonging to the current block is different from that between the reference image and the image belonging to the current block The POC relationship of the first candidate image is different, or the layer to which the first candidate image belongs is different from the layer to which the reference image belongs, or the view to which the first candidate image belongs to is different from the view to which the reference image belongs, and the current The image information of the reference image of the image block, and determining the corresponding image of the current image block from the image set includes: determining from the at least two first candidate images according to the image information of the reference image of the current image block The image with the smallest index number in the image set is used as the corresponding image of the current image block.

With reference to the first aspect, the first possible implementation manner, the second possible implementation manner and the third possible implementation manner, in a fourth possible implementation manner, the set of images includes at least one second candidate image and at least one third candidate image, wherein the image type of the second candidate image is different from that of the third candidate image, or the POC relationship between the second candidate image and the image to which the current block belongs , is different from the POC relationship between the third candidate image and the image to which the current block belongs, or the layer to which the second candidate image belongs is different from the layer to which the third candidate image belongs, or the first The associated view of the second candidate image is different from the associated view of the third candidate image, and the method further includes: from the set of images, determining a predicted image, the predicted image includes a second candidate image and a third The candidate image, the predictive image is used to determine the corresponding image of each image block in the slice where the current image block is located; and according to the type of the reference image, from the image set, determine the corresponding image of the current image block, The method includes: determining a corresponding image of the current image block from the predicted image.

With reference to the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner and the fourth possible implementation manner, in a fifth possible implementation manner, the image set including at least two second candidate images, and/or the set of images includes at least two third candidate images, and determining a predicted image from the set of images comprises: determining a predicted image from the set of images, The predicted image includes the image with the smallest index number in the image set among the at least two second candidate images; and/or from the image set, a predicted image is determined, the predicted image includes the at least two third candidate images Select the image with the smallest index number in the image collection.

Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner and the fifth possible implementation manner, in the sixth possible implementation manner In an embodiment of the method, the method includes: from the image set, determining a target image as the corresponding image of each image block in the slice where the current image block is located; and according to the image information of the corresponding image of the current image block, from In the image set, determining the reference image of the current image block includes: according to the image type of the corresponding image of the current image block, determining the reference image of the current image block from the image set, so that the image type of the reference image Different from the image type of the corresponding image; or according to the POC relationship between the corresponding image of the current image block and the image of the current block, from the image set, determine the reference image of the current image block, so that the The POC relationship between the reference image and the image to which the current block belongs is different from the POC relationship between the corresponding image and the image to which the current block belongs; or according to the layer to which the corresponding image of the current image block belongs, from the image In the set, determine the reference image of the current image block, so that the layer to which the reference image belongs is different from the layer to which the corresponding image belongs; or according to the view to which the corresponding image of the current image block belongs, from the image set, determine the A reference image of the current image block, so that the associated view of the reference image is different from the associated view of the corresponding image.

Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner and the sixth possible implementation manner Implementation manner, in a seventh possible implementation manner, the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or the fourth candidate image is The POC relationship between the four candidate images and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs, or the layer to which the fourth candidate image belongs is different from that of the current block The layer to which the reference image belongs is different, or the view to which the fourth candidate image belongs is different from the view to which the reference image belongs, and according to the image information of the corresponding image, from the image set, determine the image of the current image block The reference image includes: determining the image with the smallest index number in the image set from the at least two fourth candidate images according to the image information of the corresponding image as the reference image of the current image block.

In combination with the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible implementation manner implementation manner and the seventh possible implementation manner. In the eighth possible implementation manner, the image to which the current image block belongs is a bidirectional predictive image, the corresponding image is a bidirectional predictive image, and the reference image and the corresponding For an image block, determining the temporal motion vector predictor of the current image block includes: determining the motion vector of the corresponding image block according to the image information of the corresponding image; determining the motion vector of the corresponding image block according to the reference image and the motion vector of the corresponding image block. The temporal motion vector predictor of the current image block.

In combination with the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible implementation manner implementation manner, the seventh possible implementation manner and the eighth possible implementation manner. In the ninth possible implementation manner, determining the motion vector of the corresponding image block further includes: when the image type of the corresponding image is In the long-term type, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the image pointed to by the motion vector of the corresponding image block belongs to The first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, so that the corresponding image block The image pointed to by the motion vector belongs to the second reference image list of the corresponding image; or when the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the current image block The first reference image list of the corresponding image, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block From the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when When the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image block The image pointed to by the motion vector belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion of the corresponding image block vector, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the belonging of the corresponding image is regarded as the base view, if the reference image of the current image block comes from the current The first reference image list of the image to which the image block belongs, then determine the motion vector of the corresponding image block, so that the image of the corresponding image pointed to by the motion vector of the corresponding image block belongs to the first reference image list, if the current image block The reference image comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

In a second aspect, a method for determining a temporal motion vector predictor is provided, the method comprising: determining a reference image and a corresponding image of a current image block, wherein the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image It is a bidirectional predictive image; determine the corresponding image block of the current image block in the corresponding image; determine the motion vector of the corresponding image block according to the image information of the corresponding image, and the image information includes any of the following information: image type, and The picture sequence number POC relationship between the pictures belonging to the current block, the belonging layer in hierarchical coding or the belonging view in multi-view coding, the picture type is divided into long-term type and short-term type, and the POC relationship is divided into POC The same and different from POC, the belonging layer is divided into base layer and enhancement layer, and the belonging view is divided into base view and dependent view; according to the reference image and the motion vector of the corresponding image block, determine the temporal motion of the current image block Vector predicted values.

In a possible implementation manner, the determining the motion vector of the corresponding image block further includes:

When the image type of the corresponding image is the long-term type, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image The image of the corresponding image pointed to by the motion vector of the block belongs to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block , so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the POC of the current image block The reference image is from the first reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, If the reference image of the current image block is from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the corresponding image The second reference image list; or when the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion of the corresponding image block vector, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the belonging of the corresponding image is regarded as the base view, if the current image block The reference image is from the first reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, If the reference image of the current image block is from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the corresponding image Second reference image list.

In a third aspect, a device for determining a temporal motion vector predictor is provided, the device comprising:

The determination unit is configured to determine the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block, wherein the image information includes any of the following information: image type, and the belongingness of the current block The image sequence number POC relationship between images, the layer they belong to in hierarchical coding, or the view they belong to in multi-view coding, the image type is divided into long-term type and short-term type, and the POC relationship is divided into POC same and POC different ; or used to determine the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, wherein the image information includes any of the following information: image type, and the belongingness of the current block The image sequence number POC relationship between images, the layer to which the image belongs in layered coding, or any information in the view to which it belongs in multi-view coding, the image type is divided into long-term type and short-term type, and the POC relationship is divided into The POC is the same and the POC is different; the processing unit is used to determine the corresponding image block of the current image block in the corresponding image; it is used to determine the temporal motion vector prediction of the current image block according to the reference image and the corresponding image block value.

In a possible implementation manner, the current image block is a dependent view image, and the image set includes an image of a base view corresponding to the dependent view, or the current image block is an image block in an enhancement layer image, and the image The set includes images of the base layer corresponding to the enhancement layer image.

With reference to the third aspect and the first possible implementation manner, in a second possible implementation manner, the determining unit is specifically configured to determine the current image from the image set according to the image type of the reference image of the current image block The corresponding image of the block, so that the image type of the corresponding image is different from the image type of the reference image; or for the POC relationship between the reference image of the current image block and the image of the current block, from the image In the set, determine the corresponding image of the current image block, so that the POC relationship between the corresponding image and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs; Or for determining the corresponding image of the current image block from the image set according to the layer to which the reference image of the current image block belongs, so that the layer to which the corresponding image belongs is different from the layer to which the reference image belongs; or used to According to the belonging view of the reference image of the current image block, from the image set, the corresponding image of the current image block is determined, so that the belonging view of the corresponding image is different from the belonging view of the reference image.

With reference to the third aspect, the first possible implementation manner, and the second possible implementation manner, in a third possible implementation manner, the image set includes at least two first candidate images, where the first The type of the candidate image is different from the image type of the reference image, or the POC relationship between the first candidate image and the image belonging to the current block is different from that between the reference image and the image belonging to the current block The POC relationship of the first candidate image is different, or the layer to which the first candidate image belongs is different from the layer to which the reference image belongs, or the view to which the first candidate image belongs to is different from the view to which the reference image belongs, and the determining unit Specifically, according to the image information of the reference image, from the at least two first candidate images, determine the image with the smallest index number in the image set as the corresponding image of the current image block.

With reference to the third aspect, the first possible implementation manner, the second possible implementation manner and the third possible implementation manner, in a fourth possible implementation manner, the set of images includes at least one second candidate image and at least one third candidate image, wherein the image type of the second candidate image is different from that of the third candidate image, or the POC relationship between the second candidate image and the image to which the current block belongs , is different from the POC relationship between the third candidate image and the image to which the current block belongs, or the layer to which the second candidate image belongs is different from the layer to which the third candidate image belongs, or the first The view to which the second candidate image belongs is different from the view to which the third candidate image belongs, and the determining unit is further configured to determine a predicted image from the set of images, the predicted image includes a second candidate image and a first candidate image Three candidate images, the predicted image is used to determine the corresponding image of each image block in the slice where the current image block is located; and is used to determine the corresponding image of the current image block from the predicted image.

With reference to the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner and the fourth possible implementation manner, in a fifth possible implementation manner, the image set includes at least two second candidate images, and/or the image set includes at least two third candidate images, and the determining unit is specifically configured to determine a predicted image from the image set, the predicted image includes the at least two The image with the smallest index number in the image set among the second candidate images; and/or for determining a predicted image from the image set, the predicted image includes the at least two third candidate images in the image set The image with the lowest index number in the image collection.

In combination with the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner and the fifth possible implementation manner, in the sixth possible implementation manner In an embodiment, the determining unit is specifically configured to determine a target image from the image set as the corresponding image of each image block in the slice where the current image block is located; , from the image set, determine the reference image of the current image block, so that the image type of the reference image is different from the image type of the corresponding image; The POC relationship between the images, from the image set, determine the reference image of the current image block, so that the POC relationship between the reference image and the image to which the current block belongs is the same as that of the corresponding image and the current block The POC relationship between the corresponding images of the current image block is different; or it is used to determine the reference image of the current image block from the image set according to the layer of the corresponding image of the current image block, so that the layer of the reference image is the same as the layer of the current image block The corresponding layer of the corresponding image is different; or it is used to determine the reference image of the current image block from the image set according to the view of the corresponding image of the current image block, so that the view of the reference image is the same as that of the corresponding image Affiliation is different.

Combining the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner and the sixth possible implementation manner Implementation manner, in a seventh possible implementation manner, the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or the fourth candidate image is The POC relationship between the four candidate images and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs, or the layer to which the fourth candidate image belongs is different from that of the current block The layer to which the reference image belongs is different, or the view to which the fourth candidate image belongs is different from the view to which the reference image belongs, and the determining unit is specifically configured to, according to the image information of the corresponding image, select from the at least two fourth Among the candidate images, the image with the smallest index number in the image set is determined as the reference image of the current image block.

In combination with the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible implementation manner implementation manner and a seventh possible implementation manner. In an eighth possible implementation manner, the image to which the current image block belongs is a bidirectional predictive image, the corresponding image is a bidirectional predictive image, and the processing unit is specifically configured to The image information of the corresponding image is used to determine the motion vector of the corresponding image block; for determining the time-domain motion vector predictor of the current image block according to the reference image and the motion vector of the corresponding image block.

In combination with the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible implementation manner implementation manner, a seventh possible implementation manner, and an eighth possible implementation manner. In a ninth possible implementation manner, the processing unit is specifically configured to, when the image type of the corresponding image is a long-term type, if the current The reference image of the image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the The second reference image list of the corresponding image; or when the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first image of the image to which the current image block belongs A reference image list, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the current image If the second reference image list of the image to which the block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for when the corresponding image When the layer to which the current image block belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the motion vector of the corresponding image block The image pointed to belongs to the corresponding image and the image belongs to the first reference image list, if the reference image of the current image block is from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, to Make the image pointed to by the motion vector of the corresponding image block belong to the second reference image list of the corresponding image; or for when the corresponding image belongs to the base view, if the reference image of the current image block comes from the current image If the first reference image list of the image to which the block belongs, then determine the motion vector of the corresponding image block, so that the image of the corresponding image pointed to by the motion vector of the corresponding image block belongs to the first reference image list, if the reference image of the current image block If the image comes from the second reference image list of the image to which the current image block belongs, the motion vector of the corresponding image block is determined so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

In a fourth aspect, there is provided a device for determining a time-domain motion vector predictor, the device comprising: a determining unit configured to determine a reference image and a corresponding image of a current image block, wherein the image to which the current image block belongs is a bidirectional prediction image, the corresponding image is a bidirectional predictive image; used to determine the corresponding image block of the current image block in the corresponding image; the processing unit is used to determine the motion vector of the corresponding image block according to the image information of the corresponding image, the Image information includes any of the following information: image type, image sequence number POC relationship with the image to which the current block belongs, the layer to which it belongs in layered coding, or the view to which it belongs in multi-view coding. The image type is divided into Long-term type and short-term type, the POC relationship is divided into POC same and POC different, the belonging layer is divided into base layer and enhancement layer, and the belonging view is divided into basic view and dependent view; The motion vector of the block is used to determine the time-domain motion vector predictor of the current image block.

In a possible implementation manner, the processing unit is specifically configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs , then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the image to which the current image block belongs the second reference image list of the corresponding image block, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for when the POC of the corresponding image and the When the POC of the image to which the current image block belongs is the same, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image block The image pointed to by the motion vector belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, To make the image pointed to by the motion vector of the corresponding image block belong to the second reference image list of the corresponding image; or for when the layer of the corresponding image is the base layer, if the reference image of the current image block comes from the current The first reference image list of the image to which the image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the current image If the reference image of the block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image of the corresponding image list; or for determining the motion vector of the corresponding image block if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs when the corresponding image belongs to the base view, Make the image of the corresponding image pointed to by the motion vector of the corresponding image block belong to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the corresponding The motion vector of the image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

According to the method and device for determining the time-domain motion vector predictor according to the embodiments of the present invention, by selecting the reference image of the current block and the corresponding image, the relationship between the reference image of the current block and the image type of the corresponding image, and the image block to which the current block belongs The POC relationship between them, the layer they belong to, or the visual difference can improve the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type, so that when the motion vector of the current block When the domain distance is different from the time domain distance of the motion vector of the corresponding block, the effect of obtaining the time domain motion vector predictor of the current block can be improved.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings required in the embodiments of the present invention. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.

FIG. 1 is a schematic diagram showing an example of the relationship between a current image, a corresponding image, a reference image of the current image, and a reference image of the corresponding image.

Fig. 2 is a schematic flowchart of a method for determining a temporal motion vector predictor according to an embodiment of the present invention.

Fig. 3 is a schematic flow chart of a method for determining a temporal motion vector predictor according to another embodiment of the present invention.

4 is a schematic diagram showing another example of the relationship between the current image, the corresponding image, the reference image of the current image, and the reference image of the corresponding image.

5 is a schematic diagram showing still another example of the relationship between the current image, the corresponding image, the reference image of the current image, and the reference image of the corresponding image.

Fig. 6 is a schematic block diagram of an apparatus for determining a temporal motion vector predictor according to an embodiment of the present invention.

Fig. 7 is a schematic block diagram of an apparatus for determining a temporal motion vector predictor according to another embodiment of the present invention.

Detailed ways

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

The basic principle of video coding and compression is to use the correlation between space domain, time domain and code words to remove redundancy as much as possible. In the block-based hybrid video coding framework, video coding compression is achieved through steps such as prediction (including intra-frame prediction and inter-frame prediction), transformation, quantization, and entropy coding. In this encoding framework, a video sequence sequence includes a series of image pictures, which are further divided into strips (also called slices) slices, and slices are further divided into blocks. Video encoding starts from the upper left corner of the picture in units of blocks, and performs encoding processing line by line from left to right and top to bottom. For ease of understanding, in the following description, the image block is taken as an object to describe the process of video encoding or decoding.

Fig. 2 shows a schematic flow chart of a method 100 for determining a temporal motion vector predictor according to an embodiment of the present invention. Moreover, the subject of implementation of the method 100 may be an encoding end or a decoding end, which is not particularly limited in the present invention. As shown in Figure 2, the method 100 includes:

S110, according to the image information of the reference image of the current image block, determine the corresponding image of the current image block from the image set, wherein the image information includes any of the following information: image type, and the image to which the current block belongs The POC relationship of the sequence number of the image, the belonging layer in the layered coding or the belonging view in the multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, the belonging The layer is divided into base layer and enhancement layer, and the belonging view is divided into base view and dependent view; or

According to the image information of the corresponding image of the current image block, the reference image of the current image block is determined from the image set, wherein the image information includes any of the following information: image type, relationship with the image to which the current block belongs The POC relationship of image sequence number, the layer to which the image belongs in hierarchical coding or the view to which it belongs in multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, the The layer is divided into the basic layer and the enhanced layer, and the view is divided into the basic view and the dependent view;

S120. Determine a corresponding image block of the current image block in the corresponding image;

S130. Determine a temporal motion vector predictor of the current image block according to the reference image and the corresponding image block.

And, the current image block is a dependent view image, and the image set includes an image of a base view corresponding to the dependent view, or

The current image block is an image block in an enhancement layer image, and the image set includes an image of a base layer corresponding to the enhancement layer image.

Specifically, the method for determining the time-domain motion vector predictor according to the embodiment of the present invention can be applied to include multi-view coding technology and layered coding technology, etc. It can be obtained from multiple reference images (or the motion information of the reference images) A technique for selecting a reference image from an image collection (or in other words, an image list) and using the reference image to determine the motion information of the currently processed image block.

For example, in multi-view coding, it includes base view and dependent view. The base view is encoded independently, compatible with existing video coding standards, and the dependent view is coded with reference to the base view using inter-view prediction technology, that is, the base view is regarded as a reference view of the dependent view (or, the image of the dependent view can refer to the base view image as a reference image) to predictively encode the dependent view. Due to the strong correlation between the dependent view and the base view, the dependent view has a high probability of selecting the base view as a reference, which means that there are a large number of image blocks in the dependent view that select images from the base view as reference images .

Similarly, in layered coding or scalable coding, a base layer and an enhancement layer are involved. The base layer is independently coded and compatible with existing video coding standards. The enhancement layer is coded with reference to the base layer using inter-layer prediction technology, that is, the base layer is regarded as a reference layer of the enhancement layer (or, the image of the enhancement layer can refer to the base layer image as a reference image) to predictively encode the enhancement layer. Due to the strong correlation between the enhancement layer and the base layer, the enhancement layer has a high probability of selecting the base layer as a reference, which means that there are a large number of image blocks in the enhancement layer that select images from the base layer as reference images .

For ease of understanding, in the following description, the method for determining a time-domain motion vector predictor according to an embodiment of the present invention is used in multi-view coding as an example for description.

Moreover, in the embodiment of the present invention, the base-view image is encoded using a short-term reference image, and the base layer image is encoded using a short-term reference image.

Specifically, reference images (or in other words, how to use reference images) can be divided into long-term and short-term. The long-term means that, for example, because the static background does not change for a long time, an image with a larger distance from the current image on the time axis can also be used as a reference for the current image. Compared with long-term, short-term means that the closer the distance between the two images on the time axis, the higher the correlation, and the better the effect as a reference image. Therefore, short-term reference images are usually used. to encode.

In the following, for the convenience of description, in the embodiment of the present invention, for the encoding of images in the base view and dependent views, for example, the inter-frame prediction encoding process (including MCP and MV prediction), short-term type reference images are used for encoding , similarly, for the encoding of images in the base layer and the enhancement layer, for example, the inter-frame prediction encoding process, including MCP and MV prediction, uses short-term reference images for encoding.

When encoding and decoding the currently processed image block (current image block, hereinafter referred to as the current block for convenience of description), the current block includes two or more motion vectors, and these motion vectors can be used to include two or more A plurality of reference blocks can be obtained from a reference image, so that, for example, the predictor value (MVP, MV predictor) of the motion vector of the current block can be determined according to the reference blocks.

In order to save the encoding bit overhead of the motion vector of the current block, the method of MV prediction + encoding prediction difference is used. Firstly, the predicted value of the motion vector of the current block is obtained through the MV prediction technology, then the difference between the MV of the current block and the predicted MV is determined, and finally the difference is encoded. The process of obtaining the predicted value of the motion vector of the current block through the MV prediction technology is performed in the same way in encoding and decoding, so as to obtain the same MV predicted value and realize the matching of encoding and decoding.

The predictor of the motion vector includes the predictor of the temporal motion vector (TMVP, Temporal MVpredictor). The predicted value of the time domain motion vector is the MV value obtained according to the time domain reference image (also known as the corresponding image) of the current block. The so-called time domain refers to the time between the image where the current block is located and the reference image of the current block in the video sequence. The axis is at different time positions, which are represented by the POC (Picture Order Count) of the image. The temporal distance of the MV refers to the distance on the time axis between the reference image pointed to by the MV and the image where the current block is located, that is, the difference of the image POC.

The process of obtaining TMVP involves the selection of the reference image of the current block and the corresponding image, as well as the scaling of the MV. In the process of obtaining TMVP, if the temporal distance of the MV of the current block and the temporal distance of the MV of the corresponding image block of the current block may be different , involves the scaling of MV, and the scaling process is shown in Equation 1.

It should be noted that, for example, in multi-view coding, since the reference image of the current block may come from other views, the reference image and the image where the current block is located may have the same POC, for example, the dependent view and the base view at a certain moment The images have the same POC (i.e., the POC relation is POC-same), so it may cause a divisor by zero during MV scaling involved in the TMVP acquisition process, i.e., POC(currRefPic)-POC(currPic)=0, To avoid this situation, the reference images from different views are treated as long-term, for example, the dependent view uses the reference images from the base view as long-term.

In the embodiment of the present invention, at S110, the coding end or the decoding end (for the convenience of description, the coded end will be used as an example of the implementation subject for illustration below) can select from the image list (image set) including at least two reference images , determine currRefPic and colPic.

It should be noted that the above image collection may be composed of multiple image lists, or may be only one image list (or image collection), which is not particularly limited in the present invention. For example, for a forward prediction image (P-slice, Prediction slice), the reference set is an image list, while for a bidirectional prediction image (B-slice, Bi-prediction slice), the image set includes two image lists.

In the embodiment of the present invention, currRefPic may be determined first, and then colPic may be determined according to the type of currRefPic (that is, case 1), or colPic may be determined first, and then currRefPic may be determined according to the type of colPic (that is, case 2). In the following, the above two cases will be described respectively.

Case 1

Specifically, for example, the encoding end (or decoding end) may determine an image from the reference image list (image set) as the reference image currRefPic of the current block.

Optionally, the encoder may determine the image with the smallest index number from the list of reference images as currRefPic.

It should be understood that the methods for determining currRefPic listed above are only illustrative examples, and the present invention is not limited thereto, and any image in the reference image list may be determined as currRefPic.

Moreover, the encoding end (or decoding end) can use the same method as the prior art to acquire the reference image list.

It should be noted that, in order to enable the encoding end and the decoding end to obtain the same TMVP to achieve the matching of encoding and decoding, it is necessary to ensure that the encoding end and the decoding end select the same currRefPic. Therefore, it can be stipulated that the encoding end and the decoding end select currRefPic according to the same rules, and after the encoding end determines currRefPic, it can notify the decoding end of the selected currRefPic (for example, inform the decoding end of the index of the image of the currRefPic in the reference image list number), so that the decoder selects the same currRefPic.

Afterwards, the encoding end can base on the image information of the reference image (image type, the image sequence number POC relationship with the image of the current block, the layer it belongs to in layered coding or the view it belongs to in multi-view coding any information) from the list of reference images, determine colPic.

case a

Optionally, in the embodiment of the present invention, according to the image information of the reference image of the current image block, from the image set, determining the corresponding image of the current image block includes:

According to the image type of the reference image of the current image block, from the image set, determine the corresponding image of the current image block, so that the image type of the corresponding image is different from the image type of the reference image.

Specifically, for example, the encoder may determine from the attribute information of currRefPic that the image type of currRefPic is long-term or short-term.

If currRefPic is long-term, make colPic short-term. If currRefPic is short-term, make colPic long-term.

Specifically, as described above, in multi-view coding, reference images from other views (specifically, the base view) are regarded as long-term, and reference images from the current view are regarded as short-term.

So, for example, if the selected currRefPic is short-term and colPic is long-term, it means that colPic is a reference picture from the base view. As mentioned above, the colRefPic used in encoding the base view (that is, colPic) is usually short-term, that is, the colRefPic of the corresponding block colBlock in the colPic is short-term. Therefore, both currRefPic and colRefPic are short-term, which can improve the effect of obtaining TMVP.

For another example, if the selected currRefPic is long-term and colPic is short-term, it means that colPic is a reference image from the current view (dependant view). The image of the current view (colPic) usually refers to images from other views (base views) when encoding, that is, the colRefPic of the colBlock in colPic is usually long-term. Therefore, both currRefPic and colRefPic are usually long-term, which can improve the effect of obtaining TMVP.

case b

Optionally, in the embodiment of the present invention, according to the image information of the reference image of the current image block, from the image set, determining the corresponding image of the current image block includes:

According to the POC relationship between the reference image of the current image block and the image of the current block, determine the corresponding image of the current image block from the image set, so that the corresponding image and the image to which the current block belongs The POC relationship between is different from the POC relationship between the reference picture and the picture to which the current block belongs

Specifically, for example, the encoder can determine the POC of currRefPic from the attribute information of currRefPic, and can determine the relationship between the POC of currRefPic and the POC of currPic from the POC of the image currPic to which the current block belongs.

If the POC of currRefPic is the same as the POC of currPic, make the POC of colPic different from the POC of currPic, and if the POC of currRefPic is different from the POC of currPic, make the POC of colPic the same as the POC of currPic.

Specifically, in the prior art, if the POC of a certain image (currRefPic or colPic) is the same as the POC of currPic, it means that the image comes from the base view or base layer, and the image type of the image is long-term. If the POC of a certain image (currRefPic or colPic) is different from the POC of currPic, it means that the image comes from the dependent view or enhancement layer, and the image type of the image is short-term. And vice versa, that is, if the image type of an image (currRefPic or colPic) is short-term, it means that the POC of the image is different from the POC of currPic, and if the image type of an image (currRefPic or colPic) is long-term, it means that the POC of the image is the same as the POC of currPic.

So, for example, if the selected POC of currRefPic is different from that of currPic, it means that the image type of currRefPic is short-term, while if the POC of colPic is the same as that of currPic, the image type of colPic is long-term, i.e., Indicates that colPic is a reference image from the base view. As mentioned above, the colRefPic used in encoding the base view (that is, colPic) is usually short-term, that is, the colRefPic of the corresponding block colBlock in the colPic is short-term. Therefore, both currRefPic and colRefPic are short-term, which can improve the effect of obtaining TMVP.

For another example, if the POC of the selected currRefPic is the same as the POC of currPic, it means that the selected currRefPic is long-term, and if the POC of currRefPic is different from the POC of currPic, it means that colPic is short-term, that is, it means that colPic is A reference image from the current view (the dependent view). The image of the current view (colPic) usually refers to images from other views (base views) when encoding, that is, the colRefPic of the colBlock in colPic is usually long-term. Therefore, both currRefPic and colRefPic are usually long-term, which can improve the effect of obtaining TMVP.

case c

Optionally, in the embodiment of the present invention, according to the image information of the reference image of the current image block, from the image set, determining the corresponding image of the current image block includes:

According to the layer to which the reference image of the current image block belongs, the corresponding image of the current image block is determined from the image set, so that the layer to which the corresponding image belongs is different from the layer to which the reference image belongs.

Specifically, if the currRefPic of the current block comes from the current layer (enhancement layer), it means that the currRefPic is short-term. At this time, the image (long-term) from the base layer is selected as the colPic. Since the reference pictures selected during encoding of pictures from the base layer (including the colPic) come from the base layer, that is, the reference pictures are all short-term. Therefore, the colRefPic of the corresponding block colBlock in colPic is short-term, that is, both colRefPic and currRefPic are short-term.

If the currRefPic of the current block comes from the base layer, it means that the currRefPic is long-term. At this time, the image (short-term) in the current layer (enhancement layer) is selected as the colPic. Since the reference image in the current layer usually uses inter-frame prediction to select the base layer as a reference during encoding, the colRefPic of the colBlock of colPic usually comes from the base layer (long-term), that is, both colRefPic and currRefPic are long -term.

situation d

Optionally, in the embodiment of the present invention, according to the image information of the reference image of the current image block, from the image set, determining the corresponding image of the current image block includes:

According to the belonging view of the reference image of the current image block, from the image set, the corresponding image of the current image block is determined, so that the belonging view of the corresponding image is different from the belonging view of the reference image.

Specifically, if the currRefPic of the current block comes from the current view (dependent view), it means that the currRefPic is short-term. At this time, the image (long-term) from the base view is selected as the colPic. Since the reference pictures selected during encoding of pictures from the base view (including the colPic) come from the base view, that is, the reference pictures are all short-term. Therefore, the colRefPic of the corresponding block colBlock in colPic is short-term, that is, both colRefPic and currRefPic are short-term.

If the currRefPic of the current block comes from the base view, it means that the currRefPic is long-term. At this time, the image (short-term) in the current view (dependent view) is selected as the colPic. Since the reference picture in the current view usually uses inter-frame prediction to select the base view as a reference during encoding, therefore, the colRefPic of the colBlock of colPic usually comes from the base view (long-term), that is, both colRefPic and currRefPic are long -term.

Optionally, the image set includes at least two first candidate images, wherein the type of the first candidate image is different from the image type of the reference image, or

The POC relationship between the first candidate picture and the picture to which the current block belongs is different from the POC relationship between the reference picture and the picture to which the current block belongs, or

the layer to which the first candidate picture belongs is different from the layer to which the reference picture belongs, or

the associated view of the first candidate image is different from the associated view of the reference image, and

The determination of the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block includes:

According to the image information of the reference image of the current image block, from the at least two first candidate images, determine the image with the smallest index number in the image set as the corresponding image of the current image block.

Specifically, after determining that currRefPic is the first type of image (image type short-term or long-term, the POC relationship with the image to which the current block belongs is the same or different, and the layer to which it belongs is the base layer or the enhancement layer, After being regarded as the base view or dependent view), the second type of image (different from the first type of image) needs to be selected from the first image list as colPic. At this time, if the first image list includes multiple (at least Two) the second type of image (that is, the first candidate image), you can select an image from the multiple first candidate images as colPic, for example, you can select the index number in the multiple first candidate images The smallest image is used as colPic, that is, the image whose type is different from currRefPic can be searched from the reference image list in ascending order of reference image index numbers as colPic.

In this way, since the smaller the index number, it means that the image is closer to the current image, so that the effect of the embodiment of the present invention can be further improved.

It should be understood that the selection of the image with the smallest index number among the second type of images as colPic is just an example for illustration, and the present invention is not limited thereto, and any one of the first candidate images may also be selected as colPic.

It should be noted that, in order to enable the encoding end and the decoding end to obtain the same TMVP to achieve encoding and decoding matching, it is necessary to ensure that the encoding end and the decoding end select the same colPic. Therefore, it can be stipulated that the encoding end and the decoding end select the colPic according to the same rules, and after the encoding end determines the colPic, it can notify the decoding end of the selected colPic, so that the decoding end selects the same colPic.

According to the method for obtaining the time-domain motion vector predictor according to the embodiment of the present invention, the currRefPic is determined first, and then the colPic is determined. Different colPic can be obtained for different image blocks, which has better adaptability and helps to obtain better encoding and compression performance.

Optionally, the set of images includes at least one second candidate image and at least one third candidate image, wherein the second candidate image is of a different image type than the third candidate image, or

The POC relationship between the second candidate image and the image to which the current block belongs is different from the POC relationship between the third candidate image and the image to which the current block belongs, or

the layer to which the second candidate image belongs is different from the layer to which the third candidate image belongs, or

the belonging view of the second candidate image is different from the belonging view of the third candidate image, and

The method also includes:

From the image set, determine a predicted image, the predicted image includes a second candidate image and a third candidate image, and the predicted image is used to determine a corresponding image of each image block in the slice where the current image block is located; as well as

According to the type of the reference image, from the image set, determine the corresponding image of the current image block, including:

From the predicted image, a corresponding image for the current image block is determined.

Specifically, in this embodiment of the present invention, for example, the reference image list includes at least three images (at least one image of the first type and at least two images of the second type, or at least one image of the second type and at least two images of the second type In the case of the first type image), one first type image and one second type image can be selected in advance from the first image list to form a new reference image list (predicted image).

After the currRefPic is determined as described above, according to the image type of the currRefPic, a colPic whose type is different from that of the currRefPic may be acquired in the predicted image. Since the predicted image includes the first type of image and the second type of image (that is, a short-term image and a long-term image, or an image that has the same POC relationship with the image of the current block and the same as the current block The POC relationship between the images belonging to the block is a different image, or the image belonging to the base layer and the image belonging to the enhancement layer, or the image belonging to the base view and the image belonging to the dependent view), Therefore, regardless of whether currRefPic is a first-type image or a second-type image, colPic of a type different from currRefPic can be acquired. Thus, codec efficiency can be improved.

Optionally, in the embodiment of the present invention, the method further includes:

From the image set, determine a reference image of a second image block, wherein the second image block is in the same band as the current image block;

According to the type of the reference image of the second image block, from the prediction image, determine the corresponding image of the second image block, so that the type of the corresponding image of the second image block is consistent with the reference image of the second image block of different types.

Specifically, since each image block of the same slice can use the same corresponding image, when acquiring the TMVP of the second image block in the same slice as the current block, the predicted image can be reused, thus reducing the processing time. of complexity.

Optionally, the set of images includes at least two second candidate images, and/or

the set of images includes at least two third candidate images, and

From this set of images, a predicted image is determined, including:

From the set of images, determining a predicted image comprising the image with the smallest index number in the set of images among the at least two second candidate images; and/or

From the set of images, a predicted image is determined, the predicted image including the image with the smallest index number in the set of images among the at least two third candidate images.

Specifically, the selected predictive image may be the image with the smallest index number among the first type images and/or the image with the smallest index number among the at least two second type images.

In this way, since the smaller the index number, it means that the image is closer to the current image, so that the effect of the embodiment of the present invention can be further improved.

Case 2

Optionally, the method includes:

From the image set, determine a target image as a corresponding image of each image block in the slice where the current image block is located; and

The determination of the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block includes:

Determining a reference image of the current image block from the image set according to the image type of the corresponding image of the current image block, so that the image type of the reference image is different from the image type of the corresponding image; or

According to the POC relationship between the corresponding image of the current image block and the image of the current block, determine the reference image of the current image block from the image set, so that the relationship between the reference image and the image to which the current block belongs The POC relationship between is different from the POC relationship between the corresponding image and the image to which the current block belongs; or

Determining a reference image of the current image block from the image set according to the layer to which the corresponding image of the current image block belongs, so that the layer to which the reference image belongs is different from the layer to which the corresponding image belongs; or

According to the belonging view of the corresponding image of the current image block, the reference image of the current image block is determined from the image set, so that the belonging view of the reference image is different from the belonging view of the corresponding image.

Specifically, since each image block of the same slice can use the same corresponding image, for example, the encoding end (or decoding end) can determine an image from the list of reference images as the reference image of each image block in the slice where the current block is located. Corresponding image colPic (target image).

Optionally, from the list of reference pictures, the picture with the smallest index number can be determined as colPic.

It should be understood that the methods for determining colPic listed above are only illustrative examples, and the present invention is not limited thereto, and any image in the reference image list may be determined as colPic.

It should be noted that, in order to enable the encoding end and the decoding end to obtain the same TMVP to achieve encoding and decoding matching, it is necessary to ensure that the encoding end and the decoding end select the same colPic. Therefore, it can be stipulated that the encoding end and the decoding end select colPic according to the same rules, and after the encoding end determines the colPic, it can notify the decoding end of the selected colPic (for example, inform the decoding end that the image of the colPic is in the first image list index number), so that the decoder selects the same colPic.

Afterwards, the encoding end can, according to the image information of the corresponding image (image type, the image sequence number POC relationship with the image of the current block, the layer it belongs to in layered coding or the view it belongs to in multi-view coding any information) from the list of reference pictures, determine currRefPic.

Situation e

Optionally, in the embodiment of the present invention, according to the image information of the corresponding image of the current image block, determining the reference image of the current image block from the image set includes:

According to the image type of the corresponding image of the current image block, a reference image of the current image block is determined from the image set, so that the image type of the reference image is different from the image type of the corresponding image.

Specifically, for example, the encoder may determine from the attribute information of colPic that the image type of colPic is long-term or short-term.

If colPic is long-term, make currRefPic short-term. If colPic is short-term, make currRefPic long-term.

Specifically, as described above, in multi-view coding, corresponding images from other views (specifically, the base view) are regarded as long-term, and corresponding images from the current view are regarded as short-term.

So, for example, if the selected colPic is short-term and currRefPic is long-term, it means that colPic is the corresponding image from the current view (depending on the view). The image of the current view (colPic) usually refers to images from other views (base views) when encoding, that is, the colRefPic of the colBlock in colPic is usually long-term. Therefore, both colPic and colRefPic are generally long-term, which can improve the effect of obtaining TMVP.

For another example, if the selected colPic is long-term and currRefPic is short-term, it means that colPic is the corresponding image from the base view. The colRefPic used by the basic view (that is, colPic) during encoding is usually short-term, that is, the colRefPic of the corresponding block colBlock in colPic is short-term. Therefore, both colPic and colRefPic are short-term, which can improve the effect of obtaining TMVP.

situation f

Optionally, in the embodiment of the present invention, according to the image information of the corresponding image of the current image block, determining the reference image of the current image block from the image set includes:

According to the POC relationship between the corresponding image of the current image block and the image of the current block, determine the reference image of the current image block from the image set, so that the relationship between the reference image and the image to which the current block belongs The POC relationship between is different from the POC relationship between the corresponding image and the image to which the current block belongs

Specifically, for example, the encoder can determine the POC of colPic from the attribute information of colPic, and can determine the relationship between the POC of colPic and the POC of currPic from the POC of the image currPic to which the current block belongs.

If the POC of colPic is the same as the POC of currPic, make the POC of currRefPic different from the POC of currPic, and if the POC of colPic is different from the POC of currPic, make the POC of currRefPic the same as the POC of currPic.

Specifically, in the prior art, if the POC of a certain image (currRefPic or colPic) is the same as the POC of currPic, it means that the image comes from the base view or base layer, and the image type of the image is long-term. If the POC of a certain image (currRefPic or colPic) is different from the POC of currPic, it means that the image comes from the dependent view or enhancement layer, and the image type of the image is short-term. And vice versa, that is, if the image type of an image (currRefPic or colPic) is short-term, it means that the POC of the image is different from the POC of currPic, and if the image type of an image (currRefPic or colPic) is long-term, it means that the POC of the image is the same as the POC of currPic.

So, for example, if the POC of the selected colPic is different from that of currPic, it means that the image type of colPic is short-term, while if the POC of currRefPic is the same as that of currPic, the image type of currRefPic is long-term. As mentioned above, the colRefPic used by the dependent view (that is, colPic) during encoding usually comes from the base view, that is, the colRefPic of the corresponding block colBlock in currRefPic is long-term. Therefore, both colPic and colRefPic are long-term, which can improve the effect of obtaining TMVP.

For another example, if the POC of the selected colPic is the same as the POC of currPic, it means that the selected colPic is long-term, and if the POC of colPic is different from that of currPic, it means that currRefPic is short-term, that is, it means that currRefPic is The corresponding image from the current view (the dependent view). The image of the basic view (ie colPic) uses a short-term reference image when encoding, that is, the colRefPic of the colBlock in the colPic is usually short-term. Therefore, colPic and colRefPic are generally short-term, which can improve the effect of obtaining TMVP.

situation g

Optionally, in the embodiment of the present invention, according to the image information of the corresponding image of the current image block, determining the reference image of the current image block from the image set includes:

Determine the reference image of the current image block from the image set according to the layer to which the corresponding image of the current image block belongs, so that the layer to which the reference image belongs is different from the layer to which the corresponding image belongs.

Specifically, if the colPic of the current block comes from the current layer (enhancement layer), it means that the colPic is short-term. At this time, the image (long-term) from the base layer is selected as currRefPic. Since the corresponding image in the current layer usually uses inter-frame prediction to select the base layer as a reference during encoding, the colRefPic of the colBlock of colPic usually comes from the base layer (long-term), that is, both colRefPic and colPic are long -term.

If the colPic of the current block comes from the base layer, it means that the colPic is long-term. At this time, the image (short-term) in the current layer (enhancement layer) is selected as the currRefPic. Since the reference pictures selected during encoding of pictures from the base layer (including the colPic) come from the base layer, that is, the reference pictures are all short-term. Therefore, the colRefPic of the corresponding block colBlock in colPic is short-term, that is, both colRefPic and colPic are short-term.

Situation h

Optionally, in the embodiment of the present invention, according to the image information of the corresponding image of the current image block, determining the reference image of the current image block from the image set includes:

According to the belonging view of the corresponding image of the current image block, the reference image of the current image block is determined from the image set, so that the belonging view of the reference image is different from the belonging view of the corresponding image.

Specifically, if the colPic of the current block comes from the current view (dependent view), it means that the colPic is short-term. At this time, the image (long-term) from the base view is selected as currRefPic. Since the corresponding image in the current view usually uses inter-frame prediction to select the base view as a reference during encoding, the colRefPic of colBlock in colPic usually comes from the base view (long-term), that is, both colRefPic and colPic are long-term.

If the colPic of the current block comes from the base view, it means that the colPic is long-term. At this time, the image (short-term) in the current view (dependent view) is selected as the currRefPic. Since the reference pictures selected during encoding of pictures from the base view (including the colPic) come from the base view, that is, the reference pictures are all short-term. Therefore, the colRefPic of the corresponding block colBlock in colPic is short-term, that is, both colRefPic and colPic are short-term.

Optionally, the image set includes at least two fourth candidate images, wherein the type of the fourth candidate image is different from the image type of the reference image, or

The POC relationship between the fourth candidate image and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs, or

The layer to which the fourth candidate picture belongs is different from the layer to which the reference picture belongs, or

the belonging view of the fourth candidate picture is different from the belonging view of the reference picture, and

Determining the reference image of the current image block from the image set according to the image information of the corresponding image includes:

According to the image information of the corresponding image, from the at least two fourth candidate images, determine the image with the smallest index number in the image set as the reference image of the current image block.

Specifically, after determining that colPic is the first type of image (image type short-term or long-term, the POC relationship between the image of the current block and the image to which it belongs is the same or different, and the layer to which it belongs is the base layer or the enhancement layer, After it is regarded as the base view or dependent view), it is necessary to select the second type of image (type different from the first type of image) as currRefPic from the reference image list. At this time, if the reference image list includes multiple (at least two ) image of the second type (that is, the fourth candidate image), an image can be selected from the multiple fourth candidate images as currRefPic, for example, the one with the smallest index number among the multiple fourth candidate images can be selected An image, as currRefPic, that is, an image whose type is different from colPic can be searched from the reference image list in ascending order of reference image index number as currRefPic.

In this way, since the smaller the index number, it means that the image is closer to the current image, so that the effect of the embodiment of the present invention can be further improved.

It should be understood that the selection of the image with the smallest index number among the fourth candidate images as the currRefPic listed above is only an example for illustration, and the present invention is not limited thereto, and any second candidate image may also be selected as the currRefPic.

According to the method for obtaining the time-domain motion vector predictor according to the embodiment of the present invention, the colPic of the current block is determined first, and then the currRefPic of the current block is determined. Since the colPic of each image block in the same slice is the same, the determined currRefPic is also the same, and it only needs to be determined once in the same slice, which can effectively reduce the processing complexity. In addition, the same colPic is used for all image blocks in the entire slice, which can effectively reduce the occupation of cache resources.

According to the method for determining the time-domain motion vector predictor in the embodiment of the present invention, by selecting the reference image of the current block and the corresponding image, the relationship between the reference image of the current block and the image type of the corresponding image, and the image block to which the current block belongs The POC relationship, the layer to which it belongs, or the visual difference can improve the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type, so that the temporal distance of the motion vector of the current block In a case where the time-domain distance from the motion vector of the corresponding block is different, the effect of obtaining the time-domain motion vector predictor of the current block can be improved.

It should be understood that the above enumerates that according to the image information of the images in the image set, the reference image and the corresponding image of the current image block are determined from the image set, so that the reference image of the current block and the image type of the corresponding image, and the image type of the current block The POC relationship between the corresponding image blocks, the corresponding layer or the embodiment of the visual difference, but the present invention is not limited thereto. Other embodiments that use the image information of the images in the image set to determine the reference image and the corresponding image of the current image block to improve the effect of obtaining the temporal motion vector prediction value of the current block all fall within the protection scope of the present invention.

For example, if the corresponding image of the selected current block is short-term, it means that the corresponding image comes from the current view or current layer (non-base view or basic augmentation), if the current view or current layer does not use the base view or base layer As a reference, if you use a short-term reference image, that is, colRefPic is short-term, you can select a short-term image as currRefPic.

For another example, when the base view or base layer uses long-term reference pictures, if the selected currRefPic is long-term and colPic is long-term, it means that colPic is a reference picture from the base view. As mentioned above, the colRefPic used by the basic view (that is, colPic) during encoding is long-term, that is, the colRefPic of the corresponding block colBlock in colPic is long-term. Therefore, both currRefPic and colRefPic are long-term, which can improve the effect of obtaining TMVP.

Moreover, in the embodiment of the present invention, there may be one or more dependent views, and the current block may refer to images of the base view or images of other dependent views. Similarly, there may be one or more enhancement layers, and the current block may refer to images of the base layer or images of other enhancement layers.

At S120, the corresponding image block of the current image block in the corresponding image may be determined, and the process and method of determining the corresponding image block may be the same as the prior art, and the description thereof is omitted here to avoid redundant description.

At S130, the temporal motion vector predictor of the current image block can be determined according to the reference image and the corresponding image block, specifically, the motion vector MV of the corresponding image block can be obtained, and if the MV of the current block If the time domain distance of the current block is different from the time domain distance of the MV of the corresponding image block of the current block, then the above formula 1 can be used to scale the MV according to the reference image and the corresponding image block.

Optionally, in this embodiment of the present invention, the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image, and

The determining the temporal motion vector predictor of the current image block according to the reference image and the corresponding image block includes:

Determine the motion vector of the corresponding image block according to the image information of the corresponding image;

According to the reference image and the motion vector of the corresponding image block, determine the temporal domain motion vector predictor of the current image block.

And, the determining the motion vector of the corresponding image block further includes:

When the image type of the corresponding image is the long-term type, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image The image pointed to by the motion vector of the block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block , so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion of the corresponding image block vector, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image The image pointed to by the motion vector of the block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the corresponding image block a motion vector, such that the picture pointed to by the motion vector of the corresponding picture block belongs to the second reference picture list of the corresponding picture; or

When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image The image of the corresponding image pointed to by the motion vector of the block belongs to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block , so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

Specifically, in the prior art, when acquiring the TMVP, a reference image with an index number of 0 is designated as the reference image of the current block. For B-slice, two reference images can be selected, which are the reference image with index number 0 in the first reference image list (list 0) and the second reference image list (list 1).

In addition, the corresponding image of the current block includes two MVs, namely, colMV_L0 and colMV_L1, and the list corresponding to colPic is used to select one of colMV_L1 in colMV_L0 as the predictive value of the MV. If colPic comes from list 0, select collMV_L1 pointing to list 1; if colPic comes from list 1, select colMV_L0 pointing to list 0.

For example, when the POC of colPic is not equal to the POC of the current image (that is, colPic is located before or after the current image, or colPic comes from the image of the current view), there is a certain correspondence between the list corresponding to colPic and the currMV of the current block. That is, the list of colPic is list 1, indicating that colPic is located behind the current image. At this time, colMV_L0 pointing to list 0 may pass through the current image. That is to say, colMV_L0 has a higher correlation with the currMV of the current block, so colMV_L0 is selected.

However, if colPic comes from the base view or base layer (that is, the image type of colPic is long-term, or the POC of colPic is the same as the POC of the currPic), at this time, there is no gap between the list corresponding to colPic and the current block currMV The determined relationship does not help to select the appropriate colMV for calculating the currMV of the current block. On the contrary, if the selected source list of the reference picture of the current block is different from the list pointed to by the selected colMV, it will seriously affect the acquisition of TMVP.

Therefore, in the embodiment of the present invention, colMV can be selected according to the list corresponding to the current block, and, after the reference image currRefPic of the current block is determined, the corresponding list of the current block can be determined according to the list from which currRefPic comes. The reference index in the list.

Specifically, if the list corresponding to the current block is list 0 (the first reference image list), select colMV_L0 pointing to list 0.

If the list corresponding to the current block is list 1 (the second reference image list), select collMV_L1 pointing to list 1.

In this way, the current block and the corresponding block have the same POC and the same MV direction, and the MV correlation of the two is higher, which helps to improve the prediction accuracy of TMVP.

Fig. 3 shows a schematic flow chart of a method 200 for determining a temporal motion vector predictor according to an embodiment of the present invention. Moreover, the subject of implementation of the method 200 may be an encoding end or a decoding end, which is not particularly limited in the present invention. As shown in Figure 3, the method 200 includes:

S210. Determine a reference image and a corresponding image of the current image block, where the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image;

S220. Determine a corresponding image block of the current image block in the corresponding image;

S230, according to the image information of the corresponding image, determine the motion vector of the corresponding image block, the image information includes any of the following information: image type, image sequence number POC relationship with the image to which the current block belongs, and layered Any information of the belonging layer in coding or the belonging view in multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, and the belonging layer is divided into basic layer and enhancement layer, the belonging view is divided into basic view and dependent view;

S240. Determine a temporal motion vector predictor of the current image block according to the reference image and the motion vector of the corresponding image block.

And, in the embodiment of the present invention, the determination of the motion vector of the corresponding image block further includes:

When the image type of the corresponding image is the long-term type, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image The image of the corresponding image pointed to by the motion vector of the block belongs to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block , so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion of the corresponding image block vector, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image The image pointed to by the motion vector of the block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block , so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block so that the corresponding image The image pointed to by the motion vector of the block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block , so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

Specifically, in the prior art, when acquiring the TMVP, a reference image with an index number of 0 is designated as the reference image of the current block. For B-slice, two reference images can be selected, which are the reference image whose index number is 0 in the first reference image list (list 0) and the second reference image list (list1).

In addition, the corresponding image of the current block includes two MVs, namely, colMV_L0 and colMV_L1, and the list corresponding to colPic is used to select one of colMV_L1 in colMV_L0 as the predictive value of the MV. If colPic comes from list 0, select collMV_L1 pointing to list 1; if colPic comes from list 1, select colMV_L0 pointing to list 0.

As shown in Figure 4, for example, when the POC of colPic is not equal to the POC of the current image (that is, colPic is located before or after the current image, or colPic comes from the image of the current view), the list corresponding to colPic and the currMV of the current block There is a certain correspondence, that is, the list of colPic is list 1, indicating that colPic is located behind the current image. At this time, colMV_L0 pointing to list 0 may pass through the current image, which means that colMV_L0 is more correlated with the currMV of the current block. High, so colMV_L0 is selected.

However, as shown in Figure 5, if colPic comes from the base view or base layer (that is, the image type of colPic is long-term, or the POC of colPic is the same as the POC of the currPic), at this time, the list corresponding to colPic and the current There is no definite relationship between the blocks currMV, which does not help to select the appropriate colMV for calculating the currMV of the current block. On the contrary, if the selected source list of the reference picture of the current block is different from the list pointed to by the selected colMV, it will seriously affect the acquisition of TMVP.

Therefore, in the embodiment of the present invention, if colPic comes from the base view or base layer (that is, the image type of colPic is long-term, or the POC of colPic is the same as the POC of currPic), then the list corresponding to the current block can be , to select colMV, and since the reference image currRefPic of the current block is determined, the corresponding list of the current block and the reference index in the list can be determined according to the list from which currRefPic comes.

Specifically, if the list corresponding to the current block is list 0 (the first reference image list), select colMV_L0 pointing to list 0.

If the list corresponding to the current block is list 1 (the second reference image list), select collMV_L1 pointing to list 1.

In this way, the current block and the corresponding block have the same POC and the same MV direction, and the MV correlation of the two is higher, which helps to improve the prediction accuracy of TMVP.

It should be understood that, as listed above, if colPic comes from the base view or base layer, colMV can be selected according to the list corresponding to the current block, but the present invention is not limited thereto. When colPic comes from the current view (dependent view) or In the case of the current layer (enhancement layer), colMV can also be selected according to the list corresponding to the current block.

The method for determining the time-domain motion vector predictor according to the embodiment of the present invention is described above with reference to FIG. 1 to FIG. 5 . Next, the apparatus for determining the time-domain motion vector predictor according to the embodiment of the present invention is described below with reference to FIG. 6 and FIG. 7 .

Fig. 6 shows a schematic block diagram of an apparatus 300 for determining a temporal motion vector predictor according to an embodiment of the present invention. As shown in Figure 6, the device 300 includes:

The determining unit 310 is configured to determine the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block, wherein the image information includes any of the following information: image type, The image sequence number POC relationship between the belonging pictures, the belonging layer in the hierarchical coding or the belonging view in the multi-view coding, the picture type is divided into long-term type and short-term type, and the POC relationship is divided into POC same and POC related different, the belonging layer is divided into base layer and enhancement layer, and the belonging view is divided into base view and dependent view; or

It is used to determine the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, wherein the image information includes any of the following information: image type, and the image type of the current block The image sequence number POC relationship between them, the layer to which the image belongs in hierarchical coding or the view to which it belongs in multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, The belonging layer is divided into basic layer and enhanced layer, and the belonging view is divided into basic view and dependent view;

A processing unit 320, configured to determine a corresponding image block of the current image block in the corresponding image;

It is used for determining the time-domain motion vector predictor of the current image block according to the reference image and the corresponding image block.

Optionally, the current image block is a dependent-view image, and the image set includes an image of a base-view corresponding to the dependent-view, or

The current image block is an image block in an enhancement layer image, and the image set includes an image of a base layer corresponding to the enhancement layer image.

Optionally, the determining unit 310 is specifically configured to determine the corresponding image of the current image block from the image set according to the image type of the reference image of the current image block, so that the image type of the corresponding image is the same as that of the reference image the image types are different; or

It is used to determine the corresponding image of the current image block from the image set according to the POC relationship between the reference image of the current image block and the image of the current block, so that the corresponding image belongs to the current block The POC relationship between pictures is different from the POC relationship between the reference picture and the picture to which the current block belongs; or

Determine the corresponding image of the current image block from the image set according to the layer to which the reference image of the current image block belongs, so that the layer to which the corresponding image belongs is different from the layer to which the reference image belongs; or

Determine the corresponding image of the current image block from the image set according to the associated view of the reference image of the current image block, so that the associated view of the corresponding image is different from the associated view of the reference image.

Optionally, the image set includes at least two first candidate images, wherein the type of the first candidate image is different from the image type of the reference image, or

The POC relationship between the first candidate picture and the picture to which the current block belongs is different from the POC relationship between the reference picture and the picture to which the current block belongs, or

the layer to which the first candidate picture belongs is different from the layer to which the reference picture belongs, or

the associated view of the first candidate image is different from the associated view of the reference image, and

The determining unit 310 is specifically configured to determine, from the at least two first candidate images, the image with the smallest index number in the image set as the corresponding image of the current image block according to the image information of the reference image.

Optionally, the set of images includes at least one second candidate image and at least one third candidate image, wherein the second candidate image is of a different image type than the third candidate image, or

The POC relationship between the second candidate image and the image to which the current block belongs is different from the POC relationship between the third candidate image and the image to which the current block belongs, or

the layer to which the second candidate image belongs is different from the layer to which the third candidate image belongs, or

the belonging view of the second candidate image is different from the belonging view of the third candidate image, and

The determining unit 310 is further configured to determine a predicted image from the image set, the predicted image includes a second candidate image and a third candidate image, and the predicted image is used to determine the slice in which the current image block is located the corresponding image of each image block;

It is used to determine the corresponding image of the current image block from the predicted image.

Optionally, the set of images includes at least two second candidate images, and/or

the set of images includes at least two third candidate images, and

The determining unit 310 is specifically configured to determine a predicted image from the image set, where the predicted image includes an image with the smallest index number in the image set among the at least two second candidate images; and/or

It is used for determining a predicted image from the image set, where the predicted image includes an image with the smallest index number in the image set among the at least two third candidate images.

Optionally, the determining unit 310 is specifically configured to determine a target image from the image set as a corresponding image of each image block in the slice where the current image block is located;

Determining a reference image of the current image block from the image set according to the image type of the corresponding image of the current image block, so that the image type of the reference image is different from the image type of the corresponding image; or

It is used to determine the reference image of the current image block from the image set according to the POC relationship between the corresponding image of the current image block and the image of the current block, so that the affiliation of the reference image with the current block The POC relationship between pictures is different from the POC relationship between the corresponding picture and the picture to which the current block belongs; or

Determine the reference image of the current image block from the image set according to the layer to which the corresponding image of the current image block belongs, so that the layer to which the reference image belongs is different from the layer to which the corresponding image belongs; or

Determine the reference image of the current image block from the image set according to the associated view of the corresponding image of the current image block, so that the associated view of the reference image is different from the associated view of the corresponding image.

Optionally, the image set includes at least two fourth candidate images, wherein the type of the fourth candidate image is different from the image type of the reference image, or

The POC relationship between the fourth candidate image and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs, or

The layer to which the fourth candidate picture belongs is different from the layer to which the reference picture belongs, or

the belonging view of the fourth candidate picture is different from the belonging view of the reference picture, and

The determining unit 310 is specifically configured to determine, from the at least two fourth candidate images, the image with the smallest index number in the image set according to the image information of the corresponding image, as the reference image of the current image block.

Optionally, the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image, and

The processing unit 320 is specifically configured to determine the motion vector of the corresponding image block according to the image information of the corresponding image;

It is used for determining the time-domain motion vector predictor of the current image block according to the reference image and the motion vector of the corresponding image block. ;

Optionally, the processing unit 320 is specifically configured to, when the image type of the corresponding image is a long-term type, determine the corresponding The motion vector of the image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference of the image to which the current image block belongs image list, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the corresponding image block so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs , then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, so that the The image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the corresponding image the motion vector of the block, so that the picture pointed to by the motion vector of the corresponding picture block belongs to the second reference picture list of the corresponding picture; or

When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, so that the The image of the corresponding image pointed to by the motion vector of the corresponding image block belongs to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the corresponding image block The motion vector, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

The device 300 for determining a time-domain motion vector predictor according to an embodiment of the present invention is the subject of implementation of the method 100 for determining a time-domain motion vector predictor according to an embodiment of the present invention, and may correspond to the encoding end or The decoding end, and each unit in the apparatus 300 for determining the time-domain motion vector predictor in FIG. I won't repeat them here.

According to the device for determining the time-domain motion vector predictor according to the embodiment of the present invention, by selecting the reference image of the current block and the corresponding image, the relationship between the image type of the reference image of the current block and the corresponding image, and the image block to which the current block belongs The POC relationship, the layer to which it belongs, or the visual difference can improve the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type, so that the temporal distance and the temporal distance of the motion vector of the current block In the case where the temporal distances of the motion vectors of the corresponding blocks are different, the effect of obtaining the temporal motion vector predictor of the current block can be improved.

Fig. 7 shows a schematic block diagram of an apparatus 400 for determining a temporal motion vector predictor according to an embodiment of the present invention. As shown in Figure 7, the device 400 includes:

A determining unit 410, configured to determine a reference image and a corresponding image of the current image block, wherein the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image;

For determining the corresponding image block of the current image block in the corresponding image;

The processing unit 420 is configured to determine the motion vector of the corresponding image block according to the image information of the corresponding image, and the image information includes any of the following information: image type, image sequence number POC relationship with the image to which the current block belongs 1. Any information of the belonging layer in hierarchical coding or the belonging view in multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, the belonging layer It is divided into the basic layer and the enhanced layer, and the view is divided into the basic view and the dependent view;

It is used for determining the time-domain motion vector predictor of the current image block according to the reference image and the motion vector of the corresponding image block.

Optionally, the processing unit 420 is specifically configured to, when the image type of the corresponding image is a long-term type, determine the corresponding The motion vector of the image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference of the image to which the current image block belongs image list, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the corresponding image block so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs , then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or

When the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, so that the The image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the corresponding image the motion vector of the block, so that the picture pointed to by the motion vector of the corresponding picture block belongs to the second reference picture list of the corresponding picture; or

When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, so that the The image of the corresponding image pointed to by the motion vector of the corresponding image block belongs to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determine the corresponding image block The motion vector, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

The apparatus 400 for determining a time-domain motion vector predictor according to an embodiment of the present invention is the subject of implementation of the method 200 for determining a time-domain motion vector predictor according to an embodiment of the present invention, and may correspond to the encoding end or The decoding end, and each unit in the device 400 for determining the time-domain motion vector predictor in FIG. I won't repeat them here.

It should be understood that the term "and/or" in this article is only an association relationship describing associated objects, which means that there may be three relationships, for example, A and/or B may mean: A exists alone, and A and B exist at the same time , there are three cases of B alone. In addition, the character "/" in this article generally indicates that the contextual objects are an "or" relationship.

It should be understood that in various embodiments of the present invention, the sequence numbers of the above-mentioned processes do not mean the order of execution, and the execution order of each process should be determined by its functions and internal logic, rather than by the embodiment of the present invention. The implementation process constitutes any limitation.

Those skilled in the art can appreciate that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the present invention.

Those skilled in the art can clearly understand that for the convenience and brevity of the description, the specific working process of the above-described system, device and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed systems, devices and methods may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit.

If the functions described above are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes. .

The above is only a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Anyone skilled in the art can easily think of changes or substitutions within the technical scope disclosed in the present invention. Should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (24)

1. A method for determining a temporal motion vector predictor, characterized in that the method comprises: According to the image information of the reference image of the current image block, determine the corresponding image of the current image block from the image set, wherein the image information includes any of the following information: image type, and the image to which the current block belongs The image sequence number POC relationship between them, the layer they belong to in hierarchical coding, or the view they belong to in multi-view coding, the image types are divided into long-term type and short-term type, and the POC relationship is divided into POC same and POC different , the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is divided into a base view and a dependent view; or According to the image information of the corresponding image of the current image block, determine the reference image of the current image block from the image set, wherein the image information includes any of the following information: image type, and the image to which the current block belongs The image sequence number POC relationship between them, the layer to which the image belongs in hierarchical coding or the view to which it belongs in multi-view coding, the image type is divided into long-term type and short-term type, and the POC relationship is divided into POC same and POC related different, said belonging layer is divided into base layer and enhanced layer, said belonging view is divided into base view and dependent view; determining a corresponding image block of the current image block in the corresponding image; A time-domain motion vector predictor of the current image block is determined according to the reference image and the corresponding image block. 2. The method according to claim 1, wherein the current image block is an image block in a dependent view image, and the image set includes an image of a base view corresponding to the dependent view, or The current image block is an image block in an enhancement layer image, and the image set includes an image of a base layer corresponding to the enhancement layer image. 3. The method according to claim 1 or 2, wherein the determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block includes: Determining, from the image set, a corresponding image of the current image block according to an image type of a reference image of the current image block, so that the image type of the corresponding image is different from the image type of the reference image; or According to the POC relationship between the reference image of the current image block and the image to which the current block belongs, determine the corresponding image of the current image block from the image set, so that the corresponding image of the corresponding image is consistent with the current image the POC relationship between the associated pictures of the block is different from the POC relationship between the reference image and the associated image of the current block; or Determine the corresponding image of the current image block from the image set according to the layer to which the reference image of the current image block belongs, so that the layer to which the corresponding image belongs is different from the layer to which the reference image belongs; or From the image set, determine the corresponding image of the current image block according to the belonging view of the reference image of the current image block, so that the belonging view of the corresponding image is different from the belonging view of the reference image. 4. The method according to claim 3, wherein the set of images includes at least two first candidate images, wherein the type of the first candidate images is the same as the image type of the reference image different, or The POC relationship between the first candidate image and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs, or the layer to which the first candidate image belongs is different from the layer to which the reference image belongs, or the associated view of the first candidate image is different from the associated view of the reference image, and The determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block includes: According to the image information of the reference image of the current image block, from the at least two first candidate images, determine the image with the smallest index number in the image set as the corresponding image of the current image block. 5. The method according to claim 3, wherein the set of images comprises at least one second candidate image and at least one third candidate image, wherein the second candidate image is the same as the third candidate image The image types of the candidate images are different, or The POC relationship between the second candidate image and the image to which the current block belongs is different from the POC relationship between the third candidate image and the image to which the current block belongs, or the layer to which the second candidate image belongs is different from the layer to which the third candidate image belongs, or the associated view of the second candidate image is different from the associated view of the third candidate image, and The method also includes: From the set of images, determine a predicted image, the predicted image includes a second candidate image and a third candidate image, and the predicted image is used to determine each image block in the slice where the current image block is located the corresponding image of ; and The determining the corresponding image of the current image block from the image set according to the type of the reference image includes: From said predicted image, a corresponding image of said current image block is determined. 6. The method of claim 5, wherein the set of images comprises at least two second candidate images, and/or the set of images includes at least two third candidate images, and The determining a predicted image from the image set includes: From said set of images, determining a predicted image comprising the image of said at least two second candidate images having the smallest index number in said set of images; and/or From the set of images, a predicted image is determined, the predicted image comprising the image with the smallest index number in the set of images among the at least two third candidate images. 7. The method according to claim 3, characterized in that the method comprises: From the image set, determine a target image as a corresponding image of each image block in the slice where the current image block is located; and The determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block includes: Determining a reference image of the current image block from the image set according to an image type of a corresponding image of the current image block, so that the image type of the reference image is different from the image type of the corresponding image; or According to the POC relationship between the corresponding image of the current image block and the image to which the current block belongs, determine the reference image of the current image block from the image set, so that the reference image of the reference image is consistent with the current image the POC relationship between the associated pictures of the block is different from the POC relationship between the corresponding image and the associated image of the current block; or Determining a reference image of the current image block from the image set according to the layer to which the corresponding image of the current image block belongs, so that the layer to which the reference image belongs is different from the layer to which the corresponding image belongs; or A reference image of the current image block is determined from the image set according to an associated view of a corresponding image of the current image block, so that the associated view of the reference image is different from the associated view of the corresponding image. 8. The method according to claim 7, wherein the image set includes at least two fourth candidate images, wherein the type of the fourth candidate image is the same as the image type of the corresponding image different, or The POC relationship between the fourth candidate image and the image to which the current block belongs is different from the POC relationship between the corresponding image and the image to which the current block belongs, or The layer to which the fourth candidate image belongs is different from the layer to which the reference image belongs, or the associated view of the fourth candidate image is different from the associated view of the reference image, and The determining the reference image of the current image block from the image set according to the image information of the corresponding image includes: According to the image information of the corresponding image, from the at least two fourth candidate images, determine the image with the smallest index number in the image set as the reference image of the current image block. 9. The method according to any one of claims 1 to 8, wherein the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image, and The determining the temporal motion vector predictor of the current image block according to the reference image and the corresponding image block includes: determining a motion vector of the corresponding image block according to the image information of the corresponding image; A time-domain motion vector predictor of the current image block is determined according to the reference image and the motion vector of the corresponding image block. 10. The method according to claim 9, wherein the determining the motion vector of the corresponding image block according to the image information of the corresponding image specifically comprises: When the image type of the corresponding image is the long-term type, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that The image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the corresponding The motion vector of the image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the image to which the current image block belongs determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that The image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, so that The image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image. 11. A method for determining a temporal motion vector predictor, characterized in that the method comprises: determining a reference image and a corresponding image of the current image block, wherein the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image; determining a corresponding image block of the current image block in the corresponding image; Determine the motion vector of the corresponding image block according to the image information of the corresponding image, the image information includes any of the following information: image type, image order number POC relationship with the image to which the current block belongs, and For the layer in layered coding or the view in multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, and the layer is divided into basic layer and enhancement layer, the said view is divided into basic view and dependent view; A time-domain motion vector predictor of the current image block is determined according to the reference image and the motion vector of the corresponding image block. 12. The method according to claim 11, wherein the determining the motion vector of the corresponding image block according to the image information of the corresponding image specifically comprises: When the image type of the corresponding image is the long-term type, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that The image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the corresponding The motion vector of the image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the image to which the current image block belongs determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the layer to which the corresponding image belongs is the base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the direction of the motion vector of the corresponding image block, to Make the image of the motion vector of the corresponding image block belong to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, so that The image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image. 13. A device for determining a temporal motion vector predictor, characterized in that the device comprises: The determining unit is configured to determine the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block, wherein the image information includes any of the following information: image type, and the current The picture sequence number POC relationship between the pictures belonging to the block, the belonging layer in hierarchical coding or the belonging view in multi-view coding, the picture type is divided into long-term type and short-term type, and the POC relationship is divided into POC same and different from POC, the belonging layer is divided into base layer and enhancement layer, and the belonging view is divided into base view and dependent view; or It is used to determine the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, wherein the image information includes any of the following information: image type, and the affiliation with the current block The image sequence number POC relationship between images, the layer to which the image belongs in layered coding or the view to which it belongs in multi-view coding, the image type is divided into long-term type and short-term type, and the POC relationship is divided into POC same and POC is different, the said belonging layer is divided into basic layer and enhancement layer, said belonging view is divided into basic view and dependent view; a processing unit, configured to determine a corresponding image block of the current image block in the corresponding image; It is used for determining the time-domain motion vector predictor of the current image block according to the reference image and the corresponding image block. 14. The apparatus according to claim 13, wherein the current image block is a dependent view image, and the image set includes an image of a base view corresponding to the dependent view, or The current image block is an image block in an enhancement layer image, and the image set includes an image of a base layer corresponding to the enhancement layer image. 15. The device according to claim 13 or 14, wherein the determining unit is specifically configured to determine the corresponding image of the current image block from the image set according to the image type of the reference image of the current image block. an image such that the image type of the corresponding image differs from the image type of the reference image; or Determine the corresponding image of the current image block from the image set according to the POC relationship between the reference image of the current image block and the image to which the current block belongs, so that the corresponding image and the corresponding image The POC relationship between the images belonging to the current block is different from the POC relationship between the reference image and the images belonging to the current block; or Determine the corresponding image of the current image block from the image set according to the layer to which the reference image of the current image block belongs, so that the layer to which the corresponding image belongs is different from the layer to which the reference image belongs; or Determine the corresponding image of the current image block from the image set according to the belonging view of the reference image of the current image block, so that the belonging view of the corresponding image is different from the belonging view of the reference image. 16. The device according to claim 15, wherein the set of images includes at least two first candidate images, wherein the type of the first candidate images is the same as the image type of the reference image different, or The POC relationship between the first candidate image and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs, or the layer to which the first candidate image belongs is different from the layer to which the reference image belongs, or the associated view of the first candidate image is different from the associated view of the reference image, and The determining unit is specifically configured to determine, from the at least two first candidate images, the image with the smallest index number in the image set according to the image information of the reference image, as the image of the current image block. corresponding image. 17. The apparatus according to claim 15, wherein the set of images comprises at least one second candidate image and at least one third candidate image, wherein the second candidate image is the same as the third candidate image The image types of the candidate images are different, or The POC relationship between the second candidate image and the image to which the current block belongs is different from the POC relationship between the third candidate image and the image to which the current block belongs, or the layer to which the second candidate image belongs is different from the layer to which the third candidate image belongs, or the associated view of the second candidate image is different from the associated view of the third candidate image, and The determining unit is further configured to determine a predicted image from the set of images, the predicted image includes a second candidate image and a third candidate image, and the predicted image is used to determine the current image block The corresponding image of each image block in the strip; It is used for determining the corresponding image of the current image block from the predicted image. 18. The apparatus of claim 17, wherein the set of images comprises at least two second candidate images, and/or the set of images includes at least two third candidate images, and The determining unit is specifically configured to determine a predicted image from the image set, the predicted image includes an image with the smallest index number in the image set among the at least two second candidate images; and/or It is used for determining a predicted image from the image set, where the predicted image includes an image with the smallest index number in the image set among the at least two third candidate images. 19. The device according to claim 15, wherein the determining unit is specifically configured to determine a target image from the image set as the corresponding image of each image block in the slice where the current image block is located ; Determining a reference image of the current image block from the image set according to an image type of a corresponding image of the current image block, so that the image type of the reference image is different from the image type of the corresponding image; or Determine the reference image of the current image block from the image set according to the POC relationship between the corresponding image of the current image block and the image to which the current block belongs, so that the reference image of the reference image is consistent with the The POC relationship between the images belonging to the current block is different from the POC relationship between the corresponding image and the image belonging to the current block; or Determine the reference image of the current image block from the image set according to the layer to which the corresponding image of the current image block belongs, so that the layer to which the reference image belongs is different from the layer to which the corresponding image belongs; or Determine the reference image of the current image block from the image set according to the associated view of the corresponding image of the current image block, so that the associated view of the reference image is different from the associated view of the corresponding image. 20. The device according to claim 19, wherein the set of images includes at least two fourth candidate images, wherein the type of the fourth candidate images is the same as the image type of the reference image different, or The POC relationship between the fourth candidate image and the image to which the current block belongs is different from the POC relationship between the reference image and the image to which the current block belongs, or The layer to which the fourth candidate image belongs is different from the layer to which the reference image belongs, or the associated view of the fourth candidate image is different from the associated view of the reference image, and The determining unit is specifically configured to determine, from the at least two fourth candidate images, the image with the smallest index number in the image set according to the image information of the corresponding image, as the image of the current image block. Reference image. 21. The device according to any one of claims 13 to 20, wherein the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image, and The processing unit is specifically configured to determine the motion vector of the corresponding image block according to the image information of the corresponding image; It is used for determining the time-domain motion vector predictor of the current image block according to the reference image and the motion vector of the corresponding image block. 22. The device according to claim 21, wherein the processing unit is specifically configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block comes from the current image If the first reference image list of the image to which the block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the current image If the reference image of the block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image 2 reference image lists; or When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the The second reference image list of the image to which it belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the layer to which the corresponding image belongs is a base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, making the image pointed to by the motion vector of the corresponding image block belong to the image of the corresponding image to belong to the first reference image list, if the reference image of the current image block comes from the second reference of the image to which the current image block belongs image list, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, making the image of the corresponding image pointed to by the motion vector of the corresponding image block belong to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs , then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image. 23. A device for determining a temporal motion vector predictor, characterized in that the device comprises: A determining unit, configured to determine a reference image and a corresponding image of the current image block, wherein the image to which the current image block belongs is a bidirectional predictive image, and the corresponding image is a bidirectional predictive image; for determining a corresponding image block of the current image block in the corresponding image; A processing unit, configured to determine the motion vector of the corresponding image block according to the image information of the corresponding image, where the image information includes any of the following information: image type, image sequence with the image to which the current block belongs Numbering POC relationship, belonging layer in hierarchical coding or belonging view in multi-view coding, the image type is divided into long-term type and short-term type, the POC relationship is divided into POC same and POC different, and the belonging The layer is divided into the basic layer and the enhanced layer, and the said view is divided into the basic view and the dependent view; It is used for determining the time-domain motion vector predictor of the current image block according to the reference image and the motion vector of the corresponding image block. 24. The device according to claim 23, wherein the processing unit is specifically configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block comes from the current image If the first reference image list of the image to which the block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the current image If the reference image of the block comes from the second reference image list of the image to which the current image block belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image 2 reference image lists; or When the POC of the corresponding image is the same as the POC of the image to which the current image block belongs, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, then determining the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block comes from the The second reference image list of the image to which it belongs, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the layer to which the corresponding image belongs is a base layer, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, making the image pointed to by the motion vector of the corresponding image block belong to the image of the corresponding image to belong to the first reference image list, if the reference image of the current image block comes from the second reference of the image to which the current image block belongs image list, then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or When the corresponding image belongs to the base view, if the reference image of the current image block comes from the first reference image list of the image to which the current image block belongs, determine the motion vector of the corresponding image block, making the image of the corresponding image pointed to by the motion vector of the corresponding image block belong to the first reference image list, if the reference image of the current image block comes from the second reference image list of the image to which the current image block belongs , then determine the motion vector of the corresponding image block, so that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.

Images