WO2014106388A1 - Method and device for determining temporal motion vector predictor - Google Patents

Method and device for determining temporal motion vector predictor Download PDF

Info

Publication number
WO2014106388A1
WO2014106388A1 PCT/CN2013/082017 CN2013082017W WO2014106388A1 WO 2014106388 A1 WO2014106388 A1 WO 2014106388A1 CN 2013082017 W CN2013082017 W CN 2013082017W WO 2014106388 A1 WO2014106388 A1 WO 2014106388A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
block
current
motion vector
determining
Prior art date
Application number
PCT/CN2013/082017
Other languages
French (fr)
Chinese (zh)
Inventor
林永兵
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2014106388A1 publication Critical patent/WO2014106388A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/513Processing of motion vectors
    • H04N19/517Processing of motion vectors by encoding
    • H04N19/52Processing of motion vectors by encoding by predictive encoding

Definitions

  • the present invention relates to the field of video and, more particularly, to determining predictive values of time domain motion vectors
  • a method of image processing is known, and a corresponding block corresponding to a current block is found in a reference image according to a motion vector (MV, Motion Vector:) of a currently processed image block (hereinafter, simply referred to as a current block), according to the Corresponding block, determining the motion vector predictor (MVP, Motion vector predictor) of the current block.
  • MVP Motion Vector
  • MVP is subtracted from the MV of the current block to obtain a difference, and the difference is encoded.
  • the code stream is decoded to obtain the difference, and based on the difference and the MVP, the MV of the current block is determined.
  • the MVP includes a time domain motion vector predictor (TMVP, Temporal MV Predictor), that is, an MVP obtained according to a time domain reference image block (also referred to as a corresponding block or a corresponding image block) of the current block, the so-called time domain, referring to the current
  • TMVP Temporal MV Predictor
  • the image in which the block is located and the image in which the corresponding block is located are at different time positions on the time axis of the video sequence, and the position is represented by a picture sequence number (POC, Picture Order Count).
  • the time domain distance of the MV refers to the distance between the reference image and the image in which the current block is located, that is, the difference between the image POC.
  • currMV d/D * colMV formula 1
  • currMV represents the TMVP of the current block to be acquired
  • colMV represents the TMV of the time domain reference block of the current block
  • the time domain reference block is also referred to as a co-located block (colBlock).
  • D Indicates the time domain distance of the MV of the current block (currBlock, current Block), and D is equal to the POC difference between the current block's reference image (currRefPic, current Reference Picture) and the current image (currPic, current Picture) where the current block is located.
  • FIG. 1 is a diagram showing the relationship between a current image, a corresponding image, a reference image of a current image, and a reference image of a corresponding image.
  • reference images are classified into long-term long-term and short-term short-term types.
  • d/D is a small value (close to zero), therefore, the obtained TMVP of the current block has no reference. value.
  • the reference image type of colRefPic is long-term
  • the reference image type of currRefPic is short-term
  • d/D is a large value (close to infinity)
  • the TMVP of the current block obtained is not Reference value.
  • Embodiments of the present invention provide a method, apparatus, and device for determining a time domain motion vector predictor, which can improve an effect of acquiring a time domain motion vector predictor of a currently processed image block.
  • a method for determining a time domain motion vector predictor comprising: determining, according to image information of a reference image of a current image block, a corresponding image of the current image block from the image set, where
  • the image information includes any of the following information: image type, image sequence number POC relationship with the image of the current block, associated layer in hierarchical coding, or in multi-view
  • the image type is divided into a long-term type and a short-term type.
  • the POC relationship is divided into a POC and a POC.
  • the belonging layer is divided into a basic layer and an enhancement layer.
  • the belonging view is divided into a basic view and a dependent view.
  • image information includes any of the following information: an image type, and an image of the current block
  • the image type is divided into a long-term type and a short-term type.
  • the POC relationship is divided into the same POC and the POC, and the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; determining a corresponding image block of the current image block in the corresponding image; The reference image and the corresponding image block determine a temporal motion vector predictor of the current image block.
  • the current image block is a dependent view image
  • the image set includes a base view image corresponding to the dependent view
  • the current image block is an image block in the enhancement layer image
  • the image The set includes an image of the base layer corresponding to the enhancement layer image.
  • determining, according to image information of a reference image of a current image block, a corresponding image of the current image block from the image set including Determining, according to an image type of the reference image of the current image block, a corresponding image of the current image block from the image set such that an image type of the corresponding image is different from an image type of the reference image; or according to the current image block a POC relationship between the reference image and the image of the current block, from which the corresponding image of the current image block is determined such that the POC relationship between the corresponding image and the image of the current block belongs to Determining a POC relationship with the associated image of the current block and the associated image of the current block; or determining a corresponding image of the current image block from the image set according to the associated layer of the reference image of the current image block, so that the The belonging layer of the corresponding image is different from the belonging layer of the reference image; or according to the belonging view of the reference
  • the image set includes at least two first candidate images, where The type of the first candidate image is different from the image type of the reference image, or a POC relationship between the image of the first candidate image and the image of the current block, and the belonging of the reference image and the current block
  • the POC relationship between the images is different, or the belonging layer of the first candidate image is different from the belonging layer of the reference image, or the belonging view of the first candidate image is different from the belonging view of the reference image
  • Determining, according to the image information of the reference image of the current image block, the corresponding image of the current image block from the image set comprising: according to the image information of the reference image of the current image block, from the at least two first candidate images
  • the image having the smallest index number in the image set is determined as the corresponding image of the current image block.
  • the image collection includes at least one second candidate image And at least one third candidate image, wherein the second candidate image is different from the image type of the third candidate image, or between the image of the second candidate image and the image of the current block
  • the method further includes: determining, from the image set, a predicted image, the predicted image including a second candidate image and a a third candidate image, the predicted image is used to determine a corresponding image of each image block in a strip in which the current image block is located; and determining, according to a type of the reference image, a correspondence of the current image block from the image set
  • the image includes: determining, from the predicted image, a corresponding image of the current image block.
  • the image collection include at least two second candidate images, and/or the image set includes at least two third candidate images
  • determining the predicted image from the set of images includes: determining a predicted image from the set of images, The predicted image includes an image having the smallest index number in the image set of the at least two second candidate images; and/or determining a predicted image from the set of images, the predicted image including the at least two third preparations The image with the smallest index number in the image set in the image is selected.
  • the method includes: determining, from the image set, a target image as a corresponding image of each image block in a strip in which the current image block is located; and image information according to the corresponding image of the current image block, Determining the reference image of the current image block in the image set, comprising: determining, according to an image type of the corresponding image of the current image block, a reference image of the current image block from the image set, so that the image type of the reference image Differentiating from the image type of the corresponding image; or determining a reference image of the current image block from the image set according to a POC relationship between the corresponding image of the current image block and the image of the current image, so that the a POC relationship between the reference image and the associated image of the current block and between the image of the corresponding image and the image of the current block The POC relationship is
  • the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or the first a POC relationship between the four candidate images and the associated image of the current block, different from a POC relationship between the reference image and the associated image of the current block, or the associated layer of the fourth candidate image
  • the belonging layer of the reference image is different, or the belonging view of the fourth candidate image is different from the belonging view of the reference image, and the image information according to the corresponding image is used to determine the current image block from the image set.
  • the reference image includes: determining, according to the image information of the corresponding image, an image with the smallest index number in the image set from the at least two fourth candidate images as the current Like reference image block.
  • the belonging image of the current image block is a bidirectional prediction image
  • the corresponding image is a bidirectional prediction image
  • the corresponding image and the corresponding image Determining a time domain motion vector predictor of the current image block, comprising: determining a motion vector of the corresponding image block according to image information of the corresponding image; determining the sound according to the reference image and a motion vector of the corresponding image block The time domain motion vector predictor of the current image block.
  • the determining a motion vector of the corresponding image block further includes: when the image type of the corresponding image is In the case of the long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to a first reference image list of the corresponding image, if the reference image of the current image block is from a second reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image block is The image pointed by the motion vector belongs to the second reference image list of the corresponding image; or when the corresponding Image
  • the POC is the same as the POC of the image of the current image block
  • determining a motion vector of the corresponding image block so that the POC And the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image
  • determining the corresponding image block a motion vector, such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the associated layer of the corresponding image is the base layer, if the reference image of the current image block is from the Determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the The image of the image corresponding to the motion vector of the corresponding image block belongs to the first reference image list, and if the reference image of the current image
  • a motion vector of the block such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the belonging of the corresponding image is regarded as the base view, if the reference image of the current image block comes from And determining, by the first reference image list of the image of the current image block, a motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if the current The reference image of the image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second reference of the corresponding image.
  • a method for determining a time domain motion vector predictor comprising: determining a reference image of a current image block and a corresponding image, wherein the belonging image of the current image block is a bidirectional predicted image, and the corresponding image Determining an image for two directions; determining a corresponding image block of the current image block in the corresponding image; determining a motion vector of the corresponding image block according to image information of the corresponding image, the image information including any of the following information: image type, and The image sequence number POC relationship between the images of the current block, the belonging layer in the layered coding, or the belonging view in the multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into POCs.
  • the affiliation layer is divided into a base layer and an enhancement layer, and the affiliation is divided into a base view and a dependent view; determining the time domain motion of the current image block according to the reference image and the motion vector of the corresponding image block Vector predictive value.
  • the determining a motion vector of the corresponding image block further includes:
  • the image type of the corresponding image is a long-term type
  • determining a motion vector of the corresponding image block so that the corresponding image
  • the image of the corresponding image pointed by the motion vector of the block belongs to the first reference image list
  • the reference image of the current image block is from the associated image of the current image block
  • the POC of the image of the image block is the same
  • the motion vector of the corresponding image block is determined, so that the corresponding image block is The image pointed by the motion vector belongs to the first reference image list of the corresponding image, and
  • Motion vector such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the belonging of the corresponding image is regarded as the base view, if the reference image of the current image block is from Determining, by the first reference image list of the image of the current image block, a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the current image The reference image of the block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image of the corresponding image. List.
  • an apparatus for determining a time domain motion vector predictor comprising: a determining unit, configured to determine, according to image information of a reference image of a current image block, a correspondence of the current image block from the image set An image, wherein the image information includes any of the following: an image type, an image sequence number POC relationship with an image of the current block, an belonging layer in hierarchical coding, or an attribute in multi-view coding,
  • the image type is divided into a long-term type and a short-term type
  • the POC relationship is divided into a POC and a POC, or is used for a corresponding image according to a current image block.
  • Image information from the image set, determining a reference image of the current image block, wherein the image information includes any of the following information: an image type, an image sequence number POC relationship with an image of the current block, Any information in the layer to which the image belongs or belongs to in the multiview encoding.
  • the image type is divided into a long-term type and a short-term type.
  • the POC relationship is divided into POC and POC.
  • the processing unit uses Determining a corresponding image block of the current image block in the corresponding image; and determining, according to the reference image and the corresponding image block, a time domain motion vector predictor of the current image block.
  • the current image block is a dependent view image
  • the image set includes a base view image corresponding to the dependent view
  • the current image block is an image block in the enhancement layer image
  • the image The set includes an image of the base layer corresponding to the enhancement layer image.
  • the determining unit is specifically configured to determine the current image from the image set according to an image type of the reference image of the current image block. a corresponding image of the block such that the image type of the corresponding image is different from the image type of the reference image; or from a POC relationship between the reference image of the current image block and the image of the current block, from the image In the set, determining a corresponding image of the current image block, so that a POC relationship between the corresponding image and an image of the current block is different from a POC relationship between the reference image and the image of the current block; Or determining, according to the belonging layer of the reference image of the current image block, from the image set, determining a corresponding image of the current image block, such that the belonging layer of the corresponding image is different from the belonging layer of the reference image; or Determining, according to the belonging view of the reference image of the current image block, a corresponding image of the current image block from the image
  • the image set includes at least two first candidate images, where the first The type of the candidate image is different from the image type of the reference image, or a POC relationship between the image of the first candidate image and the image of the current block, and the image of the reference image and the image of the current block
  • the POC relationship is different, or the belonging layer of the first candidate image and the belonging of the reference image
  • the layers are different, or the belonging view of the first candidate image is different from the belonging view of the reference image
  • the determining unit is specifically configured to use image information of the reference image from the at least two first candidate images. And determining an image with the smallest index number in the image set as a corresponding image of the current image block.
  • the image collection includes at least one second candidate image And at least one third candidate image, wherein the second candidate image is different from the image type of the third candidate image, or between the image of the second candidate image and the image of the current block
  • the determining unit is further configured to determine, from the image set, a predicted image, the predicted image including a second candidate image and a third candidate image for determining a corresponding image of each image block in the strip in which the current image block is located; for determining a corresponding image of the current image block from the predicted image.
  • the image collection include at least two second candidate images, and/or the image set includes at least two third candidate images
  • the determining unit is specifically configured to determine a predicted image from the image set, the predicted image including the at least two An image of the second candidate image having the smallest index number in the image set; and/or for determining a predicted image from the image set, the predicted image including the at least two third candidate images The image with the smallest index number in the image collection.
  • the determining unit is specifically configured to: determine, from the image set, a target image as a corresponding image of each image block in the strip in which the current image block is located; and an image type used according to the corresponding image of the current image block Determining, from the image set, a reference image of the current image block such that an image type of the reference image is different from an image type of the corresponding image; or for a POC relationship between a corresponding image of the image block and the image of the current block, from which the reference image of the current image block is determined such that the reference image is between the image of the current block and the image of the current block The POC relationship is different from the POC relationship between the corresponding image and the image to which the current block belongs; or is used to determine a reference image of the current image block from the image set according to the belonging layer of the corresponding image of the
  • the associated layer of the reference image is different from the associated layer of the corresponding image; or for determining the reference image of the current image block from the image set according to the belonging view of the corresponding image of the current image block, so that The belonging view of the reference image is different from the belonging view of the corresponding image.
  • the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or the first a POC relationship between the four candidate images and the associated image of the current block, different from a POC relationship between the reference image and the associated image of the current block, or the associated layer of the fourth candidate image
  • the belonging layer of the reference image is different, or the belonging view of the fourth candidate image is different from the belonging view of the reference image
  • the determining unit is specifically configured to: according to the image information of the corresponding image, from the at least two fourth In the candidate image, an image with the smallest index number in the image set is determined as a reference image of the current image block.
  • the belonging image of the current image block is a bidirectional predicted image
  • the corresponding image is a bidirectional predicted image
  • the processing unit is specifically configured to use the Corresponding to the image information of the image, determining a motion vector of the corresponding image block; and determining a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block.
  • the processing unit is specifically configured to: when the image type of the corresponding image is a long-term type, If the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the corresponding image a first reference image list, if the reference image of the current image block is from a second reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block to point the motion vector of the corresponding image block The image belongs to the second reference image list of the corresponding image; or when the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of
  • a reference image list a reference image list; or when the belonging of the corresponding image is regarded as a base view, If the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to a first reference image list, if the reference image of the current image block is from a second reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block to point the motion vector of the corresponding image block The image belongs to a second reference image list of the corresponding image.
  • an apparatus for determining a time domain motion vector predictor comprising: a determining unit, configured to determine a reference image and a corresponding image of a current image block, where the image of the current image block is bidirectionally predicted An image, the corresponding image is a bidirectional predicted image; a corresponding image block for determining the current image block in the corresponding image; a processing unit, configured to determine a motion vector of the corresponding image block according to the image information of the corresponding image,
  • the image information includes any of the following information: an image type, an image sequence number POC relationship with an image of the current block, an belonging layer in hierarchical coding, or an attribute in multi-view coding, the image type is divided into For the long-term type and the short-term type, the POC relationship is divided into the same POC and the POC, and the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; and is used according to the reference image and the
  • the processing unit is specifically configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block is from a first reference image list of the image of the current image block. And determining a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the image of the current image block.
  • a second reference image list determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for the POC of the corresponding image and the
  • the motion vector of the corresponding image block is determined, so that the corresponding image block is The image pointed by the motion vector belongs to the first reference image list of the corresponding image, if The reference image of the front image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second of the corresponding image.
  • a reference image list if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the motion of the corresponding image block Vector, such that the image pointed to by the motion vector of the corresponding image block belongs to the image of the corresponding image belongs to the first reference image list, if The reference image of the current image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second of the corresponding image.
  • a reference image list if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining the motion of the corresponding image block Vector, the image of the corresponding image pointed to by the motion vector of the corresponding image block belongs to the first reference image list, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, A motion vector of the corresponding image block is determined such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.
  • a method and apparatus for determining a time domain motion vector predictor by selecting a reference image and a corresponding image of a current block, causing a reference image of the current block and an image type of the corresponding image, and an image block to which the current block belongs
  • the POC relationship, the affiliation layer, or the view difference can improve the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type, and thus, at the time of the motion vector of the current block When the domain distance is different from the time domain distance of the motion vector of the corresponding block, the effect of acquiring the temporal motion vector predictor of the current block can be improved.
  • Fig. 1 is a schematic diagram showing an example of a relationship between a current image, a corresponding image, a reference image of a current image, and a reference image of a corresponding image.
  • FIG. 2 is a schematic flow chart of a method of determining a time domain motion vector predictor in accordance with an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of a method of determining a time domain motion vector predictor according to another embodiment of the present invention.
  • 4 is a schematic diagram showing another example of the relationship between the current image, the corresponding image, the reference image of the current image, and the reference image of the corresponding image.
  • Fig. 5 is a schematic diagram showing still another example of the relationship between the current image, the corresponding image, the reference image of the current image, and the reference image of the corresponding image.
  • FIG. 6 is a schematic block diagram of an apparatus for determining a time domain motion vector predictor in accordance with an embodiment of the present invention.
  • Figure 7 is a schematic block diagram of an apparatus for determining a time domain motion vector predictor in accordance with another embodiment of the present invention.
  • video coding compression is implemented by prediction (including intra prediction and inter prediction), transform, quantization, entropy coding, and the like.
  • the video sequence includes a series of pictures, the picture is further divided into slices (also called slices) slices, which are then divided into block blocks.
  • the video encoding is encoded in units of blocks from the top left position of the picture from left to right and from top to bottom. For ease of understanding, in the following description, the process of encoding or decoding a video will be described with respect to an image block.
  • the method 100 includes:
  • S110 Determine, according to image information of a reference image of the current image block, a corresponding image of the current image block from the image set, where the image information includes any of the following information:
  • the image information includes any of the following information: an image type, and an image of the current block
  • the layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view;
  • the current image block is a dependent view image
  • the image set includes a base view image corresponding to the dependent view
  • the current image block is an image block in the enhancement layer image, the image collection including an image of the base layer corresponding to the enhancement layer image.
  • the method for determining a time domain motion vector predictor can be applied to include a plurality of reference images (or motion information of the reference image) including a multi-view coding technique and a layered coding technique.
  • a base view and an dependent view are included.
  • Basic view independent coding compatible with existing video coding standards, relying on the use of inter-view prediction technology to reference the base view coding, that is, the basic view is regarded as a reference view of the dependent view (or, depending on the view, the base view can be viewed as a base view)
  • the image is used as a reference image) to predictively encode the dependent image. Since there is a strong correlation between the dependent view and the base view, the probability of relying on the selected base view as a reference Very large, this means that there are a large number of image blocks in the dependent view to select the image from the base view as the reference image.
  • a base layer and an enhancement layer are included.
  • the base layer is independently coded and compatible with existing video coding standards.
  • the enhancement layer uses the inter-layer prediction technique to reference the base layer for coding, that is, the base layer is treated as a reference layer of the enhancement layer (or the enhancement layer image can be the base layer)
  • the image is used as a reference image to predictively encode the enhancement layer. Since there is a strong correlation between the enhancement layer and the base layer, the probability that the enhancement layer selects the base layer as a reference is very high, which means that there are a large number of image blocks in the enhancement layer, and the image from the base layer is selected as the reference image. .
  • the base view image is encoded using a short-term type of reference image
  • the base layer image is encoded using a short-term type of reference image
  • the reference image (or the way the reference image is used) can be divided into long-term long-term and short-term short-term.
  • Long-term means, for example, that the background of the still image does not change for a long time, so that the image with a larger distance from the current image on the time axis can also be used as a reference for the current image.
  • Relative to long-term, short-term means that the closer the two images are on the time axis, the higher the correlation, the better the effect as a reference image. Therefore, the reference image of short-term is usually used. Encode.
  • encoding of an image in a base view and a dependent view for example, an interframe predictive encoding process (including MCP and MV prediction)
  • an interframe predictive encoding process is encoded using a reference image of a short-term type.
  • encoding of images in the base layer and the enhancement layer for example, an interframe predictive encoding process, including MCP and MV prediction, is encoded using a reference image of a short-term type.
  • the current block When performing a codec operation on a currently processed image block (current image block, hereinafter referred to as a current block for convenience of explanation), the current block includes two or more motion vectors, and these motion vectors can be utilized, including two or more Obtaining a plurality of reference blocks in the reference image, and thus, for example, may be based on The reference block determines a predicted value (MVP, MV predictor ) of the motion vector of the current block.
  • MVP predicted value
  • the MV prediction + coding prediction difference value method is used. First, the predicted value of the motion vector of the current block is obtained by the MV prediction technique, and then the difference between the MV of the current block and the predicted value of the MV is determined, and finally the difference is encoded. The process of obtaining the predicted value of the motion vector of the current block by the MV prediction technique is performed in the same manner in encoding and decoding to obtain the same MV prediction value, and the matching of encoding and decoding is realized.
  • the predicted value of the motion vector includes the predicted value of the time domain motion vector (TMVP, Temporal MV predictor).
  • the predicted value of the time domain motion vector is the MV value acquired according to the time domain reference image (also referred to as the corresponding image) of the current block, and the so-called time domain refers to the time when the image of the current block and the reference image of the current block are in the video sequence.
  • the axes are at different time positions, which are represented by the POC (Picture Order Count) of the image.
  • the time domain distance of the MV refers to the distance on the time axis between the reference image pointed to by the MV and the image in which the current block is located, that is, the difference of the image POC.
  • the acquisition of the TMVP process involves the selection of the reference image and the corresponding image of the current block, and the scaling of the MV.
  • the scaling process is shown in Equation 1.
  • the reference image of the current block may come from other views, the reference image may have the same POC as the image in which the current block is located, for example, dependent-view and base-view at a certain moment.
  • the reference image from different views is treated as a long-term.
  • the dependent view takes the reference image from the base view as a long-term.
  • the encoding end or the decoding end may be from an image list (image set) including at least two reference images. , determine currRefPic and colPic.
  • image set may be composed of a plurality of image lists, or may be only one image list (or image collection), and the present invention is not particularly limited.
  • the reference set is one image list
  • B-slice, Bi-prediction slice the image set includes two image lists.
  • currRefPic may be first determined, and colPic (ie, case 1) may be determined according to the type of currRefPic, or colPic may be determined first, and currRefPic (ie, case 2) is determined according to the type of colPic.
  • colPic ie, case 1
  • currRefPic ie, case 2
  • the encoding end (or the decoding end) can determine an image from the reference image list (image set) as the reference image currRefPic of the current block.
  • the encoding end may determine, from the reference image list, an image with the smallest index number as currRefPic.
  • currRefPic any image in the reference image list may be determined as currRefPic.
  • the encoding end (or the decoding end) can acquire the reference image list using the same method as the prior art.
  • currRefPic in order to enable the encoding end and the decoding end to obtain the same TMVP to achieve the matching of encoding and decoding, it is necessary to ensure that the encoding end and the decoding end select the same currRefPic. Therefore, it may be specified that the encoding end and the decoding end select currRefPic according to the same rule, and may also notify the decoding end of the selected currRefPic after the encoding end determines currRefPic (for example, notifying the decoding end as an index of the image of the currRefPic in the reference image list) No.), so that the decoder selects the same currRefPic.
  • the encoding end may be based on image information of the reference image (image type, image sequence number POC relationship with the image of the current block, belonging layer in hierarchical coding, or belonging in multi-view coding) Any of the information) from the list of reference images, determine colPic.
  • determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block including:
  • a corresponding image of the current image block is determined from the image set such that the image type of the corresponding image is different from the image type of the reference image.
  • the encoding end may determine, from the attribute information of currRefPic, that the image type of currRefPic is long-term or short-term.
  • the mouth currRefPic is a long-term, and the shell 1 J makes colPic a short-term.
  • the mouth currRefPic is short-term, and Bay 1 J makes colPic a long-term.
  • a reference picture from other views (specifically, a basic view) is regarded as a long-term, and a reference picture from the current view is regarded as a short-term.
  • colPic is a reference image from the base view.
  • the colRefPic used by the base view is usually short-term, that is, the colRefPic of the corresponding block colBlock in colPic is short-term.
  • both currRefPic and colRefPic are short-term, which can improve the effect of acquiring TMVP.
  • determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block including:
  • the POC relationship between the belonging images of the block is different from the POC relationship between the reference image and the image of the current block
  • the encoding end may determine the POC of the currRefPic from the attribute information of the currRefPic, and may determine the POC of the currRefPic from the POC of the currPic from the POC of the image currPic of the current block.
  • the POC of the currRefPic is the same as the POC of the currPic, the POC of the colPic is different from the POC of the currPic. If the POC of the currRefPic is different from the POC of the currPic, the POC of the colPic is the same as the POC of the currPic.
  • the POC of an image (currRefPic or colPic) is the same as the POC of the currPic, it indicates that the image is from the base view or the base layer, indicating that the image type of the image is long-term, If the POC of an image ( currRefPic or colPic ) is different from the POC of currPic, it means that the image is from a dependent view or enhancement layer, indicating that the image type of the image is short-term.
  • the image type of the currRefPic is short-term
  • the colPic image type is long-term, ie, Indicates that colPic is a reference image from the base view.
  • the colRefPic used by the base view ie colPic
  • the colRefPic used by the base view is usually short-term, that is, the colRefPic of the corresponding block colBlock in colPic is short-term.
  • both currRefPic and colRefPic are short-term, which can improve the effect of acquiring TMVP.
  • the selected currRefPic is the same as the POC of the currPic, the selected currRefPic is a long-term, and the POC of the currRefPic is different from the POC of the currPic, indicating that the colPic is a short-term, that is, a colPic Is from the current view (dependency) Reference image.
  • the current view image ie, colPic usually refers to images from other views (base view) when encoding, that is, the colRefPic of colBlock in colPic is usually long-term.
  • currRefPic and colRefPic are usually long- Term, can improve the effect of acquiring TMVP.
  • determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block including:
  • the current block's currRefPic is from the current layer (enhancement layer), it means that currRefPic is a short-term.
  • the image from the base layer long-term
  • the reference image comes from the base layer, that is, the reference image is a short-term. Therefore, the corresponding block colBlock ⁇ colRefPic in colPic is short-term, and colRefPic and currRefPic are short-term.
  • the currRefPic of the current block of the mouth comes from the base layer, indicating that currRefPic is long-term.
  • the image (short-term) in the current layer (enhancement layer) is selected as colPic.
  • the reference picture in the current layer usually uses the inter-prediction to select the base layer as a reference when encoding
  • the colRefPic of the colPlock of colPic usually comes from the base layer (which is a long-term), that is, both colRefPic and currRefPic are long. -term.
  • determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block including:
  • the currRefPic of the current block comes from the current view (dependent view)
  • the image from the base view (long-term) is selected as colPic.
  • the reference image is from the base view, that is, the reference image is short-term. Therefore, the corresponding block colBlock ⁇ colRefPic in colPic is short-term, and colRefPic and currRefPic are short-term.
  • the current currRefPic of the current block comes from the base view, which means that currRefPic is long-term.
  • the image (short-term) in the current view (dependency view) is selected as colPic.
  • the reference image in the current view usually uses inter prediction to select the base view as a reference when encoding
  • the colRefPic of the colPlock of colPic usually comes from the base view (which is a long-term), that is, both colRefPic and currRefPic are long. -term.
  • the image set includes at least two first candidate images, where the type of the first candidate image is different from the image type of the reference image, or
  • a POC relationship between the first candidate image and the associated image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
  • the associated layer of the first candidate image is different from the layer to which the reference image belongs, or
  • the belonging view of the first candidate image is different from the belonging view of the reference image
  • currRefPic is the first type image (the image type short-term or long-term, the POC relationship with the image of the current block is the same or different, and the belonging layer is a base layer or an enhancement layer
  • the first image list includes a plurality (at least Two) the second type of image (ie, the first candidate image)
  • one of the plurality of first candidate images may be selected as the colPic, for example, the index numbers of the plurality of first candidate images may be selected
  • the smallest image, as colPic that is, an image of a type different from currRefPic can be found from the reference image list in ascending order of the reference image index number as colPic.
  • the smaller the index number the closer the image is to the current image, so that the effect of the embodiment of the present invention can be further improved.
  • colPic is only an example description, and the present invention is not limited thereto, and any one of the first candidate images may be selected as colPic.
  • a method of obtaining a time domain motion vector predictor first determines currRefPic and then determines colPic. Different colPic can be obtained for different image blocks, which has better adaptability and helps to obtain better coding compression performance.
  • the image set includes at least one second candidate image and at least one third candidate image, wherein the second candidate image is different from the image type of the third candidate image, or
  • a POC relationship between the second candidate image and the associated image of the current block is different from a POC relationship between the third candidate image and the associated image of the current block, or
  • the belonging layer of the second candidate image is different from the layer to which the third candidate image belongs, or
  • the belonging view of the second candidate image is different from the belonging view of the third candidate image, and the method further includes:
  • a predicted image the predicted image comprising a second candidate image and a third candidate image, the predicted image being used to determine a corresponding image of each image block in the strip in which the current image block is located; as well as
  • the reference image list includes at least three images (at least one first type image and at least two second type images, or at least one second type image and at least two
  • a first type image and a second type image may be selected in advance from the first image list to constitute a new reference image list (predicted image).
  • a colPic of a type different from the currRefPic type may be obtained in the predicted image. Since the predicted image includes the first type image and the second type image (ie, the short-term image and the long-term image, or the POC relationship with the associated image of the current block is the same image and the current The POC relationship between the images belonging to the block is a different image, or the image in which the layer belongs to the base layer and the image in which the layer belongs to the enhancement layer, or the image regarded as the base view and the image to which the dependent view is regarded, Therefore, whether currRefPic is a first type image or a second type image, a colPic of a type different from currRefPic can be obtained. Thereby, the codec efficiency can be improved.
  • the method further includes:
  • each image block of the same slice can use the same corresponding image, when the TMVP of the second image block of the same slice as the current block is acquired, the predicted image can be reused, thereby reducing the processing.
  • the complexity since each image block of the same slice can use the same corresponding image, when the TMVP of the second image block of the same slice as the current block is acquired, the predicted image can be reused, thereby reducing the processing. The complexity.
  • the set of images includes at least two second candidate images, and/or
  • the set of images includes at least two third candidate images, and
  • Determining the predicted image from the image set includes:
  • a predicted image is determined, the predicted image comprising an image of the at least two third candidate images having the smallest index number in the set of images.
  • the selected predicted image may be an image having the smallest index number in the first type image and/or an image having the smallest index number among the at least two second type images.
  • the smaller the index number the closer the image is to the current image, so that the effect of the embodiment of the present invention can be further improved.
  • the method comprises:
  • the reference image of the current image block is determined from the image set such that the belonging view of the reference image is different from the belonging view of the corresponding image.
  • each image block of the same slice can use the same corresponding image, for example, the encoding end (or the decoding end) can determine an image from the reference image list as the current The corresponding image colPic (target image) of each image block in the slice in which the block is located.
  • an image with the smallest index number may be determined from the reference image list as colPic. It should be understood that the above-listed methods of determining colPic are merely exemplary, and the present invention is not limited thereto, and any image in the reference image list may be determined as colPic.
  • the encoding end and the decoding end may be specified that the encoding end and the decoding end select colPic according to the same rule, and may also notify the decoding end of the selected colPic after the encoding end determines colPic (for example, notifying the decoding end as the image of the colPic in the first image list. The index number), so that the decoder selects the same colPic.
  • the encoding end may be based on the image information of the corresponding image (the image type, the POC relationship with the image sequence between the image of the current block, the belonging layer in the layered encoding, or the dependent view in the multi-view encoding). Any of the information) from the list of reference images, determine currRefPic.
  • determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block including:
  • a reference image of the current image block is determined from the image set such that the image type of the reference image is different from the image type of the corresponding image.
  • the encoding end may determine, from the attribute information of colPic, that the image type of colPic is long-term or short-term.
  • the colPic is a long-term, and Bay 1 J makes currRefPic a short-term.
  • the colPic of the mouth is short-term, and the shell 1 J makes currRefPic a long-term.
  • a corresponding image from another view (specifically, a basic view) is regarded as a long-term, and a corresponding image from the current view is regarded as a short-term.
  • colPic is the corresponding image from the current view (dependent view).
  • the current view image usually refers to images from other views (base view) when encoding, that is, the colRefPic of colBlock in colPic is usually long-term.
  • colPic and colRefPic are usually long-terms, which can improve the effect of acquiring TMVP.
  • colPic used by the base view (ie colPic) is usually short-term, that is, the colRefPic of the corresponding block colBlock in colPic is short-term. Therefore, both colPic and colRefPic are short-term, which can improve the effect of acquiring TMVP.
  • determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block including:
  • the POC relationship between the two is different from the POC relationship between the corresponding image and the image of the current block.
  • the encoding end may determine the POC of the colPic from the attribute information of the colPic, and may determine the POC of the colPic from the POC of the currPic from the POC of the image currPic of the current block.
  • the POC of colPic is the same as the POC of currPic, the POC of currRefPic is different from the POC of currPic. If the POC of colPic is different from the POC of currPic, the POC of currRefPic is the same as the POC of currPic.
  • the POC of an image (currRefPic or colPic) is the same as the POC of the currPic, it indicates that the image is from the base view or the base layer, indicating that the image type of the image is long-term
  • the POC of an image ( currRefPic or colPic ) is different from the POC of currPic, it means that the image is from a dependent view or enhancement layer, indicating that the image type of the image is short-term.
  • the type is short-term, it means that the POC of the image is different from the POC of currPic.
  • the image type of a certain image (currRefPic or colPic) is long-term, it means that the POC of the image is the same as the POC of currPic.
  • the image type of colPic is short-term
  • the POC of currRefPic is the same as the POC of currPic
  • the currRefPic image type is long-term.
  • the colRefPic used by the dependent view (ie colPic) in encoding is usually derived from the base view, that is, the colRefPic of the corresponding block colBlock in currRefPic is long-term.
  • both colPic and colRefPic are long-term, which can improve the effect of acquiring TMVP.
  • the selected colPic is a long-term
  • the currRefPic is a short-term
  • the currRefPic is Corresponding image from the current view (dependency view).
  • the base view image ie, colPic
  • colPic and colRefPic are usually short-terms, which can improve the effect of acquiring TMVP.
  • determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block including:
  • a reference image of the current image block is determined from the image set according to an associated layer of the corresponding image of the current image block such that the associated layer of the reference image is different from the associated layer of the corresponding image.
  • colPic of the current block comes from the current layer (enhancement layer), it means that colPic is a short-term.
  • the image from the base layer ( long -term ) is selected as currRefPicgla due to the current layer.
  • Corresponding images usually use inter prediction to select the base layer as a reference when encoding. Therefore, the colRefPic of colPlock of colPic usually comes from the base layer (long-term), that is, both colRefPic and colPic are long-term.
  • colPic of the current block comes from the base layer, it means that colPic is a long-term.
  • determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block including:
  • colPic of the current block comes from the current view (dependent view)
  • the image from the base view ( long-term ) is selected as currRefPic. Since the corresponding image in the current view usually uses inter prediction to select the base view as a reference when encoding, the colRefPic of the colBlock in colPic usually comes from the base view (which is long-term), that is, both colRefPic and colPic are Long-term.
  • the colPic of the current block comes from the base view, it means that colPic is a long-term.
  • the image (short-term) in the current view (dependency view) is selected as currRefPic. Since the image from the basic view (including the colPic) is selected at the time of encoding, the reference image comes from the base view, that is, the reference image is a short-term. Therefore, the colRefPic of the corresponding block colBlock in colPic is short-term, and colRefPic and colPic are short-term.
  • the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or
  • a POC relationship between the fourth candidate image and the belonging image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
  • the belonging layer of the fourth candidate image is different from the layer to which the reference image belongs, or
  • the belonging view of the fourth candidate image is different from the belonging view of the reference image
  • an image having the smallest index number in the image set is determined as a reference image of the current image block.
  • colPic is the first type of image (the image type short-term or long-term, the POC relationship with the image of the current block is the same or different, and the belonging layer is a base layer or an enhancement layer
  • a second type image the type is different from the first type image
  • the reference image list includes a plurality (at least two) a second type of image (ie, a fourth candidate image)
  • one of the plurality of fourth candidate images may be selected as a currRefPic, for example, a plurality of fourth candidate images may be selected with the smallest index number
  • the image, as currRefPic, that is, the colRefPic can be found from the reference image list in the order of the reference image index numbers from small to large.
  • the smaller the index number the closer the image is to the current image, so that the effect of the embodiment of the present invention can be further improved.
  • currRefPic is only an example description, and the present invention is not limited thereto, and any one of the second candidate images may be selected as currRefPic.
  • the method for obtaining a time domain motion vector predictor first determines the colPic of the current block, and then determines the currRefPic of the current block. Since the colPic of each image block in the same slice is the same, the determined currRefPic is also the same, and the determination is performed once in the same slice, which can effectively reduce the processing complexity. In addition, the same colPic is used for all image blocks in the entire slice, which can effectively reduce the occupation of cache resources.
  • the reference image of the current block and the image type of the corresponding image and the image block of the current block are The POC relationship, the belonging layer or the view is different, and the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type can be improved. Therefore, in the case where the time domain distance of the motion vector of the current block and the time domain distance of the motion vector of the corresponding block are different, the effect of acquiring the time domain motion vector predictor of the current block can be improved.
  • the reference image and the corresponding image of the current image block are determined from the image set, so that the reference image of the current block and the image type of the corresponding image, and the current block are
  • the POC relationship between the associated image blocks, the associated layer or the different embodiments are not limited thereto.
  • Other embodiments that use the image information according to the image in the image set to determine the reference image and the corresponding image of the current image block to improve the effect of acquiring the temporal motion vector predictor of the current block fall within the scope of the present invention.
  • the corresponding image of the selected current block is short-term, it means that the corresponding image is from the current view or the current layer (non-base view or basic increase), if the current view or current layer does not use the base view or the base layer
  • the reference image of short-term that is, colRefPic is short-term, you can select the short-term image as currRefPic.
  • the base view or the base layer uses the long-term reference image
  • the shell 1 J indicates that the colPic is a reference image from the base view.
  • the colRefPic used by the base view ie, colPic
  • the colRefPic of the corresponding block colBlock in colPic is a long-term.
  • both currRefPic and colRefPic are long-term, which can improve the effect of acquiring TMVP.
  • the current block may refer to the image of the base view, and may also refer to other dependent images.
  • the current block can refer to the image of the base layer or the image of other enhancement layers.
  • a corresponding image block of the current image block in the corresponding image may be determined, and the process and method of determining the corresponding image block may be the same as in the prior art, and the description thereof is omitted here to avoid redundancy.
  • a time domain motion vector predictor of the current image block may be determined according to the reference image and the corresponding image block, and specifically, a motion vector MV of the corresponding image block may be acquired, and If the time domain distance of the MV of the current block is different from the time domain distance of the MV of the corresponding image block of the current block, the scaling of the MV may be performed according to the reference image and the corresponding image block using Equation 1 above.
  • the belonging image of the current image block is a bidirectional predicted image
  • the corresponding image is a bidirectional predicted image
  • Determining a time domain motion vector prediction value of the current image block according to the reference image and the corresponding image block including:
  • a time domain motion vector predictor of the current image block is determined based on the reference image and a motion vector of the corresponding image block.
  • the image type of the corresponding image is a long-term type
  • determining a motion vector of the corresponding image block so that the corresponding image The image pointed by the motion vector of the block belongs to the first reference image list of the corresponding image
  • determining the motion vector of the corresponding image block such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image
  • the belonging layer of the corresponding image is the base layer
  • determining a motion vector of the corresponding image block so that the corresponding image
  • the image pointed to by the motion vector of the block belongs to the image of the corresponding image a first reference image list
  • determining a motion vector of the corresponding image block to point the motion vector of the corresponding image block The image belongs to a second reference image list of the corresponding image; or
  • the belonging of the corresponding image is regarded as a base view
  • determining a motion vector of the corresponding image block so that the corresponding image
  • the image of the corresponding image pointed by the motion vector of the block belongs to the first reference image list
  • the reference image of the current image block is from the second reference image list of the belonging image of the current image block
  • the motion vector of the corresponding image block is determined. And causing the image pointed by the motion vector of the corresponding image block to belong to the second reference image list of the corresponding image.
  • a reference image having an index number of 0 is designated as a reference image of the current block.
  • two reference images can be selected, which are the reference image with the index number 0 in the first reference image list (list 0 ) and the second reference image list (list 1 ).
  • the corresponding image of the current block includes two MVs, that is, colMV_L0 and colMV_L1, and uses colPic corresponding list to select colMV_L1 in colMV_L0 as a predicted value of the MV. If colPic is from list 0, select collMV_L1 pointing to list 1; if colPic is from list 1, select colMV_L0 pointing to list 0.
  • the list corresponding to colPic has a certain correspondence with the currMV of the current block. That is, the list of colPic is list 1 indicating that colPic is located after the current image.
  • colMV_L0 pointing to list O may pass through the current image, that is, colMV_L0 has higher correlation with currMV of the current block. So choose colMV_L0.
  • colPic comes from the base view or base layer (ie, the image type of colPic is long-term, or the POC of colPic is the same as the POC of the currPic), there is no between the list corresponding to colPic and the current block currMV.
  • the determined relationship does not help to select the appropriate colMV for calculating the currMV of the current block.
  • the selected reference block of the current block is selected from the list Different from the list pointed to by the selected colMV, it will seriously affect the acquisition of TMVP.
  • colMV may be selected according to the list corresponding to the current block, and after the reference image currRefPic of the current block is determined, the corresponding list of the current block may be determined according to the list from which currRefPic is derived.
  • the reference index in the list may be selected according to the list corresponding to the current block, and after the reference image currRefPic of the current block is determined, the corresponding list of the current block may be determined according to the list from which currRefPic is derived.
  • colMV_L0 pointing to list 0 is selected.
  • the current block and the corresponding block have the same POC and have the same MV direction, and the MV correlation between the two is higher, which helps to improve the accuracy of TMVP prediction.
  • FIG. 3 shows a schematic flow diagram of a method 200 of determining a time domain motion vector predictor in accordance with an embodiment of the present invention.
  • the implementation body of the method 200 may be an encoding end or a decoding end, and the present invention is not particularly limited.
  • the method 200 includes:
  • S230 Determine, according to image information of the corresponding image, a motion vector of the corresponding image block, where the image information includes any of the following information: an image type, an image sequence number POC relationship with an image of the current block, and a layering Any information in the encoding of the affiliation layer or the dependent view in the multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the affiliation layer is divided into a basic layer. And an enhancement layer, the belonging view is a base view and a dependent view;
  • S240 Determine a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block.
  • determining the motion vector of the corresponding image block further includes:
  • the image type of the corresponding image is a long-term type
  • the reference image of the current image block if the reference image of the current image block And determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if The reference image of the current image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second of the corresponding image.
  • Reference image list or
  • the belonging layer of the corresponding image is the base layer
  • determining a motion vector of the corresponding image block so that the corresponding image The image pointed by the motion vector of the block belongs to the first reference image list of the corresponding image
  • determining the motion vector of the corresponding image block such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image
  • the belonging of the corresponding image is regarded as a base view
  • determining a motion vector of the corresponding image block so that the corresponding image The image pointed by the motion vector of the block belongs to the first reference image list of the corresponding image
  • determining the motion vector of the corresponding image block And causing the image pointed by the motion vector of the corresponding image block to belong to the second reference image list of the corresponding image.
  • a reference image having an index number of 0 is designated as a reference image of the current block.
  • the corresponding image of the current block includes two MVs, that is, colMV_L0 and colMV_L1, and uses colPic corresponding list to select colMV_L1 in colMV_L0 as a predicted value of the MV. If colPic is from list 0, select collMV_L1 pointing to list 1; if colPic is from list 1, select colMV_L0 pointing to list 0.
  • the list corresponding to colPic and the currMV of the current block is list 1 indicating that colPic is located after the current image.
  • colMV_L0 pointing to list O may pass through the current image, that is, colMV-LO and the current block currMV is more relevant, so choose colMV_L0.
  • colPic comes from the base view or the base layer (ie, the image type of colPic is long-term, or the POC of colPic is the same as the POC of the currPic), at this time, the list and current of colPic There is no definite relationship between the blocks currMV, which does not help to select the appropriate colMV for calculating the currMV of the current block. Conversely, if the selected list of reference images for the current block differs from the list pointed to by the selected colMV, the acquisition of TMVP is severely affected.
  • the list corresponding to the current block may be used.
  • the corresponding list of the current block and the reference index in the list may be determined according to the list from which currRefPic is derived.
  • colMV_L0 pointing to list 0 is selected.
  • the list corresponding to the current block is list 1 (second reference image list)
  • the current block and the corresponding block have the same POC and have the same MV direction, and the MV correlation between the two is higher, which helps to improve the TMVP prediction accuracy.
  • colMV may be selected according to the list corresponding to the current block, but the present invention is not limited thereto, and the colPic is from the current view (dependency view) or In the case of the current layer (enhancement layer), it is also possible to select colMV according to the list corresponding to the current block.
  • FIG. 6 shows a schematic block diagram of an apparatus 300 for determining a time domain motion vector predictor in accordance with an embodiment of the present invention.
  • the apparatus 300 includes:
  • the determining unit 310 is configured to determine, according to image information of the reference image of the current image block, a corresponding image of the current image block from the image set, where the image information includes any of the following information: an image type, and the current block
  • the image type is divided into long-term type and short-term type.
  • the POC relationship is divided into POC and POC. Different, the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; or
  • the image type is divided into a long-term type and a short-term type.
  • the POC relationship is divided into POC and POC.
  • the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view;
  • the processing unit 320 is configured to determine a corresponding image block of the current image block in the corresponding image, and configured to determine a time domain motion vector predictor of the current image block according to the reference image and the corresponding image block.
  • the current image block is a dependent view image
  • the image set includes a base view image corresponding to the dependent view, or
  • the current image block is an image block in the enhancement layer image, the image collection including an image of the base layer corresponding to the enhancement layer image.
  • the determining unit 310 is specifically configured to determine, according to an image type of the reference image of the current image block, a corresponding image of the current image block from the image set, so that an image type of the corresponding image and the reference image are Image types are different; or
  • the image set includes at least two first candidate images, wherein the type of the first candidate image is different from the image type of the reference image, or
  • a POC relationship between the first candidate image and the associated image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
  • the associated layer of the first candidate image is different from the layer to which the reference image belongs, or
  • the belonging view of the first candidate image is different from the belonging view of the reference image
  • the determining unit 310 is specifically configured to determine, from the at least two first candidate images, an image with the smallest index number in the image set as the corresponding image of the current image block according to the image information of the reference image.
  • the image set includes at least one second candidate image and at least one third alternative image Image, wherein the second candidate image is different from the image type of the third candidate image, or a POC relationship between the second candidate image and the image of the current block, and the third candidate The POC relationship between the image and the image of the current block is different, or
  • the belonging layer of the second candidate image is different from the layer to which the third candidate image belongs, or
  • the belonging view of the second candidate image is different from the belonging view of the third candidate image
  • the determining unit 310 is further configured to determine, from the image set, a predicted image, where the predicted image includes a second candidate image. And a third candidate image, the predicted image being used to determine a corresponding image of each image block in the strip in which the current image block is located;
  • the set of images includes at least two second candidate images, and/or
  • the set of images includes at least two third candidate images, and
  • the determining unit 310 is specifically configured to determine, from the image set, a predicted image, where the predicted image includes an image with the smallest index number in the image set of the at least two second candidate images; and/or for In the image set, a predicted image is determined, the predicted image including an image of the at least two third candidate images having the smallest index number in the image set.
  • the determining unit 310 is specifically configured to determine, from the image set, a target image as a corresponding image of each image block in a strip in which the current image block is located;
  • the image set includes at least two fourth candidate images, wherein the type of the fourth candidate image is different from the image type of the reference image, or
  • a POC relationship between the fourth candidate image and the belonging image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
  • the belonging layer of the fourth candidate image is different from the layer to which the reference image belongs, or
  • the belonging view of the fourth candidate image is different from the belonging view of the reference image
  • the determining unit 310 is specifically configured to determine, from the at least two fourth candidate images, an image with the smallest index number in the image set as the reference image of the current image block according to the image information of the corresponding image.
  • the image to which the current image block belongs is a bidirectional predicted image, and the corresponding image is a bidirectional predicted image, and
  • the processing unit 320 is specifically configured to determine a motion vector of the corresponding image block according to the image information of the corresponding image;
  • the processing unit 320 is configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining Corresponding to the motion vector of the image block, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the second image of the current image block Referring to the image list, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or And when the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the corresponding
  • the corresponding image is determined.
  • a motion vector of the block such that an image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for when the belonging of the corresponding image is regarded as a base view, if the current image block is referenced And determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if The reference image of the current image block is from the image of the current image block A second reference picture list, it is determined that the motion vector corresponding to the image block, so that the image corresponding to the image block belonging to the second motion vector points to the reference picture list corresponding images.
  • the apparatus 300 for determining the time domain motion vector predictor according to the embodiment of the present invention may correspond to the encoding end in the method of the embodiment of the present invention or The decoding end, and the modules in the apparatus 300 for determining the time domain motion vector predictor in FIG. 6 and the other operations and/or functions described above are respectively used to implement the processes of the method 100 in FIG. 2, for the sake of brevity, I will not repeat them here.
  • the apparatus for determining a time domain motion vector predictor by selecting a reference image and a corresponding image of a current block, causing a reference image of the current block and an image type of the corresponding image, and The POC relationship between the associated image blocks of the previous block, the associated layer or the view is different, and the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type can be improved, thereby In the case where the time domain distance of the motion vector of the block is different from the time domain distance of the motion vector of the corresponding block, the effect of acquiring the predicted value of the time domain motion vector of the current block can be improved.
  • FIG. 7 shows a schematic block diagram of an apparatus 400 for determining a time domain motion vector predictor in accordance with an embodiment of the present invention.
  • the apparatus 400 includes:
  • a determining unit 410 configured to determine a reference image and a corresponding image of the current image block, where the belonging image of the current image block is a bidirectional predicted image, and the corresponding image is a bidirectional predicted image;
  • the processing unit 420 is configured to determine, according to the image information of the corresponding image, a motion vector of the corresponding image block, where the image information includes any of the following information: an image type, and an image sequence number POC relationship with the image of the current block
  • the image type is classified into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the belonging layer is different.
  • the processing unit 420 is specifically configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the corresponding a motion vector of the image block such that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the second reference of the associated image of the current image block Image list, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
  • the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the current image block a second reference image list of the image, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
  • the corresponding image is determined.
  • a motion vector of the block such that an image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for when the belonging of the corresponding image is regarded as a base view, if the current image block is referenced And determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if The reference image of the current image block is from the image of the current image block A second reference picture list, it is determined that the motion vector corresponding to the image block, so that the image corresponding to the image block belonging to the second motion vector points to the reference picture list corresponding images.
  • the apparatus 400 for determining the time domain motion vector predictor according to the embodiment of the present invention may correspond to the encoding end in the method of the embodiment of the present invention or The decoding end, and the modules in the apparatus 400 for determining the time domain motion vector predictor in FIG. 7 and the other operations and/or functions described above are respectively used to implement the processes of the method 200 in FIG. 3, for the sake of brevity, I will not repeat them here.
  • the disclosed systems, devices, and methods may be implemented in other ways.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed.
  • the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the function is implemented in the form of a software functional unit and sold or used as a standalone product It can be stored on a computer readable storage medium.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, which can store program codes. .

Abstract

Provided is a method for determining a temporal motion vector predictor, which can improve the effect of acquiring a temporal motion vector predictor of a currently processed image block. The method comprises: according to image information about a reference image of a current image block, determining a corresponding image of the current image block from an image set, wherein the image information comprises any of the following information: an image type, an image order count (POC) relationship between same and an image to which the current block belongs, and a belonging layer in scalable coding or a belonging view in multi-view coding, the image type is divided into a long-term type and a short-term type, the POC relationship is divided into POCs that are the same and POCs that are different, the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is divided into a base view and a dependent view; or according to image information about a corresponding image of the current image block, determining a reference image of the current image block from the image set; determining a corresponding image block of the current image block in the corresponding image; and according to the reference image and the corresponding image block, determining a temporal motion vector predictor of the current image block.

Description

确定时域运动矢量预测值的方法和装置 技术领域  Method and apparatus for determining time domain motion vector predictors
本发明涉及视频领域, 并且更具体地, 涉及确定时域运动矢量预测值的  The present invention relates to the field of video and, more particularly, to determining predictive values of time domain motion vectors
背景技术 Background technique
目前, 已知一种图像处理的方法, 根据当前处理的图像块(以下, 简称 当前块) 的运动矢量(MV, Motion Vector: )在参考图像中找到与当前块相 对应的对应块,根据该对应块, 确定当前块的运动矢量预测值(MVP, Motion vector predictor ) 。 在编码端, 用当前块的 MV减去该 MVP获得差值, 对该 差值进行编码。在解码端,对码流进行解码获取该差值,根据该差值和该 MVP, 确定当前块的 MV。  At present, a method of image processing is known, and a corresponding block corresponding to a current block is found in a reference image according to a motion vector (MV, Motion Vector:) of a currently processed image block (hereinafter, simply referred to as a current block), according to the Corresponding block, determining the motion vector predictor (MVP, Motion vector predictor) of the current block. At the encoding end, the MVP is subtracted from the MV of the current block to obtain a difference, and the difference is encoded. At the decoding end, the code stream is decoded to obtain the difference, and based on the difference and the MVP, the MV of the current block is determined.
MVP包括时域运动矢量预测值(TMVP, Temporal MV Predictor ) , 即, 根据当前块的时域参考图像块(也称为对应块或对应图象块), 获取的 MVP, 所谓时域, 指当前块所在的图像与对应块所在的图像在视频序列的时间轴上 处于不同时间位置, 该位置采用图像顺序编号 (POC, Picture Order Count ) 来表示。 MV的时域距离是指参考图像和当前块所在的图像之间的距离, 即图 像 POC的差值。  The MVP includes a time domain motion vector predictor (TMVP, Temporal MV Predictor), that is, an MVP obtained according to a time domain reference image block (also referred to as a corresponding block or a corresponding image block) of the current block, the so-called time domain, referring to the current The image in which the block is located and the image in which the corresponding block is located are at different time positions on the time axis of the video sequence, and the position is represented by a picture sequence number (POC, Picture Order Count). The time domain distance of the MV refers to the distance between the reference image and the image in which the current block is located, that is, the difference between the image POC.
在获取 TMVP的过程中, 如果当前块的 MV的时域距离和当前块的对应 图像块的 MV的时域距离可能不同, 涉及 MV的缩放。 该缩放过程如以下公 式 1所示:  In the process of acquiring TMVP, if the time domain distance of the MV of the current block and the time domain distance of the MV of the corresponding image block of the current block may be different, the scaling of the MV is involved. The scaling process is shown in Equation 1 below:
currMV = d/D * colMV 公式 1  currMV = d/D * colMV formula 1
D = POC(currRefPic)- POC(currPic)  D = POC(currRefPic)- POC(currPic)
d = POC(colRefPic)- POC(colPic)  d = POC(colRefPic)- POC(colPic)
这里, currMV表示需要获取的当前块的 TMVP, colMV表示当前块的时 域参考块的 TMV, 时域参考块也称为对应块 (colBlock, co-located Block)。 D 表示当前块 ( currBlock, current Block ) 的 MV的时域距离, D等于当前块的 参考图像 ( currRefPic , current Reference Picture ) 与当前块所在的当前图像 ( currPic, current Picture )的 POC差值。 d表示对应块的 MV的时 i ^巨离 , d 等于对应块的 MV(即 colMV )指向的参考图像( colRefPic, co-located Reference Picture )与对应块所在的图像的 POC差值。 这里, 对应块所在的图像被称为 对应图像(colPic co-located picture ) 。 图 1示出了当前图像、 对应图像、 当 前图像的参考图像以及对应图像的参考图像的关系的示意图。 Here, currMV represents the TMVP of the current block to be acquired, colMV represents the TMV of the time domain reference block of the current block, and the time domain reference block is also referred to as a co-located block (colBlock). D Indicates the time domain distance of the MV of the current block (currBlock, current Block), and D is equal to the POC difference between the current block's reference image (currRefPic, current Reference Picture) and the current image (currPic, current Picture) where the current block is located. d represents the time i ^ large distance of the MV of the corresponding block, and d is equal to the POC difference value of the reference image (colRefPic, co-located Reference Picture) pointed to by the MV of the corresponding block (the colRefPic, co-located Reference Picture) and the image of the corresponding block. Here, the image in which the corresponding block is located is referred to as a colPic co-located picture. FIG. 1 is a diagram showing the relationship between a current image, a corresponding image, a reference image of a current image, and a reference image of a corresponding image.
在现有技术中, 参考图像被分为长期 long-term和短期 short-term两种类 型。  In the prior art, reference images are classified into long-term long-term and short-term short-term types.
如果 colRefPic和 currRefPic的参考图像类型都是 short-term, 那么进行 MV缩放获得 TMVP, 即 currMV=d/D*colMV。 如果 colRefPic和 currRefPic 的参考图像类型都是 long-term , 那么 currMV= colMV , 此时缩放系数为 1。 如果 colRefPic和 currRefPic的参考图像类型不同, 则无法获得 currMV。  If the reference image types of colRefPic and currRefPic are both short-term, then MV scaling is performed to obtain TMVP, ie currMV=d/D*colMV. If the reference image types of colRefPic and currRefPic are both long-term , then currMV= colMV , and the scaling factor is 1. If colRefPic and currRefPic have different reference image types, currMV cannot be obtained.
例如, 如果 colRefPic的参考图像类型是 short-term , currRefPic的参考图 像类型是 long-term, 则 d/D是一个很小的值(趋近于零) , 因此, 获取的当 前块的 TMVP没有参考价值。  For example, if the reference image type of colRefPic is short-term and the reference image type of currRefPic is long-term, then d/D is a small value (close to zero), therefore, the obtained TMVP of the current block has no reference. value.
再例如, 如果 colRefPic的参考图像类型是 long-term, currRefPic的参考 图像类型是 short-term, 则 d/D是一个很大的值(趋近于无穷大) , 同样, 获 取的当前块的 TMVP没有参考价值。  For another example, if the reference image type of colRefPic is long-term, the reference image type of currRefPic is short-term, then d/D is a large value (close to infinity), and likewise, the TMVP of the current block obtained is not Reference value.
发明内容 Summary of the invention
本发明实施例提供一种确定时域运动矢量预测值的方法、 装置和设备, 能够提高获取当前处理的图像块的时域运动矢量预测值的效果。  Embodiments of the present invention provide a method, apparatus, and device for determining a time domain motion vector predictor, which can improve an effect of acquiring a time domain motion vector predictor of a currently processed image block.
第一方面, 提供了一种确定时域运动矢量预测值的方法, 该方法包括: 根据当前图像块的参考图像的图像信息, 从图像集合中, 确定该当前图像块 的对应图像, 其中, 该图像信息包括以下任一信息: 图像类型、 与该当前块 的所属图像之间的图像顺序编号 POC关系、 在分层编码中的所属层或在多视 编码中的所属视,该图像类型分为长期类型和短期类型,该 POC关系分为 POC 相同和 POC相异, 该所属层分为基本层和增强层, 该所属视分为基本视和依 赖视; 或根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该 当前图像块的参考图像, 其中, 该图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中图像的 所属层或在多视编码中的所属视, 该图像类型分为长期类型和短期类型, 该In a first aspect, a method for determining a time domain motion vector predictor is provided, the method comprising: determining, according to image information of a reference image of a current image block, a corresponding image of the current image block from the image set, where The image information includes any of the following information: image type, image sequence number POC relationship with the image of the current block, associated layer in hierarchical coding, or in multi-view In the encoding, the image type is divided into a long-term type and a short-term type. The POC relationship is divided into a POC and a POC. The belonging layer is divided into a basic layer and an enhancement layer. The belonging view is divided into a basic view and a dependent view. Or determining, according to image information of the corresponding image of the current image block, a reference image of the current image block from the image set, wherein the image information includes any of the following information: an image type, and an image of the current block The image sequence number between the POC relationship, the layer to which the image belongs in layered coding, or the view in the multi-view code. The image type is divided into a long-term type and a short-term type.
POC关系分为 POC相同和 POC相异, 该所属层分为基本层和增强层, 该所 属视分为基本视和依赖视; 确定该当前图像块在该对应图像中的对应图像块; 根据该参考图像和该对应图像块, 确定该当前图像块的时域运动矢量预测值。 The POC relationship is divided into the same POC and the POC, and the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; determining a corresponding image block of the current image block in the corresponding image; The reference image and the corresponding image block determine a temporal motion vector predictor of the current image block.
在一种可能的实施方式中, 该当前图像块是依赖视图像, 该图像集合包 括与该依赖视相对应的基本视的图像, 或该当前图像块是增强层图像中的图 像块, 该图像集合包括与该增强层图像相对应的基本层的图像。  In a possible implementation manner, the current image block is a dependent view image, the image set includes a base view image corresponding to the dependent view, or the current image block is an image block in the enhancement layer image, the image The set includes an image of the base layer corresponding to the enhancement layer image.
结合第一方面和第一种可能的实施方式, 在第二种可能的实施方式中, 根据当前图像块的参考图像的图像信息, 从该图像集合中, 确定该当前图像 块的对应图像, 包括: 根据当前图像块的参考图像的图像类型, 从该图像集 合中, 确定该当前图像块的对应图像, 以使该对应图像的图像类型与该参考 图像的图像类型相异; 或根据当前图像块的参考图像的与该当前块的该图像 之间的 POC关系, 从该图像集合中, 确定该当前图像块的对应图像, 以使该 对应图像的与该当前块的所属图像之间的 POC关系与该参考图像的与该当前 块的所属图像之间的 POC关系相异;或根据当前图像块的参考图像的所属层, 从该图像集合中, 确定该当前图像块的对应图像, 以使该对应图像的所属层 与该参考图像的所属层相异; 或根据当前图像块的参考图像的所属视, 从该 图像集合中, 确定该当前图像块的对应图像, 以使该对应图像的所属视与该 参考图像的所属视相异。  With reference to the first aspect and the first possible implementation manner, in a second possible implementation manner, determining, according to image information of a reference image of a current image block, a corresponding image of the current image block from the image set, including Determining, according to an image type of the reference image of the current image block, a corresponding image of the current image block from the image set such that an image type of the corresponding image is different from an image type of the reference image; or according to the current image block a POC relationship between the reference image and the image of the current block, from which the corresponding image of the current image block is determined such that the POC relationship between the corresponding image and the image of the current block belongs to Determining a POC relationship with the associated image of the current block and the associated image of the current block; or determining a corresponding image of the current image block from the image set according to the associated layer of the reference image of the current image block, so that the The belonging layer of the corresponding image is different from the belonging layer of the reference image; or according to the belonging view of the reference image of the current image block, From the set of images, a corresponding image of the current image block is determined such that the belonging view of the corresponding image is different from the belonging view of the reference image.
结合第一方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该图像集合中包括至少两个第一备选图像, 其中, 该第一备选图像的类型与该参考图像的图像类型相异, 或该第一备选图像的 与该当前块的所属图像之间的 POC关系, 与该参考图像的与该当前块的所属 图像之间的 POC关系相异, 或该第一备选图像的所属层与该参考图像的所属 层相异, 或该第一备选图像的所属视与该参考图像的所属视相异, 以及该根 据当前图像块的参考图像的图像信息, 从该图像集合中, 确定该当前图像块 的对应图像, 包括: 根据当前图像块的参考图像的图像信息, 从该至少两个 第一备选图像中, 确定在该图像集合中的索引号最小的图像, 作为该当前图 像块的对应图像。 With reference to the first aspect, the first possible implementation, and the second possible implementation, in a third possible implementation, the image set includes at least two first candidate images, where The type of the first candidate image is different from the image type of the reference image, or a POC relationship between the image of the first candidate image and the image of the current block, and the belonging of the reference image and the current block The POC relationship between the images is different, or the belonging layer of the first candidate image is different from the belonging layer of the reference image, or the belonging view of the first candidate image is different from the belonging view of the reference image, and Determining, according to the image information of the reference image of the current image block, the corresponding image of the current image block from the image set, comprising: according to the image information of the reference image of the current image block, from the at least two first candidate images The image having the smallest index number in the image set is determined as the corresponding image of the current image block.
结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该图像集合包括至少一个 第二备选图像和至少一个第三备选图像, 其中, 该第二备选图像与该第三备 选图像的图像类型相异, 或该第二备选图像的与该当前块的所属图像之间的 With reference to the first aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the image collection includes at least one second candidate image And at least one third candidate image, wherein the second candidate image is different from the image type of the third candidate image, or between the image of the second candidate image and the image of the current block
POC关系,与该第三备选图像的与该当前块的所属图像之间的 POC关系相异, 或该第二备选图像的所属层与该第三备选图像的所属层相异, 或该第二备选 图像的所属视与该第三备选图像的所属视相异, 以及该方法还包括: 从该图 像集合中, 确定预测图像, 该预测图像包括一个第二备选图像和一个第三备 选图像, 该预测图像用于确定该当前图像块所处条带中各图像块的对应图像; 以及该根据该参考图像的类型, 从该图像集合中, 确定该当前图像块的对应 图像, 包括: 从该预测图像中, 确定该当前图像块的对应图像。 a POC relationship, which is different from a POC relationship between the third candidate image and the belonging image of the current block, or the belonging layer of the second candidate image is different from the belonging layer of the third candidate image, or The belonging view of the second candidate image is different from the belonging view of the third candidate image, and the method further includes: determining, from the image set, a predicted image, the predicted image including a second candidate image and a a third candidate image, the predicted image is used to determine a corresponding image of each image block in a strip in which the current image block is located; and determining, according to a type of the reference image, a correspondence of the current image block from the image set The image includes: determining, from the predicted image, a corresponding image of the current image block.
结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该图像集合包括至少两个第二备选图像, 和 /或该图像集合包括至少两个第三 备选图像, 以及该从该图像集合中, 确定预测图像, 包括: 从该图像集合中, 确定预测图像, 该预测图像包括该至少两个第二备选图像中在该图像集合中 的索引号最小的图像; 和 /或从该图像集合中, 确定预测图像, 该预测图像包 括该至少两个第三备选图像中在该图像集合中的索引号最小的图像。 结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该方法包括: 从该图像集合中, 确定目标图像, 作 为该当前图像块所处条带中各图像块的对应图像; 以及该根据当前图像块的 对应图像的图像信息, 从该图像集合中, 确定该当前图像块的参考图像, 包 括: 根据当前图像块的对应图像的图像类型, 从该图像集合中, 确定该当前 图像块的参考图像, 以使该参考图像的图像类型与该对应图像的图像类型相 异; 或根据当前图像块的对应图像的与该当前块的该图像之间的 POC关系, 从该图像集合中, 确定该当前图像块的参考图像, 以使该参考图像的与该当 前块的所属图像之间的 POC关系与该对应图像的与该当前块的所属图像之间 的 POC关系相异;或根据当前图像块的对应图像的所属层,从该图像集合中, 确定该当前图像块的参考图像, 以使该参考图像的所属层与该对应图像的所 属层相异; 或根据当前图像块的对应图像的所属视, 从该图像集合中, 确定 该当前图像块的参考图像, 以使该参考图像的所属视与该对应图像的所属视 相异。 With reference to the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in a fifth possible implementation manner, the image collection Include at least two second candidate images, and/or the image set includes at least two third candidate images, and determining the predicted image from the set of images includes: determining a predicted image from the set of images, The predicted image includes an image having the smallest index number in the image set of the at least two second candidate images; and/or determining a predicted image from the set of images, the predicted image including the at least two third preparations The image with the smallest index number in the image set in the image is selected. Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In an embodiment, the method includes: determining, from the image set, a target image as a corresponding image of each image block in a strip in which the current image block is located; and image information according to the corresponding image of the current image block, Determining the reference image of the current image block in the image set, comprising: determining, according to an image type of the corresponding image of the current image block, a reference image of the current image block from the image set, so that the image type of the reference image Differentiating from the image type of the corresponding image; or determining a reference image of the current image block from the image set according to a POC relationship between the corresponding image of the current image block and the image of the current image, so that the a POC relationship between the reference image and the associated image of the current block and between the image of the corresponding image and the image of the current block The POC relationship is different; or the reference image of the current image block is determined from the image set according to the belonging layer of the corresponding image of the current image block, so that the belonging layer of the reference image is different from the belonging layer of the corresponding image; Or determining a reference image of the current image block from the image set according to the belonging view of the corresponding image of the current image block, so that the belonging view of the reference image is different from the belonging view of the corresponding image.
结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该图像集合中包括至少两 个第四备选图像, 其中, 该第四备选图像的类型与该参考图像的图像类型相 异, 或该第四备选图像的与该当前块的所属图像之间的 POC关系, 与该参考 图像的与该当前块的所属图像之间的 POC关系相异, 或该第四备选图像的所 属层与该参考图像的所属层相异, 或该第四备选图像的所属视与该参考图像 的所属视相异, 以及该根据该对应图像的图像信息, 从该图像集合中, 确定 该当前图像块的参考图像, 包括: 根据该对应图像的图像信息, 从该至少两 个第四备选图像中, 确定在该图像集合中的索引号最小的图像, 作为该当前 图像块的参考图像。 结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该当前图像块的所属图像为双向预测图像, 该对应图像为双向预测图像, 以 及该根据该参考图像和该对应图像块, 确定该当前图像块的时域运动矢量预 测值, 包括: 根据该对应图像的图像信息, 确定该对应图像块的运动矢量; 根据该参考图像和该对应图像块的运动矢量, 确定该当前图像块的时域运动 矢量预测值。 Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, in a seventh possible implementation, the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or the first a POC relationship between the four candidate images and the associated image of the current block, different from a POC relationship between the reference image and the associated image of the current block, or the associated layer of the fourth candidate image The belonging layer of the reference image is different, or the belonging view of the fourth candidate image is different from the belonging view of the reference image, and the image information according to the corresponding image is used to determine the current image block from the image set. The reference image includes: determining, according to the image information of the corresponding image, an image with the smallest index number in the image set from the at least two fourth candidate images as the current Like reference image block. Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments and a seventh possible implementation manner, in an eighth possible implementation manner, the belonging image of the current image block is a bidirectional prediction image, the corresponding image is a bidirectional prediction image, and the corresponding image and the corresponding image Determining a time domain motion vector predictor of the current image block, comprising: determining a motion vector of the corresponding image block according to image information of the corresponding image; determining the sound according to the reference image and a motion vector of the corresponding image block The time domain motion vector predictor of the current image block.
结合第一方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中, 该确定该对应图像块的运动矢量, 进一步包括: 当 该对应图像的图像类型为长期类型时, 如果该当前图像块的参考图像来自于 该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动矢 量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第一参考图 像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第 二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动 矢量指向的图像属于该对应图像的第二参考图像列表; 或当该对应图像的 Combining the first aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible The embodiment, the seventh possible implementation manner, and the eighth possible implementation manner, in the ninth possible implementation manner, the determining a motion vector of the corresponding image block further includes: when the image type of the corresponding image is In the case of the long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to a first reference image list of the corresponding image, if the reference image of the current image block is from a second reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image block is The image pointed by the motion vector belongs to the second reference image list of the corresponding image; or when the corresponding Image
POC与该当前图像块的所属图像的 POC相同时,如果该当前图像块的参考图 像来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块 的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第 一参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属 图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像 块的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或当该对应 图像的所属层为基本层时, 如果该当前图像块的参考图像来自于该当前图像 块的所属图像的第一参考图像列表, 则确定对应图像块的运动矢量, 以使该 对应图像块的运动矢量指向的图像属于该对应图像的图像属于第一参考图像 列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第二 参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢 量指向的图像属于该对应图像的第二参考图像列表; 或当该对应图像的所属 视为基本视时, 如果该当前图像块的参考图像来自于该当前图像块的所属图 像的第一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块 的运动矢量指向的该对应图像的图像属于第一参考图像列表, 如果该当前图 像块的参考图像来自于该当前图像块的所属图像的第二参考图像列表, 则确 定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该 对应图像的第二参考图像列表。 When the POC is the same as the POC of the image of the current image block, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that the POC And the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, determining the corresponding image block a motion vector, such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the associated layer of the corresponding image is the base layer, if the reference image of the current image block is from the Determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the The image of the image corresponding to the motion vector of the corresponding image block belongs to the first reference image list, and if the reference image of the current image block is from the second reference image list of the image of the current image block, the corresponding image is determined. a motion vector of the block such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the belonging of the corresponding image is regarded as the base view, if the reference image of the current image block comes from And determining, by the first reference image list of the image of the current image block, a motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if the current The reference image of the image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second reference of the corresponding image. A list of images.
第二方面, 提供了一种确定时域运动矢量预测值的方法, 该方法包括: 确定当前图像块的参考图像和对应图像, 其中, 该当前图像块的所属图像为 双向预测图像, 该对应图像为双向预测图像; 确定该当前图像块在该对应图 像中的对应图像块; 根据该对应图像的图像信息, 确定该对应图像块的运动 矢量, 该图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之 间的图像顺序编号 POC关系、 在分层编码中的所属层或在多视编码中的所属 视,该图像类型分为长期类型和短期类型,该 POC关系分为 POC相同和 POC 相异, 该所属层分为基本层和增强层, 该所属视分为基本视和依赖视; 根据 该参考图像和该对应图像块的运动矢量, 确定该当前图像块的时域运动矢量 预测值。  In a second aspect, a method for determining a time domain motion vector predictor is provided, the method comprising: determining a reference image of a current image block and a corresponding image, wherein the belonging image of the current image block is a bidirectional predicted image, and the corresponding image Determining an image for two directions; determining a corresponding image block of the current image block in the corresponding image; determining a motion vector of the corresponding image block according to image information of the corresponding image, the image information including any of the following information: image type, and The image sequence number POC relationship between the images of the current block, the belonging layer in the layered coding, or the belonging view in the multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into POCs. The same as the POC, the affiliation layer is divided into a base layer and an enhancement layer, and the affiliation is divided into a base view and a dependent view; determining the time domain motion of the current image block according to the reference image and the motion vector of the corresponding image block Vector predictive value.
在一种可能的实施方式中, 该确定该对应图像块的运动矢量, 进一步包 括:  In a possible implementation manner, the determining a motion vector of the corresponding image block further includes:
当该对应图像的图像类型为长期类型时, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的该对应图像的图像属于第一 参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图 像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块 的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或当该对应图 像的 POC与该当前图像块的所属图像的 POC相同时,如果该当前图像块的参 考图像来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图 像块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像 的第一参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的 所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应 图像块的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或当该 对应图像的所属层为基本层时, 如果该当前图像块的参考图像来自于该当前 图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动矢量, 以 使该对应图像块的运动矢量指向的图像属于该对应图像的第一参考图像列 表, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第二参 考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量 指向的图像属于该对应图像的第二参考图像列表; 或当该对应图像的所属视 为基本视时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像 的第一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的 运动矢量指向的图像属于该对应图像的第一参考图像列表, 如果该当前图像 块的参考图像来自于该当前图像块的所属图像的第二参考图像列表, 则确定 对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对 应图像的第二参考图像列表。 When the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image The image of the corresponding image pointed by the motion vector of the block belongs to the first reference image list, if the reference image of the current image block is from the associated image of the current image block Determining, by the second reference image list of the image, a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the POC of the corresponding image is related to the current When the POC of the image of the image block is the same, if the reference image of the current image block is from the first reference image list of the image of the current image block, the motion vector of the corresponding image block is determined, so that the corresponding image block is The image pointed by the motion vector belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, determining the motion vector of the corresponding image block, And causing the image pointed by the motion vector of the corresponding image block to belong to the second reference image list of the corresponding image; or when the belonging layer of the corresponding image is the base layer, if the reference image of the current image block is from the current image block Corresponding to the first reference image list of the image, determining the motion vector of the corresponding image block, so that The image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the image of the current image block, the corresponding image block is determined. Motion vector, such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the belonging of the corresponding image is regarded as the base view, if the reference image of the current image block is from Determining, by the first reference image list of the image of the current image block, a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the current image The reference image of the block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image of the corresponding image. List.
第三方面, 提供了一种确定时域运动矢量预测值的装置, 该装置包括: 确定单元, 用于根据当前图像块的参考图像的图像信息, 从图像集合中, 确定该当前图像块的对应图像, 其中, 该图像信息包括以下任一信息: 图像 类型、 与该当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中 的所属层或在多视编码中的所属视, 该图像类型分为长期类型和短期类型, 该 POC关系分为 POC相同和 POC相异; 或用于根据当前图像块的对应图像 的图像信息, 从该图像集合中, 确定该当前图像块的参考图像, 其中, 该图 像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之间的图像顺 序编号 POC关系、 在分层编码中图像的所属层或在多视编码中的所属视中的 任一信息,该图像类型分为长期类型和短期类型,该 POC关系分为 POC相同 和 POC相异; 处理单元, 用于确定该当前图像块在该对应图像中的对应图像 块; 用于根据该参考图像和该对应图像块, 确定该当前图像块的时域运动矢 量预测值。 In a third aspect, an apparatus for determining a time domain motion vector predictor is provided, the apparatus comprising: a determining unit, configured to determine, according to image information of a reference image of a current image block, a correspondence of the current image block from the image set An image, wherein the image information includes any of the following: an image type, an image sequence number POC relationship with an image of the current block, an belonging layer in hierarchical coding, or an attribute in multi-view coding, The image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, or is used for a corresponding image according to a current image block. Image information, from the image set, determining a reference image of the current image block, wherein the image information includes any of the following information: an image type, an image sequence number POC relationship with an image of the current block, Any information in the layer to which the image belongs or belongs to in the multiview encoding. The image type is divided into a long-term type and a short-term type. The POC relationship is divided into POC and POC. The processing unit uses Determining a corresponding image block of the current image block in the corresponding image; and determining, according to the reference image and the corresponding image block, a time domain motion vector predictor of the current image block.
在一种可能的实施方式中, 该当前图像块是依赖视图像, 该图像集合包 括与该依赖视相对应的基本视的图像, 或该当前图像块是增强层图像中的图 像块, 该图像集合包括与该增强层图像相对应的基本层的图像。  In a possible implementation manner, the current image block is a dependent view image, the image set includes a base view image corresponding to the dependent view, or the current image block is an image block in the enhancement layer image, the image The set includes an image of the base layer corresponding to the enhancement layer image.
结合第三方面和第一种可能的实施方式, 在第二种可能的实施方式中, 该确定单元具体用于根据当前图像块的参考图像的图像类型, 从该图像集合 中, 确定该当前图像块的对应图像, 以使该对应图像的图像类型与该参考图 像的图像类型相异; 或用于根据当前图像块的参考图像的与该当前块的该图 像之间的 POC关系, 从该图像集合中, 确定该当前图像块的对应图像, 以使 该对应图像的与该当前块的所属图像之间的 POC关系与该参考图像的与该当 前块的所属图像之间的 POC关系相异; 或用于根据当前图像块的参考图像的 所属层, 从该图像集合中, 确定该当前图像块的对应图像, 以使该对应图像 的所属层与该参考图像的所属层相异; 或用于根据当前图像块的参考图像的 所属视, 从该图像集合中, 确定该当前图像块的对应图像, 以使该对应图像 的所属视与该参考图像的所属视相异。  With reference to the third aspect and the first possible implementation manner, in a second possible implementation manner, the determining unit is specifically configured to determine the current image from the image set according to an image type of the reference image of the current image block. a corresponding image of the block such that the image type of the corresponding image is different from the image type of the reference image; or from a POC relationship between the reference image of the current image block and the image of the current block, from the image In the set, determining a corresponding image of the current image block, so that a POC relationship between the corresponding image and an image of the current block is different from a POC relationship between the reference image and the image of the current block; Or determining, according to the belonging layer of the reference image of the current image block, from the image set, determining a corresponding image of the current image block, such that the belonging layer of the corresponding image is different from the belonging layer of the reference image; or Determining, according to the belonging view of the reference image of the current image block, a corresponding image of the current image block from the image set, so that the corresponding image is The belonging view of the image is different from the view of the reference image.
结合第三方面、 第一种可能的实施方式和第二种可能的实施方式, 在第 三种可能的实施方式中, 该图像集合中包括至少两个第一备选图像, 其中, 该第一备选图像的类型与该参考图像的图像类型相异, 或该第一备选图像的 与该当前块的所属图像之间的 POC关系, 与该参考图像的与该当前块的所属 图像之间的 POC关系相异, 或该第一备选图像的所属层与该参考图像的所属 层相异, 或该第一备选图像的所属视与该参考图像的所属视相异, 以及该确 定单元具体用于根据该参考图像的图像信息, 从该至少两个第一备选图像中, 确定在该图像集合中的索引号最小的图像, 作为该当前图像块的对应图像。 With reference to the third aspect, the first possible implementation manner, and the second possible implementation manner, in a third possible implementation manner, the image set includes at least two first candidate images, where the first The type of the candidate image is different from the image type of the reference image, or a POC relationship between the image of the first candidate image and the image of the current block, and the image of the reference image and the image of the current block The POC relationship is different, or the belonging layer of the first candidate image and the belonging of the reference image The layers are different, or the belonging view of the first candidate image is different from the belonging view of the reference image, and the determining unit is specifically configured to use image information of the reference image from the at least two first candidate images. And determining an image with the smallest index number in the image set as a corresponding image of the current image block.
结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式和第三 种可能的实施方式, 在第四种可能的实施方式中, 该图像集合包括至少一个 第二备选图像和至少一个第三备选图像, 其中, 该第二备选图像与该第三备 选图像的图像类型相异, 或该第二备选图像的与该当前块的所属图像之间的 With reference to the third aspect, the first possible implementation manner, the second possible implementation manner, and the third possible implementation manner, in a fourth possible implementation manner, the image collection includes at least one second candidate image And at least one third candidate image, wherein the second candidate image is different from the image type of the third candidate image, or between the image of the second candidate image and the image of the current block
POC关系,与该第三备选图像的与该当前块的所属图像之间的 POC关系相异, 或该第二备选图像的所属层与该第三备选图像的所属层相异, 或该第二备选 图像的所属视与该第三备选图像的所属视相异, 以及该确定单元还用于从该 图像集合中, 确定预测图像, 该预测图像包括一个第二备选图像和一个第三 备选图像, 该预测图像用于确定该当前图像块所处条带中各图像块的对应图 像; 用于从该预测图像中, 确定该当前图像块的对应图像。 a POC relationship, which is different from a POC relationship between the third candidate image and the belonging image of the current block, or the belonging layer of the second candidate image is different from the belonging layer of the third candidate image, or The belonging view of the second candidate image is different from the belonging view of the third candidate image, and the determining unit is further configured to determine, from the image set, a predicted image, the predicted image including a second candidate image and a third candidate image for determining a corresponding image of each image block in the strip in which the current image block is located; for determining a corresponding image of the current image block from the predicted image.
结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式和第四种可能的实施方式, 在第五种可能的实施方式中, 该图像集合包括至少两个第二备选图像, 和 /或该图像集合包括至少两个第三 备选图像, 以及该确定单元具体用于从该图像集合中, 确定预测图像, 该预 测图像包括该至少两个第二备选图像中在该图像集合中的索引号最小的图 像; 和 /或用于从该图像集合中, 确定预测图像, 该预测图像包括该至少两个 第三备选图像中在该图像集合中的索引号最小的图像。  With reference to the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, and the fourth possible implementation manner, in the fifth possible implementation manner, the image collection Include at least two second candidate images, and/or the image set includes at least two third candidate images, and the determining unit is specifically configured to determine a predicted image from the image set, the predicted image including the at least two An image of the second candidate image having the smallest index number in the image set; and/or for determining a predicted image from the image set, the predicted image including the at least two third candidate images The image with the smallest index number in the image collection.
结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式和第五种可能的实施方式, 在第 六种可能的实施方式中, 该确定单元具体用于从该图像集合中, 确定目标图 像, 作为该当前图像块所处条带中各图像块的对应图像; 用于根据当前图像 块的对应图像的图像类型, 从该图像集合中, 确定该当前图像块的参考图像, 以使该参考图像的图像类型与该对应图像的图像类型相异; 或用于根据当前 图像块的对应图像的与该当前块的该图像之间的 POC关系,从该图像集合中, 确定该当前图像块的参考图像, 以使该参考图像的与该当前块的所属图像之 间的 POC关系与该对应图像的与该当前块的所属图像之间的 POC关系相异; 或用于根据当前图像块的对应图像的所属层, 从该图像集合中, 确定该当前 图像块的参考图像, 以使该参考图像的所属层与该对应图像的所属层相异; 或用于根据当前图像块的对应图像的所属视, 从该图像集合中, 确定该当前 图像块的参考图像, 以使该参考图像的所属视与该对应图像的所属视相异。 Combining the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, and the fifth possible implementation manner, in the sixth possibility In an embodiment, the determining unit is specifically configured to: determine, from the image set, a target image as a corresponding image of each image block in the strip in which the current image block is located; and an image type used according to the corresponding image of the current image block Determining, from the image set, a reference image of the current image block such that an image type of the reference image is different from an image type of the corresponding image; or for a POC relationship between a corresponding image of the image block and the image of the current block, from which the reference image of the current image block is determined such that the reference image is between the image of the current block and the image of the current block The POC relationship is different from the POC relationship between the corresponding image and the image to which the current block belongs; or is used to determine a reference image of the current image block from the image set according to the belonging layer of the corresponding image of the current image block. So that the associated layer of the reference image is different from the associated layer of the corresponding image; or for determining the reference image of the current image block from the image set according to the belonging view of the corresponding image of the current image block, so that The belonging view of the reference image is different from the belonging view of the corresponding image.
结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式和第六 种可能的实施方式, 在第七种可能的实施方式中, 该图像集合中包括至少两 个第四备选图像, 其中, 该第四备选图像的类型与该参考图像的图像类型相 异, 或该第四备选图像的与该当前块的所属图像之间的 POC关系, 与该参考 图像的与该当前块的所属图像之间的 POC关系相异, 或该第四备选图像的所 属层与该参考图像的所属层相异, 或该第四备选图像的所属视与该参考图像 的所属视相异, 以及该确定单元具体用于根据该对应图像的图像信息, 从该 至少两个第四备选图像中, 确定在该图像集合中的索引号最小的图像, 作为 该当前图像块的参考图像。  Combining the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments, in a seventh possible implementation, the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or the first a POC relationship between the four candidate images and the associated image of the current block, different from a POC relationship between the reference image and the associated image of the current block, or the associated layer of the fourth candidate image The belonging layer of the reference image is different, or the belonging view of the fourth candidate image is different from the belonging view of the reference image, and the determining unit is specifically configured to: according to the image information of the corresponding image, from the at least two fourth In the candidate image, an image with the smallest index number in the image set is determined as a reference image of the current image block.
结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式和第七种可能的实施方式, 在第八种可能的实施方式中, 该当前图像块的所属图像为双向预测图像, 该对应图像为双向预测图像, 以 及该处理单元具体用于根据该对应图像的图像信息, 确定该对应图像块的运 动矢量; 用于根据该参考图像和该对应图像块的运动矢量, 确定该当前图像 块的时域运动矢量预测值。  Combining the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, and the sixth possible Embodiments and a seventh possible implementation manner, in an eighth possible implementation manner, the belonging image of the current image block is a bidirectional predicted image, the corresponding image is a bidirectional predicted image, and the processing unit is specifically configured to use the Corresponding to the image information of the image, determining a motion vector of the corresponding image block; and determining a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block.
结合第三方面、 第一种可能的实施方式、 第二种可能的实施方式、 第三 种可能的实施方式、 第四种可能的实施方式、 第五种可能的实施方式、 第六 种可能的实施方式、 第七种可能的实施方式和第八种可能的实施方式, 在第 九种可能的实施方式中, 该处理单元具体用于当该对应图像的图像类型为长 期类型时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的 第一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运 动矢量指向的图像属于该对应图像的第一参考图像列表, 如果该当前图像块 的参考图像来自于该当前图像块的所属图像的第二参考图像列表, 则确定对 应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应 图像的第二参考图像列表; 或用于当该对应图像的 POC与该当前图像块的所 属图像的 POC相同时, 如果该当前图像块的参考图像来自于该当前图像块的 所属图像的第一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应 图像块的运动矢量指向的图像属于该对应图像的第一参考图像列表, 如果该 当前图像块的参考图像来自于该当前图像块的所属图像的第二参考图像列 表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图 像属于该对应图像的第二参考图像列表; 或用于当该对应图像的所属层为基 本层时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第 一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动 矢量指向的图像属于该对应图像的图像属于第一参考图像列表, 如果该当前 图像块的参考图像来自于该当前图像块的所属图像的第二参考图像列表, 则 确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于 该对应图像的第二参考图像列表; 或用于当该对应图像的所属视为基本视时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第一参考图 像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向 的该对应图像的图像属于第一参考图像列表, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第二参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第二 参考图像列表。 第四方面, 提供了一种确定时域运动矢量预测值的装置, 该装置包括: 确定单元, 用于确定当前图像块的参考图像和对应图像, 其中, 该当前图像 块的所属图像为双向预测图像, 该对应图像为双向预测图像; 用于确定该当 前图像块在该对应图像中的对应图像块; 处理单元, 用于根据该对应图像的 图像信息, 确定该对应图像块的运动矢量, 该图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之间的图像顺序编号 POC关系、 在分层编 码中的所属层或在多视编码中的所属视, 该图像类型分为长期类型和短期类 型,该 POC关系分为 POC相同和 POC相异,该所属层分为基本层和增强层, 该所属视分为基本视和依赖视; 用于根据该参考图像和该对应图像块的运动 矢量, 确定该当前图像块的时域运动矢量预测值。 With reference to the third aspect, the first possible implementation manner, the second possible implementation manner, the third possible implementation manner, the fourth possible implementation manner, the fifth possible implementation manner, the sixth a possible implementation manner, a seventh possible implementation manner, and an eighth possible implementation manner. In the ninth possible implementation manner, the processing unit is specifically configured to: when the image type of the corresponding image is a long-term type, If the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the corresponding image a first reference image list, if the reference image of the current image block is from a second reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block to point the motion vector of the corresponding image block The image belongs to the second reference image list of the corresponding image; or when the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of the current image block is from the current image block a first reference image list of the image, determining a motion vector of the corresponding image block to make the correspondence The image pointed by the motion vector of the block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, determining the motion of the corresponding image block Vector, such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or when the associated layer of the corresponding image is the base layer, if the reference image of the current image block is from Determining, by the first reference image list of the image of the current image block, a motion vector of the corresponding image block, such that the image to which the motion vector of the corresponding image block belongs belongs to the image of the corresponding image belongs to the first reference image list, if The reference image of the current image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second of the corresponding image. a reference image list; or when the belonging of the corresponding image is regarded as a base view, If the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to a first reference image list, if the reference image of the current image block is from a second reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block to point the motion vector of the corresponding image block The image belongs to a second reference image list of the corresponding image. In a fourth aspect, an apparatus for determining a time domain motion vector predictor is provided, the apparatus comprising: a determining unit, configured to determine a reference image and a corresponding image of a current image block, where the image of the current image block is bidirectionally predicted An image, the corresponding image is a bidirectional predicted image; a corresponding image block for determining the current image block in the corresponding image; a processing unit, configured to determine a motion vector of the corresponding image block according to the image information of the corresponding image, The image information includes any of the following information: an image type, an image sequence number POC relationship with an image of the current block, an belonging layer in hierarchical coding, or an attribute in multi-view coding, the image type is divided into For the long-term type and the short-term type, the POC relationship is divided into the same POC and the POC, and the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; and is used according to the reference image and the corresponding image. The motion vector of the block determines the time domain motion vector predictor of the current image block.
在一种可能的实施方式中, 该处理单元具体用于当该对应图像的图像类 型为长期类型时, 如果该当前图像块的参考图像来自于该当前图像块的所属 图像的第一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像 块的运动矢量指向的图像属于该对应图像的第一参考图像列表, 如果该当前 图像块的参考图像来自于该当前图像块的所属图像的第二参考图像列表, 则 确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于 该对应图像的第二参考图像列表; 或用于当该对应图像的 POC与该当前图像 块的所属图像的 POC相同时, 如果该当前图像块的参考图像来自于该当前图 像块的所属图像的第一参考图像列表, 则确定对应图像块的运动矢量, 以使 该对应图像块的运动矢量指向的图像属于该对应图像的第一参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第二参考图 像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向 的图像属于该对应图像的第二参考图像列表; 或用于当该对应图像的所属层 为基本层时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像 的第一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的 运动矢量指向的图像属于该对应图像的图像属于第一参考图像列表, 如果该 当前图像块的参考图像来自于该当前图像块的所属图像的第二参考图像列 表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图 像属于该对应图像的第二参考图像列表; 或用于当该对应图像的所属视为基 本视时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第 一参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动 矢量指向的该对应图像的图像属于第一参考图像列表, 如果该当前图像块的 参考图像来自于该当前图像块的所属图像的第二参考图像列表, 则确定对应 图像块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图 像的第二参考图像列表。 In a possible implementation, the processing unit is specifically configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block is from a first reference image list of the image of the current image block. And determining a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the image of the current image block. a second reference image list, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for the POC of the corresponding image and the When the POC of the image of the current image block is the same, if the reference image of the current image block is from the first reference image list of the image of the current image block, the motion vector of the corresponding image block is determined, so that the corresponding image block is The image pointed by the motion vector belongs to the first reference image list of the corresponding image, if The reference image of the front image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second of the corresponding image. a reference image list; or when the associated layer of the corresponding image is a base layer, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the motion of the corresponding image block Vector, such that the image pointed to by the motion vector of the corresponding image block belongs to the image of the corresponding image belongs to the first reference image list, if The reference image of the current image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second of the corresponding image. a reference image list; or when the belonging of the corresponding image is regarded as a base view, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining the motion of the corresponding image block Vector, the image of the corresponding image pointed to by the motion vector of the corresponding image block belongs to the first reference image list, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, A motion vector of the corresponding image block is determined such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.
根据本发明实施例的确定时域运动矢量预测值的方法和装置, 通过选择 当前块的参考图像和对应图像, 使当前块的参考图像与对应图像的图像类型、 与当前块的所属图像块之间的 POC关系、 所属层或所述视相异, 能够提高使 该当前块的参考图像与该对应图像块的参考图像属于相同的参考图像类型的 效果, 从而, 在当前块的运动矢量的时域距离和该对应块的运动矢量的时域 距离不同的情况下, 能够提高获取当前块的时域运动矢量预测值的效果。 附图说明  A method and apparatus for determining a time domain motion vector predictor according to an embodiment of the present invention, by selecting a reference image and a corresponding image of a current block, causing a reference image of the current block and an image type of the corresponding image, and an image block to which the current block belongs The POC relationship, the affiliation layer, or the view difference can improve the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type, and thus, at the time of the motion vector of the current block When the domain distance is different from the time domain distance of the motion vector of the corresponding block, the effect of acquiring the temporal motion vector predictor of the current block can be improved. DRAWINGS
为了更清楚地说明本发明实施例的技术方案, 下面将对本发明实施例中 所需要使用的附图作简单地介绍, 显而易见地, 下面所描述的附图仅仅是本 发明的一些实施例, 对于本领域普通技术人员来讲, 在不付出创造性劳动的 前提下, 还可以根据这些附图获得其他的附图。  In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings to be used in the embodiments of the present invention will be briefly described below. It is obvious that the drawings described below are only some embodiments of the present invention, Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.
图 1 是表示当前图像、 对应图像、 当前图像的参考图像以及对应图像的 参考图像的关系的一例的示意图。  Fig. 1 is a schematic diagram showing an example of a relationship between a current image, a corresponding image, a reference image of a current image, and a reference image of a corresponding image.
图 2是根据本发明一实施例的确定时域运动矢量预测值的方法的示意性 流程图。  2 is a schematic flow chart of a method of determining a time domain motion vector predictor in accordance with an embodiment of the present invention.
图 3是根据本发明另一实施例的确定时域运动矢量预测值的方法的示意 性流程图。 图 4是表示当前图像、 对应图像、 当前图像的参考图像以及对应图像的 参考图像的关系的另一例的示意图。 FIG. 3 is a schematic flowchart of a method of determining a time domain motion vector predictor according to another embodiment of the present invention. 4 is a schematic diagram showing another example of the relationship between the current image, the corresponding image, the reference image of the current image, and the reference image of the corresponding image.
图 5是表示当前图像、 对应图像、 当前图像的参考图像以及对应图像的 参考图像的关系的再一例的示意图。  Fig. 5 is a schematic diagram showing still another example of the relationship between the current image, the corresponding image, the reference image of the current image, and the reference image of the corresponding image.
图 6是根据本发明一实施例的确定时域运动矢量预测值的装置的示意性 框图。  6 is a schematic block diagram of an apparatus for determining a time domain motion vector predictor in accordance with an embodiment of the present invention.
图 7是根据本发明另一实施例的确定时域运动矢量预测值的装置的示意 性框图。  Figure 7 is a schematic block diagram of an apparatus for determining a time domain motion vector predictor in accordance with another embodiment of the present invention.
具体实施方式 detailed description
下面将结合本发明实施例中的附图, 对本发明实施例中的技术方案进行 清楚、 完整地描述, 显然, 所描述的实施例是本发明一部分实施例, 而不是 全部的实施例。 基于本发明中的实施例, 本领域普通技术人员在没有作出创 造性劳动前提下所获得的所有其他实施例, 都属于本发明保护的范围。  The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without making creative labor are within the scope of the present invention.
视频编码压缩的基本原理是, 利用空域、 时域和码字之间的相关性, 尽 可能去除冗余。 在采用基于块的混合视频编码框架中, 通过预测 (包括帧内 预测和帧间预测) 、 变换、 量化、 熵编码等步骤来实现视频编码压缩。 在这 种编码框架中, 视频序列 sequence包括一系列图像 picture, 图像被进一步划 分为条带 (也称为, 切片) slice, slice再被划分为块 block。 视频编码以块为 单位从 picture的左上角位置开始从左到右从上到下一行一行进行编码处理。 为了便于理解, 在以下说明中, 以图像块为对象, 对视频编码或解码的过程 进行说明。  The basic principle of video coding compression is to remove redundancy as much as possible by using the correlation between airspace, time domain and codewords. In a block-based hybrid video coding framework, video coding compression is implemented by prediction (including intra prediction and inter prediction), transform, quantization, entropy coding, and the like. In this coding framework, the video sequence includes a series of pictures, the picture is further divided into slices (also called slices) slices, which are then divided into block blocks. The video encoding is encoded in units of blocks from the top left position of the picture from left to right and from top to bottom. For ease of understanding, in the following description, the process of encoding or decoding a video will be described with respect to an image block.
图 2示出了根据本发明实施例的确定时域运动矢量预测值的方法 100的 示意性流程图。 并且, 该方法 100 的实施主体可以是编码端, 也可以是解码 端, 本发明并未特别限定。 如图 2所示, 该方法 100包括:  2 shows a schematic flow diagram of a method 100 of determining a time domain motion vector predictor in accordance with an embodiment of the present invention. Moreover, the implementation body of the method 100 may be an encoding end or a decoding end, and the present invention is not particularly limited. As shown in FIG. 2, the method 100 includes:
S110, 根据当前图像块的参考图像的图像信息, 从图像集合中, 确定该 当前图像块的对应图像, 其中, 该图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中的所属 层或在多视编码中的所属视, 该图像类型分为长期类型和短期类型, 该 POC 关系分为 POC相同和 POC相异,该所属层分为基本层和增强层,该所属视分 为基本视和依赖视; 或 S110. Determine, according to image information of a reference image of the current image block, a corresponding image of the current image block from the image set, where the image information includes any of the following information: The image sequence number POC relationship with the image of the current block, the belonging layer in hierarchical coding, or the dependent view in multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into The POC is the same as the POC, and the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; or
根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该当前 图像块的参考图像, 其中, 该图像信息包括以下任一信息: 图像类型、 与该 当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中图像的所属 层或在多视编码中的所属视, 该图像类型分为长期类型和短期类型, 该 POC 关系分为 POC相同和 POC相异,该所属层分为基本层和增强层,该所属视分 为基本视和依赖视;  Determining, from the image set, a reference image of the current image block according to image information of a corresponding image of the current image block, wherein the image information includes any of the following information: an image type, and an image of the current block The image sequence number POC relationship, the belonging layer of the image in the layered coding or the belonging view in the multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the belonging is different. The layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view;
S120, 确定该当前图像块在该对应图像中的对应图像块;  S120. Determine a corresponding image block of the current image block in the corresponding image.
S130, 根据该参考图像和该对应图像块, 确定该当前图像块的时域运动 矢量预测值。  S130. Determine a time domain motion vector predictor of the current image block according to the reference image and the corresponding image block.
并且, 该当前图像块是依赖视图像, 该图像集合包括与该依赖视相对应 的基本视的图像, 或  And, the current image block is a dependent view image, the image set includes a base view image corresponding to the dependent view, or
该当前图像块是增强层图像中的图像块, 该图像集合包括与该增强层图 像相对应的基本层的图像。  The current image block is an image block in the enhancement layer image, the image collection including an image of the base layer corresponding to the enhancement layer image.
具体地说, 根据本发明实施例的确定时域运动矢量预测值的方法, 能够 适用于包括多视编码技术和分层编码技术等能够从包括多个参考图像(或该 参考图像的运动信息) 的图像集合(或者说, 图像列表) 中选择一个参考图 像, 并利用该参考图像来确定当前处理的图像块的运动信息的技术。  Specifically, the method for determining a time domain motion vector predictor according to an embodiment of the present invention can be applied to include a plurality of reference images (or motion information of the reference image) including a multi-view coding technique and a layered coding technique. A technique of selecting a reference image in a set of images (or, a list of images) and using the reference image to determine motion information of the currently processed image block.
例如,在多视编码中 ,包含基本视( base view )和依赖视( dependent view )。 基本视独立编码, 兼容现有视频编码标准, 依赖视利用视间预测技术参考基 本视进行编码, 即, 基本视被当作依赖视的一个参考视(或者说, 依赖视的 图像可以将基本视的图像作为参考图像) , 以对依赖视进行预测编码。 由于 依赖视和基本视之间存在很强的相关性, 依赖视选中基本视作为参考的概率 很大, 这就意味着依赖视中有大量的图像块选中来自于基本视的图像做为参 考图像。 For example, in multi-view coding, a base view and an dependent view are included. Basic view independent coding, compatible with existing video coding standards, relying on the use of inter-view prediction technology to reference the base view coding, that is, the basic view is regarded as a reference view of the dependent view (or, depending on the view, the base view can be viewed as a base view) The image is used as a reference image) to predictively encode the dependent image. Since there is a strong correlation between the dependent view and the base view, the probability of relying on the selected base view as a reference Very large, this means that there are a large number of image blocks in the dependent view to select the image from the base view as the reference image.
类似地, 在分层编码或可伸缩编码中, 包含基本层和增强层。 基本层独 立编码, 兼容现有视频编码标准, 增强层利用层间预测技术参考基本层进行 编码, 即, 基本层被当作增强层的一个参考层(或者说, 增强层的图像可以 将基本层的图像作为参考图像) , 以对增强层进行预测编码。 由于增强层和 基本层之间存在很强的相关性, 增强层选中基本层作为参考的概率很大, 这 就意味着增强层中有大量的图像块选中来自于基本层的图像做为参考图像。  Similarly, in layered coding or scalable coding, a base layer and an enhancement layer are included. The base layer is independently coded and compatible with existing video coding standards. The enhancement layer uses the inter-layer prediction technique to reference the base layer for coding, that is, the base layer is treated as a reference layer of the enhancement layer (or the enhancement layer image can be the base layer) The image is used as a reference image to predictively encode the enhancement layer. Since there is a strong correlation between the enhancement layer and the base layer, the probability that the enhancement layer selects the base layer as a reference is very high, which means that there are a large number of image blocks in the enhancement layer, and the image from the base layer is selected as the reference image. .
为了便于理解, 在以下说明中, 以在多视编码中使用根据本发明实施例 的确定时域运动矢量预测值的方法为例, 进行说明。  For ease of understanding, in the following description, a method of determining a time domain motion vector predictor according to an embodiment of the present invention in multi-view coding will be described as an example.
并且, 在本发明实施例中, 该基本视图像使用短期类型的参考图像进行 编码, 该基本层图像使用短期类型的参考图像进行编码。  Also, in the embodiment of the present invention, the base view image is encoded using a short-term type of reference image, and the base layer image is encoded using a short-term type of reference image.
具体地说, 参考图像(或者说, 参考图像的使用方式) 可以分为长期 long-term和短期 short-term两种。 long-term是指, 例如, 因静止的背景 4艮长 时间都不会变化, 而使得在时间轴上, 与当前图像的距离较大的图像也可以 作为当前图像的参考。 而相对 long-term而言, short-term是指, 前后两幅图像 在时间轴上的距离越近, 相关性越高, 作为参考图像的效果越好, 因此, 通 常使用 short-term的参考图像进行编码。  Specifically, the reference image (or the way the reference image is used) can be divided into long-term long-term and short-term short-term. Long-term means, for example, that the background of the still image does not change for a long time, so that the image with a larger distance from the current image on the time axis can also be used as a reference for the current image. Relative to long-term, short-term means that the closer the two images are on the time axis, the higher the correlation, the better the effect as a reference image. Therefore, the reference image of short-term is usually used. Encode.
以下, 为了便于说明, 在本发明实施例中, 对于基本视及依赖视中的图 像的编码,例如,帧间预测编码过程(包括 MCP和 MV预测 ) ,使用 short-term 类型的参考图像进行编码, 同样, 对于基本层及增强层中的图像的编码, 例 如 , 帧间预测编码过程 , 包括 MCP和 MV预测 , 使用 short-term类型的参考 图像进行编码。  Hereinafter, for convenience of description, in the embodiment of the present invention, encoding of an image in a base view and a dependent view, for example, an interframe predictive encoding process (including MCP and MV prediction), is encoded using a reference image of a short-term type. Similarly, encoding of images in the base layer and the enhancement layer, for example, an interframe predictive encoding process, including MCP and MV prediction, is encoded using a reference image of a short-term type.
在对当前处理的图像块(当前图像块, 以下为了便于说明, 简称当前块) 进行编解码操作时, 当前块包括两个或多个运动矢量, 可以利用这些运动矢 量, 从包括两个或多个参考图像中获得多个参考块, 从而, 例如, 可以根据 该参考块, 确定当前块的运动矢量的预测值(MVP, MV predictor ) 。 When performing a codec operation on a currently processed image block (current image block, hereinafter referred to as a current block for convenience of explanation), the current block includes two or more motion vectors, and these motion vectors can be utilized, including two or more Obtaining a plurality of reference blocks in the reference image, and thus, for example, may be based on The reference block determines a predicted value (MVP, MV predictor ) of the motion vector of the current block.
为节约对当前块的运动矢量的编码比特开销,采用 MV预测 +编码预测差 值的方法进行。 首先通过 MV预测技术获得当前块的运动矢量的预测值, 然 后, 确定当前块的 MV与该 MV预测值的差值, 最后对该差值进行编码。 通 过 MV预测技术获取当前块的运动矢量的预测值的过程, 在编码和解码中以 相同的方式进行, 以获得相同的 MV预测值, 实现编码和解码的匹配。  In order to save the coding bit overhead of the motion vector of the current block, the MV prediction + coding prediction difference value method is used. First, the predicted value of the motion vector of the current block is obtained by the MV prediction technique, and then the difference between the MV of the current block and the predicted value of the MV is determined, and finally the difference is encoded. The process of obtaining the predicted value of the motion vector of the current block by the MV prediction technique is performed in the same manner in encoding and decoding to obtain the same MV prediction value, and the matching of encoding and decoding is realized.
运动矢量的预测值包括时域运动矢量的预测值 (TMVP , Temporal MV predictor)。 时域运动矢量的预测值是根据当前块的时域参考图像(也称为, 对应图像)获取的 MV值, 所谓时域是指当前块所在的图像与当前块的参考 图像在视频序列的时间轴上处于不同时间位置, 该位置采用图像的 POC ( Picture Order Count )来表示。 MV的时域距离是指 MV指向的参考图像和 当前块所在的图像之间在时间轴上的距离, 即图像 POC的差值。  The predicted value of the motion vector includes the predicted value of the time domain motion vector (TMVP, Temporal MV predictor). The predicted value of the time domain motion vector is the MV value acquired according to the time domain reference image (also referred to as the corresponding image) of the current block, and the so-called time domain refers to the time when the image of the current block and the reference image of the current block are in the video sequence. The axes are at different time positions, which are represented by the POC (Picture Order Count) of the image. The time domain distance of the MV refers to the distance on the time axis between the reference image pointed to by the MV and the image in which the current block is located, that is, the difference of the image POC.
获取 TMVP过程涉及当前块的参考图像和对应图像的选择, 以及 MV的 缩放, 在获取 TMVP过程中, 如果当前块的 MV的时域距离和当前块的对应 图像块的 MV的时域距离可能不同, 涉及 MV的缩放, 该缩放过程如公式 1 所示。  The acquisition of the TMVP process involves the selection of the reference image and the corresponding image of the current block, and the scaling of the MV. In the process of acquiring the TMVP, if the time domain distance of the MV of the current block and the time domain distance of the MV of the corresponding image block of the current block may be different , involving the scaling of the MV, the scaling process is shown in Equation 1.
需要说明的是, 在例如多视编码中, 由于当前块的参考图像可能来自于 其他视, 参考图像与当前块所在的图像可能具有相同的 POC, 例如, 某一时 刻的依赖视和基本视的图像具有相同的 POC (即, POC关系为 POC相同) , 因此可能导致在 TMVP获取过程中涉及的 MV缩放过程中出现除数为零的情 况, 即, POC(currRefPic)- POC(currPic)=0 , 为避免这种情况, 将来自于不同 视的参考图像当作 long-term来处理, 例如, 依赖视将来自于基本视的参考图 像作为 long-term„  It should be noted that, for example, in multi-view coding, since the reference image of the current block may come from other views, the reference image may have the same POC as the image in which the current block is located, for example, dependent-view and base-view at a certain moment. The images have the same POC (ie, the POC relationship is the same for the POC), and thus may cause a divisor to occur in the MV scaling process involved in the TMVP acquisition process, ie, POC(currRefPic)- POC(currPic)=0, To avoid this, the reference image from different views is treated as a long-term. For example, the dependent view takes the reference image from the base view as a long-term.
在本发明实施例中, 在 S110, 编码端或解码端 (以下, 为了便于说明, 已编码端作为实施主体为例, 进行说明)可以从包括至少两个参考图像的图 像列表 (图像集合 ) 中, 确定 currRefPic以及 colPic。 需要说明的是, 上述图像集合可以是由多个图像列表构成, 也可以仅为 一个图像列表(或者说图像集合) , 本发明并未特别限定。 例如, 对于前向 预测图像 ( P-slice, Prediction slice ) , 该参考集合为一个图像列表, 而对于 双向预测图像(B-slice, Bi-prediction slice )该图像集合包括两个图像列表。 In the embodiment of the present invention, at S110, the encoding end or the decoding end (hereinafter, for convenience of explanation, the encoded end is taken as an example of the implementation main body, which can be explained) may be from an image list (image set) including at least two reference images. , determine currRefPic and colPic. It should be noted that the image set may be composed of a plurality of image lists, or may be only one image list (or image collection), and the present invention is not particularly limited. For example, for a forward predicted image (P-slice, Prediction slice), the reference set is one image list, and for a bi-prediction slice (B-slice, Bi-prediction slice), the image set includes two image lists.
在本发明实施例中,可以首先确定 currRefPic,再根据 currRefPic的类型, 确定 colPic (即, 情况 1 ) , 也可以首先确定 colPic, 再根据 colPic的类型, 确定 currRefPic (即, 情况 2 ) 。 下面, 分别对以上两种情况进行说明。  In the embodiment of the present invention, currRefPic may be first determined, and colPic (ie, case 1) may be determined according to the type of currRefPic, or colPic may be determined first, and currRefPic (ie, case 2) is determined according to the type of colPic. The following two cases will be described separately.
情况 1  Situation 1
具体地说, 例如, 编码端(或解码端)可以从参考图像列表(图像集合) 中, 确定一个图像作为当前块的参考图像 currRefPic。  Specifically, for example, the encoding end (or the decoding end) can determine an image from the reference image list (image set) as the reference image currRefPic of the current block.
可选地, 编码端可以从参考图像列表中, 确定索引号最小的图像作为 currRefPic。  Optionally, the encoding end may determine, from the reference image list, an image with the smallest index number as currRefPic.
应理解, 以上列举的确定 currRefPic的方法仅为实例性说明,本发明并不 限定于此, 可以确定参考图像列表中的任意图像作为 currRefPic。  It should be understood that the above-listed methods for determining currRefPic are merely exemplary, and the present invention is not limited thereto, and any image in the reference image list may be determined as currRefPic.
并且, 编码端 (或解码端)可以使用与现有技术相同的方法获取该参考 图像列表。  And, the encoding end (or the decoding end) can acquire the reference image list using the same method as the prior art.
需要说明的是, 为了使编码端和解码端能够获得相同的 TMVP, 以实现 编码和解码的匹配, 需要确保编码端和解码端选择相同的 currRefPic。 因此, 可以规定编码端和解码端根据相同的规则选择 currRefPic , 也可以在编码端确 定 currRefPic后, 通知解码端其选择的 currRefPic (例如, 通知解码端作为该 currRefPic 的图像在参考图像列表中的索引号) , 从而使解码端选择相同的 currRefPic。  It should be noted that in order to enable the encoding end and the decoding end to obtain the same TMVP to achieve the matching of encoding and decoding, it is necessary to ensure that the encoding end and the decoding end select the same currRefPic. Therefore, it may be specified that the encoding end and the decoding end select currRefPic according to the same rule, and may also notify the decoding end of the selected currRefPic after the encoding end determines currRefPic (for example, notifying the decoding end as an index of the image of the currRefPic in the reference image list) No.), so that the decoder selects the same currRefPic.
其后, 编码端可以根据参考图像的图像信息 (图像类型、 与该当前块的 该图像之间的图像顺序编号 POC关系、 在分层编码中的所属层或在多视编码 中的所属视中的任一信息)从参考图像列表中, 确定 colPic。  Thereafter, the encoding end may be based on image information of the reference image (image type, image sequence number POC relationship with the image of the current block, belonging layer in hierarchical coding, or belonging in multi-view coding) Any of the information) from the list of reference images, determine colPic.
情况 a 可选地, 在本发明实施例中, 根据当前图像块的参考图像的图像信息, 从该图像集合中, 确定该当前图像块的对应图像, 包括: Situation a Optionally, in the embodiment of the present invention, determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block, including:
根据当前图像块的参考图像的图像类型, 从该图像集合中, 确定该当前 图像块的对应图像, 以使该对应图像的图像类型与该参考图像的图像类型相 异。  Based on the image type of the reference image of the current image block, a corresponding image of the current image block is determined from the image set such that the image type of the corresponding image is different from the image type of the reference image.
具体地说,例如,编码端可以从 currRefPic的属性信息中,确定 currRefPic 的图像类型为 long-term或 short-term。  Specifically, for example, the encoding end may determine, from the attribute information of currRefPic, that the image type of currRefPic is long-term or short-term.
^口果 currRefPic为 long-term, 贝1 J使 colPic为 short-term。 ^口果 currRefPic 为 short-term, 贝1 J使 colPic为 long-term。 ^The mouth currRefPic is a long-term, and the shell 1 J makes colPic a short-term. ^The mouth currRefPic is short-term, and Bay 1 J makes colPic a long-term.
具体地说, 如上所述, 多视编码中, 将来自于其他视(具体地说, 是基 本视)的参考图像视为 long-term,将来自于当前视的参考图像视为 short-term。  Specifically, as described above, in multi-view coding, a reference picture from other views (specifically, a basic view) is regarded as a long-term, and a reference picture from the current view is regarded as a short-term.
因 jH , 例^口, ^口果选择的 currRefPic为 short-term, 而 colPic为 long-term, 则表示 colPic是来自于基本视的参考图像。 而如上所述, 基本视(即 colPic ) 在编码时所使用的 colRefPic通常为 short-term, 也就是说, colPic中的对应块 colBlock 的 colRefPic 为 short-term。 从而, currRefPic 与 colRefPic 均为 short-term , 能够提高获取 TMVP的效果。  Because jH , the example ^ mouth, ^ currRefPic is a short-term, and colPic is a long-term, it means that colPic is a reference image from the base view. As mentioned above, the colRefPic used by the base view (ie colPic) is usually short-term, that is, the colRefPic of the corresponding block colBlock in colPic is short-term. Thus, both currRefPic and colRefPic are short-term, which can improve the effect of acquiring TMVP.
再 1*列 ^口, ^口果选择的 currRefPic为 long-term, 而 colPic为 short-term, 贝1 J 表示 colPic是来自于当前视(依赖视)的参考图像。而当前视的图像(即 colPic ) 在编码时通常会参考来自于其他视(基本视)的图像,即, colPic中的 colBlock 的 colRefPic 通常为 long-term。 从而, currRefPic 与 colRefPic 通常均为 long-term , 能够提高获取 TMVP的效果。 Then 1* column ^, ^ currRefPic is a long-term, and colPic is a short-term, and Bay 1 J indicates that colPic is a reference image from the current view (dependent view). The current view image (ie colPic) is usually referenced from other views (base view) when encoding, ie the colRefPic of colBlock in colPic is usually a long-term. Thus, currRefPic and colRefPic are usually long-terms, which can improve the effect of acquiring TMVP.
情况 b  Situation b
可选地, 在本发明实施例中, 根据当前图像块的参考图像的图像信息, 从该图像集合中, 确定该当前图像块的对应图像, 包括:  Optionally, in the embodiment of the present invention, determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block, including:
根据当前图像块的参考图像的与该当前块的该图像之间的 POC关系, 从 该图像集合中, 确定该当前图像块的对应图像, 以使该对应图像的与该当前 块的所属图像之间的 POC关系与该参考图像的与该当前块的所属图像之间的 POC关系相异 Determining, according to a POC relationship between the reference image of the current image block and the image of the current block, from the image set, determining a corresponding image of the current image block to make the corresponding image and the current image The POC relationship between the belonging images of the block is different from the POC relationship between the reference image and the image of the current block
具体地说,例如,编码端可以从 currRefPic的属性信息中,确定 currRefPic 的 POC , 并且, 可以从当前块的所属图像 currPic 的 POC, 从而可以确定 currRefPic的 POC与 currPic的 POC的关系。  Specifically, for example, the encoding end may determine the POC of the currRefPic from the attribute information of the currRefPic, and may determine the POC of the currRefPic from the POC of the currPic from the POC of the image currPic of the current block.
如果 currRefPic的 POC与 currPic的 POC相同, 则使 colPic的 POC与 currPic的 POC相异,如果 currRefPic的 POC与 currPic的 POC相异,则使 colPic 的 POC与 currPic的 POC相同。  If the POC of the currRefPic is the same as the POC of the currPic, the POC of the colPic is different from the POC of the currPic. If the POC of the currRefPic is different from the POC of the currPic, the POC of the colPic is the same as the POC of the currPic.
具体地说, 在现有技术中, 如果某一图像 ( currRefPic或 colPic ) 的 POC 与 currPic的 POC相同, 则表示该图像来自于基本视或基本层,表示该图像的 图像类型为 long-term,如果某一图像 ( currRefPic或 colPic )的 POC与 currPic 的 POC相异, 则表示该图像来自于依赖视或增强层, 表示该图像的图像类型 为 short-term。 反之亦然, 即, 如果某一图像( currRefPic或 colPic )的图像类 型为 short-term, 则表示该图像的的 POC与 currPic的 POC相异, 如果某一图 像(currRefPic或 colPic ) 的图像类型为 long-term, 则表示该图像的 POC与 currPic的 POC相同。  Specifically, in the prior art, if the POC of an image (currRefPic or colPic) is the same as the POC of the currPic, it indicates that the image is from the base view or the base layer, indicating that the image type of the image is long-term, If the POC of an image ( currRefPic or colPic ) is different from the POC of currPic, it means that the image is from a dependent view or enhancement layer, indicating that the image type of the image is short-term. The reverse is also true, that is, if the image type of an image ( currRefPic or colPic ) is short-term, it means that the POC of the image is different from the POC of currPic, if the image type of an image (currRefPic or colPic ) is Long-term, which means that the POC of the image is the same as the POC of currPic.
因此, 例如, 如果选择的 currRefPic的 POC与 currPic的 POC相异, 则 表示 currRefPic的图像类型为 short-term, 而如果 colPic的 POC与 currPic的 POC相同, 则 colPic图像类型为 long-term, 即, 表示 colPic是来自于基本视 的参考图像。 而如上所述, 基本视(即 colPic )在编码时所使用的 colRefPic 通常为 short-term, 也就是说, colPic 中的对应块 colBlock 的 colRefPic 为 short-term。从而, currRefPic与 colRefPic均为 short-term,能够提高获取 TMVP 的效果。  Therefore, for example, if the POC of the selected currRefPic is different from the POC of the currPic, the image type of the currRefPic is short-term, and if the POC of the colPic is the same as the POC of the currPic, the colPic image type is long-term, ie, Indicates that colPic is a reference image from the base view. As mentioned above, the colRefPic used by the base view (ie colPic) is usually short-term, that is, the colRefPic of the corresponding block colBlock in colPic is short-term. Thus, both currRefPic and colRefPic are short-term, which can improve the effect of acquiring TMVP.
再例如, 如果选择的 currRefPic的 POC与 currPic的 POC相同, 则表示 选择的 currRefPic为 long-term, 而 口果 currRefPic的 POC与 currPic的 POC 相异, 则表示 colPic为 short-term, 即, 表示 colPic是来自于当前视 (依赖视 ) 的参考图像。 而当前视的图像(即 colPic )在编码时通常会参考来自于其他视 (基本视 ) 的图像, 即, colPic中的 colBlock的 colRefPic通常为 long-term„ 从而, currRefPic与 colRefPic通常均为 long-term, 能够提高获取 TMVP的效 果。 For another example, if the POC of the selected currRefPic is the same as the POC of the currPic, the selected currRefPic is a long-term, and the POC of the currRefPic is different from the POC of the currPic, indicating that the colPic is a short-term, that is, a colPic Is from the current view (dependency) Reference image. The current view image (ie, colPic) usually refers to images from other views (base view) when encoding, that is, the colRefPic of colBlock in colPic is usually long-term. Thus, currRefPic and colRefPic are usually long- Term, can improve the effect of acquiring TMVP.
情况 c  Situation c
可选地, 在本发明实施例中, 根据当前图像块的参考图像的图像信息, 从该图像集合中, 确定该当前图像块的对应图像, 包括:  Optionally, in the embodiment of the present invention, determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block, including:
根据当前图像块的参考图像的所属层, 从该图像集合中, 确定该当前图 像块的对应图像, 以使该对应图像的所属层与该参考图像的所属层相异。  And determining, according to the belonging layer of the reference image of the current image block, a corresponding image of the current image block from the image set such that the belonging layer of the corresponding image is different from the associated layer of the reference image.
具体地说, 如果当前块的 currRefPic来自于当前层(增强层)内, 则表示 currRefPic 为 short-term, 此时, 选择来自于基本层的图像 ( long-term )作为 colPic。 由于来自于基本层的图像(包括该 colPic )在编码时选择的参考图像 来自于基本层, 即, 该参考图像均为 short-term。 因此, colPic 中的对应块 colBlock ^ colRefPic为 short-term, , colRefPic与 currRefPic 为 short-term。  Specifically, if the current block's currRefPic is from the current layer (enhancement layer), it means that currRefPic is a short-term. At this time, the image from the base layer ( long-term ) is selected as colPic. Since the image from the base layer (including the colPic) is selected at the time of encoding, the reference image comes from the base layer, that is, the reference image is a short-term. Therefore, the corresponding block colBlock ^ colRefPic in colPic is short-term, and colRefPic and currRefPic are short-term.
^口果当前块的 currRefPic来自于基本层, 则表示 currRefPic为 long-term, 此时, 选择当前层(增强层) 内的图像 ( short-term )作为 colPic。 由于当前 层内的参考图像在编码时通常会利用帧间预测而选中基本层作为参考, 因此, colPic的 colBlock的 colRefPic通常来自于基本层(为 long-term ),即, colRefPic 与 currRefPic均为 long-term。  ^ The currRefPic of the current block of the mouth comes from the base layer, indicating that currRefPic is long-term. At this time, the image (short-term) in the current layer (enhancement layer) is selected as colPic. Since the reference picture in the current layer usually uses the inter-prediction to select the base layer as a reference when encoding, the colRefPic of the colPlock of colPic usually comes from the base layer (which is a long-term), that is, both colRefPic and currRefPic are long. -term.
情况 d  Situation d
可选地, 在本发明实施例中, 根据当前图像块的参考图像的图像信息, 从该图像集合中, 确定该当前图像块的对应图像, 包括:  Optionally, in the embodiment of the present invention, determining the corresponding image of the current image block from the image set according to the image information of the reference image of the current image block, including:
根据当前图像块的参考图像的所属视, 从该图像集合中, 确定该当前图 像块的对应图像, 以使该对应图像的所属视与该参考图像的所属视相异。  And determining, according to the belonging view of the reference image of the current image block, a corresponding image of the current image block from the image set such that the belonging view of the corresponding image is different from the belonging view of the reference image.
具体地说, 如果当前块的 currRefPic来自于当前视(依赖视 )内, 则表示 currRefPic 为 short-term, 此时, 选择来自于基本视的图像 ( long-term )作为 colPic。 由于来自于基本视的图像(包括该 colPic )在编码时选择的参考图像 来自于基本视, 即, 该参考图像均为 short-term。 因此, colPic 中的对应块 colBlock ^ colRefPic为 short-term, , colRefPic与 currRefPic 为 short-term。 Specifically, if the currRefPic of the current block comes from the current view (dependent view), it means that currRefPic is a short-term, and at this time, the image from the base view (long-term) is selected as colPic. Since the image from the base view (including the colPic) is selected at the time of encoding, the reference image is from the base view, that is, the reference image is short-term. Therefore, the corresponding block colBlock ^ colRefPic in colPic is short-term, and colRefPic and currRefPic are short-term.
:¾口果当前块的 currRefPic来自于基本视, 则表示 currRefPic为 long-term, 此时, 选择当前视(依赖视) 内的图像( short-term )作为 colPic。 由于当前 视内的参考图像在编码时通常会利用帧间预测而选中基本视作为参考, 因此, colPic的 colBlock的 colRefPic通常来自于基本视(为 long-term ),即, colRefPic 与 currRefPic均为 long-term。  :3⁄4 The current currRefPic of the current block comes from the base view, which means that currRefPic is long-term. At this time, the image (short-term) in the current view (dependency view) is selected as colPic. Since the reference image in the current view usually uses inter prediction to select the base view as a reference when encoding, the colRefPic of the colPlock of colPic usually comes from the base view (which is a long-term), that is, both colRefPic and currRefPic are long. -term.
可选的, 该图像集合中包括至少两个第一备选图像, 其中, 该第一备选 图像的类型与该参考图像的图像类型相异, 或  Optionally, the image set includes at least two first candidate images, where the type of the first candidate image is different from the image type of the reference image, or
该第一备选图像的与该当前块的所属图像之间的 POC关系, 与该参考图 像的与该当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the first candidate image and the associated image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
该第一备选图像的所属层与该参考图像的所属层相异, 或  The associated layer of the first candidate image is different from the layer to which the reference image belongs, or
该第一备选图像的所属视与该参考图像的所属视相异, 以及  The belonging view of the first candidate image is different from the belonging view of the reference image, and
该根据当前图像块的参考图像的图像信息, 从该图像集合中, 确定该当 前图像块的对应图像, 包括:  And determining, according to the image information of the reference image of the current image block, the corresponding image of the current image block from the image set, including:
根据当前图像块的参考图像的图像信息, 从该至少两个第一备选图像中, 确定在该图像集合中的索引号最小的图像, 作为该当前图像块的对应图像。  And determining, from the at least two first candidate images, an image with the smallest index number in the image set as the corresponding image of the current image block according to the image information of the reference image of the current image block.
具体地说, 在确定 currRefPic 为第一类型图像(图像类型 short-term或 long-term, 与该当前块的所属图像之间的 POC关系为相同或相异, 所属层为 基本层或增强层, 所属视为基本视或依赖视)后, 需要从第一图像列表中选 择第二类型图像(类型与第一类型图像相异)作为 colPic, 此时, 如果第一图 像列表中包括多个 (至少两个) 第二类型图像(即, 第一备选图像) , 则可 以从该多个第一备选图像中, 选择一个图像作为 colPic, 例如, 可以选择多个 第一备选图像中索引号最小的图像, 作为 colPic, 即, 可以按照参考图像索引 号从小到大的顺序从参考图像列表中寻找类型与 currRefPic相异的图像,作为 colPic。 Specifically, when determining that currRefPic is the first type image (the image type short-term or long-term, the POC relationship with the image of the current block is the same or different, and the belonging layer is a base layer or an enhancement layer, After being regarded as a base view or a dependent view, it is necessary to select a second type image (the type is different from the first type image) as the colPic from the first image list, at this time, if the first image list includes a plurality (at least Two) the second type of image (ie, the first candidate image), then one of the plurality of first candidate images may be selected as the colPic, for example, the index numbers of the plurality of first candidate images may be selected The smallest image, as colPic, that is, an image of a type different from currRefPic can be found from the reference image list in ascending order of the reference image index number as colPic.
这样, 由于索引号越小, 代表该图像越接近当前图像, 从而能够进一步 提高本发明实施例的效果。  Thus, the smaller the index number, the closer the image is to the current image, so that the effect of the embodiment of the present invention can be further improved.
应理解,以上列举的,选择第二类型图像中索引号最小的图像,作为 colPic 仅为实例性说明, 本发明并不限定于此, 也可与选择任意一个第一备选图像 作为 colPic。  It should be understood that, in the above enumeration, the image with the smallest index number in the second type image is selected, and colPic is only an example description, and the present invention is not limited thereto, and any one of the first candidate images may be selected as colPic.
需要说明的是, 为了使编码端和解码端能够获得相同的 TMVP, 以实现 编码和解码的匹配, 需要确保编码端和解码端选择相同的 colPic。 因此, 可以 规定编码端和解码端根据相同的规则选择 colPic, 也可以在编码端确定 colPic 后, 通知解码端其选择的 colPic, 从而使解码端选择相同的 colPic。  It should be noted that in order to enable the encoding end and the decoding end to obtain the same TMVP to achieve matching between encoding and decoding, it is necessary to ensure that the encoding end and the decoding end select the same colPic. Therefore, it is possible to specify that the encoding end and the decoding end select colPic according to the same rule, or after the encoding end determines colPic, notify the decoding end of the selected colPic, so that the decoding end selects the same colPic.
根据本发明实施例的获取时域运动矢量预测值的方法, 通过首先确定 currRefPic , 然后再确定 colPic。 对于不同的图像块可以获取到不同的 colPic , 有较好的适应性, 有助于获得更好的编码压缩性能。  A method of obtaining a time domain motion vector predictor according to an embodiment of the present invention first determines currRefPic and then determines colPic. Different colPic can be obtained for different image blocks, which has better adaptability and helps to obtain better coding compression performance.
可选地, 该图像集合包括至少一个第二备选图像和至少一个第三备选图 像, 其中, 该第二备选图像与该第三备选图像的图像类型相异, 或  Optionally, the image set includes at least one second candidate image and at least one third candidate image, wherein the second candidate image is different from the image type of the third candidate image, or
该第二备选图像的与该当前块的所属图像之间的 POC关系, 与该第三备 选图像的与该当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the second candidate image and the associated image of the current block is different from a POC relationship between the third candidate image and the associated image of the current block, or
该第二备选图像的所属层与该第三备选图像的所属层相异, 或  The belonging layer of the second candidate image is different from the layer to which the third candidate image belongs, or
该第二备选图像的所属视与该第三备选图像的所属视相异, 以及 该方法还包括:  The belonging view of the second candidate image is different from the belonging view of the third candidate image, and the method further includes:
从该图像集合中, 确定预测图像, 该预测图像包括一个第二备选图像和 一个第三备选图像, 该预测图像用于确定该当前图像块所处条带中各图像块 的对应图像; 以及  Determining, from the set of images, a predicted image, the predicted image comprising a second candidate image and a third candidate image, the predicted image being used to determine a corresponding image of each image block in the strip in which the current image block is located; as well as
该根据该参考图像的类型, 从该图像集合中, 确定该当前图像块的对应 图像, 包括:  Determining, according to the type of the reference image, a corresponding image of the current image block from the image set, comprising:
从该预测图像中, 确定该当前图像块的对应图像。 具体地说, 在本发明实施例中, 例如, 在参考图像列表包括至少三个图 像(至少一个第一类型图像和至少两个第二类型图像, 或, 至少一个第二类 型图像和至少两个第一类型图像) 的情况下, 可以预先从该第一图像列表中 选择一个第一类型图像和一个第二类型图像, 构成新的参考图像列表(预测 图像) 。 From the predicted image, a corresponding image of the current image block is determined. Specifically, in the embodiment of the present invention, for example, the reference image list includes at least three images (at least one first type image and at least two second type images, or at least one second type image and at least two In the case of the first type image, a first type image and a second type image may be selected in advance from the first image list to constitute a new reference image list (predicted image).
在如上所述确定了 currRefPic后, 可以, 根据该 currRefPic的图像类型, 该预测图像中获取类型与 currRefPic的类型相异的 colPic。 由于该预测图像包 括了第一类型图像和第二类型图像(即, short-term图像和 long-term的图像, 或与该当前块的所属图像之间的 POC关系为相同的图像和与该当前块的所属 图像之间的 POC关系为相异的图像, 或所属层为基本层的图像和所属层为增 强层的图像, 或所属视为基本视的图像和所属视为依赖视的图像) , 因此, 无论 currRefPic 是第一类型图像还是第二类型图像, 均能够获取类型与 currRefPic相异的 colPic。 从而, 能够提高编解码效率。  After the currRefPic is determined as described above, according to the image type of the currRefPic, a colPic of a type different from the currRefPic type may be obtained in the predicted image. Since the predicted image includes the first type image and the second type image (ie, the short-term image and the long-term image, or the POC relationship with the associated image of the current block is the same image and the current The POC relationship between the images belonging to the block is a different image, or the image in which the layer belongs to the base layer and the image in which the layer belongs to the enhancement layer, or the image regarded as the base view and the image to which the dependent view is regarded, Therefore, whether currRefPic is a first type image or a second type image, a colPic of a type different from currRefPic can be obtained. Thereby, the codec efficiency can be improved.
可选地, 在本发明实施例中, 该方法还包括:  Optionally, in the embodiment of the present invention, the method further includes:
从该图像集合中, 确定第二图像块的参考图像, 其中, 该第二图像块与 该当前图像块处于同一条带;  Determining, from the image set, a reference image of the second image block, wherein the second image block is in the same strip as the current image block;
根据该第二图像块的参考图像的类型, 从该预测图像中, 确定该第二图 像块的对应图像, 以使该该第二图像块的对应图像的类型与该第二图像块的 参考图像的类型相异。  Determining, according to a type of the reference image of the second image block, a corresponding image of the second image block from the predicted image, such that a type of the corresponding image of the second image block and a reference image of the second image block The types are different.
具体地说, 由于同一 slice的各图像块可以使用相同的对应图像, 因此, 在获取与当前块处于同一 slice的第二图像块的 TMVP时, 可以重复利用该该 预测图像, 从而, 降低了处理的复杂度。  Specifically, since each image block of the same slice can use the same corresponding image, when the TMVP of the second image block of the same slice as the current block is acquired, the predicted image can be reused, thereby reducing the processing. The complexity.
可选地, 该图像集合包括至少两个第二备选图像, 和 /或  Optionally, the set of images includes at least two second candidate images, and/or
该图像集合包括至少两个第三备选图像, 以及  The set of images includes at least two third candidate images, and
该从该图像集合中, 确定预测图像, 包括:  Determining the predicted image from the image set includes:
从该图像集合中, 确定预测图像, 该预测图像包括该至少两个第二备选 图像中在该图像集合中的索引号最小的图像; 和 /或 Determining, from the set of images, a predicted image, the predicted image including the at least two second alternatives The image with the smallest index number in the image set in the image; and/or
从该图像集合中, 确定预测图像, 该预测图像包括该至少两个第三备选 图像中在该图像集合中的索引号最小的图像。  From the set of images, a predicted image is determined, the predicted image comprising an image of the at least two third candidate images having the smallest index number in the set of images.
具体地说, 所选择的预测图像可以是第一类型图像中索引号最小的图像 和 /或该至少两个第二类型图像中索引号最小的图像。  Specifically, the selected predicted image may be an image having the smallest index number in the first type image and/or an image having the smallest index number among the at least two second type images.
这样, 由于索引号越小, 代表该图像越接近当前图像, 从而能够进一步 提高本发明实施例的效果。  Thus, the smaller the index number, the closer the image is to the current image, so that the effect of the embodiment of the present invention can be further improved.
情况 2  Situation 2
可选地, 该方法包括:  Optionally, the method comprises:
从该图像集合中, 确定目标图像, 作为该当前图像块所处条带中各图像 块的对应图像; 以及  Determining, from the set of images, a target image as a corresponding image of each image block in the strip in which the current image block is located;
该根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该当 前图像块的参考图像, 包括:  And determining, according to the image information of the corresponding image of the current image block, the reference image of the current image block from the image set, including:
根据当前图像块的对应图像的图像类型, 从该图像集合中, 确定该当前 图像块的参考图像, 以使该参考图像的图像类型与该对应图像的图像类型相 异; 或  Determining, according to an image type of the corresponding image of the current image block, a reference image of the current image block from the image set such that an image type of the reference image is different from an image type of the corresponding image; or
根据当前图像块的对应图像的与该当前块的该图像之间的 POC关系, 从 该图像集合中, 确定该当前图像块的参考图像, 以使该参考图像的与该当前 块的所属图像之间的 POC关系与该对应图像的与该当前块的所属图像之间的 POC关系相异; 或  Determining, from the image set, a reference image of the current image block according to a POC relationship between a corresponding image of the current image block and the image of the current block, such that the image of the reference image and the image of the current block The POC relationship between the two is different from the POC relationship between the corresponding image and the image of the current block; or
根据当前图像块的对应图像的所属层, 从该图像集合中, 确定该当前图 像块的参考图像, 以使该参考图像的所属层与该对应图像的所属层相异; 或 根据当前图像块的对应图像的所属视, 从该图像集合中, 确定该当前图 像块的参考图像, 以使该参考图像的所属视与该对应图像的所属视相异。  Determining, from the image set, a reference image of the current image block according to an associated layer of the corresponding image of the current image block, such that the belonging layer of the reference image is different from the belonging layer of the corresponding image; or according to the current image block Corresponding to the belonging view of the image, the reference image of the current image block is determined from the image set such that the belonging view of the reference image is different from the belonging view of the corresponding image.
具体地说, 由于同一 slice的各图像块可以使用相同的对应图像, 因此, 例如, 编码端 (或解码端)可以从参考图像列表中, 确定一个图像作为当前 块所处 slice内各图像块的对应图像 colPic (目标图像) 。 Specifically, since each image block of the same slice can use the same corresponding image, for example, the encoding end (or the decoding end) can determine an image from the reference image list as the current The corresponding image colPic (target image) of each image block in the slice in which the block is located.
可选地, 可以从参考图像列表中, 确定索引号最小的图像作为 colPic。 应理解, 以上列举的确定 colPic 的方法仅为实例性说明, 本发明并不限 定于此, 可以确定参考图像列表中的任意图像作为 colPic。  Alternatively, an image with the smallest index number may be determined from the reference image list as colPic. It should be understood that the above-listed methods of determining colPic are merely exemplary, and the present invention is not limited thereto, and any image in the reference image list may be determined as colPic.
需要说明的是, 为了使编码端和解码端能够获得相同的 TMVP , 以实现 编码和解码的匹配, 需要确保编码端和解码端选择相同的 colPic。 因此, 可以 规定编码端和解码端根据相同的规则选择 colPic , 也可以在编码端确定 colPic 后, 通知解码端其选择的 colPic (例如, 通知解码端作为该 colPic的图像在第 一图像列表中的索引号) , 从而使解码端选择相同的 colPic。  It should be noted that in order to enable the encoding end and the decoding end to obtain the same TMVP to achieve the matching of encoding and decoding, it is necessary to ensure that the encoding end and the decoding end select the same colPic. Therefore, it may be specified that the encoding end and the decoding end select colPic according to the same rule, and may also notify the decoding end of the selected colPic after the encoding end determines colPic (for example, notifying the decoding end as the image of the colPic in the first image list. The index number), so that the decoder selects the same colPic.
其后, 编码端可以根据对应图像的图像信息 (图像类型、 与该当前块的 该图像之间的图像顺序编号 POC关系、 在分层编码中的所属层或在多视编码 中的所属视中的任一信息)从参考图像列表中, 确定 currRefPic。  Thereafter, the encoding end may be based on the image information of the corresponding image (the image type, the POC relationship with the image sequence between the image of the current block, the belonging layer in the layered encoding, or the dependent view in the multi-view encoding). Any of the information) from the list of reference images, determine currRefPic.
情况 e  Situation e
可选地, 在本发明实施例中, 根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该当前图像块的参考图像, 包括:  Optionally, in the embodiment of the present invention, determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, including:
根据当前图像块的对应图像的图像类型, 从该图像集合中, 确定该当前 图像块的参考图像, 以使该参考图像的图像类型与该对应图像的图像类型相 异。  Based on the image type of the corresponding image of the current image block, a reference image of the current image block is determined from the image set such that the image type of the reference image is different from the image type of the corresponding image.
具体地说, 例如, 编码端可以从 colPic的属性信息中, 确定 colPic的图 像类型为 long-term或 short-term„  Specifically, for example, the encoding end may determine, from the attribute information of colPic, that the image type of colPic is long-term or short-term.
^口果 colPic为 long-term, 贝1 J使 currRefPic为 short-term。 ^口果 colPic为 short-term, 贝1 J使 currRefPic为 long-term。 ^The colPic is a long-term, and Bay 1 J makes currRefPic a short-term. ^The colPic of the mouth is short-term, and the shell 1 J makes currRefPic a long-term.
具体地说, 如上所述, 多视编码中, 将来自于其他视(具体地说, 是基 本视 )的对应图像视为 long-term,将来自于当前视的对应图像视为 short-term。  Specifically, as described above, in multi-view coding, a corresponding image from another view (specifically, a basic view) is regarded as a long-term, and a corresponding image from the current view is regarded as a short-term.
因 jH , 例^口, ^口果选择的 colPic为 short-term, 而 currRefPic为 long-term, 则表示 colPic是来自于当前视(依赖视) 的对应图像。 而当前视的图像(即 colPic )在编码时通常会参考来自于其他视(基本视) 的图像, 即, colPic 中 的 colBlock的 colRefPic通常为 long-term。 从而, colPic与 colRefPic通常均 为 long-term, 能够提高获取 TMVP的效果。 Because jH, the example ^ mouth, ^ the colPic selected by the word is short-term, and currRefPic is long-term, it means that colPic is the corresponding image from the current view (dependent view). The current view image (ie colPic) usually refers to images from other views (base view) when encoding, that is, the colRefPic of colBlock in colPic is usually long-term. Thus, colPic and colRefPic are usually long-terms, which can improve the effect of acquiring TMVP.
再 1*列 ^口, ^口果选择的 colPic为 long-term, 而 currRefPic为 short-term, 贝1 J 表示 colPic是来自于基本视的对应图像。 基本视 (即 colPic )在编码时所使用 的 colRefPic 通常为 short-term, 也就是说, colPic 中的对应块 colBlock 的 colRefPic为 short-term。 从而, colPic与 colRefPic均为 short-term, 能够提高 获取 TMVP的效果。 Then 1* column ^ mouth, ^ colPic selected by the word is long-term, and currRefPic is short-term, and shell 1 J indicates that colPic is the corresponding image from the base view. The colRefPic used by the base view (ie colPic) is usually short-term, that is, the colRefPic of the corresponding block colBlock in colPic is short-term. Therefore, both colPic and colRefPic are short-term, which can improve the effect of acquiring TMVP.
情况 f  Situation f
可选地, 在本发明实施例中, 根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该当前图像块的参考图像, 包括:  Optionally, in the embodiment of the present invention, determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, including:
根据当前图像块的对应图像的与该当前块的该图像之间的 POC关系, 从 该图像集合中, 确定该当前图像块的参考图像, 以使该参考图像的与该当前 块的所属图像之间的 POC关系与该对应图像的与该当前块的所属图像之间的 POC关系相异  Determining, from the image set, a reference image of the current image block according to a POC relationship between a corresponding image of the current image block and the image of the current block, such that the image of the reference image and the image of the current block The POC relationship between the two is different from the POC relationship between the corresponding image and the image of the current block.
具体地说,例如,编码端可以从 colPic的属性信息中 ,确定 colPic的 POC, 并且, 可以从当前块的所属图像 currPic的 POC,从而可以确定 colPic的 POC 与 currPic的 POC的关系。  Specifically, for example, the encoding end may determine the POC of the colPic from the attribute information of the colPic, and may determine the POC of the colPic from the POC of the currPic from the POC of the image currPic of the current block.
如果 colPic的 POC与 currPic的 POC相同, 则使 currRefPic的 POC与 currPic的 POC相异,如果 colPic的 POC与 currPic的 POC相异,则使 currRefPic 的 POC与 currPic的 POC相同。  If the POC of colPic is the same as the POC of currPic, the POC of currRefPic is different from the POC of currPic. If the POC of colPic is different from the POC of currPic, the POC of currRefPic is the same as the POC of currPic.
具体地说, 在现有技术中, 如果某一图像 ( currRefPic或 colPic ) 的 POC 与 currPic的 POC相同, 则表示该图像来自于基本视或基本层,表示该图像的 图像类型为 long-term,如果某一图像 ( currRefPic或 colPic )的 POC与 currPic 的 POC相异, 则表示该图像来自于依赖视或增强层, 表示该图像的图像类型 为 short-term。 反之亦然, 即, 如果某一图像( currRefPic或 colPic )的图像类 型为 short-term, 则表示该图像的的 POC与 currPic的 POC相异, 如果某一图 像(currRefPic或 colPic ) 的图像类型为 long-term, 则表示该图像的 POC与 currPic的 POC相同。 Specifically, in the prior art, if the POC of an image (currRefPic or colPic) is the same as the POC of the currPic, it indicates that the image is from the base view or the base layer, indicating that the image type of the image is long-term, If the POC of an image ( currRefPic or colPic ) is different from the POC of currPic, it means that the image is from a dependent view or enhancement layer, indicating that the image type of the image is short-term. And vice versa, ie if an image of a certain image ( currRefPic or colPic ) If the type is short-term, it means that the POC of the image is different from the POC of currPic. If the image type of a certain image (currRefPic or colPic) is long-term, it means that the POC of the image is the same as the POC of currPic.
因此, 例如, 如果选择的 colPic的 POC与 currPic的 POC相异, 则表示 colPic的图像类型为 short-term, 而如果 currRefPic的 POC与 currPic的 POC 相同, 则 currRefPic图像类型为 long-term。 而如上所述, 依赖视(即 colPic ) 在编码时所使用的 colRefPic通常来自于基本视, 也就是说, currRefPic中的 对应块 colBlock的 colRefPic为 long-term。 从而, colPic与 colRefPic均为 long-term , 能够提高获取 TMVP的效果。  Therefore, for example, if the POC of the selected colPic is different from the POC of the currPic, the image type of colPic is short-term, and if the POC of currRefPic is the same as the POC of currPic, the currRefPic image type is long-term. As mentioned above, the colRefPic used by the dependent view (ie colPic) in encoding is usually derived from the base view, that is, the colRefPic of the corresponding block colBlock in currRefPic is long-term. Thus, both colPic and colRefPic are long-term, which can improve the effect of acquiring TMVP.
再例如, 如果选择的 colPic的 POC与 currPic的 POC相同, 则表示选择 的 colPic为 long-term, 而如果 colPic的 POC与 currPic的 POC相异, 则表示 currRefPic为 short-term, 即 , 表示 currRefPic是来自于当前视 (依赖视 )的对 应图像。 而基本视的图像(即 colPic )在编码时使用 short-term的参考图像, 即, colPic中的 colBlock的 colRefPic通常为 short-term。从而, colPic与 colRefPic 通常均为 short-term, 能够提高获取 TMVP的效果。  For another example, if the POC of the selected colPic is the same as the POC of the currPic, the selected colPic is a long-term, and if the POC of the colPic is different from the POC of the currPic, the currRefPic is a short-term, that is, the currRefPic is Corresponding image from the current view (dependency view). The base view image (ie, colPic) uses a short-term reference image when encoding, that is, the colRefPic of colBlock in colPic is usually a short-term. Thus, colPic and colRefPic are usually short-terms, which can improve the effect of acquiring TMVP.
情况 g  Situation g
可选地, 在本发明实施例中, 根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该当前图像块的参考图像, 包括:  Optionally, in the embodiment of the present invention, determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, including:
根据当前图像块的对应图像的所属层, 从该图像集合中, 确定该当前图 像块的参考图像, 以使该参考图像的所属层与该对应图像的所属层相异。  A reference image of the current image block is determined from the image set according to an associated layer of the corresponding image of the current image block such that the associated layer of the reference image is different from the associated layer of the corresponding image.
具体地说,如果当前块的 colPic来自于当前层(增强层)内,则表示 colPic 为 short-term, 此时, 选择来自于基本层的图像( long -term )作为 currRefPic„ 由于当前层内的对应图像在编码时通常会利用帧间预测而选中基本层作为参 考, 因此, colPic的 colBlock的 colRefPic通常来自于基本层 (为 long-term ) , 即, colRefPic与 colPic均为 long-term。  Specifically, if the colPic of the current block comes from the current layer (enhancement layer), it means that colPic is a short-term. At this time, the image from the base layer ( long -term ) is selected as currRefPic„ due to the current layer. Corresponding images usually use inter prediction to select the base layer as a reference when encoding. Therefore, the colRefPic of colPlock of colPic usually comes from the base layer (long-term), that is, both colRefPic and colPic are long-term.
如果当前块的 colPic来自于基本层, 则表示 colPic为 long-term, 此时, 选择当前层(增强层) 内的图像( short-term )作为 currRefPic。 由于来自于基 本层的图像(包括该 colPic )在编码时选择的参考图像来自于基本层, 即, 该 参考图像均为 short-term。 因此, colPic中的对应块 colBlock的 colRefPic为 short-term, , colRefPic与 colPic 为 short-term。 If the colPic of the current block comes from the base layer, it means that colPic is a long-term. Select the image ( short-term ) in the current layer (enhancement layer) as currRefPic. Since the image from the base layer (including the colPic) is selected at the time of encoding, the reference image comes from the base layer, that is, the reference image is short-term. Therefore, the colRefPic of the corresponding block colBlock in colPic is short-term, and colRefPic and colPic are short-term.
情况 h  Situation h
可选地, 在本发明实施例中, 根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该当前图像块的参考图像, 包括:  Optionally, in the embodiment of the present invention, determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, including:
根据当前图像块的对应图像的所属视, 从该图像集合中, 确定该当前图 像块的参考图像, 以使该参考图像的所属视与该对应图像的所属视相异。  And determining, according to the belonging view of the corresponding image of the current image block, the reference image of the current image block from the image set such that the belonging view of the reference image is different from the belonging view of the corresponding image.
具体地说,如果当前块的 colPic来自于当前视(依赖视 )内,则表示 colPic 为 short-term, 此时, 选择来自于基本视的图像 ( long-term )作为 currRefPic。 由于当前视内的对应图像在编码时通常会利用帧间预测而选中基本视作为参 考,因此, colPic中的 colBlock的 colRefPic通常来自于基本视(为 long-term ) , 即, colRefPic与 colPic均为 long-term。  Specifically, if the colPic of the current block comes from the current view (dependent view), it means that colPic is a short-term. At this time, the image from the base view ( long-term ) is selected as currRefPic. Since the corresponding image in the current view usually uses inter prediction to select the base view as a reference when encoding, the colRefPic of the colBlock in colPic usually comes from the base view (which is long-term), that is, both colRefPic and colPic are Long-term.
如果当前块的 colPic来自于基本视, 则表示 colPic为 long-term, 此时, 选择当前视 (依赖视 ) 内的图像( short-term )作为 currRefPic。 由于来自于基 本视的图像(包括该 colPic )在编码时选择的参考图像来自于基本视, 即, 该 参考图像均为 short-term。 因此, colPic中的对应块 colBlock的 colRefPic为 short-term, , colRefPic与 colPic 为 short-term。  If the colPic of the current block comes from the base view, it means that colPic is a long-term. At this time, the image (short-term) in the current view (dependency view) is selected as currRefPic. Since the image from the basic view (including the colPic) is selected at the time of encoding, the reference image comes from the base view, that is, the reference image is a short-term. Therefore, the colRefPic of the corresponding block colBlock in colPic is short-term, and colRefPic and colPic are short-term.
可选的, 该图像集合中包括至少两个第四备选图像, 其中, 该第四备选 图像的类型与该参考图像的图像类型相异, 或  Optionally, the image set includes at least two fourth candidate images, where the type of the fourth candidate image is different from the image type of the reference image, or
该第四备选图像的与该当前块的所属图像之间的 POC关系, 与该参考图 像的与该当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the fourth candidate image and the belonging image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
该第四备选图像的所属层与该参考图像的所属层相异, 或  The belonging layer of the fourth candidate image is different from the layer to which the reference image belongs, or
该第四备选图像的所属视与该参考图像的所属视相异, 以及  The belonging view of the fourth candidate image is different from the belonging view of the reference image, and
该根据该对应图像的图像信息, 从该图像集合中, 确定该当前图像块的 参考图像, 包括: Determining, according to the image information of the corresponding image, the current image block from the image set Reference images, including:
根据该对应图像的图像信息, 从该至少两个第四备选图像中, 确定在该 图像集合中的索引号最小的图像, 作为该当前图像块的参考图像。  Based on the image information of the corresponding image, from the at least two fourth candidate images, an image having the smallest index number in the image set is determined as a reference image of the current image block.
具体地说, 在确定 colPic 为第一类型图像 (图像类型 short-term 或 long-term, 与该当前块的所属图像之间的 POC关系为相同或相异, 所属层为 基本层或增强层, 所属视为基本视或依赖视)后, 需要从参考图像列表中选 择第二类型图像(类型与第一类型图像相异)作为 currRefPic, 此时, 如果参 考图像列表中包括多个(至少两个) 第二类型图像(即, 第四备选图像) , 则可以从该多个第四备选图像中, 选择一个图像作为 currRefPic , 例如, 可以 选择多个第四备选图像中索引号最小的图像, 作为 currRefPic, 即, 可以按照 参考图像索引号从小到大的顺序从参考图像列表中寻找类型与 colPic相异的 图像为 currRefPic。  Specifically, in determining that colPic is the first type of image (the image type short-term or long-term, the POC relationship with the image of the current block is the same or different, and the belonging layer is a base layer or an enhancement layer, After being regarded as a base view or a dependent view, it is necessary to select a second type image (the type is different from the first type image) as a currRefPic from the reference image list, at this time, if the reference image list includes a plurality (at least two) a second type of image (ie, a fourth candidate image), then one of the plurality of fourth candidate images may be selected as a currRefPic, for example, a plurality of fourth candidate images may be selected with the smallest index number The image, as currRefPic, that is, the colRefPic can be found from the reference image list in the order of the reference image index numbers from small to large.
这样, 由于索引号越小, 代表该图像越接近当前图像, 从而能够进一步 提高本发明实施例的效果。  Thus, the smaller the index number, the closer the image is to the current image, so that the effect of the embodiment of the present invention can be further improved.
应理解, 以上列举的, 选择第四备选图像中索引号最小的图像, 作为 currRefPic仅为实例性说明, 本发明并不限定于此, 也可与选择任意一个第二 备选图像作为 currRefPic。  It should be understood that, as listed above, the image with the smallest index number in the fourth candidate image is selected, and currRefPic is only an example description, and the present invention is not limited thereto, and any one of the second candidate images may be selected as currRefPic.
根据本发明实施例的获取时域运动矢量预测值的方法, 通过首先确定确 定当前块的 colPic , 然后再确定当前块的 currRefPic。 由于同一 slice内各图像 块的 colPic相同, 因此, 所确定的 currRefPic也相同, 在同一 slice内进行一 次确定即可, 能够有效降低处理复杂度。 此外, 对于整个 slice中的所有图像 块, 都使用同一个 colPic, 能够有效减少对緩存资源的占用。  The method for obtaining a time domain motion vector predictor according to an embodiment of the present invention first determines the colPic of the current block, and then determines the currRefPic of the current block. Since the colPic of each image block in the same slice is the same, the determined currRefPic is also the same, and the determination is performed once in the same slice, which can effectively reduce the processing complexity. In addition, the same colPic is used for all image blocks in the entire slice, which can effectively reduce the occupation of cache resources.
根据本发明实施例的确定时域运动矢量预测值的方法, 通过选择当前块 的参考图像和对应图像, 使当前块的参考图像与对应图像的图像类型、 与当 前块的所属图像块之间的 POC关系、 所属层或所述视相异, 能够提高使该当 前块的参考图像与该对应图像块的参考图像属于相同的参考图像类型的效 果, 从而, 在当前块的运动矢量的时域距离和该对应块的运动矢量的时域距 离不同的情况下, 能够提高获取当前块的时域运动矢量预测值的效果。 According to the method for determining a time domain motion vector predictor according to an embodiment of the present invention, by selecting a reference image of the current block and a corresponding image, the reference image of the current block and the image type of the corresponding image and the image block of the current block are The POC relationship, the belonging layer or the view is different, and the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type can be improved. Therefore, in the case where the time domain distance of the motion vector of the current block and the time domain distance of the motion vector of the corresponding block are different, the effect of acquiring the time domain motion vector predictor of the current block can be improved.
应理解, 以上列举了根据图像集合中的图像的图像信息, 从该图像集合 中, 确定当前图像块的参考图像和对应图像, 以使当前块的参考图像与对应 图像的图像类型、 与当前块的所属图像块之间的 POC关系、 所属层或所述视 相异的实施例, 但本发明并不限定于此。 其他采用根据图像集合中的图像的 图像信息, 确定当前图像块的参考图像和对应图像, 以提高获取当前块的时 域运动矢量预测值的效果的实施例均落入本发明的保护范围。  It should be understood that, according to the image information of the image in the image set, the reference image and the corresponding image of the current image block are determined from the image set, so that the reference image of the current block and the image type of the corresponding image, and the current block are The POC relationship between the associated image blocks, the associated layer or the different embodiments are not limited thereto. Other embodiments that use the image information according to the image in the image set to determine the reference image and the corresponding image of the current image block to improve the effect of acquiring the temporal motion vector predictor of the current block fall within the scope of the present invention.
例如, 如果选择的当前块的对应图像为 short-term, 则代表该对应图像来 自于当前视或当前层(非基本视或基本增) , 如果该当前视或当前层不使用 基本视或基本层作为参考, 而使用 short-term 的参考图像, 即 colRefPic 为 short-term , 则可以选择 short-term的图像作为 currRefPic。  For example, if the corresponding image of the selected current block is short-term, it means that the corresponding image is from the current view or the current layer (non-base view or basic increase), if the current view or current layer does not use the base view or the base layer For reference, and using the reference image of short-term, that is, colRefPic is short-term, you can select the short-term image as currRefPic.
再例如, 当基本视或基本层使用 long-term 的参考图像时, 如果选择的 currRefPic为 long-term, 而 colPic为 long-term, 贝1 J表示 colPic是来自于基本 视的参考图像。 而如上所述, 基本视 (即 colPic )在编码时所使用的 colRefPic 为 long-term,也就是说, colPic中的对应块 colBlock的 colRefPic为 long-term。 从而, currRefPic与 colRefPic均为 long-term, 能够提高获取 TMVP的效果。 For another example, when the base view or the base layer uses the long-term reference image, if the selected currRefPic is a long-term and colPic is a long-term, the shell 1 J indicates that the colPic is a reference image from the base view. As described above, the colRefPic used by the base view (ie, colPic) is long-term, that is, the colRefPic of the corresponding block colBlock in colPic is a long-term. Thus, both currRefPic and colRefPic are long-term, which can improve the effect of acquiring TMVP.
并且, 在本发明实施例中, 依赖视可以有一个也可以有多个, 当前块可 以参考基本视的图像, 也可以参考其他依赖视的图像。 同样, 增强层可以有 一个也可以有多个, 当前块可以参考基本层的图像, 也可以参考其他增强层 的图像。  Moreover, in the embodiment of the present invention, there may be one or more dependent images, and the current block may refer to the image of the base view, and may also refer to other dependent images. Similarly, there may be one or more enhancement layers. The current block can refer to the image of the base layer or the image of other enhancement layers.
在 S120, 可以确定该当前图像块在该对应图像中的对应图像块, 并且, 确定对应图象块的过程和方法可以与现有技术相同, 这里, 为了避免贅述, 省略其说明。  At S120, a corresponding image block of the current image block in the corresponding image may be determined, and the process and method of determining the corresponding image block may be the same as in the prior art, and the description thereof is omitted here to avoid redundancy.
在 S130, 可以根据该参考图像和该对应图像块, 确定该当前图像块的时 域运动矢量预测值,具体地说,可以获取该对应图象块的运动矢量 MV,并且, 如果当前块的 MV的时域距离和当前块的对应图像块的 MV的时域距离不同, 则可以根据该参考图像和该对应图像块, 利用上述公式 1进行 MV的缩放。 At S130, a time domain motion vector predictor of the current image block may be determined according to the reference image and the corresponding image block, and specifically, a motion vector MV of the corresponding image block may be acquired, and If the time domain distance of the MV of the current block is different from the time domain distance of the MV of the corresponding image block of the current block, the scaling of the MV may be performed according to the reference image and the corresponding image block using Equation 1 above.
可选地, 在本发明实施例中, 该当前图像块的所属图像为双向预测图像, 该对应图像为双向预测图像, 以及  Optionally, in the embodiment of the present invention, the belonging image of the current image block is a bidirectional predicted image, and the corresponding image is a bidirectional predicted image, and
该根据该参考图像和该对应图像块, 确定该当前图像块的时域运动矢量 预测值, 包括:  Determining a time domain motion vector prediction value of the current image block according to the reference image and the corresponding image block, including:
根据该对应图像的图像信息, 确定该对应图像块的运动矢量;  Determining a motion vector of the corresponding image block according to the image information of the corresponding image;
根据该参考图像和该对应图像块的运动矢量, 确定该当前图像块的时域 运动矢量预测值。  A time domain motion vector predictor of the current image block is determined based on the reference image and a motion vector of the corresponding image block.
并且, 该确定该对应图像块的运动矢量, 进一步包括:  And determining the motion vector of the corresponding image block, further comprising:
当该对应图像的图像类型为长期类型时, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第一 参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图 像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块 的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或  When the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image The image pointed by the motion vector of the block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, determining the motion vector of the corresponding image block , such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
当该对应图像的 POC与该当前图像块的所属图像的 POC相同时,如果该 当前图像块的参考图像来自于该当前图像块的所属图像的第一参考图像列 表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图 像属于该对应图像的第一参考图像列表, 如果该当前图像块的参考图像来自 于该当前图像块的所属图像的第二参考图像列表, 则确定对应图像块的运动 矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第二参考 图像列表; 或  When the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the motion of the corresponding image block Vector, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, Determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
当该对应图像的所属层为基本层时, 如果该当前图像块的参考图像来自 于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动 矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的图像属于 第一参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所 属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图 像块的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或 When the belonging layer of the corresponding image is the base layer, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image The image pointed to by the motion vector of the block belongs to the image of the corresponding image a first reference image list, if the reference image of the current image block is from a second reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block to point the motion vector of the corresponding image block The image belongs to a second reference image list of the corresponding image; or
当该对应图像的所属视为基本视时, 如果该当前图像块的参考图像来自 于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动 矢量, 以使该对应图像块的运动矢量指向的该对应图像的图像属于第一参考 图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的 第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运 动矢量指向的图像属于该对应图像的第二参考图像列表。  When the belonging of the corresponding image is regarded as a base view, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image The image of the corresponding image pointed by the motion vector of the block belongs to the first reference image list, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, the motion vector of the corresponding image block is determined. And causing the image pointed by the motion vector of the corresponding image block to belong to the second reference image list of the corresponding image.
具体地说, 在现有技术中, 获取 TMVP时, 指定具有索引号为 0的参考 图像作为当前块的参考图像。 对于 B-slice, 可以选择两个参考图像, 分别是 第一参考图像列表(list 0 )和第二参考图像列表(list 1 ) 中索引号为 0的参 考图像。  Specifically, in the prior art, when TMVP is acquired, a reference image having an index number of 0 is designated as a reference image of the current block. For B-slice, two reference images can be selected, which are the reference image with the index number 0 in the first reference image list (list 0 ) and the second reference image list (list 1 ).
并且 , 当前块的对应图像包括两个 MV , 即, colMV— L0和 colMV— L 1 , 并利用 colPic对应的 list来选择 colMV— L0中的 colMV— L1—个作为 MV的预 测值。 如果 colPic来自于 list 0, 则选择指向 list 1的 collMV— L1 ; 如果 colPic 来自于 list 1 , 则选择指向 list 0的 colMV— L0。  And, the corresponding image of the current block includes two MVs, that is, colMV_L0 and colMV_L1, and uses colPic corresponding list to select colMV_L1 in colMV_L0 as a predicted value of the MV. If colPic is from list 0, select collMV_L1 pointing to list 1; if colPic is from list 1, select colMV_L0 pointing to list 0.
在例如 colPic的 POC不等于当前图像的 POC的情况(即 colPic位于当前 图像之前或之后, 或者说 colPic来自于当前视的图像) 下, colPic对应的 list 与当前块的 currMV存在一定的对应关系,即, colPic的 list为 list 1说明 colPic 位于当前图像之后, 此时, 指向 list O的 colMV— L0可能会穿过当前图像, 这 也就是说, colMV— L0与当前块的 currMV相关性更高, 因此选择 colMV— L0。  In a case where, for example, the POC of colPic is not equal to the POC of the current image (ie, before or after the colPic is located in the current image, or colPic is from the current view image), the list corresponding to colPic has a certain correspondence with the currMV of the current block. That is, the list of colPic is list 1 indicating that colPic is located after the current image. At this time, colMV_L0 pointing to list O may pass through the current image, that is, colMV_L0 has higher correlation with currMV of the current block. So choose colMV_L0.
但是, 如果 colPic 来自于基本视或基本层 (即, colPic 的图像类型为 long-term, 或 colPic的 POC与该 currPic的 POC相同) , 此时, colPic对应 的 list和当前块 currMV之间并没有确定的关系,无助于选择合适的 colMV用 于计算当前块的 currMV。 相反, 如果选择的当前块的参考图像的来自的列表 与选择的 colMV指向的列表相异, 会严重影响 TMVP的获取。 However, if colPic comes from the base view or base layer (ie, the image type of colPic is long-term, or the POC of colPic is the same as the POC of the currPic), there is no between the list corresponding to colPic and the current block currMV. The determined relationship does not help to select the appropriate colMV for calculating the currMV of the current block. Conversely, if the selected reference block of the current block is selected from the list Different from the list pointed to by the selected colMV, it will seriously affect the acquisition of TMVP.
因此, 在本发明实施例中, 可以根据当前块对应的 list, 来选择 colMV, 并且, 由于当前块的参考图像 currRefPic确定后, 可以根据 currRefPic来自的 list , 确定当前块的对应的 list和在该 list中的参考索引。  Therefore, in the embodiment of the present invention, colMV may be selected according to the list corresponding to the current block, and after the reference image currRefPic of the current block is determined, the corresponding list of the current block may be determined according to the list from which currRefPic is derived. The reference index in the list.
具体地说, 如果当前块对应的 list为 list 0 (第一参考图像列表) , 则选 择指向 list 0的 colMV— L0。  Specifically, if the list corresponding to the current block is list 0 (first reference image list), colMV_L0 pointing to list 0 is selected.
如果当前块对应的 list为 list 1 (第二参考图像列表) , 则选择指向 list 1 的 collMV— Ll。  If the list corresponding to the current block is list 1 (second reference image list), select collMV_L1 pointing to list 1.
这样, 当前块和对应块有着相同的 POC并且有着相同的 MV方向, 两者 的 MV相关性更高, 有助于提高 TMVP预测精度。  Thus, the current block and the corresponding block have the same POC and have the same MV direction, and the MV correlation between the two is higher, which helps to improve the accuracy of TMVP prediction.
图 3示出了根据本发明实施例的确定时域运动矢量预测值的方法 200的 示意性流程图。 并且, 该方法 200 的实施主体可以是编码端, 也可以是解码 端, 本发明并未特别限定。 如图 3所示, 该方法 200包括:  FIG. 3 shows a schematic flow diagram of a method 200 of determining a time domain motion vector predictor in accordance with an embodiment of the present invention. Moreover, the implementation body of the method 200 may be an encoding end or a decoding end, and the present invention is not particularly limited. As shown in FIG. 3, the method 200 includes:
S210, 确定当前图像块的参考图像和对应图像, 其中, 该当前图像块的 所属图像为双向预测图像, 该对应图像为双向预测图像;  S210, determining a reference image and a corresponding image of the current image block, where the image of the current image block is a bidirectional predicted image, and the corresponding image is a bidirectional predicted image;
S220 , 确定该当前图像块在该对应图像中的对应图像块;  S220. Determine a corresponding image block of the current image block in the corresponding image.
S230, 根据该对应图像的图像信息, 确定该对应图像块的运动矢量, 该 图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之间的图像 顺序编号 POC关系、 在分层编码中的所属层或在多视编码中的所属视中的任 一信息,该图像类型分为长期类型和短期类型,该 POC关系分为 POC相同和 POC相异, 该所属层分为基本层和增强层, 该所属视分为基本视和依赖视; S230. Determine, according to image information of the corresponding image, a motion vector of the corresponding image block, where the image information includes any of the following information: an image type, an image sequence number POC relationship with an image of the current block, and a layering Any information in the encoding of the affiliation layer or the dependent view in the multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the affiliation layer is divided into a basic layer. And an enhancement layer, the belonging view is a base view and a dependent view;
S240, 根据该参考图像和该对应图像块的运动矢量, 确定该当前图像块 的时域运动矢量预测值。 S240. Determine a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block.
并且, 在本发明实施例中, 该确定该对应图像块的运动矢量, 进一步包 括:  Moreover, in the embodiment of the present invention, determining the motion vector of the corresponding image block further includes:
当该对应图像的图像类型为长期类型时, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的该对应图像的图像属于第一 参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图 像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块 的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或 When the image type of the corresponding image is a long-term type, if the reference image of the current image block And determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if The reference image of the current image block is from the second reference image list of the image of the current image block, and then the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the second of the corresponding image. Reference image list; or
当该对应图像的 POC与该当前图像块的所属图像的 POC相同时,如果该 当前图像块的参考图像来自于该当前图像块的所属图像的第一参考图像列 表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的图 像属于该对应图像的第一参考图像列表, 如果该当前图像块的参考图像来自 于该当前图像块的所属图像的第二参考图像列表, 则确定对应图像块的运动 矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第二参考 图像列表; 或  When the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the motion of the corresponding image block Vector, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, Determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
当该对应图像的所属层为基本层时, 如果该当前图像块的参考图像来自 于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动 矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第一参考 图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的 第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运 动矢量指向的图像属于该对应图像的第二参考图像列表; 或  When the belonging layer of the corresponding image is the base layer, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image The image pointed by the motion vector of the block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, determining the motion vector of the corresponding image block , such that the image pointed to by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
当该对应图像的所属视为基本视时, 如果该当前图像块的参考图像来自 于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动 矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第一参考 图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的 第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运 动矢量指向的图像属于该对应图像的第二参考图像列表。  When the belonging of the corresponding image is regarded as a base view, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that the corresponding image The image pointed by the motion vector of the block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, determining the motion vector of the corresponding image block And causing the image pointed by the motion vector of the corresponding image block to belong to the second reference image list of the corresponding image.
具体地说, 在现有技术中, 获取 TMVP时, 指定具有索引号为 0的参考 图像作为当前块的参考图像。 对于 B-slice, 可以选择两个参考图像, 分别是 第一参考图像列表(list 0 )和第二参考图像列表(list 1 ) 中索引号为 0的参 考图像。 Specifically, in the prior art, when acquiring TMVP, a reference image having an index number of 0 is designated as a reference image of the current block. For B-slice, you can select two reference images, respectively A reference image of index number 0 in the first reference image list (list 0 ) and the second reference image list (list 1 ).
并且 , 当前块的对应图像包括两个 MV , 即, colMV— L0和 colMV— L 1 , 并利用 colPic对应的 list来选择 colMV— L0中的 colMV— L1—个作为 MV的预 测值。 如果 colPic来自于 list 0, 则选择指向 list 1的 collMV— L1 ; 如果 colPic 来自于 list 1 , 则选择指向 list 0的 colMV— L0。  And, the corresponding image of the current block includes two MVs, that is, colMV_L0 and colMV_L1, and uses colPic corresponding list to select colMV_L1 in colMV_L0 as a predicted value of the MV. If colPic is from list 0, select collMV_L1 pointing to list 1; if colPic is from list 1, select colMV_L0 pointing to list 0.
如图 4所示, 在例如 colPic的 POC不等于当前图像的 POC的情况(即 colPic位于当前图像之前或之后,或者说 colPic来自于当前视的图像)下, colPic 对应的 list与当前块的 currMV存在一定的对应关系,即, colPic的 list为 list 1 说明 colPic位于当前图像之后, 此时, 指向 list O的 colMV— L0可能会穿过当 前图像, 这也就是说, colMV—LO与当前块的 currMV相关性更高, 因此选择 colMV— L0。  As shown in FIG. 4, in the case where, for example, the POC of colPic is not equal to the POC of the current image (ie, before or after the colPic is located in the current image, or colPic is from the current view image), the list corresponding to colPic and the currMV of the current block. There is a certain correspondence, that is, the list of colPic is list 1 indicating that colPic is located after the current image. At this time, colMV_L0 pointing to list O may pass through the current image, that is, colMV-LO and the current block currMV is more relevant, so choose colMV_L0.
但是, 如图 5所示, 如果 colPic来自于基本视或基本层(即, colPic的图 像类型为 long-term,或 colPic的 POC与该 currPic的 POC相同),此时, colPic 对应的 list和当前块 currMV之间并没有确定的关系,无助于选择合适的 colMV 用于计算当前块的 currMV。 相反, 如果选择的当前块的参考图像的来自的列 表与选择的 colMV指向的列表相异, 会严重影响 TMVP的获取。  However, as shown in FIG. 5, if colPic comes from the base view or the base layer (ie, the image type of colPic is long-term, or the POC of colPic is the same as the POC of the currPic), at this time, the list and current of colPic There is no definite relationship between the blocks currMV, which does not help to select the appropriate colMV for calculating the currMV of the current block. Conversely, if the selected list of reference images for the current block differs from the list pointed to by the selected colMV, the acquisition of TMVP is severely affected.
因此,在本发明实施例中,如果 colPic来自于基本视或基本层(即, colPic 的图像类型为 long-term, 或 colPic的 POC与该 currPic的 POC相同) , 则可 以根据当前块对应的 list, 来选择 colMV , 并且, 由于当前块的参考图像 currRefPic确定后, 可以根据 currRefPic来自的 list , 确定当前块的对应的 list 和在该 list中的参考索引。  Therefore, in the embodiment of the present invention, if the colPic is from the base view or the base layer (that is, the image type of the colPic is long-term, or the POC of the colPic is the same as the POC of the currPic), the list corresponding to the current block may be used. To select colMV, and since the reference image currRefPic of the current block is determined, the corresponding list of the current block and the reference index in the list may be determined according to the list from which currRefPic is derived.
具体地说, 如果当前块对应的 list为 list 0 (第一参考图像列表) , 则选 择指向 list 0的 colMV— L0。  Specifically, if the list corresponding to the current block is list 0 (first reference image list), colMV_L0 pointing to list 0 is selected.
如果当前块对应的 list为 list 1 (第二参考图像列表) , 则选择指向 list 1 的 collMV— Ll。 这样, 当前块和对应块有着相同的 POC并且有着相同的 MV方向, 两者 的 MV相关性更高, 有助于提高 TMVP预测精度。 If the list corresponding to the current block is list 1 (second reference image list), select collMV_L1 pointing to list 1. In this way, the current block and the corresponding block have the same POC and have the same MV direction, and the MV correlation between the two is higher, which helps to improve the TMVP prediction accuracy.
应理解, 以上列举了, 如果 colPic来自于基本视或基本层, 则可以根据 当前块对应的 list, 来选择 colMV, 但本发明并不限定于此, 在 colPic来自于 当前视(依赖视) 或当前层(增强层) 的情况下, 也可以可以根据当前块对 应的 list, 来选择 colMV。  It should be understood that, as listed above, if colPic is from the base view or the base layer, colMV may be selected according to the list corresponding to the current block, but the present invention is not limited thereto, and the colPic is from the current view (dependency view) or In the case of the current layer (enhancement layer), it is also possible to select colMV according to the list corresponding to the current block.
以上, 结合图 1至图 5说明了本发明实施例的确定时域运动矢量预测值 的方法, 下面, 结合图 6和图 7说明本发明实施例的确定时域运动矢量预测 值的装置。  The method for determining the predicted value of the time domain motion vector in the embodiment of the present invention is described above with reference to FIG. 1 to FIG. 5. Hereinafter, the apparatus for determining the predicted value of the time domain motion vector according to the embodiment of the present invention will be described with reference to FIG. 6 and FIG.
图 6示出了根据本发明实施例的确定时域运动矢量预测值的装置 300的 示意性框图。 如图 6所示, 该装置 300包括:  FIG. 6 shows a schematic block diagram of an apparatus 300 for determining a time domain motion vector predictor in accordance with an embodiment of the present invention. As shown in Figure 6, the apparatus 300 includes:
确定单元 310, 用于根据当前图像块的参考图像的图像信息,从图像集合 中, 确定该当前图像块的对应图像, 其中, 该图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之间的图像顺序编号 POC关系、 在分层编 码中的所属层或在多视编码中的所属视, 该图像类型分为长期类型和短期类 型,该 POC关系分为 POC相同和 POC相异,该所属层分为基本层和增强层, 该所属视分为基本视和依赖视; 或  The determining unit 310 is configured to determine, according to image information of the reference image of the current image block, a corresponding image of the current image block from the image set, where the image information includes any of the following information: an image type, and the current block The image sequence number POC relationship between the images to which they belong, the belonging layer in hierarchical coding, or the dependent view in multi-view coding. The image type is divided into long-term type and short-term type. The POC relationship is divided into POC and POC. Different, the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; or
用于根据当前图像块的对应图像的图像信息, 从该图像集合中, 确定该 当前图像块的参考图像, 其中, 该图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中图像的 所属层或在多视编码中的所属视, 该图像类型分为长期类型和短期类型, 该 POC关系分为 POC相同和 POC相异, 该所属层分为基本层和增强层, 该所 属视分为基本视和依赖视;  Determining, from the image set, a reference image of the current image block according to image information of a corresponding image of the current image block, wherein the image information includes any of the following information: an image type, and an image of the current block The image sequence number between the POC relationship, the layer to which the image belongs in layered coding, or the attribute in the multi-view code. The image type is divided into a long-term type and a short-term type. The POC relationship is divided into POC and POC. The belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view;
处理单元 320 , 用于确定该当前图像块在该对应图像中的对应图像块; 用于根据该参考图像和该对应图像块, 确定该当前图像块的时域运动矢 量预测值。 可选地, 该当前图像块是依赖视图像, 该图像集合包括与该依赖视相对 应的基本视的图像, 或 The processing unit 320 is configured to determine a corresponding image block of the current image block in the corresponding image, and configured to determine a time domain motion vector predictor of the current image block according to the reference image and the corresponding image block. Optionally, the current image block is a dependent view image, the image set includes a base view image corresponding to the dependent view, or
该当前图像块是增强层图像中的图像块, 该图像集合包括与该增强层图 像相对应的基本层的图像。  The current image block is an image block in the enhancement layer image, the image collection including an image of the base layer corresponding to the enhancement layer image.
可选地, 该确定单元 310具体用于根据当前图像块的参考图像的图像类 型, 从该图像集合中, 确定该当前图像块的对应图像, 以使该对应图像的图 像类型与该参考图像的图像类型相异; 或  Optionally, the determining unit 310 is specifically configured to determine, according to an image type of the reference image of the current image block, a corresponding image of the current image block from the image set, so that an image type of the corresponding image and the reference image are Image types are different; or
用于根据当前图像块的参考图像的与该当前块的该图像之间的 POC 关 系, 从该图像集合中, 确定该当前图像块的对应图像, 以使该对应图像的与 该当前块的所属图像之间的 POC关系与该参考图像的与该当前块的所属图像 之间的 POC关系相异; 或  And determining, according to a POC relationship between the reference image of the current image block and the image of the current block, from the image set, determining a corresponding image of the current image block, so that the corresponding image belongs to the current block The POC relationship between the images is different from the POC relationship between the reference image and the image to which the current block belongs; or
用于根据当前图像块的参考图像的所属层, 从该图像集合中, 确定该当 前图像块的对应图像, 以使该对应图像的所属层与该参考图像的所属层相异; 或  And determining, according to the belonging layer of the reference image of the current image block, a corresponding image of the current image block from the image set, such that the belonging layer of the corresponding image is different from the belonging layer of the reference image; or
用于根据当前图像块的参考图像的所属视, 从该图像集合中, 确定该当 前图像块的对应图像, 以使该对应图像的所属视与该参考图像的所属视相异。  And determining, according to the belonging view of the reference image of the current image block, a corresponding image of the current image block from the image set such that the belonging view of the corresponding image is different from the belonging view of the reference image.
可选地, 该图像集合中包括至少两个第一备选图像, 其中, 该第一备选 图像的类型与该参考图像的图像类型相异, 或  Optionally, the image set includes at least two first candidate images, wherein the type of the first candidate image is different from the image type of the reference image, or
该第一备选图像的与该当前块的所属图像之间的 POC关系, 与该参考图 像的与该当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the first candidate image and the associated image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
该第一备选图像的所属层与该参考图像的所属层相异, 或  The associated layer of the first candidate image is different from the layer to which the reference image belongs, or
该第一备选图像的所属视与该参考图像的所属视相异, 以及  The belonging view of the first candidate image is different from the belonging view of the reference image, and
该确定单元 310具体用于根据该参考图像的图像信息, 从该至少两个第 一备选图像中, 确定在该图像集合中的索引号最小的图像, 作为该当前图像 块的对应图像。  The determining unit 310 is specifically configured to determine, from the at least two first candidate images, an image with the smallest index number in the image set as the corresponding image of the current image block according to the image information of the reference image.
可选地, 该图像集合包括至少一个第二备选图像和至少一个第三备选图 像, 其中, 该第二备选图像与该第三备选图像的图像类型相异, 或 该第二备选图像的与该当前块的所属图像之间的 POC关系, 与该第三备 选图像的与该当前块的所属图像之间的 POC关系相异, 或 Optionally, the image set includes at least one second candidate image and at least one third alternative image Image, wherein the second candidate image is different from the image type of the third candidate image, or a POC relationship between the second candidate image and the image of the current block, and the third candidate The POC relationship between the image and the image of the current block is different, or
该第二备选图像的所属层与该第三备选图像的所属层相异, 或  The belonging layer of the second candidate image is different from the layer to which the third candidate image belongs, or
该第二备选图像的所属视与该第三备选图像的所属视相异, 以及 该确定单元 310还用于从该图像集合中, 确定预测图像, 该预测图像包 括一个第二备选图像和一个第三备选图像, 该预测图像用于确定该当前图像 块所处条带中各图像块的对应图像;  The belonging view of the second candidate image is different from the belonging view of the third candidate image, and the determining unit 310 is further configured to determine, from the image set, a predicted image, where the predicted image includes a second candidate image. And a third candidate image, the predicted image being used to determine a corresponding image of each image block in the strip in which the current image block is located;
用于从该预测图像中, 确定该当前图像块的对应图像。  For determining a corresponding image of the current image block from the predicted image.
可选地, 该图像集合包括至少两个第二备选图像, 和 /或  Optionally, the set of images includes at least two second candidate images, and/or
该图像集合包括至少两个第三备选图像, 以及  The set of images includes at least two third candidate images, and
该确定单元 310具体用于从该图像集合中, 确定预测图像, 该预测图像 包括该至少两个第二备选图像中在该图像集合中的索引号最小的图像; 和 /或 用于从该图像集合中, 确定预测图像, 该预测图像包括该至少两个第三 备选图像中在该图像集合中的索引号最小的图像。  The determining unit 310 is specifically configured to determine, from the image set, a predicted image, where the predicted image includes an image with the smallest index number in the image set of the at least two second candidate images; and/or for In the image set, a predicted image is determined, the predicted image including an image of the at least two third candidate images having the smallest index number in the image set.
可选地, 该确定单元 310具体用于从该图像集合中, 确定目标图像, 作 为该当前图像块所处条带中各图像块的对应图像;  Optionally, the determining unit 310 is specifically configured to determine, from the image set, a target image as a corresponding image of each image block in a strip in which the current image block is located;
用于根据当前图像块的对应图像的图像类型, 从该图像集合中, 确定该 当前图像块的参考图像, 以使该参考图像的图像类型与该对应图像的图像类 型相异; 或  And determining, according to an image type of the corresponding image of the current image block, a reference image of the current image block from the image set such that an image type of the reference image is different from an image type of the corresponding image; or
用于根据当前图像块的对应图像的与该当前块的该图像之间的 POC 关 系, 从该图像集合中, 确定该当前图像块的参考图像, 以使该参考图像的与 该当前块的所属图像之间的 POC关系与该对应图像的与该当前块的所属图像 之间的 POC关系相异; 或  And determining, from the image set, a reference image of the current image block according to a POC relationship between the image of the current image and the image of the current image, so that the reference image and the current block belong to The POC relationship between the images is different from the POC relationship between the corresponding image and the image of the current block; or
用于根据当前图像块的对应图像的所属层, 从该图像集合中, 确定该当 前图像块的参考图像, 以使该参考图像的所属层与该对应图像的所属层相异; 或 Determining, from the image set, a reference image of the current image block according to an belonging layer of the corresponding image of the current image block, such that the belonging layer of the reference image is different from the belonging layer of the corresponding image; or
用于根据当前图像块的对应图像的所属视, 从该图像集合中, 确定该当 前图像块的参考图像, 以使该参考图像的所属视与该对应图像的所属视相异。  And determining, according to the belonging view of the corresponding image of the current image block, a reference image of the current image block from the image set such that the belonging view of the reference image is different from the belonging view of the corresponding image.
可选地, 该图像集合中包括至少两个第四备选图像, 其中, 该第四备选 图像的类型与该参考图像的图像类型相异, 或  Optionally, the image set includes at least two fourth candidate images, wherein the type of the fourth candidate image is different from the image type of the reference image, or
该第四备选图像的与该当前块的所属图像之间的 POC关系, 与该参考图 像的与该当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the fourth candidate image and the belonging image of the current block is different from a POC relationship between the reference image and the image to which the current block belongs, or
该第四备选图像的所属层与该参考图像的所属层相异, 或  The belonging layer of the fourth candidate image is different from the layer to which the reference image belongs, or
该第四备选图像的所属视与该参考图像的所属视相异, 以及  The belonging view of the fourth candidate image is different from the belonging view of the reference image, and
该确定单元 310具体用于根据该对应图像的图像信息, 从该至少两个第 四备选图像中, 确定在该图像集合中的索引号最小的图像, 作为该当前图像 块的参考图像。  The determining unit 310 is specifically configured to determine, from the at least two fourth candidate images, an image with the smallest index number in the image set as the reference image of the current image block according to the image information of the corresponding image.
可选地, 该当前图像块的所属图像为双向预测图像, 该对应图像为双向 预测图像, 以及  Optionally, the image to which the current image block belongs is a bidirectional predicted image, and the corresponding image is a bidirectional predicted image, and
该处理单元 320具体用于根据该对应图像的图像信息, 确定该对应图像 块的运动矢量;  The processing unit 320 is specifically configured to determine a motion vector of the corresponding image block according to the image information of the corresponding image;
用于根据该参考图像和该对应图像块的运动矢量, 确定该当前图像块的 时域运动矢量预测值。 ; 可选地, 该处理单元 320具体用于当该对应图像的图像类型为长期类型 时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第一参 考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量 指向的图像属于该对应图像的第一参考图像列表, 如果该当前图像块的参考 图像来自于该当前图像块的所属图像的第二参考图像列表, 则确定对应图像 块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的 第二参考图像列表; 或 用于当该对应图像的 POC与该当前图像块的所属图像的 POC相同时,如 果该当前图像块的参考图像来自于该当前图像块的所属图像的第一参考图像 列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的 图像属于该对应图像的第一参考图像列表, 如果该当前图像块的参考图像来 自于该当前图像块的所属图像的第二参考图像列表, 则确定对应图像块的运 动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第二参 考图像列表; 或 And determining a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block. Optionally, the processing unit 320 is configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining Corresponding to the motion vector of the image block, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the second image of the current image block Referring to the image list, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or And when the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the corresponding image block Motion vector, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the second reference image list of the belonging image of the current image block And determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
用于当该对应图像的所属层为基本层时, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的图像 属于第一参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块 的所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对 应图像块的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或 用于当该对应图像的所属视为基本视时, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的该对应图像的图像属于第一 参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图 像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块 的运动矢量指向的图像属于该对应图像的第二参考图像列表。  For determining that the associated image of the current image is the base layer, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the The image of the image corresponding to the motion vector of the corresponding image block belongs to the first reference image list, and if the reference image of the current image block is from the second reference image list of the image of the current image block, the corresponding image is determined. a motion vector of the block such that an image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for when the belonging of the corresponding image is regarded as a base view, if the current image block is referenced And determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if The reference image of the current image block is from the image of the current image block A second reference picture list, it is determined that the motion vector corresponding to the image block, so that the image corresponding to the image block belonging to the second motion vector points to the reference picture list corresponding images.
根据本发明实施例的确定时域运动矢量预测值的装置 300作为本发明实 施例的确定时域运动矢量预测值的方法 100 的实施主体, 可对应于本发明实 施例的方法中的编码端或解码端, 并且, 图 6 中确定时域运动矢量预测值的 装置 300中的各单元即模块和上述其他操作和 /或功能, 分别用于实现图 2中 的方法 100的各流程, 为了简洁, 在此不再贅述。  The apparatus 300 for determining the time domain motion vector predictor according to the embodiment of the present invention, as an implementation body of the method 100 for determining the time domain motion vector predictor, may correspond to the encoding end in the method of the embodiment of the present invention or The decoding end, and the modules in the apparatus 300 for determining the time domain motion vector predictor in FIG. 6 and the other operations and/or functions described above are respectively used to implement the processes of the method 100 in FIG. 2, for the sake of brevity, I will not repeat them here.
根据本发明实施例的确定时域运动矢量预测值的装置, 通过选择当前块 的参考图像和对应图像, 使当前块的参考图像与对应图像的图像类型、 与当 前块的所属图像块之间的 POC关系、 所属层或该视相异, 能够提高使该当前 块的参考图像与该对应图像块的参考图像属于相同的参考图像类型的效果, 从而, 在当前块的运动矢量的时域距离和该对应块的运动矢量的时域距离不 同的情况下, 能够提高获取当前块的时域运动矢量预测值的效果。 The apparatus for determining a time domain motion vector predictor according to an embodiment of the present invention, by selecting a reference image and a corresponding image of a current block, causing a reference image of the current block and an image type of the corresponding image, and The POC relationship between the associated image blocks of the previous block, the associated layer or the view is different, and the effect of making the reference image of the current block and the reference image of the corresponding image block belong to the same reference image type can be improved, thereby In the case where the time domain distance of the motion vector of the block is different from the time domain distance of the motion vector of the corresponding block, the effect of acquiring the predicted value of the time domain motion vector of the current block can be improved.
图 7示出了根据本发明实施例的确定时域运动矢量预测值的装置 400的 示意性框图。 如图 7所示, 该装置 400包括:  FIG. 7 shows a schematic block diagram of an apparatus 400 for determining a time domain motion vector predictor in accordance with an embodiment of the present invention. As shown in Figure 7, the apparatus 400 includes:
确定单元 410, 用于确定当前图像块的参考图像和对应图像, 其中, 该当 前图像块的所属图像为双向预测图像, 该对应图像为双向预测图像;  a determining unit 410, configured to determine a reference image and a corresponding image of the current image block, where the belonging image of the current image block is a bidirectional predicted image, and the corresponding image is a bidirectional predicted image;
用于确定该当前图像块在该对应图像中的对应图像块;  Determining a corresponding image block of the current image block in the corresponding image;
处理单元 420, 用于根据该对应图像的图像信息, 确定该对应图像块的运 动矢量, 该图像信息包括以下任一信息: 图像类型、 与该当前块的所属图像 之间的图像顺序编号 POC关系、 在分层编码中的所属层或在多视编码中的所 属视中的任一信息, 该图像类型分为长期类型和短期类型, 该 POC关系分为 POC相同和 POC相异, 该所属层分为基本层和增强层, 该所属视分为基本视 和依赖视;  The processing unit 420 is configured to determine, according to the image information of the corresponding image, a motion vector of the corresponding image block, where the image information includes any of the following information: an image type, and an image sequence number POC relationship with the image of the current block The image type is classified into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the belonging layer is different. Divided into a basic layer and an enhancement layer, the belonging view is a basic view and a dependent view;
用于根据该参考图像和该对应图像块的运动矢量, 确定该当前图像块的 时域运动矢量预测值。  And determining a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block.
可选地, 该处理单元 420具体用于当该对应图像的图像类型为长期类型 时, 如果该当前图像块的参考图像来自于该当前图像块的所属图像的第一参 考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量 指向的图像属于该对应图像的第一参考图像列表, 如果该当前图像块的参考 图像来自于该当前图像块的所属图像的第二参考图像列表, 则确定对应图像 块的运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的 第二参考图像列表; 或  Optionally, the processing unit 420 is specifically configured to: when the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the corresponding a motion vector of the image block such that the image pointed to by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the second reference of the associated image of the current image block Image list, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
用于当该对应图像的 POC与该当前图像块的所属图像的 POC相同时,如 果该当前图像块的参考图像来自于该当前图像块的所属图像的第一参考图像 列表, 则确定对应图像块的运动矢量, 以使该对应图像块的运动矢量指向的 图像属于该对应图像的第一参考图像列表, 如果该当前图像块的参考图像来 自于该当前图像块的所属图像的第二参考图像列表, 则确定对应图像块的运 动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的第二参 考图像列表; 或 For when the POC of the corresponding image is the same as the POC of the belonging image of the current image block, if the reference image of the current image block is from the first reference image of the belonging image of the current image block a list, the motion vector of the corresponding image block is determined such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the current image block a second reference image list of the image, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
用于当该对应图像的所属层为基本层时, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的图像属于该对应图像的图像 属于第一参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块 的所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对 应图像块的运动矢量指向的图像属于该对应图像的第二参考图像列表; 或 用于当该对应图像的所属视为基本视时, 如果该当前图像块的参考图像 来自于该当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的 运动矢量, 以使该对应图像块的运动矢量指向的该对应图像的图像属于第一 参考图像列表, 如果该当前图像块的参考图像来自于该当前图像块的所属图 像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使该对应图像块 的运动矢量指向的图像属于该对应图像的第二参考图像列表。  For determining that the associated image of the current image is the base layer, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining a motion vector of the corresponding image block, so that the The image of the image corresponding to the motion vector of the corresponding image block belongs to the first reference image list, and if the reference image of the current image block is from the second reference image list of the image of the current image block, the corresponding image is determined. a motion vector of the block such that an image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or for when the belonging of the corresponding image is regarded as a base view, if the current image block is referenced And determining, by the first reference image list of the image of the current image block, the motion vector of the corresponding image block, so that the image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image list, if The reference image of the current image block is from the image of the current image block A second reference picture list, it is determined that the motion vector corresponding to the image block, so that the image corresponding to the image block belonging to the second motion vector points to the reference picture list corresponding images.
根据本发明实施例的确定时域运动矢量预测值的装置 400作为本发明实 施例的确定时域运动矢量预测值的方法 200 的实施主体, 可对应于本发明实 施例的方法中的编码端或解码端, 并且, 图 7 中确定时域运动矢量预测值的 装置 400中的各单元即模块和上述其他操作和 /或功能, 分别用于实现图 3中 的方法 200的各流程, 为了简洁, 在此不再贅述。  The apparatus 400 for determining the time domain motion vector predictor according to the embodiment of the present invention, as an implementation body of the method 200 for determining the time domain motion vector predictor, may correspond to the encoding end in the method of the embodiment of the present invention or The decoding end, and the modules in the apparatus 400 for determining the time domain motion vector predictor in FIG. 7 and the other operations and/or functions described above are respectively used to implement the processes of the method 200 in FIG. 3, for the sake of brevity, I will not repeat them here.
应理解, 本文中术语 "和 /或" , 仅仅是一种描述关联对象的关联关系, 表示可以存在三种关系, 例如, A和 /或 B, 可以表示: 单独存在 A, 同时存 在 A和 B, 单独存在 B这三种情况。 另外, 本文中字符 " , —般表示前后 关联对象是一种 "或" 的关系。 应理解, 在本发明的各种实施例中, 上述各过程的序号的大小并不意味 着执行顺序的先后, 各过程的执行顺序应以其功能和内在逻辑确定, 而不应 对本发明实施例的实施过程构成任何限定。 It should be understood that the term "and/or" in this context is merely an association describing the associated object, indicating that there may be three relationships, for example, A and / or B, which may indicate: A exists separately, and A and B exist simultaneously. There are three cases of B alone. In addition, the character "," in this article, generally means that the contextual object is an "or" relationship. It should be understood that, in various embodiments of the present invention, the size of the sequence numbers of the above processes does not mean the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not be taken to the embodiments of the present invention. The implementation process constitutes any limitation.
本领域普通技术人员可以意识到, 结合本文中所公开的实施例描述的各 示例的单元及算法步骤, 能够以电子硬件、 或者计算机软件和电子硬件的结 合来实现。 这些功能究竟以硬件还是软件方式来执行, 取决于技术方案的特 定应用和设计约束条件。 专业技术人员可以对每个特定的应用来使用不同方 法来实现所描述的功能, 但是这种实现不应认为超出本发明的范围。  Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in a combination of electronic hardware or computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.
所属领域的技术人员可以清楚地了解到, 为描述的方便和简洁, 上述描 述的系统、 装置和单元的具体工作过程, 可以参考前述方法实施例中的对应 过程, 在此不再贅述。  A person skilled in the art can clearly understand that the specific working process of the system, the device and the unit described above can be referred to the corresponding process in the foregoing method embodiments for the convenience and brevity of the description, and details are not described herein again.
在本申请所提供的几个实施例中, 应该理解到, 所揭露的系统、 装置和 方法, 可以通过其它的方式实现。 例如, 以上所描述的装置实施例仅仅是示 意性的, 例如, 所述单元的划分, 仅仅为一种逻辑功能划分, 实际实现时可 以有另外的划分方式, 例如多个单元或组件可以结合或者可以集成到另一个 系统, 或一些特征可以忽略, 或不执行。 另一点, 所显示或讨论的相互之间 的耦合或直接耦合或通信连接可以是通过一些接口, 装置或单元的间接耦合 或通信连接, 可以是电性, 机械或其它的形式。  In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical, mechanical or otherwise.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的, 作 为单元显示的部件可以是或者也可以不是物理单元, 即可以位于一个地方, 或者也可以分布到多个网络单元上。 可以根据实际的需要选择其中的部分或 者全部单元来实现本实施例方案的目的。  The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solution of the embodiment.
另外, 在本发明各个实施例中的各功能单元可以集成在一个处理单元中 , 也可以是各个单元单独物理存在, 也可以两个或两个以上单元集成在一个单 元中。  In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用 时, 可以存储在一个计算机可读取存储介质中。 基于这样的理解, 本发明的 技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可 以以软件产品的形式体现出来, 该计算机软件产品存储在一个存储介质中, 包括若干指令用以使得一台计算机设备(可以是个人计算机, 服务器, 或者 网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。 而前述的 存储介质包括: U盘、 移动硬盘、 只读存储器(ROM, Read-Only Memory ) 、 随机存取存储器 ( RAM, Random Access Memory ) 、 磁碟或者光盘等各种可 以存储程序代码的介质。 The function is implemented in the form of a software functional unit and sold or used as a standalone product It can be stored on a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, which can store program codes. .
以上所述, 仅为本发明的具体实施方式, 但本发明的保护范围并不局限 于此, 任何熟悉本技术领域的技术人员在本发明揭露的技术范围内, 可轻易 想到变化或替换, 都应涵盖在本发明的保护范围之内。 因此, 本发明的保护 范围应以所述权利要求的保护范围为准。  The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the present invention. It should be covered by the scope of the present invention. Therefore, the scope of the invention should be determined by the scope of the appended claims.

Claims

权利 要求 书 Claim
1. 一种确定时域运动矢量预测值的方法, 其特征在于, 所述方法包括: 根据当前图像块的参考图像的图像信息, 从图像集合中, 确定所述当前图 像块的对应图像, 其中, 所述图像信息包括以下任一信息: 图像类型、 与所述 当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中的所属层或在 多视编码中的所属视, 所述图像类型分为长期类型和短期类型, 所述 POC关系 分为 POC相同和 POC相异,所述所属层分为基本层和增强层,所述所属视分为 基本视和依赖视; 或  A method for determining a predicted value of a time domain motion vector, the method comprising: determining, according to image information of a reference image of a current image block, a corresponding image of the current image block from an image set, wherein The image information includes any of the following: an image type, an image sequence number POC relationship with an image of the current block, an associated layer in hierarchical coding, or an affiliated view in multi-view coding. The image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is divided into a base view and a dependent view; or
根据当前图像块的对应图像的图像信息, 从图像集合中, 确定所述当前图 像块的参考图像, 其中, 所述图像信息包括以下任一信息: 图像类型、 与所述 当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中图像的所属层 或在多视编码中的所属视, 所述图像类型分为长期类型和短期类型, 所述 POC 关系分为 POC相同和 POC相异,所述所属层分为基本层和增强层,所述所属视 分为基本视和依赖视;  Determining, from the image set, a reference image of the current image block according to image information of a corresponding image of the current image block, wherein the image information includes any of the following information: an image type, and an image of the current block The image sequence number POC relationship, the belonging layer of the image in hierarchical coding or the dependent view in the multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into POC and POC Different, the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view;
确定所述当前图像块在所述对应图像中的对应图像块;  Determining a corresponding image block of the current image block in the corresponding image;
根据所述参考图像和所述对应图像块, 确定所述当前图像块的时域运动矢 量预测值。  Determining a time domain motion vector predictor of the current image block based on the reference image and the corresponding image block.
2. 根据权利要求 1所述的方法, 其特征在于, 所述当前图像块是依赖视图 像中的图像块, 所述图像集合包括与所述依赖视相对应的基本视的图像, 或 所述当前图像块是增强层图像中的图像块, 所述图像集合包括与所述增强 层图像相对应的基本层的图像。  2. The method according to claim 1, wherein the current image block is an image block in a dependent view image, the image set includes a base view image corresponding to the dependent view, or The current image block is an image block in the enhancement layer image, the image collection including an image of the base layer corresponding to the enhancement layer image.
3. 根据权利要求 1或 2所述的方法, 其特征在于, 所述根据当前图像块的 参考图像的图像信息, 从所述图像集合中, 确定所述当前图像块的对应图像, 包括:  The method according to claim 1 or 2, wherein the determining, according to the image information of the reference image of the current image block, the corresponding image of the current image block from the image set, comprises:
根据当前图像块的参考图像的图像类型, 从所述图像集合中, 确定所述当 前图像块的对应图像, 以使所述对应图像的图像类型与所述参考图像的图像类 型相异; 或 Determining, according to an image type of the reference image of the current image block, a corresponding image of the current image block from the image set, such that an image type of the corresponding image and an image class of the reference image Different type; or
根据当前图像块的参考图像的与所述当前块的所属图像之间的 POC关系, 从所述图像集合中, 确定所述当前图像块的对应图像, 以使所述对应图像的与 所述当前块的所属图像之间的 POC关系与所述参考图像的与所述当前块的所属 图像之间的 POC关系相异; 或  Determining, from the image set, a corresponding image of the current image block according to a POC relationship between a reference image of the current image block and an image of the current block, to make the corresponding image and the current image The POC relationship between the belonging images of the block is different from the POC relationship between the reference image and the image of the current block; or
根据当前图像块的参考图像的所属层, 从所述图像集合中, 确定所述当前 图像块的对应图像, 以使所述对应图像的所属层与所述参考图像的所属层相异; 或  Determining, from the image set, a corresponding image of the current image block according to a layer to which the reference image of the current image block belongs, such that an associated layer of the corresponding image is different from a layer to which the reference image belongs; or
根据当前图像块的参考图像的所属视, 从所述图像集合中, 确定所述当前 图像块的对应图像, 以使所述对应图像的所属视与所述参考图像的所属视相异。  And determining, according to the belonging view of the reference image of the current image block, a corresponding image of the current image block from the image set such that an belonging view of the corresponding image is different from an belonging view of the reference image.
4. 根据权利要求 3所述的方法, 其特征在于, 所述图像集合中包括至少两 个第一备选图像, 其中, 所述第一备选图像的类型与所述参考图像的图像类型 相异, 或  The method according to claim 3, wherein the image set includes at least two first candidate images, wherein a type of the first candidate image is different from an image type of the reference image Different, or
所述第一备选图像的与所述当前块的所属图像之间的 POC关系, 与所述参 考图像的与所述当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the image of the first candidate image and the image of the current block, and a POC relationship between the image of the reference image and the image of the current block, or
所述第一备选图像的所属层与所述参考图像的所属层相异, 或  The associated layer of the first candidate image is different from the associated layer of the reference image, or
所述第一备选图像的所属视与所述参考图像的所属视相异, 以及  The belonging view of the first candidate image is different from the belonging view of the reference image, and
所述根据当前图像块的参考图像的图像信息, 从所述图像集合中, 确定所 述当前图像块的对应图像, 包括:  Determining, according to the image information of the reference image of the current image block, the corresponding image of the current image block from the image set, including:
根据当前图像块的参考图像的图像信息, 从所述至少两个第一备选图像中, 确定在所述图像集合中的索引号最小的图像, 作为所述当前图像块的对应图像。  And determining, from the at least two first candidate images, an image having the smallest index number in the image set as a corresponding image of the current image block according to image information of a reference image of the current image block.
5. 根据权利要求 3所述的方法, 其特征在于, 所述图像集合包括至少一个 第二备选图像和至少一个第三备选图像, 其中, 所述第二备选图像与所述第三 备选图像的图像类型相异, 或  5. The method according to claim 3, wherein the image set comprises at least one second candidate image and at least one third candidate image, wherein the second candidate image and the third The image type of the alternate image is different, or
所述第二备选图像的与所述当前块的所属图像之间的 POC关系, 与所述第 三备选图像的与所述当前块的所属图像之间的 POC关系相异, 或 所述第二备选图像的所属层与所述第三备选图像的所属层相异, 或 所述第二备选图像的所属视与所述第三备选图像的所属视相异, 以及 所述方法还包括: a POC relationship between the image of the second candidate image and the image of the current block, and a POC relationship between the image of the third candidate image and the image of the current block, or The belonging layer of the second candidate image is different from the belonging layer of the third candidate image, or the belonging view of the second candidate image is different from the belonging view of the third candidate image, and The method further includes:
从所述图像集合中, 确定预测图像, 所述预测图像包括一个第二备选图像 和一个第三备选图像, 所述预测图像用于确定所述当前图像块所处条带中各图 像块的对应图像; 以及  Determining, from the set of images, a predicted image, the predicted image comprising a second candidate image and a third candidate image, the predicted image being used to determine each image block in the strip in which the current image block is located Corresponding image;
所述根据所述参考图像的类型, 从所述图像集合中, 确定所述当前图像块 的对应图像, 包括:  Determining, according to the type of the reference image, the corresponding image of the current image block from the image set, including:
从所述预测图像中, 确定所述当前图像块的对应图像。  From the predicted image, a corresponding image of the current image block is determined.
6. 根据权利要求 5所述的方法, 其特征在于, 所述图像集合包括至少两个 第二备选图像, 和 /或  6. The method of claim 5, wherein the set of images comprises at least two second candidate images, and/or
所述图像集合包括至少两个第三备选图像, 以及  The set of images includes at least two third candidate images, and
所述从所述图像集合中, 确定预测图像, 包括:  Determining the predicted image from the image set includes:
从所述图像集合中, 确定预测图像, 所述预测图像包括所述至少两个第二 备选图像中在所述图像集合中的索引号最小的图像; 和 /或  Determining, from the set of images, a predicted image, the predicted image comprising an image having the smallest index number in the set of images in the at least two second candidate images; and/or
从所述图像集合中, 确定预测图像, 所述预测图像包括所述至少两个第三 备选图像中在所述图像集合中的索引号最小的图像。  From the set of images, a predicted image is determined, the predicted image comprising an image of the at least two third candidate images having the smallest index number in the set of images.
7. 根据权利要求 3所述的方法, 其特征在于, 所述方法包括:  The method according to claim 3, wherein the method comprises:
从所述图像集合中, 确定目标图像, 作为所述当前图像块所处条带中各图 像块的对应图像; 以及  Determining, from the set of images, a target image as a corresponding image of each image block in a strip in which the current image block is located;
所述根据当前图像块的对应图像的图像信息, 从所述图像集合中, 确定所 述当前图像块的参考图像, 包括:  Determining the reference image of the current image block from the image set according to the image information of the corresponding image of the current image block, including:
根据当前图像块的对应图像的图像类型, 从所述图像集合中, 确定所述当 前图像块的参考图像, 以使所述参考图像的图像类型与所述对应图像的图像类 型相异; 或  Determining, from the image set, a reference image of the current image block according to an image type of a corresponding image of the current image block such that an image type of the reference image is different from an image type of the corresponding image; or
根据当前图像块的对应图像的与所述当前块的所属图像之间的 POC关系, 从所述图像集合中, 确定所述当前图像块的参考图像, 以使所述参考图像的与 所述当前块的所属图像之间的 POC关系与所述对应图像的与所述当前块的所属 图像之间的 POC关系相异; 或 According to a POC relationship between a corresponding image of the current image block and an image of the current block, Determining, from the image set, a reference image of the current image block such that a POC relationship between the reference image and an image of the current block belongs to and a corresponding image of the current image The POC relationship between images is different; or
根据当前图像块的对应图像的所属层, 从所述图像集合中, 确定所述当前 图像块的参考图像, 以使所述参考图像的所属层与所述对应图像的所属层相异; 或  Determining, from the image set, a reference image of the current image block according to an associated layer of the corresponding image of the current image block, such that the belonging layer of the reference image is different from the associated layer of the corresponding image; or
根据当前图像块的对应图像的所属视, 从所述图像集合中, 确定所述当前 图像块的参考图像, 以使所述参考图像的所属视与所述对应图像的所属视相异。  And determining, according to the belonging view of the corresponding image of the current image block, a reference image of the current image block from the image set such that an belonging view of the reference image is different from an belonging view of the corresponding image.
8. 根据权利要求 7所述的方法, 其特征在于, 所述图像集合中包括至少两 个第四备选图像, 其中, 所述第四备选图像的类型与所述对应图像的图像类型 相异, 或  The method according to claim 7, wherein the image set includes at least two fourth candidate images, wherein a type of the fourth candidate image is different from an image type of the corresponding image Different, or
所述第四备选图像的与所述当前块的所属图像之间的 POC关系, 与所述对 应图像的与所述当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the fourth candidate image and the belonging image of the current block is different from a POC relationship between the corresponding image and the image of the current block, or
所述第四备选图像的所属层与所述参考图像的所属层相异, 或  The belonging layer of the fourth candidate image is different from the belonging layer of the reference image, or
所述第四备选图像的所属视与所述参考图像的所属视相异, 以及  The belonging view of the fourth candidate image is different from the belonging view of the reference image, and
所述根据所述对应图像的图像信息, 从所述图像集合中, 确定所述当前图 像块的参考图像, 包括:  Determining the reference image of the current image block from the image set according to the image information of the corresponding image, including:
根据所述对应图像的图像信息, 从所述至少两个第四备选图像中, 确定在 所述图像集合中的索引号最小的图像, 作为所述当前图像块的参考图像。  And determining, from the at least two fourth candidate images, an image having the smallest index number in the image set as a reference image of the current image block, according to the image information of the corresponding image.
9. 根据权利要求 1至 8中任一项所述的方法, 其特征在于, 所述当前图像 块的所属图像为双向预测图像, 所述对应图像为双向预测图像, 以及  The method according to any one of claims 1 to 8, wherein the image to which the current image block belongs is a bidirectional predicted image, the corresponding image is a bidirectional predicted image, and
所述根据所述参考图像和所述对应图像块, 确定所述当前图像块的时域运 动矢量预测值, 包括:  Determining a time domain motion vector predictor of the current image block according to the reference image and the corresponding image block, including:
根据所述对应图像的图像信息, 确定所述对应图像块的运动矢量; 根据所述参考图像和所述对应图像块的运动矢量, 确定所述当前图像块的 时域运动矢量预测值。 Determining, according to the image information of the corresponding image, a motion vector of the corresponding image block; determining a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block.
10. 根据权利要求 9所述的方法, 其特征在于, 所述根据所述对应图像的 图像信息, 确定所述对应图像块的运动矢量, 具体包括: The method according to claim 9, wherein the determining the motion vector of the corresponding image block according to the image information of the corresponding image comprises:
当所述对应图像的图像类型为长期类型时, 如果所述当前图像块的参考图 像来自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块 的运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的 第一参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的 所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应 图像块的运动矢量指向的图像属于所述对应图像的第二参考图像列表; 或  When the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that And the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the image of the current image block, Determining a motion vector of the corresponding image block such that an image pointed by the motion vector of the corresponding image block belongs to a second reference image list of the corresponding image; or
当所述对应图像的 POC与所述当前图像块的所属图像的 POC相同时,如果 所述当前图像块的参考图像来自于所述当前图像块的所属图像的第一参考图像 列表, 则确定对应图像块的运动矢量, 以使所述对应图像块的运动矢量指向的 图像属于所述对应图像的第一参考图像列表, 如果所述当前图像块的参考图像 来自于所述当前图像块的所属图像的第二参考图像列表, 则确定对应图像块的 运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的第 二参考图像列表; 或  And when the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the corresponding a motion vector of the image block, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the image of the current image block a second reference image list, determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
当所述对应图像的所属层为基本层时, 如果所述当前图像块的参考图像来 自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运 动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的第一 参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的所属 图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像 块的运动矢量指向的图像属于所述对应图像的第二参考图像列表; 或  When the associated layer of the corresponding image is the base layer, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that And the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the image of the current image block, Determining a motion vector of the corresponding image block such that an image pointed by the motion vector of the corresponding image block belongs to a second reference image list of the corresponding image; or
当所述对应图像的所属视为基本视时, 如果所述当前图像块的参考图像来 自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运 动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的第一 参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的所属 图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像 块的运动矢量指向的图像属于所述对应图像的第二参考图像列表。 When the belonging of the corresponding image is regarded as a base view, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that And the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the image of the current image block, Determining a motion vector of the corresponding image block to make the corresponding image The image pointed by the motion vector of the block belongs to the second reference image list of the corresponding image.
11. 一种确定时域运动矢量预测值的方法, 其特征在于, 所述方法包括: 确定当前图像块的参考图像和对应图像, 其中, 所述当前图像块的所属图 像为双向预测图像, 所述对应图像为双向预测图像;  A method for determining a predicted value of a time domain motion vector, the method comprising: determining a reference image of a current image block and a corresponding image, wherein the image of the current image block is a bidirectional predicted image, The corresponding image is a bidirectional predicted image;
确定所述当前图像块在所述对应图像中的对应图像块;  Determining a corresponding image block of the current image block in the corresponding image;
根据所述对应图像的图像信息, 确定所述对应图像块的运动矢量, 所述图 像信息包括以下任一信息: 图像类型、 与所述当前块的所属图像之间的图像顺 序编号 POC关系、 在分层编码中的所属层或在多视编码中的所属视, 所述图像 类型分为长期类型和短期类型, 所述 POC关系分为 POC相同和 POC相异, 所 述所属层分为基本层和增强层, 所述所属视分为基本视和依赖视;  Determining, according to the image information of the corresponding image, a motion vector of the corresponding image block, where the image information includes any of the following information: an image type, an image sequence number POC relationship with an image of the current block, and The affiliation layer in the layered coding or the affiliation in the multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the affiliation layer is divided into a basic layer. And an enhancement layer, the belonging view is a base view and a dependent view;
根据所述参考图像和所述对应图像块的运动矢量, 确定所述当前图像块的 时域运动矢量预测值。  Determining a time domain motion vector predictor of the current image block based on the reference image and a motion vector of the corresponding image block.
12. 根据权利要求 11所述的方法, 其特征在于, 所述根据所述对应图像的 图像信息, 确定所述对应图像块的运动矢量, 具体包括:  The method according to claim 11, wherein the determining the motion vector of the corresponding image block according to the image information of the corresponding image comprises:
当所述对应图像的图像类型为长期类型时, 如果所述当前图像块的参考图 像来自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块 的运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的 第一参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的 所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应 图像块的运动矢量指向的图像属于所述对应图像的第二参考图像列表; 或  When the image type of the corresponding image is a long-term type, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that And the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the image of the current image block, Determining a motion vector of the corresponding image block such that an image pointed by the motion vector of the corresponding image block belongs to a second reference image list of the corresponding image; or
当所述对应图像的 POC与所述当前图像块的所属图像的 POC相同时,如果 所述当前图像块的参考图像来自于所述当前图像块的所属图像的第一参考图像 列表, 则确定对应图像块的运动矢量, 以使所述对应图像块的运动矢量指向的 图像属于所述对应图像的第一参考图像列表, 如果所述当前图像块的参考图像 来自于所述当前图像块的所属图像的第二参考图像列表, 则确定对应图像块的 运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的第 二参考图像列表; 或 And when the POC of the corresponding image is the same as the POC of the image of the current image block, if the reference image of the current image block is from the first reference image list of the image of the current image block, determining the corresponding a motion vector of the image block, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the image of the current image block a second reference image list, determining a motion vector of the corresponding image block such that an image pointed by the motion vector of the corresponding image block belongs to the corresponding image Second reference image list; or
当所述对应图像的所属层为基本层时, 如果所述当前图像块的参考图像来 自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运 动矢量指向, 以使所述对应图像块的运动矢量的图像属于所述对应图像的第一 参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的所属 图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像 块的运动矢量指向的图像属于所述对应图像的第二参考图像列表; 或  When the associated layer of the corresponding image is the base layer, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining the motion vector pointing of the corresponding image block, And causing the image of the motion vector of the corresponding image block to belong to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the belonging image of the current image block, Determining a motion vector of the corresponding image block such that an image pointed by the motion vector of the corresponding image block belongs to a second reference image list of the corresponding image; or
当所述对应图像的所属视为基本视时, 如果所述当前图像块的参考图像来 自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运 动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的第一 参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的所属 图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像 块的运动矢量指向的图像属于所述对应图像的第二参考图像列表。  When the belonging of the corresponding image is regarded as a base view, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, so that And the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the image of the current image block, A motion vector of the corresponding image block is determined such that an image pointed by the motion vector of the corresponding image block belongs to a second reference image list of the corresponding image.
13. 一种确定时域运动矢量预测值的装置, 其特征在于, 所述装置包括: 确定单元, 用于根据当前图像块的参考图像的图像信息, 从图像集合中, 确定所述当前图像块的对应图像, 其中, 所述图像信息包括以下任一信息: 图 像类型、 与所述当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码 中的所属层或在多视编码中的所属视, 所述图像类型分为长期类型和短期类型, 所述 POC关系分为 POC相同和 POC相异, 所述所属层分为基本层和增强层, 所述所属视分为基本视和依赖视; 或  An apparatus for determining a time domain motion vector predictor, the apparatus comprising: a determining unit, configured to determine the current image block from an image set according to image information of a reference image of a current image block Corresponding image, wherein the image information includes any of the following: an image type, an image sequence number POC relationship with an image of the current block, an associated layer in hierarchical coding, or in multi-view coding The image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the belonging layer is divided into a basic layer and an enhancement layer, and the belonging video is divided into a basic view and a Dependent; or
用于根据当前图像块的对应图像的图像信息, 从图像集合中, 确定所述当 前图像块的参考图像, 其中, 所述图像信息包括以下任一信息: 图像类型、 与 所述当前块的所属图像之间的图像顺序编号 POC关系、 在分层编码中图像的所 属层或在多视编码中的所属视, 所述图像类型分为长期类型和短期类型, 所述 Determining, from the image set, a reference image of the current image block according to image information of a corresponding image of the current image block, wherein the image information includes any of the following information: an image type, and a belonging of the current block Image sequence number POC relationship between images, belonging layer of an image in hierarchical coding or belonging in multi-view coding, the image type is divided into a long-term type and a short-term type,
POC关系分为 POC相同和 POC相异, 所述所属层分为基本层和增强层, 所述 所属视分为基本视和依赖视; 处理单元, 用于确定所述当前图像块在所述对应图像中的对应图像块; 用于根据所述参考图像和所述对应图像块, 确定所述当前图像块的时域运 动矢量预测值。 The POC relationship is divided into the same POC and the POC, and the belonging layer is divided into a base layer and an enhancement layer, and the belonging view is divided into a base view and a dependent view; a processing unit, configured to determine a corresponding image block of the current image block in the corresponding image; and configured to determine a time domain motion vector predictor of the current image block according to the reference image and the corresponding image block.
14. 根据权利要求 13所述的装置, 其特征在于, 所述当前图像块是依赖视 图像, 所述图像集合包括与所述依赖视相对应的基本视的图像, 或  14. The apparatus according to claim 13, wherein the current image block is a dependent view image, the image set includes a base view image corresponding to the dependent view, or
所述当前图像块是增强层图像中的图像块, 所述图像集合包括与所述增强 层图像相对应的基本层的图像。  The current image block is an image block in an enhancement layer image, the image collection including an image of a base layer corresponding to the enhancement layer image.
15. 根据权利要求 13或 14所述的装置, 其特征在于, 所述确定单元具体 用于根据当前图像块的参考图像的图像类型, 从所述图像集合中, 确定所述当 前图像块的对应图像, 以使所述对应图像的图像类型与所述参考图像的图像类 型相异; 或  The device according to claim 13 or 14, wherein the determining unit is configured to determine, according to an image type of a reference image of a current image block, a correspondence of the current image block from the image set. An image such that an image type of the corresponding image is different from an image type of the reference image; or
用于根据当前图像块的参考图像的与所述当前块的所属图像之间的 POC关 系, 从所述图像集合中, 确定所述当前图像块的对应图像, 以使所述对应图像 的与所述当前块的所属图像之间的 POC关系与所述参考图像的与所述当前块的 所属图像之间的 POC关系相异; 或  Determining, from the image set, a corresponding image of the current image block according to a POC relationship between a reference image of a current image block and an associated image of the current block, such that the corresponding image is The POC relationship between the images belonging to the current block is different from the POC relationship between the reference image and the image of the current block; or
用于根据当前图像块的参考图像的所属层, 从所述图像集合中, 确定所述 当前图像块的对应图像, 以使所述对应图像的所属层与所述参考图像的所属层 相异; 或  Determining, from the image set, a corresponding image of the current image block according to an associated layer of the reference image of the current image block, such that the belonging layer of the corresponding image is different from the belonging layer of the reference image; Or
用于根据当前图像块的参考图像的所属视, 从所述图像集合中, 确定所述 当前图像块的对应图像, 以使所述对应图像的所属视与所述参考图像的所属视 相异。  And determining, according to the belonging view of the reference image of the current image block, a corresponding image of the current image block from the image set such that an belonging view of the corresponding image is different from an belonging view of the reference image.
16. 根据权利要求 15所述的装置, 其特征在于, 所述图像集合中包括至少 两个第一备选图像, 其中, 所述第一备选图像的类型与所述参考图像的图像类 型相异, 或  The device according to claim 15, wherein the image set includes at least two first candidate images, wherein a type of the first candidate image is different from an image type of the reference image Different, or
所述第一备选图像的与所述当前块的所属图像之间的 POC关系, 与所述参 考图像的与所述当前块的所属图像之间的 POC关系相异, 或 所述第一备选图像的所属层与所述参考图像的所属层相异, 或 a POC relationship between the image of the first candidate image and the image of the current block, and a POC relationship between the image of the reference image and the image of the current block, or The associated layer of the first candidate image is different from the associated layer of the reference image, or
所述第一备选图像的所属视与所述参考图像的所属视相异, 以及  The belonging view of the first candidate image is different from the belonging view of the reference image, and
所述确定单元具体用于根据所述参考图像的图像信息, 从所述至少两个第 一备选图像中, 确定在所述图像集合中的索引号最小的图像, 作为所述当前图 像块的对应图像。  The determining unit is specifically configured to determine, according to the image information of the reference image, an image with the smallest index number in the image set from the at least two first candidate images, as the current image block Corresponding image.
17. 根据权利要求 15所述的装置, 其特征在于, 所述图像集合包括至少一 个第二备选图像和至少一个第三备选图像, 其中, 所述第二备选图像与所述第 三备选图像的图像类型相异, 或  17. The apparatus according to claim 15, wherein the image set includes at least one second candidate image and at least one third candidate image, wherein the second candidate image and the third The image type of the alternate image is different, or
所述第二备选图像的与所述当前块的所属图像之间的 POC关系, 与所述第 三备选图像的与所述当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the second candidate image and the belonging image of the current block is different from a POC relationship between the third candidate image and an image of the current block, or
所述第二备选图像的所属层与所述第三备选图像的所属层相异, 或  The belonging layer of the second candidate image is different from the belonging layer of the third candidate image, or
所述第二备选图像的所属视与所述第三备选图像的所属视相异, 以及 所述确定单元还用于从所述图像集合中, 确定预测图像, 所述预测图像包 括一个第二备选图像和一个第三备选图像, 所述预测图像用于确定所述当前图 像块所处条带中各图像块的对应图像;  The belonging view of the second candidate image is different from the belonging view of the third candidate image, and the determining unit is further configured to determine, from the image set, a predicted image, where the predicted image includes a first a second candidate image and a third candidate image, the predicted image being used to determine a corresponding image of each image block in the strip in which the current image block is located;
用于从所述预测图像中, 确定所述当前图像块的对应图像。  For determining a corresponding image of the current image block from the predicted image.
18. 根据权利要求 17所述的装置, 其特征在于, 所述图像集合包括至少两 个第二备选图像, 和 /或  18. The apparatus of claim 17, wherein the set of images comprises at least two second candidate images, and/or
所述图像集合包括至少两个第三备选图像, 以及  The set of images includes at least two third candidate images, and
所述确定单元具体用于从所述图像集合中, 确定预测图像, 所述预测图像 包括所述至少两个第二备选图像中在所述图像集合中的索引号最小的图像; 和 / 或  The determining unit is specifically configured to determine, from the image set, a predicted image, where the predicted image includes an image with the smallest index number in the image set in the at least two second candidate images; and/or
用于从所述图像集合中, 确定预测图像, 所述预测图像包括所述至少两个 第三备选图像中在所述图像集合中的索引号最小的图像。  And for determining, from the set of images, a predicted image, the predicted image including an image of the at least two third candidate images having the smallest index number in the set of images.
19. 根据权利要求 15所述的装置, 其特征在于, 所述确定单元具体用于从 所述图像集合中, 确定目标图像, 作为所述当前图像块所处条带中各图像块的 对应图像; The device according to claim 15, wherein the determining unit is specifically configured to determine, from the image set, a target image as each image block in a strip in which the current image block is located Corresponding image
用于根据当前图像块的对应图像的图像类型, 从所述图像集合中, 确定所 述当前图像块的参考图像, 以使所述参考图像的图像类型与所述对应图像的图 像类型相异; 或  Determining, from the image set, a reference image of the current image block according to an image type of a corresponding image of a current image block, such that an image type of the reference image is different from an image type of the corresponding image; Or
用于根据当前图像块的对应图像的与所述当前块的所属图像之间的 POC关 系, 从所述图像集合中, 确定所述当前图像块的参考图像, 以使所述参考图像 的与所述当前块的所属图像之间的 POC关系与所述对应图像的与所述当前块的 所属图像之间的 POC关系相异; 或  Determining, from the image set, a reference image of the current image block according to a POC relationship between a corresponding image of the current image block and an image of the current block, to make the reference image The POC relationship between the images belonging to the current block is different from the POC relationship between the image of the corresponding image and the image of the current block; or
用于根据当前图像块的对应图像的所属层, 从所述图像集合中, 确定所述 当前图像块的参考图像, 以使所述参考图像的所属层与所述对应图像的所属层 相异; 或  Determining, from the image set, a reference image of the current image block according to an belonging layer of a corresponding image of the current image block, such that an belonging layer of the reference image is different from an associated layer of the corresponding image; Or
用于根据当前图像块的对应图像的所属视, 从所述图像集合中, 确定所述 当前图像块的参考图像, 以使所述参考图像的所属视与所述对应图像的所属视 相异。  And determining, from the image set, a reference image of the current image block according to an belonging view of the corresponding image of the current image block, such that the belonging view of the reference image is different from the belonging view of the corresponding image.
20. 根据权利要求 19所述的装置, 其特征在于, 所述图像集合中包括至少 两个第四备选图像, 其中, 所述第四备选图像的类型与所述参考图像的图像类 型相异, 或  The device according to claim 19, wherein the image set includes at least two fourth candidate images, wherein a type of the fourth candidate image is different from an image type of the reference image Different, or
所述第四备选图像的与所述当前块的所属图像之间的 POC关系, 与所述参 考图像的与所述当前块的所属图像之间的 POC关系相异, 或  a POC relationship between the fourth candidate image and the belonging image of the current block is different from a POC relationship between the reference image and the image of the current block, or
所述第四备选图像的所属层与所述参考图像的所属层相异, 或  The belonging layer of the fourth candidate image is different from the belonging layer of the reference image, or
所述第四备选图像的所属视与所述参考图像的所属视相异, 以及  The belonging view of the fourth candidate image is different from the belonging view of the reference image, and
所述确定单元具体用于根据所述对应图像的图像信息, 从所述至少两个第 四备选图像中, 确定在所述图像集合中的索引号最小的图像, 作为所述当前图 像块的参考图像。  The determining unit is configured to determine, according to the image information of the corresponding image, an image with the smallest index number in the image set from the at least two fourth candidate images, as the current image block. Reference image.
21. 根据权利要求 13至 20中任一项所述的装置, 其特征在于, 所述当前 图像块的所属图像为双向预测图像, 所述对应图像为双向预测图像, 以及 所述处理单元具体用于根据所述对应图像的图像信息, 确定所述对应图像 块的运动矢量; The device according to any one of claims 13 to 20, wherein the belonging image of the current image block is a bidirectional predicted image, and the corresponding image is a bidirectional predicted image, and The processing unit is specifically configured to determine a motion vector of the corresponding image block according to image information of the corresponding image;
用于根据所述参考图像和所述对应图像块的运动矢量, 确定所述当前图像 块的时域运动矢量预测值。  And determining a time domain motion vector predictor of the current image block according to the reference image and a motion vector of the corresponding image block.
22. 根据权利要求 21所述的装置, 其特征在于, 所述处理单元具体用于当 所述对应图像的图像类型为长期类型时, 如果所述当前图像块的参考图像来自 于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动 矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的第一参 考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的所属图 像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像块 的运动矢量指向的图像属于所述对应图像的第二参考图像列表; 或  The device according to claim 21, wherein the processing unit is specifically configured to: when an image type of the corresponding image is a long-term type, if a reference image of the current image block is from the current image Determining, by the first reference image list of the belonging image of the block, a motion vector of the corresponding image block, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the current image And the reference image of the block is from the second reference image list of the image of the current image block, and then determining a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the corresponding image. Second reference image list; or
用于当所述对应图像的 POC与所述当前图像块的所属图像的 POC相同时, 如果所述当前图像块的参考图像来自于所述当前图像块的所属图像的第一参考 图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像块的运动矢量指 向的图像属于所述对应图像的第一参考图像列表, 如果所述当前图像块的参考 图像来自于所述当前图像块的所属图像的第二参考图像列表, 则确定对应图像 块的运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像 的第二参考图像列表; 或  For when the POC of the corresponding image is the same as the POC of the belonging image of the current image block, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, Determining a motion vector of the corresponding image block such that an image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the reference image of the current image block is from the current image block Determining, by the second reference image list of the image, a motion vector of the corresponding image block, such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
用于当所述对应图像的所属层为基本层时, 如果所述当前图像块的参考图 像来自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块 的运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的 图像属于第一参考图像列表, 如果所述当前图像块的参考图像来自于所述当前 图像块的所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使 所述对应图像块的运动矢量指向的图像属于所述对应图像的第二参考图像列 表 或  And determining, when the contiguous layer of the corresponding image is the base layer, the motion vector of the corresponding image block, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, An image in which the image pointed to by the motion vector of the corresponding image block belongs to the corresponding image belongs to the first reference image list, if the reference image of the current image block is from the second reference of the associated image of the current image block And determining, by the image list, a motion vector of the corresponding image block, such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image or
用于当所述对应图像的所属视为基本视时, 如果所述当前图像块的参考图 像来自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块 的运动矢量, 以使所述对应图像块的运动矢量指向的所述对应图像的图像属于 第一参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的 所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应 图像块的运动矢量指向的图像属于所述对应图像的第二参考图像列表。 For when the belonging of the corresponding image is regarded as a base view, if the reference picture of the current image block Determining, according to a first reference image list of the belonging image of the current image block, a motion vector of the corresponding image block, so that an image of the corresponding image pointed by the motion vector of the corresponding image block belongs to the first reference image a list, if a reference image of the current image block is from a second reference image list of an image of the current image block, determining a motion vector of the corresponding image block to cause an image of the motion vector of the corresponding image block to point to A second reference image list belonging to the corresponding image.
23. 一种确定时域运动矢量预测值的装置, 其特征在于, 所述装置包括: 确定单元, 用于确定当前图像块的参考图像和对应图像, 其中, 所述当前 图像块的所属图像为双向预测图像, 所述对应图像为双向预测图像;  An apparatus for determining a time domain motion vector predictor, wherein the apparatus includes: a determining unit, configured to determine a reference image and a corresponding image of a current image block, where the image of the current image block belongs to Bidirectionally predicting an image, the corresponding image being a bidirectional predicted image;
用于确定所述当前图像块在所述对应图像中的对应图像块;  And determining a corresponding image block of the current image block in the corresponding image;
处理单元, 用于根据所述对应图像的图像信息, 确定所述对应图像块的运 动矢量, 所述图像信息包括以下任一信息: 图像类型、 与所述当前块的所属图 像之间的图像顺序编号 POC关系、 在分层编码中的所属层或在多视编码中的所 属视,所述图像类型分为长期类型和短期类型,所述 POC关系分为 POC相同和 POC相异, 所述所属层分为基本层和增强层, 所述所属视分为基本视和依赖视; 用于根据所述参考图像和所述对应图像块的运动矢量, 确定所述当前图像 块的时域运动矢量预测值。  a processing unit, configured to determine, according to the image information of the corresponding image, a motion vector of the corresponding image block, where the image information includes any of the following information: an image type, an image sequence with an image of the current block The numbered POC relationship, the belonging layer in hierarchical coding, or the dependent view in multi-view coding, the image type is divided into a long-term type and a short-term type, and the POC relationship is divided into a POC and a POC, and the belonging The layer is divided into a base layer and an enhancement layer, and the belonging view is a base view and a dependent view; and is configured to determine a time domain motion vector prediction of the current image block according to the reference image and a motion vector of the corresponding image block. value.
24. 根据权利要求 23所述的装置, 其特征在于, 所述处理单元具体用于当 所述对应图像的图像类型为长期类型时, 如果所述当前图像块的参考图像来自 于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块的运动 矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的第一参 考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的所属图 像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像块 的运动矢量指向的图像属于所述对应图像的第二参考图像列表; 或  The device according to claim 23, wherein the processing unit is specifically configured to: when an image type of the corresponding image is a long-term type, if a reference image of the current image block is from the current image Determining, by the first reference image list of the belonging image of the block, a motion vector of the corresponding image block, such that the image pointed by the motion vector of the corresponding image block belongs to the first reference image list of the corresponding image, if the current image And the reference image of the block is from the second reference image list of the image of the current image block, and then determining a motion vector of the corresponding image block, so that the image pointed by the motion vector of the corresponding image block belongs to the corresponding image. Second reference image list; or
用于当所述对应图像的 POC与所述当前图像块的所属图像的 POC相同时, 如果所述当前图像块的参考图像来自于所述当前图像块的所属图像的第一参考 图像列表, 则确定对应图像块的运动矢量, 以使所述对应图像块的运动矢量指 向的图像属于所述对应图像的第一参考图像列表, 如果所述当前图像块的参考 图像来自于所述当前图像块的所属图像的第二参考图像列表, 则确定对应图像 块的运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像 的第二参考图像列表; 或 For when the POC of the corresponding image is the same as the POC of the belonging image of the current image block, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, Determining a motion vector of the corresponding image block such that the motion vector of the corresponding image block The image of the image belongs to the first reference image list of the corresponding image, and if the reference image of the current image block is from the second reference image list of the image of the current image block, the motion vector of the corresponding image block is determined, The image that points the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image; or
用于当所述对应图像的所属层为基本层时, 如果所述当前图像块的参考图 像来自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块 的运动矢量, 以使所述对应图像块的运动矢量指向的图像属于所述对应图像的 图像属于第一参考图像列表, 如果所述当前图像块的参考图像来自于所述当前 图像块的所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使 所述对应图像块的运动矢量指向的图像属于所述对应图像的第二参考图像列 表 或  And determining, when the contiguous layer of the corresponding image is the base layer, the motion vector of the corresponding image block, if the reference image of the current image block is from the first reference image list of the belonging image of the current image block, An image in which the image pointed to by the motion vector of the corresponding image block belongs to the corresponding image belongs to the first reference image list, if the reference image of the current image block is from the second reference of the associated image of the current image block And determining, by the image list, a motion vector of the corresponding image block, such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image or
用于当所述对应图像的所属视为基本视时, 如果所述当前图像块的参考图 像来自于所述当前图像块的所属图像的第一参考图像列表, 则确定对应图像块 的运动矢量, 以使所述对应图像块的运动矢量指向的所述对应图像的图像属于 第一参考图像列表, 如果所述当前图像块的参考图像来自于所述当前图像块的 所属图像的第二参考图像列表, 则确定对应图像块的运动矢量, 以使所述对应 图像块的运动矢量指向的图像属于所述对应图像的第二参考图像列表。  And determining, when the reference image of the current image block is from the first reference image list of the belonging image of the current image block, determining a motion vector of the corresponding image block, The image of the corresponding image pointed to by the motion vector of the corresponding image block belongs to the first reference image list, if the reference image of the current image block is from the second reference image list of the belonging image of the current image block And determining a motion vector of the corresponding image block such that the image pointed by the motion vector of the corresponding image block belongs to the second reference image list of the corresponding image.
PCT/CN2013/082017 2013-01-07 2013-08-22 Method and device for determining temporal motion vector predictor WO2014106388A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310005057.6 2013-01-07
CN201310005057.6A CN103024397B (en) 2013-01-07 2013-01-07 Method and device for determining time domain motion vector predictor

Publications (1)

Publication Number Publication Date
WO2014106388A1 true WO2014106388A1 (en) 2014-07-10

Family

ID=47972469

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/082017 WO2014106388A1 (en) 2013-01-07 2013-08-22 Method and device for determining temporal motion vector predictor

Country Status (2)

Country Link
CN (1) CN103024397B (en)
WO (1) WO2014106388A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110832868A (en) * 2018-08-31 2020-02-21 深圳市大疆创新科技有限公司 Encoding method, decoding method, encoding device, and decoding device

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103024397B (en) * 2013-01-07 2015-07-08 华为技术有限公司 Method and device for determining time domain motion vector predictor
EP2982123A4 (en) * 2013-04-05 2016-09-07 Sharp Kk Decoding of inter-layer reference picture set and reference picture list construction
CN103237213B (en) * 2013-04-08 2016-03-30 华为技术有限公司 Method for video coding and video encoding/decoding method and relevant apparatus
CN105144714B (en) * 2013-04-09 2019-03-29 寰发股份有限公司 Three-dimensional or multi-view video coding or decoded method and device
CN104301734B (en) * 2013-07-15 2017-11-17 华为技术有限公司 The method and apparatus for handling image
US10187641B2 (en) 2013-12-24 2019-01-22 Kt Corporation Method and apparatus for encoding/decoding multilayer video signal
US10708606B2 (en) 2014-03-24 2020-07-07 Kt Corporation Multilayer video signal encoding/decoding method and device
US20150373350A1 (en) * 2014-06-20 2015-12-24 Qualcomm Incorporated Temporal motion vector prediction (tmvp) indication in multi-layer codecs
CN110381323B (en) * 2018-04-12 2021-10-26 福州瑞芯微电子股份有限公司 Inter-frame prediction-based lossless compression system and method for assisting frame motion vector information

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090304083A1 (en) * 2003-12-31 2009-12-10 Institute Of Computing Technology Chinese Academy Of Sciences Method for obtaining image reference block in a code of mode of fixed reference frame number
CN101841712A (en) * 2010-04-28 2010-09-22 广西大学 B-frame expansion direct mode oriented to panoramic video coding
US20120008688A1 (en) * 2010-07-12 2012-01-12 Mediatek Inc. Method and Apparatus of Temporal Motion Vector Prediction
CN102769748A (en) * 2012-07-02 2012-11-07 华为技术有限公司 Motion vector prediction method, device and system
CN103024397A (en) * 2013-01-07 2013-04-03 华为技术有限公司 Method and device for determining time domain motion vector predictor

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090304083A1 (en) * 2003-12-31 2009-12-10 Institute Of Computing Technology Chinese Academy Of Sciences Method for obtaining image reference block in a code of mode of fixed reference frame number
CN101841712A (en) * 2010-04-28 2010-09-22 广西大学 B-frame expansion direct mode oriented to panoramic video coding
US20120008688A1 (en) * 2010-07-12 2012-01-12 Mediatek Inc. Method and Apparatus of Temporal Motion Vector Prediction
CN102769748A (en) * 2012-07-02 2012-11-07 华为技术有限公司 Motion vector prediction method, device and system
CN103024397A (en) * 2013-01-07 2013-04-03 华为技术有限公司 Method and device for determining time domain motion vector predictor

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110832868A (en) * 2018-08-31 2020-02-21 深圳市大疆创新科技有限公司 Encoding method, decoding method, encoding device, and decoding device
US11368679B2 (en) 2018-08-31 2022-06-21 SZ DJI Technology Co., Ltd. Encoding method, decoding method, encoding apparatus, and decoding apparatus

Also Published As

Publication number Publication date
CN103024397B (en) 2015-07-08
CN103024397A (en) 2013-04-03

Similar Documents

Publication Publication Date Title
WO2014106388A1 (en) Method and device for determining temporal motion vector predictor
US11968390B2 (en) Method and device for encoding a sequence of images and method and device for decoding a sequence of images
CN110809887B (en) Method and apparatus for motion vector modification for multi-reference prediction
TWI619374B (en) Method and apparatus of video coding with affine motion compensation
EP2745513B1 (en) Motion vector processing
JP5916266B2 (en) Video coding method and apparatus
JP6293788B2 (en) Device and method for scalable coding of video information based on high efficiency video coding
TW202013978A (en) Interaction between ibc and dmvr
TW202005383A (en) Partial cost calculation
TW202013958A (en) Interaction of asymmetric weighted merges and other coding tools
JP2015514342A5 (en)
WO2015100710A1 (en) Existence of inter-view reference picture and availability of 3dvc coding tools
CN111903123B (en) Image processing method based on inter prediction mode and apparatus therefor
WO2014048372A1 (en) Method and device for image processing, coder and decoder
KR20140005099A (en) Method and apparatus for image encoding/decoding
CN113475075B (en) Motion prediction based on shared Merge list
WO2015143603A1 (en) An improved method for temporal motion vector prediction in video coding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13869980

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13869980

Country of ref document: EP

Kind code of ref document: A1