WO2017188509A1 - 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 - Google Patents
인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 Download PDFInfo
- Publication number
- WO2017188509A1 WO2017188509A1 PCT/KR2016/007233 KR2016007233W WO2017188509A1 WO 2017188509 A1 WO2017188509 A1 WO 2017188509A1 KR 2016007233 W KR2016007233 W KR 2016007233W WO 2017188509 A1 WO2017188509 A1 WO 2017188509A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- motion information
- block
- reference picture
- picture
- backward
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
Definitions
- the present invention relates to a still image or moving image processing method, and more particularly, to a method for encoding / decoding a still image or moving image based on an inter prediction mode and an apparatus supporting the same.
- Compression coding refers to a series of signal processing techniques for transmitting digitized information through a communication line or for storing in a form suitable for a storage medium.
- Media such as an image, an image, an audio, and the like may be a target of compression encoding.
- a technique of performing compression encoding on an image is called video image compression.
- Next-generation video content will be characterized by high spatial resolution, high frame rate and high dimensionality of scene representation. Processing such content would result in a tremendous increase in terms of memory storage, memory access rate, and processing power.
- An object of the present invention is to define a backward motion information prediction method, which is a new motion information prediction method in inter picture prediction (inter prediction), and propose a method of encoding / decoding an image using the same.
- a current block is generated by using motion information of a block in a reference picture of a current picture. deriving backward motion information of the block; adding the backward motion information as a motion information candidate to the motion information candidate list of the current block including a plurality of motion information candidates; Deriving motion information of the current block from motion information selected from motion information candidates, and generating a prediction block of the current block by using motion information of the current block, wherein the reference is determined by the backward motion information.
- Blocks in the picture may be specified.
- a current block is generated by using motion information of a block in a reference picture of a current picture.
- a backward motion information derivation unit for deriving backward motion information of a block
- a motion information candidate list constructing unit for adding the backward motion information as a motion information candidate to the motion information candidate list of the current block including a plurality of motion information candidates
- the backward motion information Blocks in the reference picture may be specified.
- the motion information of the block in the reference picture is scaled to face the current block, and the backward motion information may be derived as motion information having the same size and opposite direction as the scaled motion information.
- motion information of a block in the reference picture is to be scaled based on a picture order count (POC) difference between the current picture and the reference picture and a POC difference between the reference picture and the reference picture of the reference picture.
- POC picture order count
- the method may further include searching for a block having motion information in a reference picture of the current picture, wherein the backward motion information may be derived based on the motion information of the found block. have.
- the backward motion information corresponds to a corresponding block specified by the scaled motion information, and backward motion information of the current block overlaps backward motion information of the corresponding block. Can be determined.
- the method may further include giving priority to the reverse motion information of the current block to the plurality of backward motion information.
- a higher priority may be given when a difference in a picture order count (POC) between the current picture and the reference picture is small.
- POC picture order count
- a higher priority may be given when a difference in a picture order count (POC) between the current picture and a reference picture of the reference picture is small.
- POC picture order count
- POC picture order count
- the difference value between the block in the reference picture and the block in the reference picture of the reference picture specified by the block in the reference picture is small, a higher priority may be given.
- higher priority may be given to backward motion information which is first mapped and stored in the corresponding block among the plurality of backward motion information.
- the current block when there are a plurality of corresponding blocks in the current block, giving priority to selecting backward motion information of the current block to backward motion information of the plurality of corresponding blocks. It may include.
- higher priority may be given to backward motion information of a corresponding block existing at a short distance from a position of a specific sample of the current block among the plurality of backward motion information.
- the specific sample may be any one of the upper left sample, the middle sample, and the lower right sample of the current block.
- higher priority may be given to backward motion information having a different value compared to motion information of a block neighboring the current block among the plurality of backward motion information.
- the backward motion information may be added to the motion information candidate list of the current block by a preset number based on the priority given to the plurality of backward motion information. have.
- the single corresponding block may include bidirectional motion information derived from the plurality of backward motion information. Can be mapped and stored.
- the accuracy of the prediction can be improved by predicting the motion information in the reverse direction.
- the peripheral motion information can be used in various ways as much as possible, thereby improving the coding efficiency.
- the residual signal may be reduced, thereby improving the compression ratio of the image.
- FIG. 1 is a schematic block diagram of an encoder in which encoding of a still image or video signal is performed according to an embodiment to which the present invention is applied.
- FIG. 2 is a schematic block diagram of a decoder in which encoding of a still image or video signal is performed according to an embodiment to which the present invention is applied.
- FIG. 3 is a diagram for describing a partition structure of a coding unit that may be applied to the present invention.
- FIG. 4 is a diagram for explaining a prediction unit applicable to the present invention.
- FIG. 5 is a diagram illustrating a direction of inter prediction as an embodiment to which the present invention may be applied.
- FIG 6 illustrates integer and fractional sample positions for quarter sample interpolation, as an embodiment to which the present invention may be applied.
- FIG. 7 illustrates a position of a spatial candidate as an embodiment to which the present invention may be applied.
- FIG. 8 is a diagram illustrating an inter prediction method as an embodiment to which the present invention is applied.
- FIG. 9 is a diagram illustrating a motion compensation process as an embodiment to which the present invention may be applied.
- FIG. 10 is a diagram for describing backward prediction motion information according to an embodiment to which the present invention may be applied.
- FIG. 11 is a diagram for describing a backward motion information prediction process as an embodiment to which the present invention may be applied.
- FIG. 12 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- FIG. 13 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- FIG. 14 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- 15 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- 16 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- 17 is a diagram for describing a method of generating bidirectional predictive motion information according to an embodiment of the present invention.
- FIG. 18 is a schematic block diagram of an encoder including a bidirectional motion information prediction method according to an embodiment of the present invention.
- 19 is a schematic block diagram of a decoder including a bidirectional motion information prediction method according to an embodiment of the present invention.
- FIG. 20 illustrates a method of constructing a motion information candidate list using backward motion information as an embodiment to which the present invention may be applied.
- FIG. 21 illustrates a method for constructing a motion information candidate list using reverse motion information according to an embodiment to which the present invention can be applied.
- FIG. 22 illustrates a method of inserting backward prediction motion information into a motion information candidate list according to an embodiment of the present invention.
- FIG. 23 is a diagram illustrating an inter prediction based image processing method according to an embodiment of the present invention.
- 24 is a diagram illustrating a backward motion information predictor and an inter predictor, according to an embodiment of the present invention.
- the 'processing unit' refers to a unit in which a process of encoding / decoding such as prediction, transformation, and / or quantization is performed.
- the processing unit may be referred to as a 'processing block' or 'block'.
- the processing unit may be interpreted to include a unit for the luma component and a unit for the chroma component.
- the processing unit may correspond to a Coding Tree Unit (CTU), a Coding Unit (CU), a Prediction Unit (PU), or a Transform Unit (TU).
- CTU Coding Tree Unit
- CU Coding Unit
- PU Prediction Unit
- TU Transform Unit
- the processing unit may be interpreted as a unit for a luma component or a unit for a chroma component.
- the processing unit may be a coding tree block (CTB), a coding block (CB), a prediction block (PU), or a transform block (TB) for a luma component. May correspond to. Or, it may correspond to a coding tree block (CTB), a coding block (CB), a prediction block (PU), or a transform block (TB) for a chroma component.
- CTB coding tree block
- CB coding block
- PU prediction block
- TB transform block
- the present invention is not limited thereto, and the processing unit may be interpreted to include a unit for a luma component and a unit for a chroma component.
- processing unit is not necessarily limited to square blocks, but may also be configured in a polygonal form having three or more vertices.
- FIG. 1 is a schematic block diagram of an encoder in which encoding of a still image or video signal is performed according to an embodiment to which the present invention is applied.
- the encoder 100 may include an image divider 110, a subtractor 115, a transform unit 120, a quantizer 130, an inverse quantizer 140, an inverse transform unit 150, and a filtering unit. 160, a decoded picture buffer (DPB) 170, a predictor 180, and an entropy encoder 190.
- the predictor 180 may include an inter predictor 181 and an intra predictor 182.
- the image divider 110 divides an input video signal (or a picture or a frame) input to the encoder 100 into one or more processing units.
- the subtractor 115 subtracts the difference from the prediction signal (or prediction block) output from the prediction unit 180 (that is, the inter prediction unit 181 or the intra prediction unit 182) in the input image signal. Generate a residual signal (or difference block). The generated difference signal (or difference block) is transmitted to the converter 120.
- the transform unit 120 may convert a differential signal (or a differential block) into a transform scheme (eg, a discrete cosine transform (DCT), a discrete sine transform (DST), a graph-based transform (GBT), and a karhunen-loeve transform (KLT)). Etc.) to generate transform coefficients.
- a transform scheme eg, a discrete cosine transform (DCT), a discrete sine transform (DST), a graph-based transform (GBT), and a karhunen-loeve transform (KLT)
- the quantization unit 130 quantizes the transform coefficients and transmits the transform coefficients to the entropy encoding unit 190, and the entropy encoding unit 190 entropy codes the quantized signals and outputs them as bit streams.
- the quantized signal output from the quantization unit 130 may be used to generate a prediction signal.
- the quantized signal may recover the differential signal by applying inverse quantization and inverse transformation through an inverse quantization unit 140 and an inverse transformation unit 150 in a loop.
- a reconstructed signal may be generated by adding the reconstructed difference signal to a prediction signal output from the inter predictor 181 or the intra predictor 182.
- the filtering unit 160 applies filtering to the reconstruction signal and outputs it to the reproduction apparatus or transmits the decoded picture buffer to the decoding picture buffer 170.
- the filtered signal transmitted to the decoded picture buffer 170 may be used as the reference picture in the inter prediction unit 181. As such, by using the filtered picture as a reference picture in the inter prediction mode, not only image quality but also encoding efficiency may be improved.
- the decoded picture buffer 170 may store the filtered picture for use as a reference picture in the inter prediction unit 181.
- the inter prediction unit 181 performs temporal prediction and / or spatial prediction to remove temporal redundancy and / or spatial redundancy with reference to a reconstructed picture.
- the inter prediction unit 181 may use backward motion information during inter prediction (or inter picture prediction). Detailed description thereof will be described later.
- the reference picture used to perform the prediction is a transformed signal that has been quantized and dequantized in units of blocks at the time of encoding / decoding in the previous time, blocking artifacts or ringing artifacts may exist. have.
- the inter prediction unit 181 may interpolate the signals between pixels in sub-pixel units by applying a lowpass filter to solve performance degradation due to discontinuity or quantization of such signals.
- the sub-pixels mean virtual pixels generated by applying an interpolation filter
- the integer pixels mean actual pixels existing in the reconstructed picture.
- the interpolation method linear interpolation, bi-linear interpolation, wiener filter, or the like may be applied.
- the interpolation filter may be applied to a reconstructed picture to improve the precision of prediction.
- the inter prediction unit 181 generates an interpolation pixel by applying an interpolation filter to integer pixels, and uses an interpolated block composed of interpolated pixels as a prediction block. You can make predictions.
- the intra predictor 182 predicts the current block by referring to samples in the vicinity of the block to which the current encoding is to be performed.
- the intra prediction unit 182 may perform the following process to perform intra prediction. First, reference samples necessary for generating a prediction signal may be prepared. The prediction signal may be generated using the prepared reference sample. Then, the prediction mode is encoded. In this case, the reference sample may be prepared through reference sample padding and / or reference sample filtering. Since the reference sample has been predicted and reconstructed, there may be a quantization error. Accordingly, the reference sample filtering process may be performed for each prediction mode used for intra prediction to reduce such an error.
- the prediction signal (or prediction block) generated by the inter prediction unit 181 or the intra prediction unit 182 is used to generate a reconstruction signal (or reconstruction block) or a differential signal (or differential block). It can be used to generate.
- FIG. 2 is a schematic block diagram of a decoder in which encoding of a still image or video signal is performed according to an embodiment to which the present invention is applied.
- the decoder 200 includes an entropy decoding unit 210, an inverse quantization unit 220, an inverse transform unit 230, an adder 235, a filtering unit 240, and a decoded picture buffer (DPB).
- Buffer Unit (250) the prediction unit 260 may be configured.
- the predictor 260 may include an inter predictor 261 and an intra predictor 262.
- the reconstructed video signal output through the decoder 200 may be reproduced through the reproducing apparatus.
- the decoder 200 receives a signal (ie, a bit stream) output from the encoder 100 of FIG. 1, and the received signal is entropy decoded through the entropy decoding unit 210.
- the inverse quantization unit 220 obtains a transform coefficient from the entropy decoded signal using the quantization step size information.
- the inverse transform unit 230 applies an inverse transform scheme to inverse transform the transform coefficients to obtain a residual signal (or a differential block).
- the adder 235 outputs the obtained difference signal (or difference block) from the prediction unit 260 (that is, the prediction signal (or prediction block) output from the inter prediction unit 261 or the intra prediction unit 262. ) Generates a reconstructed signal (or a reconstruction block).
- the filtering unit 240 applies filtering to the reconstructed signal (or the reconstructed block) and outputs the filtering to the reproduction device or transmits the decoded picture buffer unit 250 to the reproduction device.
- the filtered signal transmitted to the decoded picture buffer unit 250 may be used as a reference picture in the inter predictor 261.
- the embodiments described by the filtering unit 160, the inter prediction unit 181, and the intra prediction unit 182 of the encoder 100 are respectively the filtering unit 240, the inter prediction unit 261, and the decoder of the decoder. The same may be applied to the intra predictor 262.
- the inter prediction unit 261 may use backward motion information during inter prediction (or inter picture prediction). Detailed description thereof will be described later.
- a still image or video compression technique uses a block-based image compression method.
- the block-based image compression method is a method of processing an image by dividing the image into specific block units, and may reduce memory usage and calculation amount.
- FIG. 3 is a diagram for describing a partition structure of a coding unit that may be applied to the present invention.
- the encoder splits one image (or picture) into units of a coding tree unit (CTU) in a rectangular shape.
- CTU coding tree unit
- one CTU is sequentially encoded according to a raster scan order.
- the size of the CTU may be set to any one of 64 ⁇ 64, 32 ⁇ 32, and 16 ⁇ 16.
- the encoder may select and use the size of the CTU according to the resolution of the input video or the characteristics of the input video.
- the CTU includes a coding tree block (CTB) for luma components and a CTB for two chroma components corresponding thereto.
- CTB coding tree block
- One CTU may be divided into a quad-tree structure. That is, one CTU has a square shape and is divided into four units having a half horizontal size and a half vertical size to generate a coding unit (CU). have. This partitioning of the quad-tree structure can be performed recursively. That is, a CU is hierarchically divided into quad-tree structures from one CTU.
- CU coding unit
- the CU refers to a basic unit of coding in which an input image is processed, for example, intra / inter prediction is performed.
- the CU includes a coding block (CB) for a luma component and a CB for two chroma components corresponding thereto.
- CB coding block
- the size of a CU may be set to any one of 64 ⁇ 64, 32 ⁇ 32, 16 ⁇ 16, and 8 ⁇ 8.
- the root node of the quad-tree is associated with the CTU.
- the quad-tree is split until it reaches a leaf node, which corresponds to a CU.
- the CTU may not be divided according to the characteristics of the input image.
- the CTU corresponds to a CU.
- a node that is no longer divided ie, a leaf node
- CU a node that is no longer divided
- CU a node that is no longer divided
- CU a node corresponding to nodes a, b, and j are divided once in the CTU and have a depth of one.
- a node (ie, a leaf node) that is no longer divided in a lower node having a depth of 2 corresponds to a CU.
- CU (c), CU (h) and CU (i) corresponding to nodes c, h and i are divided twice in the CTU and have a depth of two.
- a node that is no longer partitioned (ie, a leaf node) in a lower node having a depth of 3 corresponds to a CU.
- CU (d), CU (e), CU (f), and CU (g) corresponding to nodes d, e, f, and g are divided three times in the CTU, Has depth.
- the maximum size or the minimum size of the CU may be determined according to characteristics (eg, resolution) of the video image or in consideration of encoding efficiency. Information about this or information capable of deriving the information may be included in the bitstream.
- a CU having a maximum size may be referred to as a largest coding unit (LCU), and a CU having a minimum size may be referred to as a smallest coding unit (SCU).
- LCU largest coding unit
- SCU smallest coding unit
- a CU having a tree structure may be hierarchically divided with predetermined maximum depth information (or maximum level information).
- Each partitioned CU may have depth information. Since the depth information indicates the number and / or degree of division of the CU, the depth information may include information about the size of the CU.
- the size of the SCU can be obtained by using the size and maximum depth information of the LCU. Or conversely, using the size of the SCU and the maximum depth information of the tree, the size of the LCU can be obtained.
- information indicating whether the corresponding CU is split may be transmitted to the decoder.
- This split mode is included in all CUs except the SCU. For example, if the flag indicating whether to split or not is '1', the CU is divided into 4 CUs again. If the flag indicating whether to split or not is '0', the CU is not divided further. Processing may be performed.
- a CU is a basic unit of coding in which intra prediction or inter prediction is performed.
- HEVC divides a CU into prediction units (PUs) in order to code an input image more effectively.
- the PU is a basic unit for generating a prediction block, and may generate different prediction blocks in PU units within one CU. However, PUs belonging to one CU are not mixed with intra prediction and inter prediction, and PUs belonging to one CU are coded by the same prediction method (ie, intra prediction or inter prediction).
- the PU is not divided into quad-tree structures, but is divided once in a predetermined form in one CU. This will be described with reference to the drawings below.
- FIG. 4 is a diagram for explaining a prediction unit applicable to the present invention.
- the PU is divided differently according to whether an intra prediction mode or an inter prediction mode is used as a coding mode of a CU to which the PU belongs.
- FIG. 4A illustrates a PU when an intra prediction mode is used
- FIG. 4B illustrates a PU when an inter prediction mode is used.
- N ⁇ N type PU when divided into N ⁇ N type PU, one CU is divided into four PUs, and different prediction blocks are generated for each PU unit.
- the division of the PU may be performed only when the size of the CB for the luminance component of the CU is the minimum size (that is, the CU is the SCU).
- one CU has 8 PU types (ie, 2N ⁇ 2N). , N ⁇ N, 2N ⁇ N, N ⁇ 2N, nL ⁇ 2N, nR ⁇ 2N, 2N ⁇ nU, 2N ⁇ nD).
- PU partitioning in the form of N ⁇ N may be performed only when the size of the CB for the luminance component of the CU is the minimum size (that is, the CU is the SCU).
- AMP Asymmetric Motion Partition
- 'n' means a 1/4 value of 2N.
- AMP cannot be used when the CU to which the PU belongs is a CU of the minimum size.
- an optimal partitioning structure of a coding unit (CU), a prediction unit (PU), and a transformation unit (TU) is subjected to the following process to perform a minimum rate-distortion. It can be determined based on the value. For example, looking at the optimal CU partitioning process in 64 ⁇ 64 CTU, rate-distortion cost can be calculated while partitioning from a 64 ⁇ 64 CU to an 8 ⁇ 8 CU.
- the specific process is as follows.
- the partition structure of the optimal PU and TU that generates the minimum rate-distortion value is determined by performing inter / intra prediction, transform / quantization, inverse quantization / inverse transform, and entropy encoding for a 64 ⁇ 64 CU.
- the 32 ⁇ 32 CU is subdivided into four 16 ⁇ 16 CUs, and a partition structure of an optimal PU and TU that generates a minimum rate-distortion value for each 16 ⁇ 16 CU is determined.
- 16 ⁇ 16 blocks by comparing the sum of the rate-distortion values of the 16 ⁇ 16 CUs calculated in 3) above with the rate-distortion values of the four 8 ⁇ 8 CUs calculated in 4) above. Determine the partition structure of the optimal CU within. This process is similarly performed for the remaining three 16 ⁇ 16 CUs.
- a prediction mode is selected in units of PUs, and prediction and reconstruction are performed in units of actual TUs for the selected prediction mode.
- the TU means a basic unit in which actual prediction and reconstruction are performed.
- the TU includes a transform block (TB) for a luma component and a TB for two chroma components corresponding thereto.
- TB transform block
- the TUs are hierarchically divided into quad-tree structures from one CU to be coded.
- the TU divided from the CU can be further divided into smaller lower TUs.
- the size of the TU may be set to any one of 32 ⁇ 32, 16 ⁇ 16, 8 ⁇ 8, and 4 ⁇ 4.
- a root node of the quad-tree is associated with a CU.
- the quad-tree is split until it reaches a leaf node, which corresponds to a TU.
- the CU may not be divided according to the characteristics of the input image.
- the CU corresponds to a TU.
- a node ie, a leaf node
- TU (a), TU (b), and TU (j) corresponding to nodes a, b, and j are divided once in a CU and have a depth of 1.
- FIG. 3B TU (a), TU (b), and TU (j) corresponding to nodes a, b, and j are divided once in a CU and have a depth of 1.
- a node (ie, a leaf node) that is no longer divided in a lower node having a depth of 2 corresponds to a TU.
- TU (c), TU (h), and TU (i) corresponding to nodes c, h, and i are divided twice in a CU and have a depth of two.
- a node that is no longer partitioned (ie, a leaf node) in a lower node having a depth of 3 corresponds to a CU.
- TU (d), TU (e), TU (f), and TU (g) corresponding to nodes d, e, f, and g are divided three times in a CU. Has depth.
- a TU having a tree structure may be hierarchically divided with predetermined maximum depth information (or maximum level information). Each divided TU may have depth information. Since the depth information indicates the number and / or degree of division of the TU, it may include information about the size of the TU.
- information indicating whether the corresponding TU is split may be delivered to the decoder.
- This partitioning information is included in all TUs except the smallest TU. For example, if the value of the flag indicating whether to split is '1', the corresponding TU is divided into four TUs again. If the value of the flag indicating whether to split is '0', the corresponding TU is no longer divided.
- the decoded portion of the current picture or other pictures in which the current processing unit is included may be used to reconstruct the current processing unit in which decoding is performed.
- Intra picture or I picture which uses only the current picture for reconstruction, i.e. performs only intra picture prediction, predicts a picture (slice) using at most one motion vector and reference index to predict each unit
- a picture using a predictive picture or P picture (slice), up to two motion vectors, and a reference index (slice) may be referred to as a bi-predictive picture or a B picture (slice).
- Intra prediction means a prediction method that derives the current processing block from data elements (eg, sample values, etc.) of the same decoded picture (or slice). That is, a method of predicting pixel values of the current processing block by referring to reconstructed regions in the current picture.
- data elements eg, sample values, etc.
- Inter Inter prediction (or inter screen prediction)
- Inter prediction means a prediction method of deriving a current processing block based on data elements (eg, sample values or motion vectors, etc.) of pictures other than the current picture. That is, a method of predicting pixel values of the current processing block by referring to reconstructed regions in other reconstructed pictures other than the current picture.
- data elements eg, sample values or motion vectors, etc.
- Inter prediction (or inter picture prediction) is a technique for removing redundancy existing between pictures, and is mostly performed through motion estimation and motion compensation.
- FIG. 5 is a diagram illustrating a direction of inter prediction as an embodiment to which the present invention may be applied.
- inter prediction includes uni-directional prediction that uses only one past picture or a future picture as a reference picture on a time axis with respect to one block, and bidirectional prediction that simultaneously refers to past and future pictures. Bi-directional prediction).
- uni-directional prediction includes forward direction prediction using one reference picture displayed (or output) before the current picture in time and 1 displayed (or output) after the current picture in time. It can be divided into backward direction prediction using two reference pictures.
- the motion parameter (or information) used to specify which reference region (or reference block) is used to predict the current block in the inter prediction process is an inter prediction mode (where
- the inter prediction mode may indicate a reference direction (i.e., unidirectional or bidirectional) and a reference list (i.e., L0, L1 or bidirectional), a reference index (or reference picture index or reference list index), Contains motion vector information.
- the motion vector information may include a motion vector, a motion vector prediction (MVP), or a motion vector difference (MVD).
- the motion vector difference value means a difference value between the motion vector and the motion vector prediction value.
- motion parameters for one direction are used. That is, one motion parameter may be needed to specify the reference region (or reference block).
- Bidirectional prediction uses motion parameters for both directions.
- up to two reference regions may be used.
- the two reference regions may exist in the same reference picture or may exist in different pictures, respectively. That is, up to two motion parameters may be used in the bidirectional prediction scheme, and two motion vectors may have the same reference picture index or different reference picture indexes. In this case, all of the reference pictures may be displayed (or output) before or after the current picture in time.
- the encoder performs motion estimation to find the reference region most similar to the current processing block from the reference pictures in the inter prediction process.
- the encoder may provide a decoder with a motion parameter for the reference region.
- the encoder / decoder may obtain a reference region of the current processing block using the motion parameter.
- the reference region exists in a reference picture having the reference index.
- the pixel value or interpolated value of the reference region specified by the motion vector may be used as a predictor of the current processing block. That is, using motion information, motion compensation is performed to predict an image of a current processing block from a previously decoded picture.
- a method of acquiring a motion vector prediction value mvp using motion information of previously coded blocks and transmitting only a difference value mvd thereof may be used. That is, the decoder obtains a motion vector prediction value of the current processing block using motion information of other decoded blocks, and obtains a motion vector value for the current processing block using the difference value transmitted from the encoder. In obtaining the motion vector prediction value, the decoder may obtain various motion vector candidate values by using motion information of other blocks that are already decoded, and obtain one of them as the motion vector prediction value.
- a set of previously decoded pictures are stored in a decoded picture buffer (DPB) for decoding the remaining pictures.
- DPB decoded picture buffer
- a reference picture refers to a picture including a sample that can be used for inter prediction in a decoding process of a next picture in decoding order.
- a reference picture set refers to a set of reference pictures associated with a picture, and is composed of all pictures previously associated in decoding order.
- the reference picture set may be used for inter prediction of an associated picture or a picture following an associated picture in decoding order. That is, reference pictures maintained in the decoded picture buffer DPB may be referred to as a reference picture set.
- the encoder may provide the decoder with reference picture set information in a sequence parameter set (SPS) (ie, a syntax structure composed of syntax elements) or each slice header.
- SPS sequence parameter set
- a reference picture list refers to a list of reference pictures used for inter prediction of a P picture (or slice) or a B picture (or slice).
- the reference picture list may be divided into two reference picture lists, and may be referred to as reference picture list 0 (or L0) and reference picture list 1 (or L1), respectively.
- a reference picture belonging to reference picture list 0 may be referred to as reference picture 0 (or L0 reference picture)
- a reference picture belonging to reference picture list 1 may be referred to as reference picture 1 (or L1 reference picture).
- one reference picture list i.e., reference picture list 0
- two reference picture lists i.e., reference Picture list 0 and reference picture list 1
- Such information for distinguishing a reference picture list for each reference picture may be provided to the decoder through reference picture set information.
- the decoder adds the reference picture to the reference picture list 0 or the reference picture list 1 based on the reference picture set information.
- a reference picture index (or reference index) is used to identify any one specific reference picture in the reference picture list.
- a sample of the prediction block for the inter predicted current processing block is obtained from the sample value of the corresponding reference region in the reference picture identified by the reference picture index.
- the corresponding reference region in the reference picture represents the region of the position indicated by the horizontal component and the vertical component of the motion vector.
- Fractional sample interpolation is used to generate predictive samples for noninteger sample coordinates, except when the motion vector has an integer value. For example, a motion vector of one quarter of the distance between samples may be supported.
- fractional sample interpolation of luminance components applies an 8-tap filter in the horizontal and vertical directions, respectively.
- fractional sample interpolation of the color difference component applies a 4-tap filter in the horizontal direction and the vertical direction, respectively.
- FIG 6 illustrates integer and fractional sample positions for quarter sample interpolation, as an embodiment to which the present invention may be applied.
- the shaded block in which the upper-case letter (A_i, j) is written indicates the integer sample position
- the shaded block in which the lower-case letter (x_i, j) is written is the fractional sample position. Indicates.
- Fractional samples are generated by applying interpolation filters to integer sample values in the horizontal and vertical directions, respectively.
- an 8-tap filter may be applied to four integer sample values on the left side and four integer sample values on the right side based on the fractional sample to be generated.
- a merge mode and advanced motion vector prediction may be used to reduce the amount of motion information.
- Merge mode refers to a method of deriving a motion parameter (or information) from a neighboring block spatially or temporally.
- the set of candidates available in merge mode is composed of spatial neighbor candidates, temporal candidates and generated candidates.
- FIG. 7 illustrates a position of a spatial candidate as an embodiment to which the present invention may be applied.
- each spatial candidate block is available according to the order of ⁇ A1, B1, B0, A0, B2 ⁇ . In this case, when the candidate block is encoded in the intra prediction mode and there is no motion information, or when the candidate block is located outside the current picture (or slice), the candidate block is not available.
- the spatial merge candidate can be constructed by excluding unnecessary candidate blocks from candidate blocks of the current processing block. For example, when the candidate block of the current prediction block is the first prediction block in the same coding block, the candidate block having the same motion information may be excluded except for the corresponding candidate block.
- the temporal merge candidate configuration process is performed in the order of ⁇ T0, T1 ⁇ .
- the block when the right bottom block T0 of the collocated block of the reference picture is available, the block is configured as a temporal merge candidate.
- the colocated block refers to a block existing at a position corresponding to the current processing block in the selected reference picture.
- the block T1 located at the center of the collocated block is configured as a temporal merge candidate.
- the maximum number of merge candidates may be specified in the slice header. If the number of merge candidates is larger than the maximum number, the number of spatial candidates and temporal candidates smaller than the maximum number is maintained. Otherwise, the number of merge candidates is generated by combining the candidates added so far until the maximum number of candidates becomes the maximum (ie, combined bi-predictive merging candidates). .
- the encoder constructs a merge candidate list in the above manner and performs motion estimation to merge candidate block information selected from the merge candidate list into a merge index (for example, merge_idx [x0] [y0] '). Signal to the decoder.
- a merge index for example, merge_idx [x0] [y0] '.
- the B1 block is selected from the merge candidate list.
- “index 1” may be signaled to the decoder as a merge index.
- the decoder constructs a merge candidate list similarly to the encoder, and derives the motion information of the current block from the motion information of the candidate block corresponding to the merge index received from the encoder in the merge candidate list.
- the decoder generates a prediction block for the current processing block based on the derived motion information (ie, motion compensation).
- the AMVP mode refers to a method of deriving a motion vector prediction value from neighboring blocks.
- horizontal and vertical motion vector difference (MVD), reference index, and inter prediction modes are signaled to the decoder.
- the horizontal and vertical motion vector values are calculated using the derived motion vector prediction value and the motion vector difference (MVD) provided from the encoder.
- the encoder constructs a motion vector predictor candidate list and performs motion estimation to perform a motion estimation flag (ie, candidate block information) selected from the motion vector predictor candidate list (for example, mvp_lX_flag [x0] [y0). ] ') Is signaled to the decoder.
- the decoder constructs a motion vector predictor candidate list similarly to the encoder, and derives a motion vector predictor of the current processing block using the motion information of the candidate block indicated by the motion reference flag received from the encoder in the motion vector predictor candidate list.
- the decoder obtains a motion vector value for the current processing block by using the derived motion vector prediction value and the motion vector difference value transmitted from the encoder.
- the decoder generates a prediction block for the current processing block based on the derived motion information (ie, motion compensation).
- the first spatial motion candidate is selected from the set of ⁇ A0, A1 ⁇ located on the left side
- the second spatial motion candidate is selected from the set of ⁇ B0, B1, B2 ⁇ located above.
- the candidate configuration is terminated, but if less than two, the temporal motion candidate is added.
- FIG. 8 is a diagram illustrating an inter prediction method as an embodiment to which the present invention is applied.
- a decoder decodes a motion parameter for a processing block (eg, a prediction unit) (S801).
- the decoder may decode the merge index signaled from the encoder.
- the motion parameter of the current processing block can be derived from the motion parameter of the candidate block indicated by the merge index.
- the decoder may decode horizontal and vertical motion vector difference (MVD), reference index, and inter prediction mode signaled from the encoder.
- the motion vector prediction value may be derived from the motion parameter of the candidate block indicated by the motion reference flag, and the motion vector value of the current processing block may be derived using the motion vector prediction value and the received motion vector difference value.
- the decoder performs motion compensation on the prediction unit by using the decoded motion parameter (or information) (S802).
- the encoder / decoder performs motion compensation that predicts an image of the current unit from a previously decoded picture by using the decoded motion parameter.
- FIG. 9 is a diagram illustrating a motion compensation process as an embodiment to which the present invention may be applied.
- FIG. 9 illustrates a case in which a motion parameter for a current block to be encoded in a current picture is unidirectional prediction, a second picture in LIST0, LIST0, and a motion vector (-a, b). do.
- the current block is predicted using values of positions (ie, sample values of reference blocks) that are separated from the current block by (-a, b) in the second picture of LIST0.
- another reference list (eg, LIST1), a reference index, and a motion vector difference value are transmitted so that the decoder derives two reference blocks and predicts the current block value based on the reference block.
- the present invention proposes a method of encoding / decoding an image by predicting motion information in the reverse direction in order to improve the accuracy of prediction of inter prediction (ie, inter prediction).
- the present invention proposes a method for determining the priority of motion information predicted backward.
- a method of applying backward motion predicted motion information to a motion information candidate list is proposed.
- the backward motion information prediction method refers to a method of predicting motion information of a current picture using motion information of a reference picture present in a reference list.
- the backward motion vector may mean a vector from any position in the current picture to any position in the reference picture, derived from a motion vector of any position in the reference picture.
- the backward motion information may include a backward motion vector and / or reference picture information (eg, including a reference picture list and / or a reference picture index).
- a backward motion vector e.g, including a reference picture list and / or a reference picture index.
- FIG. 10 is a diagram for describing backward prediction motion information according to an embodiment to which the present invention may be applied.
- the encoder / decoder may first select a reference picture 1002 from a reference picture list of the current picture 1001.
- the encoder / decoder may project a motion vector 1004 at any position 1007 in the reference picture 1002 to the current picture 1001.
- the encoder / decoder may scale the motion vector 1004 at any location 1007 in the reference picture 1002 and transform it into a vector 1006 that is directed to the current picture 1001.
- scaled motion vector (or scaled motion information) 1006 is arbitrary location 1007 in reference picture 1002, which scales motion vector 1004 of arbitrary location 1007 in reference picture 1002.
- the process of projecting the motion vector 1004 of the arbitrary position 1007 in the reference picture 1002 to the current picture 1001 may apply a scaling operation of the motion vector.
- the scaled motion vector 1006 may include a picture order count (POC) difference between the current picture 1001 and the reference picture 1002 and a reference picture of the reference picture 1002 and the reference picture 1002. It can be calculated through vector scaling based on the POC difference between 1003.
- POC picture order count
- FIG. 10 is a diagram for describing a backward motion vector (or reverse motion information).
- a reference picture 1003 of the reference picture 1002 may be located between the current picture 1001 and the reference picture 1002. .
- the motion vector 1004 and the scaled motion vector 1006 at an arbitrary position 1007 in the reference picture 1002 have the same sign (that is, a vector having a different magnitude but the same direction). )
- a position corresponding to an arbitrary position 1007 of the reference picture 1002 may be obtained from the current picture by using the vector 1006 in which the reference picture 1002 refers to the current picture 1001. May be defined as a corresponding block 1005.
- a corresponding block 1005 may refer to a block 1005 in the current picture 1001, identified by the scaled motion vector 1006.
- a motion vector (i.e., a backward motion vector) directed from a corresponding block 1005 of the current picture 1001 to an arbitrary position 1007 of the reference picture 1002 is obtained from scaling (i.e., scaled motion vector) ( It becomes a vector which takes the opposite signs of each component of 1006), and the index information of the reference list for this vector and the reference picture can be defined as backward motion information.
- the encoder / decoder takes an opposite sign on each component of the scaled motion vector 1006 and reverses it from the corresponding block 1005 to the block 1007 in the reference picture 1002 (ie, scaled motion vector 1006). Can be derived from the same size and opposite directions.
- the encoder / decoder may perform the backward motion information prediction described above while searching all regions in the reference picture 1002.
- the encoder / decoder is backward motion if any position 1007 of the reference picture 1002 does not have motion information 1004 (e.g., encoded / decoded by intra picture prediction (or intra prediction)). Information prediction may be skipped (ie, other areas within reference picture 1002 may be searched).
- motion information 1004 e.g., encoded / decoded by intra picture prediction (or intra prediction)
- Information prediction may be skipped (ie, other areas within reference picture 1002 may be searched).
- the encoder / decoder may perform the backward motion information prediction described above with respect to all reference pictures existing in the reference picture list of the current picture 1001. A backward motion information prediction process will be described with reference to the following drawings.
- FIG. 11 is a diagram for describing a backward motion information prediction process as an embodiment to which the present invention may be applied.
- the backward motion information prediction process will be described in detail with reference to FIG. 11 for convenience of description, but the motion information prediction process is not limited thereto.
- the encoder / decoder selects a reference picture from a reference picture list of the current picture (S1101).
- the encoder / decoder selects a reference picture and then selects an arbitrary block within the selected reference picture (S1102). In this case, the encoder / decoder may select an arbitrary block within the selected reference picture by using various scan methods.
- the block can be selected.
- the encoder / decoder determines whether the block in the selected reference picture is a block having motion information (S1103).
- step S1103 if the block in the selected reference picture is not a block having the motion information, the encoder / decoder moves to the next block of the selected block in the reference picture (S1104).
- the encoder / decoder scales the motion information of the block in the reference picture toward the current picture ( S1105).
- the encoder / decoder may calculate a vector in a direction in which the reference picture refers to the current picture by applying a vector scaling operation.
- the encoder / decoder may apply a vector scaling operation to transform the motion vector (or motion information) of the block in the reference picture from the block in the reference picture to the vector toward the block in the current picture.
- the scaled motion vector may be scaled based on the POC difference between the current picture and the reference picture and the POC difference between the reference picture and the reference picture of the reference picture.
- the encoder / decoder scales the motion vector (or motion information) of the block in the reference picture toward the current picture, and then whether the scaled motion vector corresponds to the area of the current picture (whether it specifies the area of the current picture). It is determined (S1106). That is, the encoder / decoder may determine whether an end point (or end point) of the scaled motion vector is located in the region of the current picture.
- the encoder / decoder moves to the next block of the selected block in the reference picture (S1104).
- the encoder / decoder stores an application by applying an opposite sign to the vector calculated at the position of the corresponding block. (S1107).
- the encoder / decoder places the vector with the opposite sign of the scaled motion vector (i.e., the backward motion vector) at the corresponding block position of the current picture. Can be mapped and stored.
- the corresponding block 1005 may have the same size and shape as the found PU.
- the shape of the PU is 2N ⁇ N
- the shape of the corresponding block 1005 may also be 2N ⁇ N.
- backward motion information may be stored in units of the corresponding block 1005.
- the corresponding block 1005 may be determined in the fixed size unit. For example, when motion information of a PU in a reference picture is stored in units of 4 ⁇ 4 and the current PU is 8 ⁇ 4 in size, each motion is stored in units of 4 ⁇ 4 when stored in a decoded picture buffer (DPB). Information can be stored. In this case, the encoder / decoder may search for motion information in units of 4 ⁇ 4 and store backward motion information in units of corresponding blocks (4 ⁇ 4 units) 1005.
- DPB decoded picture buffer
- the corresponding block 1005 having an 8 ⁇ 8 size may be divided into four 4 ⁇ 4 sized blocks, and backward motion information of the corresponding block 1005 may be equally stored in each divided block.
- the encoder / decoder maps and stores the backward motion information to the corresponding block position of the current picture, and then determines whether the block in the selected reference picture is the last block of the reference picture (S1108).
- step S1108 As a result of determining whether the selected block is the last block in the reference picture in step S1108, if the selected block is not the last block, the encoder / decoder moves to the next block of the selected block in the reference picture (S1104).
- the encoder / decoder determines whether the selected reference picture is the last picture in the reference picture list ( S1109).
- step S1109 As a result of determining whether the reference picture selected in step S1109 is the last picture of the reference picture list, when the reference picture is not the last picture of the reference picture list, the encoder / decoder moves to the next reference picture of the reference picture list (S1110).
- the encoder / decoder may end the backward motion information prediction.
- the encoder / decoder may perform the above backward motion information prediction for all regions of the reference picture and all reference pictures in the reference list (or reference picture list).
- a motion vector projected backward by another reference picture of the reference list may correspond to the same corresponding block of the current picture.
- the encoder / decoder must determine the priority between the backward prediction motion information. .
- the same corresponding block may be specified by a scaled motion vector derived from motion information of different blocks with reference pictures.
- the encoder / decoder may determine the priority between the backward motion information.
- the present invention is not limited thereto.
- various methods may be used for priority selection (or determination) between backward motion information.
- the above four methods may be individually applied, or the priority between the backward motion information may be determined (or assigned) by a plurality of methods (for example, two to three).
- the encoder / decoder may give higher priority to backward predictive motion information derived from the reference picture nearest to the current picture. It demonstrates with reference to the following drawings.
- FIG. 12 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- the first method includes the same position of the current picture 1201 in which the backward predicted motion vector at an arbitrary position of the reference picture 1 1202 and the backward predicted motion vector at an arbitrary position of the reference picture 2 1203 are the same. May be applied when the corresponding block 1208 of.
- the motion vector 1204 at an arbitrary position in reference picture 1 1202 and the motion vector 1206 at an arbitrary position in reference picture 2 1203 are scaled to face the current picture 1201, scaling is performed.
- the method may be applied when the specified motion vectors 1205 and 1207 specify (or indicate) corresponding blocks 1204 at the same location of the current picture 1201.
- the encoder / decoder may give higher priority to the backward prediction motion information derived from reference picture 1 1202 located closer to the current picture 1201.
- the encoder / decoder may determine the distance between the current picture 1201 and the reference picture based on the POC difference. That is, since the POC difference between the current picture 1201 and the reference picture 1 1202 is 1, and the POC difference between the current picture 1201 and the reference picture 2 1203 is 2, the encoder / decoder is a reference having a small POC difference. Higher priority may be given to backward motion information derived from Picture 1 1202.
- the encoder / decoder may give higher priority to the derived backward predictive motion information when the reference picture of the reference picture exists at a short distance from the current picture. It demonstrates with reference to the following drawings.
- FIG. 13 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- the motion vector 1305 of a block in reference picture 1130 and the motion vector 1307 of a block in reference picture 2130 are scaled to face the current picture 1301,
- the method may be applied when the motion vectors 1306 and 1308 specify (or indicate) corresponding blocks 1305 of the same location of the current picture 1301.
- the backward motion derived from the reference picture 2130 at which the reference picture 1302 of the reference picture 21303 is closer to the current picture 1301 than the reference picture 1304 of the reference picture 1130 is present. Higher priority can be given to the information.
- the encoder / decoder may determine the distance between the current picture 1301 and the reference pictures 1304 and 1302 of the reference pictures 1302 and 1303 based on the POC difference. That is, the POC difference between the current picture 1301 and the reference picture 1304 of the reference picture 1130 is 3, and the POC difference between the current picture 1301 and the reference picture 1302 of the reference picture 21303 is 1. Because of this, the encoder / decoder can give higher priority to the backward motion information derived from reference picture 2 1303 having a small POC difference.
- the encoder / decoder may give higher priority to the derived backward prediction motion information when the POC difference between the reference picture and the reference picture of the reference picture and the POC difference between the reference picture and the current picture have the same code.
- the motion vector 1305 of the reference picture 1130 2 and the motion vector 1306 scaled to face the current picture 1301 are opposite in directions (ie, reference picture 11302).
- the POC difference between the reference picture 1304 of the picture 1130 and the POC difference between the reference picture 1130 and the current picture 1301 are opposite signs).
- the motion vector 1307 of reference picture 21303 and the motion vector 1308 scaled to face the current picture 1301 are the same in direction (i.e., reference picture 21303 and reference picture 21303).
- the POC difference between the reference picture 1302 and the POC difference between the reference picture 2130 and the current picture 1301 is the same code).
- the encoder / decoder may give higher priority to backward motion information derived from reference picture 21303 having the same direction of motion vector 1307 and scaled motion vector 1308.
- the encoder / decoder may determine a difference between a block in a reference picture and a block in a reference picture of the reference picture specified by motion information of a block in the reference picture (that is, a block identified by motion information of a block in the reference picture). Alternatively, higher priority may be given to the reverse prediction motion information derived when the difference value is small). It demonstrates with reference to the following drawings.
- FIG. 14 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- the motion vector 1409 of the block 1405 in the reference picture 1140 and the motion vector 1411 of the block 1407 in the reference picture 2140 are directed toward the current picture 1401.
- the method may be applied when the scaled motion vectors 1410 and 1412 specify (or indicate) corresponding blocks 1404 of the same location of the current picture 1401.
- Block 1405 in reference picture 1140 and block in reference picture 1403 of reference picture 1140 specified by the motion information 1409 of the block 1405 ie, reference picture 1140
- a block in reference picture 1402 of reference picture 21403 specified by block 1407 of reference picture 21403 and motion information 1411 of block 1407 ie, reference picture 21403.
- Reverse direction derived when the difference (or difference) between the blocks (1408) of reference picture 1402 of reference picture 21403 matched by motion information 1411 of inner block 1407 has a smaller value
- Higher priority may be given to motion information.
- a method of calculating a difference (or difference value) between blocks may be calculated by various methods.
- the difference (or difference) between blocks is calculated by methods such as Mean Square Error (MSE), Mean Absolute Deviation (MAD), and Sum of Squared Error. Can be.
- MSE Mean Square Error
- MAD Mean Absolute Deviation
- Sum of Squared Error Can be.
- the lowest priority may be given (or assigned).
- various methods may be used as the priority determining method.
- the above-described methods may be used individually, or a combination of a plurality of methods may be used.
- additional information may be stored in addition to the backward motion information in the backward motion information prediction process.
- the encoder / decoder may include a POC difference value between the current picture and a reference picture, a POC difference value between a reference picture of the current picture and a reference picture, and any block of the reference picture and a block of the reference picture of the reference picture.
- the difference (or difference) may need to be stored.
- the encoder / decoder may apply a method of prioritizing the values that are filled first without any other condition in order to perform the data without storing other values other than the backward prediction motion information.
- the encoder / decoder may first apply a higher priority to the stored backward motion information mapped to the corresponding block so that backward prediction motion information may be stored without additional information when storing the motion information.
- the search order of the reference list is set to the far picture starting from the reference picture close to the POC from the current picture, the same result as that of the first method can be obtained.
- a higher priority is given to the backward motion information mapped and stored in the corresponding block first. In this case, the same result as in the method described with reference to FIG. 12 may be obtained.
- 15 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- the encoder / decoder When the encoder / decoder performs backward motion information prediction within the reference picture, a spiral search that searches while rotating from the center of the reference picture to the edge of the reference picture as shown in FIG. 15 instead of the raster scan oder. Can be applied. In this case, the encoder / decoder may give higher priority as it gets closer to the center of the reference picture.
- the method of determining the priority between the backward motion information when the plurality of scaled motion information indicates the same corresponding block when a plurality of pieces of backward motion information exist in a current block (HEVC, for example, a prediction unit (PU)) when using motion information obtained through the backward motion information prediction process, the encoder / decoder encodes / A method of selecting backward motion information to be used in the decoding process will be described.
- HEVC a prediction unit
- the following method may be applied to determine (or assign) the priority.
- the encoder / decoder may use backward motion information of a specific position in the current block as backward motion information of the current block.
- the encoder / decoder may use backward motion information having a value different from motion information of a neighboring (or neighboring) block of the current block as backward motion information of the current block.
- the encoder / decoder may list backward motion information and use the plurality of backward motion information as backward motion information of the current block.
- priority of the backward motion information may be determined (or given) by a method other than the above method, and between the backward motion information by a method combining a plurality of the above methods. Priority may be determined (or assigned).
- the encoder / decoder may give higher priority to the backward motion information of the corresponding block existing at a specific position of the current block among the plurality of backward motion information. It demonstrates with reference to the following drawings.
- 16 is a diagram illustrating a prioritization method according to an embodiment of the present invention.
- the upper left sample 1601 of the current block may be a sample having horizontal and vertical coordinates [0,0] based on a 2N ⁇ 2N block.
- the center sample 1602 of the current block may be a sample having horizontal and vertical coordinates of [N, N] based on the 2N ⁇ 2N block.
- the lower right sample 1603 of the current block may be a sample having horizontal and vertical coordinates of [2N-1, 2N-1] based on the 2N ⁇ 2N block.
- the encoder / decoder may select by weighting backward motion information present at positions of the upper left sample 1601, the center sample 1602, or the lower right sample 1603.
- One location or several locations at the same time may be used in the current block for weighting, and other locations may be applied in addition to the three locations illustrated in FIG. 16.
- the encoder / decoder may select the backward motion information closest to the specific location.
- the encoder / decoder may store the backward motion information present at the position of the upper left sample 1601, the center sample 1602, or the lower right sample 1603 of the current block, or the backward motion information located at the closest distance from the position. Higher priority can be given.
- motion information of a position (right-bottom RB) to which spatial motion information is not applied can also be used.
- the position of a specific sample may be designated as a position other than the above-described three positions according to the characteristics of the image, the complexity of the calculation, or the like, and the position of the specific sample may be changed in the encoding process.
- the encoder / decoder may use backward motion information having a value different from motion information of a neighboring (or neighboring) block of the current block as backward motion information of the current block.
- the backward motion information may be added (or inserted) to the motion information candidate list.
- the backward motion information may be inserted into the motion information candidate list of the merge mode or the advanced motion vector prediction (AMVP) mode.
- AMVP advanced motion vector prediction
- the encoder since the encoder may not have a significant meaning as data when the data has the same value as the motion information of the neighboring (or neighboring) blocks (that is, it may be only duplicate motion information), the encoder / decoder may move around. If the value is different from the information, higher priority can be given and used as backward motion information of the current block.
- the encoder / decoder may list the backward motion information and store a plurality of backward motion information for use in the encoding / decoding process.
- the encoder / decoder may configure a backward motion information list by setting a specific number in advance, or may configure the backward motion information list by storing all backward motion information without determining the number in advance.
- the encoder / decoder is assigned among four backward motion information. Based on the priority, two can be selected and stored in the backward motion information list and used in the encoding / decoding process.
- the first method and the second method described above may be applied respectively or simultaneously.
- the encoder / decoder may perform pruning to avoid duplication of backward motion information.
- the encoder / decoder overlaps the current block when a plurality of corresponding blocks overlap with the current block. Higher priority may be given to backward motion information of a corresponding block having a larger area.
- the encoder / decoder has a larger overlapping area of 8 Higher priority can be given to the backward motion information of the corresponding block of size ⁇ 8.
- the boundary of the current PU may be located in the corresponding block.
- one of the two corresponding blocks may have all 8x4 size parts in the current PU.
- the other corresponding block may have only a 4 ⁇ 4 size part that is half the size in the current PU and the remaining 4 ⁇ 4 size part may exist outside the current PU.
- the encoder / decoder may give higher priority to the backward motion information of the corresponding block in which all of the 8 ⁇ 4 size parts exist in the current PU.
- the encoder / decoder may generate bidirectional predictive motion information in reverse motion information prediction. To generate the bidirectional predictive motion information, the following method may be applied.
- the encoder / decoder may set the direction of bidirectional predictive motion information according to the direction of the reference picture list. That is, the encoder / decoder sets backward motion information derived from reference picture 0 (or L0 reference picture) belonging to reference picture list 0 (or L0) in the direction of L0, and references belonging to reference picture list 1 (or L1). Reverse motion information derived from Picture 1 (or L1 reference picture) may be set in the direction of L1.
- the encoder / decoder may set the L0 direction and the L1 direction according to whether the output time of the reference picture is past or future, compared to the current picture, regardless of the direction of the reference picture list. That is, when the output time point of the reference picture is in the past compared to the current picture, it may be set to the L0 direction, and when the output time point is the future, it may be set to the L1 direction.
- the comparison operation may not be performed in the process of setting the bidirectional predictive motion information by setting the direction in accordance with the direction of the reference picture list of the current picture.
- a comparison operation process may be needed to determine whether the output time of the reference picture is in the past or in the future by comparing it with the current picture.
- this method it is possible to prevent the case where the past picture is included in L1 on the output and the future picture is included in L0 on the output.
- 17 is a diagram for describing a method of generating bidirectional predictive motion information according to an embodiment of the present invention.
- reference picture list 0 may include Picture 2 1702, which is a future direction based on an output time point.
- the backward motion information derived from the picture 2 1702 may be used as the motion information of the reference picture list 0 (or L0).
- the backward motion information derived from the picture 2 1702 is referred to as reference picture list 1. (Or L1) may be used as motion information. That is, when the second method is applied, the backward motion information derived from the picture 2 1702 is not used as the motion information of the reference picture list 0 (or L0).
- FIG. 18 is a schematic block diagram of an encoder including a bidirectional motion information prediction method according to an embodiment of the present invention.
- the encoder includes a backward motion information predictor 1810, a subtractor 1815, a transformer 1820, a quantizer 1830, an inverse quantizer 1840, an inverse transform unit 1850, and a filtering unit ( 1860, a decoded picture buffer (DPB) 1870, an inter predictor 1188, an intra predictor 1882, and an entropy encoder 1890.
- a backward motion information predictor 1810 the encoder includes a backward motion information predictor 1810, a subtractor 1815, a transformer 1820, a quantizer 1830, an inverse quantizer 1840, an inverse transform unit 1850, and a filtering unit ( 1860, a decoded picture buffer (DPB) 1870, an inter predictor 1188, an intra predictor 1882, and an entropy encoder 1890.
- DPB decoded picture buffer
- the backward motion information predictor 1810 may perform backward motion information prediction on all reference pictures in the reference picture list.
- the backward motion information prediction unit 1810 may perform backward motion information prediction on a unit of picture with respect to an arbitrary block of the reference picture.
- the backward motion information prediction unit 1810 may perform backward motion information prediction before an actual encoding / decoding process (that is, a process of encoding / decoding on a block basis within the current picture). That is, the backward motion information predictor 1810 may derive backward motion information with respect to the reference pictures of all the reference lists before the encoding / decoding process is performed, and store backward motion information in a corresponding block of the current picture to inter-picture. Can be used during the prediction process.
- backward motion information may be derived in units of blocks on which inter prediction is performed.
- the backward motion information predictor 1810 may not be implemented in a separate configuration as shown in FIG. 18, or may be implemented as a part of the inter predictor 188.
- backward motion information prediction may be performed by the backward motion information predictor 1810.
- the backward motion information prediction unit 1810 may perform backward motion information prediction by the method described with reference to FIGS. 10 to 17.
- the backward motion information predictor 1810 may derive backward motion information by using motion information of an arbitrary block in the reference picture.
- the backward motion information predictor 1810 may store the derived backward motion information by mapping the corresponding backward motion information to the corresponding block of the current picture.
- the backward motion information predictor 1810 may perform backward motion information prediction on all regions in all reference pictures existing in the reference picture list of the current picture.
- the backward motion information predictor 1810 may determine the priority among the plurality of backward motion information when the plurality of scaled motion vectors indicate the same corresponding block of the current picture.
- the backward motion information predictor 1810 may determine the priority among the plurality of backward motion information.
- the subtractor 1815 subtracts a prediction signal (or prediction block) output from the inter prediction unit 1801 or the intra prediction unit 1882 from the input image signal, and receives a residual signal (or difference block). Create The generated difference signal (or difference block) is transmitted to the converter 1820.
- the transform unit 1820 may convert a differential signal (or a differential block) into a transform scheme (for example, a discrete cosine transform (DCT), a discrete sine transform (DST), a graph-based transform (GBT), and a karhunen-loeve transform (KLT)). Etc.) to generate transform coefficients.
- a transform scheme for example, a discrete cosine transform (DCT), a discrete sine transform (DST), a graph-based transform (GBT), and a karhunen-loeve transform (KLT)
- the quantization unit 1830 quantizes the transform coefficients and transmits the transform coefficients to the entropy encoding unit 1890, and the entropy encoding unit 1890 entropy-codes the quantized signal and outputs the bitstream.
- the quantized signal output from the quantization unit 1830 may be used to generate a prediction signal.
- the quantized signal may be restored by applying inverse quantization and inverse transformation through an inverse quantization unit 1840 and an inverse transformation unit 1850 in a loop.
- the reconstructed signal may be generated by adding the reconstructed difference signal to a prediction signal output from the inter predictor 188 or the intra predictor 1882.
- the filtering unit 1860 applies filtering to the reconstruction signal and outputs the filtered signal to the reproduction device or transmits the decoded picture buffer to the decoded picture buffer 1870.
- the filtered signal transmitted to the decoded picture buffer 1870 may be used as a reference picture in the inter predictor 188. As such, by using the filtered picture as a reference picture in the inter prediction mode, not only image quality but also encoding efficiency may be improved.
- the decoded picture buffer 1870 may store the filtered picture for use as a reference picture in the inter predictor 188.
- the inter predictor 188 performs temporal prediction and / or spatial prediction to remove temporal redundancy and / or spatial redundancy with reference to a reconstructed picture.
- the inter predictor 188 may use backward motion information that the backward motion information predictor 1810 maps and stores to a corresponding block during inter prediction (or inter picture prediction). Detailed description thereof will be described later.
- the reference picture used to perform the prediction is a transformed signal that has been quantized and dequantized in units of blocks at the time of encoding / decoding in the previous time, blocking artifacts or ringing artifacts may exist. have.
- the inter prediction unit 188 may interpolate the signals between pixels in sub-pixel units by applying a lowpass filter to solve performance degradation due to discontinuity or quantization of such signals.
- the sub-pixels mean virtual pixels generated by applying an interpolation filter
- the integer pixels mean actual pixels existing in the reconstructed picture.
- the interpolation method linear interpolation, bi-linear interpolation, wiener filter, or the like may be applied.
- the interpolation filter may be applied to a reconstructed picture to improve the precision of prediction.
- the inter prediction unit 188 generates an interpolation pixel by applying an interpolation filter to integer pixels, and uses an interpolated block composed of interpolated pixels as a prediction block. You can make predictions.
- the intra predictor 1882 predicts the current block by referring to samples in the vicinity of the block to which the current encoding is to be performed.
- the intra prediction unit 1882 may perform the following process to perform intra prediction. First, reference samples necessary for generating a prediction signal may be prepared. The prediction signal may be generated using the prepared reference sample. Then, the prediction mode is encoded. In this case, the reference sample may be prepared through reference sample padding and / or reference sample filtering. Since the reference sample has been predicted and reconstructed, there may be a quantization error. Accordingly, the reference sample filtering process may be performed for each prediction mode used for intra prediction to reduce such an error.
- the prediction signal (or prediction block) generated by the inter prediction unit 1882 or the intra prediction unit 1882 is used to generate a reconstruction signal (or reconstruction block) or a differential signal (or difference block). It can be used to generate.
- 19 is a schematic block diagram of a decoder including a bidirectional motion information prediction method according to an embodiment of the present invention.
- the decoder includes an entropy decoding unit 1910, a backward motion information predicting unit 1920, an inverse quantization unit 1930, an inverse transform unit 1940, an adder 1945, a filtering unit 1950, and a decoding picture. It may be configured to include a decoded picture buffer unit (DPB) 1960, an inter predictor 1971, and an intra predictor 1972.
- DPB decoded picture buffer unit
- the reconstructed video signal output through the decoder may be reproduced through the reproducing apparatus.
- the decoder receives a signal (ie, a bit stream) output from the encoder of FIG. 18, and the received signal is entropy decoded through the entropy decoding unit 1910.
- the backward motion information predictor 1920 may perform backward motion information prediction on all reference pictures in the reference picture list.
- the backward motion information prediction unit 1920 may perform backward motion information prediction on a picture-by-picture basis for any block of the reference picture.
- the backward motion information prediction unit 1920 may perform backward motion information prediction before an actual encoding / decoding process (that is, a process of encoding / decoding on a block basis within the current picture). That is, the backward motion information prediction unit 1920 may derive backward motion information for all reference pictures of the reference list before the encoding / decoding process is performed, and store backward motion information in a corresponding block of the current picture to inter-picture. Can be used during the prediction process.
- backward motion information of the block may be derived in units of blocks on which inter prediction is performed.
- the backward motion information predictor 1920 may not be implemented in a separate configuration as shown in FIG. 19, or may be implemented as a part of the inter predictor 1971.
- backward motion information may be derived in units of blocks on which inter prediction is performed.
- the backward motion information predictor 1920 may perform backward motion information prediction as described with reference to FIGS. 10 to 17.
- the backward motion information predictor 1920 may derive backward motion information using motion information of an arbitrary block in the reference picture, similarly to the encoder.
- the backward motion information predictor 1920 may store the derived backward motion information by mapping the corresponding backward motion information to the corresponding block of the current picture.
- the backward motion information predictor 1920 may perform backward motion information prediction on all regions in all reference pictures existing in the reference picture list of the current picture.
- the backward motion information predictor 1920 may determine the priority among the plurality of backward motion information when the plurality of scaled motion vectors indicate the same corresponding block of the current picture.
- the backward motion information predictor 1920 may determine the priority among the backward motion information.
- the inverse quantization unit 1930 obtains a transform coefficient from the entropy decoded signal using the quantization step size information.
- the inverse transform unit 1940 applies an inverse transform scheme to inverse transform the transform coefficients to obtain a residual signal (or a differential block).
- the adder 1945 adds the obtained difference signal (or difference block) to the prediction signal (or prediction block) output from the inter prediction unit 1971 or the intra prediction unit 1972, and then the reconstructed signal. (Or recovery block) is generated.
- the filtering unit 1950 applies filtering to a reconstructed signal (or a reconstructed block) and outputs the filtered signal to a reproduction device or transmits the decoded picture buffer unit 1960.
- the filtered signal transmitted to the decoded picture buffer unit 1960 may be used as the reference picture in the inter prediction unit 1971.
- the embodiments described in the filtering unit 1860, the inter prediction unit 1882, and the intra prediction unit 1882 of the encoder are respectively the filtering unit 1950, the inter prediction unit 1971, and the intra prediction unit of the decoder. The same applies to (1972).
- the inter prediction unit 1971 may use the backward motion information that the backward motion information prediction unit 1920 maps and stores to the corresponding block during inter prediction (or inter picture prediction). Detailed description thereof will be described later.
- the backward motion information derived through the backward motion information prediction may be used for inter prediction (or inter picture prediction).
- the backward motion information may be applied as a candidate of the motion information list in the merge mode of the inter prediction or the Advanced Motion Vector Prediction (AMVP) mode.
- AMVP Advanced Motion Vector Prediction
- FIG. 20 illustrates a method of constructing a motion information candidate list using backward motion information as an embodiment to which the present invention may be applied.
- the number of items (items) of the merge candidate list is set to 5 for convenience of description, but the present invention is not limited thereto.
- a merge candidate list construction process will be described in detail with reference to FIG. 20 for convenience of description, but the motion information prediction process is not limited thereto.
- the encoder / decoder selects up to four candidates from spatial peripheral motion information except for overlapping motion information and adds the candidates to the candidate list (S2001).
- the spatial neighbor motion information candidate may be configured with motion information of a current block and a neighboring block. For example, as illustrated in FIG. 7A, five merge candidates (ie, A1, B1, B0, A0, and B2 in FIG. 7A) may be used as the neighboring block with the current block. .
- the temporal merge candidate configuration process is performed. That is, the encoder / decoder selects one candidate from the temporal peripheral motion information and adds it to the candidate list except the overlapped motion information (S2002).
- the direction of the reference picture and the reference picture index for the temporal merge candidate may be transmitted to the decoder through the slice header.
- the temporal merge candidate may be configured with motion information of a position corresponding to the current block in the reference picture or a position of a neighboring block of the current block in the reference picture.
- a position as described with reference to FIG. 7A that is, T0 and T1 in FIG. 7A may be used.
- the encoder / decoder determines whether the number of merge candidate list items is five or less than five (S2003).
- the encoder / decoder may terminate the merge candidate list.
- step S2003 determines whether the merge candidate is less than five, the number of preset items. If it is determined in step S2003 that the merge candidate is less than five, the number of preset items, the encoder / decoder adds the combined bi-predictive merging candidate to the candidate list (S2004).
- the encoder / decoder determines whether the number of merge candidate list items is five or less than five (S2005).
- the encoder / decoder may terminate the merge candidate list.
- step S2005 if it is determined in step S2005 that the merge candidate is less than five, which is the number of preset items, the encoder / decoder adds the backward prediction motion vector to the merge candidate list (S2006).
- the encoder / decoder determines whether the number of merge candidate list items is five or less than five (S2007).
- the encoder / decoder may terminate the merge candidate list.
- step S2007 if it is determined in step S2007 that the number of merge candidates is less than the preset maximum number of five, the encoder / decoder changes the reference picture index until there are five merge candidates in consideration of overlapping motion information and zero motion vectors. (zero motion vector) is added to the merge candidate list (S2009).
- motion information ie, spatial motion information candidate, temporal motion information candidate, combined bidirectional motion information candidate, reverse motion information candidate, zero vector candidate
- search may be performed on only some of the motion information in the example of FIG. 20, or motion information not illustrated in FIG. 20 may be further searched.
- the method (process or order) of constructing the merge candidate list is not limited to the method illustrated in FIG. 20. That is, unlike FIG. 20, not only the backward motion information may be inserted into the merge candidate list before the combined bi-predictive merging candidate but also the backward motion information may be inserted before the spatial motion information candidate. The backward motion information may be inserted after the spatial motion information candidate is inserted and before the temporal motion information candidate is inserted.
- the merge mode-related syntax of the video encoder / decoder may be changed even when the insertion order is different, such as when backward motion information is inserted into the merge candidate list before the combined bi-predictive merging candidate. It may not change.
- AMVP Advanced Motion Vector Prediction
- FIG. 21 illustrates a method for constructing a motion information candidate list using reverse motion information according to an embodiment to which the present invention can be applied.
- the encoder / decoder adds spatial peripheral motion information to the AMVP candidate list (S2101).
- the spatial neighbor motion information candidate may be configured with motion information of a current block and a neighboring block. For example, as shown in FIG. 7A, five candidates (ie, A1, B1, B0, A0, and B2 in FIG. 7A) may be used as the neighboring block with the current block.
- the encoder / decoder determines whether the number of selected candidates is two or less than two (S2102).
- step S2102 if the number of candidates selected as a result of the search for the spatial motion candidate is two, the candidate configuration may be terminated.
- step S2102 if it is determined in step S2102 that the number of candidates selected as a result of the search for the spatial motion candidate is less than two, the encoder / decoder adds temporal peripheral motion information to the candidate list (S2103).
- the direction of the reference picture and the reference picture index for the temporal AMVP candidate may be transmitted to the decoder through the slice header.
- the temporal AMVP candidate may be configured with motion information of a position corresponding to the current block in the reference picture or a position of a neighboring block of the current block in the reference picture.
- As the selection position of the temporal AMVP candidate for example, two positions (that is, T0 and T1 in FIG. 7A) may be used as described with reference to FIG. 7A.
- the encoder / decoder determines whether there are two or less than two AMVP candidate list items (S2104).
- the encoder / decoder may finish constructing the AMVP candidate list.
- step S2104 if it is determined in step S2104 that the AMVP candidates are less than two, the number of preset items, the encoder / decoder adds the combined bidirectional predictive AMVP candidates to the candidate list (S2105).
- the encoder / decoder determines whether two AMVP candidate list items are present or less than two (S2106).
- the encoder / decoder may finish constructing the AMVP candidate list.
- step S2106 determines whether the AMVP candidate is less than two, the number of preset items. If it is determined in step S2106 that the AMVP candidate is less than two, the number of preset items, the encoder / decoder adds the backward prediction motion vector to the AMVP candidate list (S2107).
- the encoder / decoder determines whether there are two or less than two AMVP candidate list items (S2108).
- the encoder / decoder may finish constructing the AMVP candidate list.
- step S2108 if it is determined in step S2108 that the AMVP candidate is less than two, the number of preset items, the encoder / decoder adds a zero motion vector to the AMVP candidate list (S2109).
- motion information ie, spatial motion information candidate, temporal motion information candidate, combined bidirectional motion information candidate, reverse motion information candidate, zero vector candidate
- search may be performed on only some of the motion information in the example of FIG. 21, or motion information not illustrated in FIG. 21 may be further searched.
- the method (process or order) of constructing the AMVP candidate list is not limited to the method illustrated in FIG. 21. That is, unlike FIG. 21, not only the backward motion information may be inserted into the AMVP candidate list before the combined bidirectional predictive AMVP candidate, but also the backward motion information may be inserted before the spatial motion information candidate, and the spatial motion information candidate is inserted. The backward motion information may be inserted after the temporal motion information candidate is inserted.
- both the backward motion information and the unidirectional predicted motion information may be inserted. It demonstrates with reference to the following drawings.
- FIG. 22 illustrates a method of inserting backward prediction motion information into a motion information candidate list according to an embodiment of the present invention.
- the motion information in each direction may be individually applied as unidirectional prediction or simultaneously as bidirectional prediction. have.
- bidirectional predictive motion information stored in a corresponding block may be unidirectionally inserted into a motion information candidate list.
- backward prediction motion information When backward prediction motion information is inserted in one direction, two candidates may be inserted. That is, the backward motion information in the direction of the reference picture list 0 may be inserted into the candidate list (2201), and the backward motion information in the direction of the reference picture list 1 may be separately inserted into the candidate list (2202).
- the bidirectional predictive motion information stored in the corresponding block may be inserted in the motion information candidate list in both directions.
- motion information in a direction of reference picture list 0 (ie, L0) and reference picture list 1 (ie, L1) may be inserted into the candidate list as one motion information (2203).
- a plurality of backward prediction motion information lists may be configured for each direction (reference picture list 0 or reference picture list 1 direction) to select one of the plurality of motion information and insert the selected motion information into the candidate list.
- FIG. 23 is a diagram illustrating an inter prediction based image processing method according to an embodiment of the present invention.
- the encoder / decoder derives backward motion information of the current block by using motion information of a block in the reference picture of the current picture (S2301).
- the encoder / decoder may derive backward motion information by using motion information of an arbitrary position in the reference picture.
- the encoder / decoder may scale the motion vector of the block in the reference picture and transform the motion vector toward the current picture.
- the encoder / decoder may map and store backward motion information having an opposite sign to each code of the scaled motion vector to a corresponding block of the current picture.
- the encoder / decoder may perform backward motion information prediction on all regions within all reference pictures existing in the reference picture list of the current picture.
- the encoder / decoder has a priority for selecting backward motion information of the current block as a plurality of backward motion information. Can be given.
- the encoder / decoder when there are a plurality of corresponding blocks having backward motion information in the current block, the encoder / decoder has priority to select backward motion information of the current block in backward motion information of the plurality of corresponding blocks. You can assign a rank.
- the encoder / decoder may add backward motion information to the motion information candidate list of the current block (S2302).
- the backward motion information may be added (or inserted) to the motion information list in the merge mode of the inter prediction or the Advanced Motion Vector Prediction (AMVP) mode.
- AMVP Advanced Motion Vector Prediction
- the number of motion information candidates added to the current motion information candidate list is smaller than the number of predetermined items in the motion information candidate list. If so, backward motion information may be added to the motion information candidate list.
- the number of motion information candidates added to the current motion information candidate list is the number of predetermined items of the motion information candidate list. If smaller, the combined bidirectional motion information candidate may be added to the motion information candidate list by combining the motion information added to the motion information candidate list. After the combined bidirectional motion information candidate is added (or may not be added) to the motion information candidate list, the number of motion information candidates added to the current motion information candidate list is smaller than the number of predetermined items in the motion information candidate list. If so, backward motion information may be added to the motion information candidate list.
- the number of backward motion information may be added (or inserted) to the motion information candidate list of the current block by a preset number based on the priority given to the plurality of backward motion information.
- the encoder / decoder derives the motion information of the current block from the motion information selected from the motion information candidates added to the motion information candidate list (S2303).
- the decoder may receive a motion information candidate index for specifying motion information of the current block from the motion information candidate list of the current block from the encoder.
- the motion information of the current block may be derived from the motion information candidate indicated by the received motion information candidate index.
- the decoder may receive a merge index from the encoder and decode the received merge index. Then, the motion information indicated by the merge index in the merge candidate list (or the motion information candidate list) may be derived as the motion information of the current block.
- the decoder may receive a motion reference flag from the encoder and decode the received motion reference flag.
- the motion information indicated by the motion reference flag in the motion vector predictor candidate list can be derived as the motion vector predictor of the current block.
- the decoder may decode the motion vector difference value, the reference picture index, and the inter prediction mode received from the encoder, and derive the motion vector of the current block by adding the derived motion vector prediction value and the decoded motion vector difference value.
- the encoder / decoder generates a prediction block of the current block by using the motion information of the current block (S2304).
- the encoder / decoder may generate the predictive block of the current block from the block specified by the motion information (especially the motion vector) in the reference picture specified by the motion information (especially the reference picture index).
- the encoder / decoder may generate (derive) the sample value of the prediction unit of the current block from the sample value of the block (region) specified by the motion vector in the reference picture.
- 24 is a diagram illustrating a backward motion information predictor and an inter predictor, according to an embodiment of the present invention.
- the backward motion information predictor 2401 and the inter predictor 2402 are separately illustrated for convenience of description, but the reverse motion information predictor 2401 is implemented to be included in the inter predictor 2402. Can be.
- the backward motion information predictor 2401 and the inter predictor 2402 are shown as one block, the backward motion information predictor 2401 and / or the inter predictor 2402 are provided to the encoder and / or the decoder. It may be implemented in an included configuration.
- the backward motion information predictor 2401 and / or the inter predictor 2402 implement the functions, processes, and / or methods proposed in FIGS. 5 to 19.
- the inter prediction unit 2402 may include a motion information candidate list constructer 2403, a motion information derivation unit 2404, and a prediction block generator 2405.
- the backward motion information predictor 2401 may derive backward motion information using motion information of an arbitrary position in the reference picture.
- the backward motion information predictor 2401 may scale the motion vector of the block in the reference picture to transform the motion vector toward the current picture.
- the backward motion information predictor 2401 may map backward motion information having an opposite sign to each code of the scaled motion vector to a corresponding block of the current picture.
- the backward motion information predictor 2401 may perform backward motion information prediction on all regions in all reference pictures existing in the reference picture list of the current picture.
- the backward motion information prediction unit 2401 may use the plurality of backward motion information as backward motion information of the current block. Priority for selection can be given.
- the backward motion information predicting unit 2401 may include backward motion information of the current block in backward motion information of the plurality of corresponding blocks. Can be given priority for selection.
- the motion information candidate list construction unit 2403 may add reverse motion information to the motion information candidate list of the current block.
- the motion information candidate list constructer 2403 adds backward motion information to the motion information list in the merge mode of the inter prediction or the Advanced Motion Vector Prediction (AMVP) mode. Or insert).
- AMVP Advanced Motion Vector Prediction
- the number of motion information candidates added to the current motion information candidate list is smaller than the number of predetermined items in the motion information candidate list. If so, backward motion information may be added to the motion information candidate list.
- the number of motion information candidates added to the current motion information candidate list is the number of predetermined items of the motion information candidate list. If smaller, the combined bidirectional motion information candidate may be added to the motion information candidate list by combining the motion information added to the motion information candidate list. After the combined bidirectional motion information candidate is added (or may not be added) to the motion information candidate list, the number of motion information candidates added to the current motion information candidate list is smaller than the number of predetermined items in the motion information candidate list. If so, backward motion information may be added to the motion information candidate list.
- the motion information candidate list constructing unit 2403 adds backward motion information to the motion information candidate list of the current block by a preset number based on the priority given to the plurality of backward motion information. (Or insert).
- the motion information derivation unit 2404 may derive the motion information of the current block from the motion information selected from the motion information candidates added to the motion information candidate list.
- the motion information derivation unit 2404 may receive a motion information candidate index for specifying motion information of the current block from the motion information candidate list of the current block from the encoder.
- the motion information of the current block may be derived from the motion information candidate indicated by the received motion information candidate index.
- the motion information derivation unit 2404 may receive a merge index from the encoder and decode the received merge index. Then, the motion information indicated by the merge index in the merge candidate list (or the motion information candidate list) may be derived as the motion information of the current block.
- the motion information derivation unit 2404 may receive a motion reference flag from the encoder and decode the received motion reference flag.
- the motion information indicated by the motion reference flag in the motion vector predictor candidate list can be derived as the motion vector predictor of the current block.
- the motion information derivation unit 2403 decodes the motion vector difference value, the reference picture index, and the inter prediction mode received from the encoder, and adds the derived motion vector prediction value and the decoded motion vector difference value to obtain a motion vector of the current block. Can be derived.
- the prediction block generator 2405 may generate the prediction block of the current block by using the derived motion information of the current block.
- the prediction block generator 2405 may generate the prediction block of the current block from the block specified by the motion information (particularly, the motion vector) in the reference picture specified by the motion information (particularly, the reference picture index).
- the prediction block generator 2405 may generate (derive) the sample value of the prediction unit of the current block from the sample value of the block (region) specified by the motion vector in the reference picture.
- each component or feature is to be considered optional unless stated otherwise.
- Each component or feature may be embodied in a form that is not combined with other components or features. It is also possible to combine some of the components and / or features to form an embodiment of the invention.
- the order of the operations described in the embodiments of the present invention may be changed. Some components or features of one embodiment may be included in another embodiment or may be replaced with corresponding components or features of another embodiment. It is obvious that the claims may be combined to form an embodiment by combining claims that do not have an explicit citation relationship in the claims or as new claims by post-application correction.
- Embodiments according to the present invention may be implemented by various means, for example, hardware, firmware, software, or a combination thereof.
- an embodiment of the present invention may include one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), FPGAs ( field programmable gate arrays), processors, controllers, microcontrollers, microprocessors, and the like.
- ASICs application specific integrated circuits
- DSPs digital signal processors
- DSPDs digital signal processing devices
- PLDs programmable logic devices
- FPGAs field programmable gate arrays
- processors controllers, microcontrollers, microprocessors, and the like.
- an embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that performs the functions or operations described above.
- the software code may be stored in memory and driven by the processor.
- the memory may be located inside or outside the processor, and may exchange data with the processor by various known means.
Abstract
Description
Claims (18)
- 인터 예측(inter prediction)을 기반으로 영상을 처리하는 방법에 있어서,현재 픽쳐(current picture)의 참조 픽쳐(reference picture) 내 블록의 움직임 정보를 이용하여, 현재 블록(current block)의 역방향 움직임 정보를 도출하는 단계;복수의 움직임 정보 후보로 구성되는 상기 현재 블록의 움직임 정보 후보 리스트에 상기 역방향 움직임 정보를 움직임 정보 후보로서 추가하는 단계;상기 움직임 정보 후보 리스트 내 상기 복수의 움직임 정보 후보 중에서 선택된 움직임 정보로부터 상기 현재 블록의 움직임 정보를 도출하는 단계; 및상기 현재 블록의 움직임 정보를 이용하여 상기 현재 블록의 예측 블록을 생성하는 단계를 포함하고,상기 역방향 움직임 정보에 의해 상기 참조 픽쳐 내 블록이 특정되는 인터 예측 모드 기반 영상 처리 방법.
- 제 1항에 있어서,상기 참조 픽쳐 내 블록의 움직임 정보는 상기 현재 블록으로 향하도록 스케일링되고,상기 역방향 움직임 정보는 상기 스케일링된 움직임 정보와 크기가 동일하고 방향이 반대인 움직임 정보로 도출되는 인터 예측 모드 기반 영상 처리 방법.
- 제 2항에 있어서,상기 참조 픽쳐 내 블록의 움직임 정보는 상기 현재 픽쳐와 상기 참조 픽쳐간의 픽쳐 순서 카운트(picture order count:POC) 차이와 상기 참조 픽쳐와 상기 참조 픽쳐의 참조 픽쳐간의 POC 차이에 기초하여 스케일링되는 인터 예측 모드 기반 영상 처리 방법.
- 제 2항에 있어서,상기 현재 픽쳐(current picture)의 참조 픽쳐(reference picture) 내 움직임 정보를 갖는 블록을 탐색하는 단계를 더 포함하고,상기 탐색된 블록의 움직임 정보를 기반으로 상기 역방향 움직임 정보가 도출되는 인터 예측 모드 기반 영상 처리 방법.
- 제 2항에 있어서,상기 스케일링된 움직임 정보에 의해 특정되는 대응 블록(corresponding block)에 상기 역방향 움직임 정보가 대응되고,상기 현재 블록의 역방향 움직임 정보는 상기 현재 블록과 중복되는(overlap) 대응 블록의 역방향 움직임 정보로 결정되는 인터 예측 모드 기반 영상 처리 방법.
- 제 5항에 있어서,복수의 역방향 움직임 정보가 단일의 대응 블록에 대응되는 경우, 상기 복수의 역방향 움직임 정보에 상기 현재 블록의 역방향 움직임 정보로 선택하기 위한 우선 순위를 부여하는 단계를 더 포함하는 인터 예측 모드 기반 영상 처리 방법.
- 제 6항에 있어서,상기 현재 픽쳐와 상기 참조 픽쳐 간의 픽쳐 순서 카운트(picture order count:POC)의 차이가 작을 때, 더 높은 우선 순위가 부여되는 인터 예측 모드 기반 영상 처리 방법.
- 제 6항에 있어서,상기 현재 픽쳐와 상기 참조 픽쳐의 참조 픽쳐간의 픽쳐 순서 카운트(picture order count:POC)의 차이가 작을 때, 더 높은 우선 순위가 부여되는 인터 예측 모드 기반 영상 처리 방법.
- 제 6항에 있어서,상기 현재 픽쳐와 상기 참조 픽쳐간의 픽쳐 순서 카운트(picture order count:POC) 차이와 상기 참조 픽쳐와 상기 참조 픽쳐의 참조 픽쳐간의 POC 차이가 동일한 부호를 가질 때, 더 높은 우선 순위가 부여되는 인터 예측 모드 기반 영상 처리 방법.
- 제 6항에 있어서,상기 참조 픽쳐 내 블록과 상기 참조 픽쳐 내 블록에 의해 특정되는 상기 참조 픽쳐의 참조 픽쳐 내 블록간의 차분 값이 작을 때, 더 높은 우선 순위가 부여되는 영상 처리 방법.
- 제 6항에 있어서,상기 복수의 역방향 움직임 정보 중 상기 대응 블록(corresponding block)에 먼저 대응되는 역방향 움직임 정보에 더 높은 우선 순위가 부여되는 영상 처리 방법.
- 제 5항에 있어서,상기 현재 블록 내 상기 대응 블록(corresponding block)이 복수 개 존재하는 경우, 상기 복수 개의 대응 블록의 역방향 움직임 정보에 상기 현재 블록의 역방향 움직임 정보로 선택하기 위한 우선 순위를 부여하는 단계를 더 포함하는 인터 예측 모드 기반 영상 처리 방법.
- 제 12항에 있어서,상기 복수의 역방향 움직임 정보 중 상기 현재 블록의 특정 샘플의 위치로부터 가까운 거리에 존재하는 대응 블록의 역방향 움직임 정보에 더 높은 우선 순위가 부여되는 인터 예측 모드 기반 영상 처리 방법.
- 제 13항에 있어서,상기 특정 샘플은 상기 현재 블록의 좌상단 샘플, 중앙 샘플 및 우하단 샘플 중 어느 하나의 샘플인 인터 예측 모드 기반 영상 처리 방법.
- 제 12항에 있어서,상기 복수의 역방향 움직임 정보 중 상기 현재 블록에 이웃하는 블록의 움직임 정보와 비교하여 다른 값을 가지는 역방향 움직임 정보에 더 높은 우선 순위가 부여되는 인터 예측 모드 기반 영상 처리 방법.
- 제 5항에 있어서,상기 현재 블록의 역방향 움직임 정보가 복수 개인 경우, 상기 복수 개의 역방향 움직임 정보에 부여된 우선 순위에 기초하여 기 설정된 개수만큼 상기 역방향 움직임 정보가 상기 현재 블록의 움직임 정보 후보 리스트에 추가되는 인터 예측 모드 기반 영상 처리 방법.
- 제 5항에 있어서,참조 픽쳐 리스트가 서로 다른 참조 픽쳐로부터 도출된 복수의 역방향 움직임 정보가 단일의 대응 블록에 대응되는 경우, 상기 복수의 역방향 움직임 정보로부터 도출된 양방향 움직임 정보를 상기 단일의 대응 블록(corresponding block)에 매핑시켜 저장하는 인터 예측 모드 기반 영상 처리 방법.
- 인터 예측(inter prediction)을 기반으로 영상을 처리하는 장치에 있어서,현재 픽쳐(current picture)의 참조 픽쳐(reference picture) 내 블록의 움직임 정보를 이용하여, 현재 블록(current block)의 역방향 움직임 정보를 도출하는 역방향 움직임 정보 도출부;복수의 움직임 정보 후보로 구성되는 상기 현재 블록의 움직임 정보 후보 리스트에 상기 역방향 움직임 정보를 움직임 정보 후보로서 추가하는 움직임 정보 후보 리스트 구성부;상기 움직임 정보 후보 리스트 내 상기 복수의 움직임 정보 후보 중에서 선택된 움직임 정보로부터 상기 현재 블록의 움직임 정보를 도출하는 움직임 정보 도출부; 및상기 현재 블록의 움직임 정보를 이용하여 상기 현재 블록의 예측 블록을 생성하는 예측 블록 생성부를 포함하고,상기 역방향 움직임 정보에 의해 상기 참조 픽쳐 내 블록이 특정되는 인터 예측 모드 기반 영상 처리 장치.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020187031370A KR20180132756A (ko) | 2016-04-28 | 2016-07-05 | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 |
EP16900583.2A EP3439303B1 (en) | 2016-04-28 | 2016-07-05 | Inter prediction mode-based image processing method and apparatus therefor |
CN201680084964.6A CN109076213A (zh) | 2016-04-28 | 2016-07-05 | 基于间预测模式的图像处理方法及其装置 |
US16/097,100 US20200351505A1 (en) | 2016-04-28 | 2016-07-05 | Inter prediction mode-based image processing method and apparatus therefor |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662328620P | 2016-04-28 | 2016-04-28 | |
US62/328,620 | 2016-04-28 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017188509A1 true WO2017188509A1 (ko) | 2017-11-02 |
Family
ID=60160866
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2016/007233 WO2017188509A1 (ko) | 2016-04-28 | 2016-07-05 | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 |
Country Status (5)
Country | Link |
---|---|
US (1) | US20200351505A1 (ko) |
EP (1) | EP3439303B1 (ko) |
KR (1) | KR20180132756A (ko) |
CN (1) | CN109076213A (ko) |
WO (1) | WO2017188509A1 (ko) |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019184556A1 (zh) * | 2018-03-29 | 2019-10-03 | 华为技术有限公司 | 一种双向帧间预测方法及装置 |
WO2020005007A1 (ko) * | 2018-06-29 | 2020-01-02 | 주식회사 케이티 | 비디오 신호 처리 방법 및 장치 |
CN110944193A (zh) * | 2018-09-24 | 2020-03-31 | 北京字节跳动网络技术有限公司 | 视频编码和解码中的加权双向预测 |
US11477463B2 (en) | 2018-06-21 | 2022-10-18 | Beijing Bytedance Network Technology Co., Ltd. | Component-dependent sub-block dividing |
US11509915B2 (en) | 2018-06-05 | 2022-11-22 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between IBC and ATMVP |
RU2792221C2 (ru) * | 2018-06-29 | 2023-03-21 | Кт Корпорейшен | Способ и устройство обработки видеосигнала |
US11792421B2 (en) | 2018-11-10 | 2023-10-17 | Beijing Bytedance Network Technology Co., Ltd | Rounding in pairwise average candidate calculations |
US11968377B2 (en) | 2018-06-21 | 2024-04-23 | Beijing Bytedance Network Technology Co., Ltd | Unified constrains for the merge affine mode and the non-merge affine mode |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102438181B1 (ko) * | 2017-06-09 | 2022-08-30 | 한국전자통신연구원 | 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체 |
CN111385575A (zh) * | 2018-12-29 | 2020-07-07 | 华为技术有限公司 | 帧间预测方法、装置以及相应的编码器和解码器 |
CN111953997A (zh) | 2019-05-15 | 2020-11-17 | 华为技术有限公司 | 候选运动矢量列表获取方法、装置及编解码器 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20120088611A (ko) * | 2011-01-31 | 2012-08-08 | 한국전자통신연구원 | 움직임 벡터를 이용한 영상 부호화/복호화 방법 및 장치 |
KR20140009955A (ko) * | 2009-12-23 | 2014-01-23 | 한국전자통신연구원 | 영상의 부호화/복호화 장치 및 그 방법 |
KR20140136428A (ko) * | 2012-02-29 | 2014-11-28 | 엘지전자 주식회사 | 인터 레이어 예측 방법 및 이를 이용하는 장치 |
KR20150091271A (ko) * | 2010-07-12 | 2015-08-10 | 미디어텍 인크. | 시간 움직임 벡터 예측 방법 및 장치 |
KR20160017012A (ko) * | 2009-12-16 | 2016-02-15 | 한국전자통신연구원 | 적응적인 영상 부호화 방법 및 장치 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2149262A4 (en) * | 2007-04-25 | 2010-09-01 | Lg Electronics Inc | METHOD AND DEVICE FOR DECODING / CODING A VIDEO SIGNAL |
US8098732B2 (en) * | 2007-10-10 | 2012-01-17 | Sony Corporation | System for and method of transcoding video sequences from a first format to a second format |
ES2861773T3 (es) * | 2011-05-31 | 2021-10-06 | Jvc Kenwood Corp | Dispositivo de decodificación de imágenes en movimiento, procedimiento de decodificación de imágenes en movimiento y programa de decodificación de imágenes en movimiento |
KR20150088909A (ko) * | 2011-06-30 | 2015-08-03 | 가부시키가이샤 제이브이씨 켄우드 | 화상 부호화 장치, 화상 부호화 방법, 화상 부호화 프로그램, 화상 복호 장치, 화상 복호 방법 및 화상 복호 프로그램 |
MX2014000159A (es) * | 2011-07-02 | 2014-02-19 | Samsung Electronics Co Ltd | Metodo y aparato para la codificacion de video, y metodo y aparato para la decodificacion de video acompañada por inter prediccion utilizando imagen co-localizada. |
-
2016
- 2016-07-05 WO PCT/KR2016/007233 patent/WO2017188509A1/ko active Application Filing
- 2016-07-05 CN CN201680084964.6A patent/CN109076213A/zh not_active Withdrawn
- 2016-07-05 EP EP16900583.2A patent/EP3439303B1/en active Active
- 2016-07-05 US US16/097,100 patent/US20200351505A1/en not_active Abandoned
- 2016-07-05 KR KR1020187031370A patent/KR20180132756A/ko unknown
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20160017012A (ko) * | 2009-12-16 | 2016-02-15 | 한국전자통신연구원 | 적응적인 영상 부호화 방법 및 장치 |
KR20140009955A (ko) * | 2009-12-23 | 2014-01-23 | 한국전자통신연구원 | 영상의 부호화/복호화 장치 및 그 방법 |
KR20150091271A (ko) * | 2010-07-12 | 2015-08-10 | 미디어텍 인크. | 시간 움직임 벡터 예측 방법 및 장치 |
KR20120088611A (ko) * | 2011-01-31 | 2012-08-08 | 한국전자통신연구원 | 움직임 벡터를 이용한 영상 부호화/복호화 방법 및 장치 |
KR20140136428A (ko) * | 2012-02-29 | 2014-11-28 | 엘지전자 주식회사 | 인터 레이어 예측 방법 및 이를 이용하는 장치 |
Cited By (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11350122B2 (en) | 2018-03-29 | 2022-05-31 | Huawei Technologies Co., Ltd. | Bidirectional inter prediction method and apparatus |
US11924458B2 (en) | 2018-03-29 | 2024-03-05 | Huawei Technologies Co., Ltd. | Bidirectional inter prediction method and apparatus |
US11838535B2 (en) | 2018-03-29 | 2023-12-05 | Huawei Technologies Co., Ltd. | Bidirectional inter prediction method and apparatus |
CN112040244A (zh) * | 2018-03-29 | 2020-12-04 | 华为技术有限公司 | 一种双向帧间预测方法及装置 |
WO2019184556A1 (zh) * | 2018-03-29 | 2019-10-03 | 华为技术有限公司 | 一种双向帧间预测方法及装置 |
CN112040244B (zh) * | 2018-03-29 | 2021-06-29 | 华为技术有限公司 | 一种双向帧间预测方法及装置 |
RU2762262C1 (ru) * | 2018-03-29 | 2021-12-17 | Хуавэй Текнолоджиз Ко., Лтд. | Способ и устройство двунаправленного межкадрового предсказания |
US11831884B2 (en) | 2018-06-05 | 2023-11-28 | Beijing Bytedance Network Technology Co., Ltd | Interaction between IBC and BIO |
US11509915B2 (en) | 2018-06-05 | 2022-11-22 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between IBC and ATMVP |
US11523123B2 (en) | 2018-06-05 | 2022-12-06 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between IBC and ATMVP |
US11973962B2 (en) | 2018-06-05 | 2024-04-30 | Beijing Bytedance Network Technology Co., Ltd | Interaction between IBC and affine |
US11659192B2 (en) | 2018-06-21 | 2023-05-23 | Beijing Bytedance Network Technology Co., Ltd | Sub-block MV inheritance between color components |
US11477463B2 (en) | 2018-06-21 | 2022-10-18 | Beijing Bytedance Network Technology Co., Ltd. | Component-dependent sub-block dividing |
US11968377B2 (en) | 2018-06-21 | 2024-04-23 | Beijing Bytedance Network Technology Co., Ltd | Unified constrains for the merge affine mode and the non-merge affine mode |
US11895306B2 (en) | 2018-06-21 | 2024-02-06 | Beijing Bytedance Network Technology Co., Ltd | Component-dependent sub-block dividing |
GB2587984B (en) * | 2018-06-29 | 2022-12-14 | Kt Corp | Method and apparatus for processing a video signal |
GB2587984A (en) * | 2018-06-29 | 2021-04-14 | Kt Corp | Method and apparatus for processing video signal |
WO2020005007A1 (ko) * | 2018-06-29 | 2020-01-02 | 주식회사 케이티 | 비디오 신호 처리 방법 및 장치 |
RU2792221C2 (ru) * | 2018-06-29 | 2023-03-21 | Кт Корпорейшен | Способ и устройство обработки видеосигнала |
US11394959B2 (en) | 2018-06-29 | 2022-07-19 | Kt Corporation | Method and apparatus for processing video signal |
CN110944193B (zh) * | 2018-09-24 | 2023-08-11 | 北京字节跳动网络技术有限公司 | 视频编码和解码中的加权双向预测 |
CN110944193A (zh) * | 2018-09-24 | 2020-03-31 | 北京字节跳动网络技术有限公司 | 视频编码和解码中的加权双向预测 |
US11616945B2 (en) | 2018-09-24 | 2023-03-28 | Beijing Bytedance Network Technology Co., Ltd. | Simplified history based motion vector prediction |
US11792421B2 (en) | 2018-11-10 | 2023-10-17 | Beijing Bytedance Network Technology Co., Ltd | Rounding in pairwise average candidate calculations |
Also Published As
Publication number | Publication date |
---|---|
EP3439303A1 (en) | 2019-02-06 |
KR20180132756A (ko) | 2018-12-12 |
CN109076213A (zh) | 2018-12-21 |
EP3439303A4 (en) | 2019-11-27 |
US20200351505A1 (en) | 2020-11-05 |
EP3439303B1 (en) | 2020-12-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2017039117A1 (ko) | 영상의 부호화/복호화 방법 및 이를 위한 장치 | |
WO2017043816A1 (ko) | 인터-인트라 병합 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017171107A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017188509A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017043734A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2018066927A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017183751A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2018012886A1 (ko) | 영상 부호화/복호화 방법 및 이를 위한 기록 매체 | |
WO2018030773A1 (ko) | 영상 부호화/복호화 방법 및 장치 | |
WO2018084339A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017003063A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017018664A1 (ko) | 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2019083334A1 (ko) | 비대칭 서브 블록 기반 영상 부호화/복호화 방법 및 장치 | |
WO2016137149A1 (ko) | 폴리곤 유닛 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017204427A1 (ko) | 영상 처리 방법, 그를 이용한 영상 복호화 및 부호화 방법 | |
WO2017086748A1 (ko) | 기하 변환 영상을 이용하는 영상의 부호화/복호화 방법 및 장치 | |
WO2017069505A1 (ko) | 영상의 부호화/복호화 방법 및 이를 위한 장치 | |
WO2018034373A1 (ko) | 영상 처리 방법 및 이를 위한 장치 | |
WO2015133838A1 (ko) | 폴리곤 유닛 기반 영상 인코딩/디코딩 방법 및 이를 위한 장치 | |
WO2017034113A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2020096426A1 (ko) | 영상 신호 부호화/복호화 방법 및 이를 위한 장치 | |
WO2020184979A1 (ko) | 영상 신호 부호화/복호화 방법 및 이를 위한 장치 | |
WO2019194653A1 (ko) | 움직임 정보의 복합적 머지 모드 처리를 제공하는 영상 처리 방법, 그를 이용한 영상 복호화, 부호화 방법 및 그 장치 | |
WO2019009498A1 (ko) | 인터 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2020067709A1 (ko) | 인터 모드 기반의 영상 부호화/복호화 방법 및 장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 20187031370 Country of ref document: KR Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2016900583 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2016900583 Country of ref document: EP Effective date: 20181031 |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16900583 Country of ref document: EP Kind code of ref document: A1 |