WO2019235896A1 - 적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 - Google Patents
적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 Download PDFInfo
- Publication number
- WO2019235896A1 WO2019235896A1 PCT/KR2019/006913 KR2019006913W WO2019235896A1 WO 2019235896 A1 WO2019235896 A1 WO 2019235896A1 KR 2019006913 W KR2019006913 W KR 2019006913W WO 2019235896 A1 WO2019235896 A1 WO 2019235896A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- resolution
- motion vector
- current block
- difference value
- available
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/53—Multi-resolution motion estimation; Hierarchical motion estimation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/57—Motion estimation characterised by a search window with variable size or shape
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
Definitions
- the present invention relates to a method and apparatus for processing a video signal, and more particularly, to a video signal processing method and apparatus for encoding or decoding a video signal.
- Compression coding refers to a series of signal processing techniques for transmitting digitized information through a communication line or for storing in a form suitable for a storage medium.
- the object of compression encoding includes objects such as voice, video, text, and the like.
- a technique of performing compression encoding on an image is called video image compression.
- Compression coding on a video signal is performed by removing redundant information in consideration of spatial correlation, temporal correlation, and stochastic correlation.
- An object of the present invention is to improve the coding efficiency of a video signal.
- the present invention has an object to increase the signaling efficiency associated with the motion information set of the current block.
- the present invention provides a video signal processing apparatus and a video signal processing method as follows.
- a motion vector predictor (MVP) candidate for motion compensation of a current block using any one of a first method and a second method Constructing a list; Obtaining a motion vector predictor of the current block based on the configured MVP candidate list; Obtaining a motion vector difference value representing a difference between the motion vector of the current block and the motion vector predictor; Modifying the motion vector difference value based on a resolution of the motion vector difference value of the current block, wherein the resolution of the motion vector difference value is any one of a plurality of available resolutions included in the resolution set, The configuration of the plurality of available resolutions included in the resolution set depends on which of the first and second methods is used to construct an MVP candidate list of the current block; Obtaining a motion vector of the current block based on the motion vector predictor and the modified motion vector difference value; And reconstructing the current block based on the obtained motion vector.
- MVP motion vector predictor
- a video signal decoding apparatus comprising a processor, wherein the processor is a motion vector predictor for motion compensation of a current block using any one of a first method and a second method.
- a motion vector difference constructing a candidate motion list (MV) candidate list, obtaining a motion vector predictor of the current block based on the configured MVP candidate list, and indicating a difference between the motion vector of the current block and the motion vector predictor Obtain a value and modify the motion vector difference value based on a resolution of the motion vector difference value of the current block, wherein the resolution of the motion vector difference value is one of a plurality of available resolutions included in the resolution set.
- MV candidate motion list
- the configuration of the plurality of available resolutions included in the resolution set may be any one of the first method and phase.
- the resolution of the motion vector difference value is determined from one of a first resolution set and a second resolution set, respectively, depending on which of the first and second methods the MVP candidate list of the current block is constructed.
- the second resolution set may include at least one other available resolution other than a plurality of available resolutions included in the first resolution set.
- the MVP candidate list is constructed using the first method based on an affine model
- the resolution of the motion vector differential value is obtained from the first resolution set
- the MVP candidate list is the affine model.
- the second method that is not based on the resolution of the motion vector differential value may be obtained from the second resolution set.
- the largest first available resolution among the plurality of available resolutions included in the first resolution set may be smaller than the second largest available resolution among the plurality of available resolutions included in the second resolution set.
- the processor obtains an indicator indicating a resolution of a motion vector difference value of the current block among a plurality of available resolutions included in one of the first resolution set and the second resolution set, and indicates the indicator.
- the motion vector difference value may be modified based on resolution.
- the value of the indicator is a first value
- the resolution indicated by the first value may vary depending on which of the first and second methods the MVP candidate list is configured. .
- the first value indicates a first available resolution that is one of the available resolutions included in the first resolution set, and the MVP candidate list is the second.
- the first value represents a second soluble resolution that is one of the soluble resolutions included in the second resolution set, and the first soluble resolution and the second soluble resolution may be different.
- the first resolution set and the second resolution set both include a first available resolution, and when the MVP candidate list is configured using the second method, the first available resolution is the first value of the indicator. It may be indicated by a second value that is different from.
- the indicator is represented by a variable length bit, and the first value may be any one of a plurality of values represented by the variable length bit.
- the third value different from the first value of the indicator is a value represented by a bit having the shortest length among the plurality of values, and when the MVP candidate list is configured in the second method, the third value is the second value. If the resolution set indicates the smallest available resolution among a plurality of available resolution sets and the MVP candidate list is configured by the first method, the third value is a plurality of available resolutions included in the first resolution set. It is possible to indicate other soluble resolutions other than the smallest soluble resolution of the set.
- a video signal encoding apparatus comprising a processor
- the processor obtains a motion vector of the current block based on a position of a reference block referred to for motion compensation of the current block And constructing a motion vector predictor (MVP) candidate list for motion compensation of the current block using any one of a first method and a second method, wherein the plurality of candidates included in the MVP candidate list Obtain a motion vector difference value based on a difference between any one of the current block and the motion vector of the current block, and determine a signaled motion vector difference value based on a resolution of the motion vector difference value of the current block,
- the resolution of the motion vector difference value is any one of a plurality of available resolutions included in the resolution set
- the configuration of the plurality of available resolutions included in the solution set depends on whether the MVP candidate list of the current block is constructed using one of the first method and the second method.
- An encoding apparatus is provided for generating a bitstream that includes.
- the processor determines an indicator indicating any one of a plurality of available resolutions included in one of the first resolution set and the second resolution set, and includes the indicator and the signaled motion vector difference value.
- a bitstream can be generated.
- the value of the indicator is a first value
- the resolution indicated by the first value may vary depending on which of the first and second methods the MVP candidate list is configured. .
- the bitstream is characterized by that of the current block is modified based on the resolution of the motion vector difference value of the current block.
- a modified motion vector difference value wherein the resolution of the motion vector difference value is any one of a plurality of available resolutions included in the resolution set, and wherein the configuration of the plurality of available resolutions included in the resolution set includes: a first method and Provided is a computer readable recording medium storing a bitstream that depends on which of the second methods is used to construct a motion vector prediction (MVP) candidate list for motion compensation of the current block.
- MVP motion vector prediction
- the bitstream may further include an indicator indicating a resolution of a motion vector difference value of the current block among a plurality of available resolutions included in one of the first resolution set and the second resolution set.
- the value of the indicator is a first value
- the resolution indicated by the first value may vary depending on which of the first and second methods the MVP candidate list is configured.
- coding efficiency of a video signal may be increased.
- signaling efficiency regarding inter prediction of a current block may be increased.
- FIG. 1 is a schematic block diagram of a video signal encoding apparatus according to an embodiment of the present invention.
- FIG. 2 is a schematic block diagram of a video signal decoding apparatus according to an embodiment of the present invention.
- FIG. 3 illustrates an embodiment in which a coding tree unit is divided into coding units within a picture.
- FIG. 4 illustrates one embodiment of a method for signaling the splitting of a quad tree and a multi-type tree.
- 5 and 6 show an intra prediction method in more detail according to an embodiment of the present invention.
- FIG 7 illustrates an inter prediction method according to an embodiment of the present invention.
- FIG. 8 is a diagram illustrating a method of signaling a motion vector of a current block according to an embodiment of the present invention.
- FIG. 9 is a diagram illustrating a method of signaling a motion vector difference value of a current block according to an embodiment of the present invention.
- FIG. 10 is a diagram illustrating a method in which a resolution of a motion vector difference value of a current block is signaled according to an embodiment of the present invention.
- 11 and 12 are diagrams illustrating a method in which a resolution of a motion vector difference value of a current block is signaled according to another embodiment of the present invention.
- FIG. 13 is a diagram illustrating an embodiment in which a configuration of available resolutions included in a resolution set is changed.
- FIG. 14 is a diagram illustrating an embodiment of a method in which a resolution of a motion vector difference value of a current block is signaled according to a motion vector predictor of a current block.
- 15 is a diagram illustrating another embodiment of a method in which a resolution of a motion vector difference value is signaled according to a motion vector predictor of a current block.
- 16 is a diagram illustrating a method of obtaining a resolution of a motion vector difference value based on a template matching method according to an embodiment of the present invention.
- 17 is a diagram illustrating a method of obtaining a resolution of a motion vector difference value based on a bilateral matching method according to an embodiment of the present invention.
- FIG. 18 is a diagram illustrating a method in which a resolution of a motion vector difference value is signaled for each reference picture list of a current block according to an embodiment of the present invention.
- 19 is a diagram illustrating an embodiment of a method in which a resolution of a motion vector difference value of a current block is signaled according to a resolution of a picture.
- 20 is a diagram illustrating a method of resolution of a motion vector difference value based on a size of a reference picture of a current block according to an embodiment of the present invention.
- 21 is a flowchart illustrating a method of obtaining a resolution of a motion vector difference value of a current block according to an embodiment of the present invention.
- FIG. 22 is a flowchart illustrating a method of obtaining a resolution of a motion vector difference value of a current block according to an embodiment of the present invention.
- FIG. 23 is a flowchart illustrating a method of obtaining a motion vector of a current block according to an embodiment of the present invention.
- 24 is a flowchart illustrating a method of obtaining a motion vector of a current block according to an embodiment of the present invention.
- FIG. 25 is a diagram illustrating a method in which a sign bit of a motion vector difference value of a current block is implicitly signaled according to an embodiment of the present invention.
- FIG. 26 is a diagram illustrating a method in which a sign bit of a motion vector difference value of a current block is implicitly signaled according to an embodiment of the present invention.
- FIG. 27 is a diagram illustrating a method in which a sign bit of a motion vector difference value of a current block is implicitly signaled according to an embodiment of the present invention.
- FIG. 28 is a diagram illustrating an example of syntax for the embodiments of FIGS. 25 to 27.
- FIG. 29 is a diagram illustrating a resolution of a motion vector difference value of a current block and a method of predicting a motion vector predictor according to an embodiment of the present invention.
- FIG. 30 is a diagram illustrating a method of deriving a motion vector of a current block based on a plurality of motion vector difference values according to an embodiment of the present invention.
- FIG. 31 is a diagram illustrating motion compensation based on an affine model according to an embodiment of the present invention.
- 32 illustrates one embodiment of a four-parameter affine motion compensation method.
- 33 illustrates one embodiment of a six-parameter affine motion compensation method.
- 35, 36, 37 and 38 illustrate embodiments of a method of obtaining a set of control point motion vectors for prediction of the current block.
- FIG. 39 is a diagram illustrating a method of obtaining a control point motion vector of a current block according to another embodiment of the present invention.
- FIG. 40 illustrates a method of obtaining a control point motion vector of a current block according to an embodiment of the present invention.
- 41 is a view illustrating a method of controlling a control point motion vector difference value of a current block according to an embodiment of the present invention.
- FIG. 42 is a view illustrating a method of obtaining a control point motion vector of a current block according to another embodiment of the present invention.
- FIG. 43 illustrates a method in which a control point motion vector difference value is signaled when a control point motion vector of a current block is obtained according to the embodiment described with reference to FIG. 42.
- 44 is a diagram illustrating a method of signaling a control point motion vector difference value of a current block according to an embodiment of the present invention.
- 45 is a diagram illustrating a method of obtaining a motion vector using a difference predictor for control point motion vector difference values of a current block according to one embodiment of the present invention.
- 46 is a diagram illustrating a method of obtaining a control point motion vector of a current block using a difference predictor, according to an embodiment of the present invention.
- FIG. 47 is a diagram illustrating a method of obtaining a control point motion vector of a current block using a difference predictor according to another embodiment of the present invention.
- 48 is a diagram illustrating a method of obtaining a difference predictor according to an embodiment of the present invention.
- FIG. 49 illustrates a method of determining a difference vector predictor of a current block according to an embodiment of the present invention.
- 50 is a diagram illustrating how a control point motion vector difference value of a current block is signaled.
- 51 is a diagram illustrating a method of deriving a control point motion vector of a current block according to another embodiment of the present invention.
- FIG. 52 is a diagram illustrating a method of deriving a plurality of control point motion vectors for affine motion compensation of a current block according to one embodiment of the present invention.
- FIG. 53 illustrates various embodiments in which a current block is divided into a plurality of subblocks.
- 54 illustrates a method of dividing a current block according to an intra prediction mode of the current block.
- 55 illustrates a method of dividing a current block into a plurality of subblocks based on sample values of reference samples of the current block according to an embodiment of the present invention.
- FIG. 56 illustrates a method of determining a primary subblock group and a secondary subblock group according to an embodiment of the present invention.
- 57 illustrates a method for predicting a primary subblock group and a secondary subblock group according to an embodiment of the present invention.
- 58 illustrates an order in which coding tree units are processed according to an embodiment of the present invention.
- FIG. 59 illustrates a bidirectional intra prediction method according to an embodiment of the present invention.
- 60 is a view illustrating a method of predicting each of a plurality of subblocks divided from a current block according to an embodiment of the present invention.
- Coding may optionally be interpreted as encoding or decoding.
- an apparatus for generating a video signal bitstream by encoding (encoding) a video signal is referred to as an encoding apparatus or an encoder, and an apparatus for reconstructing a video signal by performing decoding (decoding) of a video signal bitstream is decoded.
- device or decoder referred to as device or decoder.
- the video signal processing apparatus is used herein as a term of a concept including both an encoder and a decoder.
- Information is a term that includes values, parameters, coefficients, elements, and the like. In some cases, meanings may be interpreted differently, and thus the present invention is not limited thereto.
- 'Unit' is used to refer to a basic unit of image processing or a specific position of a picture, and refers to an image region including both a luma component and a chroma component.
- 'block' refers to an image region including a luma component and a specific component of chroma components (ie, Cb and Cr).
- terms such as 'unit', 'block', 'partition', and 'region' may be used interchangeably.
- a unit may be used as a concept including a coding unit, a prediction unit, and a transform unit.
- a picture refers to a field or frame, and in some embodiments, the terms may be used interchangeably.
- the encoding apparatus 100 of the present invention includes a transformer 110, a quantizer 115, an inverse quantizer 120, an inverse transformer 125, a filter 130, and a predictor 150. ) And the entropy coding unit 160.
- the transform unit 110 obtains a transform coefficient value by converting a residual signal that is a difference between the input video signal and the prediction signal generated by the predictor 150.
- a discrete cosine transform DCT
- DST discrete sine transform
- the discrete cosine transform and the discrete sine transform divide the input picture signal into a block to perform the transform.
- the coding efficiency may vary depending on the distribution and the characteristics of the values in the transform domain.
- the quantization unit 115 quantizes the transform coefficient value output from the transform unit 110.
- the prediction unit 150 predicts the picture using a region already coded, and adds a residual value between the original picture and the predictive picture to the predicted picture to increase the coding efficiency.
- the method of obtaining is used.
- information that is also available at the decoder should be used when performing prediction at the encoder.
- the encoder performs a process of restoring the encoded current block again.
- the inverse quantization unit 120 inverse quantizes the transform coefficient value, and the inverse transform unit 125 restores the residual value by using the inverse quantized transform coefficient value.
- the filtering unit 130 performs a filtering operation for improving the quality of the reconstructed picture and improving the coding efficiency.
- a deblocking filter For example, a sample adaptive offset (SAO), an adaptive loop filter, and the like may be included.
- the filtered picture is output or stored in a decoded picture buffer (DPB) 156 for use as a reference picture.
- DPB decoded picture buffer
- the predictor 150 includes an intra predictor 152 and an inter predictor 154.
- the intra predictor 152 performs intra prediction in the current picture, and the inter predictor 154 predicts the current picture using the reference picture stored in the decoded picture buffer 156. Do this.
- the intra prediction unit 152 performs intra prediction from reconstructed samples in the current picture, and transmits the intra encoding information to the entropy coding unit 160.
- the intra encoding information may include at least one of an intra prediction mode, a Most Probable Mode (MPM) flag, and an MPM index.
- the inter predictor 154 may include a motion estimator 154a and a motion compensator 154b.
- the motion estimation unit 154a obtains a motion vector value of the current region by referring to a specific region of the reconstructed reference picture.
- the motion estimator 154a transmits a motion information set (reference picture index, motion vector information, etc.) for the reference region to the entropy coding unit 160.
- the motion compensator 154b performs motion compensation using the motion vector value transmitted from the motion estimator 154a.
- the inter prediction unit 154 transfers inter encoding information including the motion information set for the reference region to the entropy coding unit 160.
- the predictor 150 may include an intra block copy (BC) predictor (not shown).
- the intra BC prediction unit performs intra BC prediction from reconstructed samples in the current picture, and transmits the intra BC encoding information to the entropy coding unit 160.
- the intra BC predictor obtains a block vector value indicating a reference region used for prediction of the current region by referring to a specific region in the current picture.
- the intra BC predictor may perform intra BC prediction using the obtained block vector value.
- the intra BC predictor transfers the intra BC encoding information to the entropy coding unit 160.
- the intra BC encoding information may include block vector information.
- the transform unit 110 obtains a transform coefficient value by converting a residual value between the original picture and the predictive picture.
- the transformation may be performed in a specific block unit in the picture, and the size of the specific block may vary within a preset range.
- the quantization unit 115 quantizes the transform coefficient value generated by the transform unit 110 and transmits the quantized unit 115 to the entropy coding unit 160.
- the entropy coding unit 160 entropy-codes the quantized transform coefficients, intra encoding information, inter encoding information, and the like to generate a video signal bitstream.
- a variable length coding (VLC) method and an arithmetic coding method may be used.
- the variable length coding (VLC) scheme converts input symbols into consecutive codewords, which may have a variable length. For example, frequently occurring symbols are represented by short codewords and infrequently occurring symbols by long codewords.
- a context-based adaptive variable length coding (CAVLC) method may be used as a variable length coding method.
- Arithmetic coding converts consecutive data symbols into a single prime number, which can obtain the optimal fractional bits needed to represent each symbol.
- Context-based Adaptive Binary Arithmetic Code (CABAC) may be used as the arithmetic coding.
- CABAC Context-based Adaptive Binary Arithmetic Code
- the generated bitstream is encapsulated in a NAL unit.
- the NAL unit includes coded integer coding tree units.
- a bitstream In order to decode a bitstream in a video decoder, a bitstream must first be divided into NAL unit units, and then each separated NAL unit must be decoded.
- information necessary for decoding the video signal bitstream is a higher level set such as a picture parameter set (PPS), a sequence parameter set (SPS), a video parameter set (VPS), or the like. It may be transmitted through the Raw Byte Sequence Payload (RBSP).
- PPS picture parameter set
- SPS sequence parameter set
- VPN video parameter set
- RBSP Raw Byte Sequence Payload
- FIG. 1 illustrates an encoding apparatus 100 according to an embodiment of the present invention, in which blocks marked separately represent logically distinguishing elements of the encoding apparatus 100. Therefore, the above-described elements of the encoding apparatus 100 may be mounted in one chip or in a plurality of chips according to the design of the device. According to an embodiment, the operation of each element of the encoding apparatus 100 described above may be performed by a processor (not shown).
- the decoding apparatus 200 of the present invention includes an entropy decoding unit 210, an inverse quantization unit 220, an inverse transform unit 225, a filtering unit 230, and a prediction unit 250.
- the entropy decoding unit 210 entropy decodes the video signal bitstream to extract transform coefficients, intra encoding information, inter encoding information, and the like for each region.
- the inverse quantizer 220 inverse quantizes the entropy decoded transform coefficient, and the inverse transform unit 225 restores the residual value by using the inverse quantized transform coefficient.
- the video signal processing apparatus 200 reconstructs the original pixel value by summing the residual value obtained by the inverse transformer 225 with a predictor obtained by the predictor 250.
- the filtering unit 230 performs filtering on the picture to improve the picture quality. This may include a deblocking filter to reduce block distortion and / or an adaptive loop filter to remove distortion of the entire picture.
- the filtered picture is output or stored in a decoded picture buffer (DPB) 256 for use as a reference picture for the next picture.
- DPB decoded picture buffer
- the predictor 250 includes an intra predictor 252 and an inter predictor 254.
- the predictor 250 generates a predictive picture by using the encoding type decoded by the entropy decoding unit 210 described above, transform coefficients for each region, intra / inter encoding information, and the like.
- a decoded area of the current picture or other pictures including the current block may be used.
- a picture (or tile / slice) that can be performed is called an inter picture (or tile / slice).
- a picture (or tile / slice) using at most one motion vector and reference picture index to predict the sample values of each block among the inter pictures (or tiles / slices) is a predictive picture or a P picture (or , A tile / slice), and a picture (or tile / slice) using at most two motion vectors and a reference picture index is called a bi-predictive picture or a B picture (or tile / slice).
- the P picture (or tile / slice) uses up to one set of motion information to predict each block
- the B picture (or tile / slice) uses up to two motion information to predict each block.
- the motion information set includes one or more motion vectors and one reference picture index.
- the intra prediction unit 252 generates a prediction block by using the intra encoding information and the reconstructed samples in the current picture.
- the intra encoding information may include at least one of an intra prediction mode, a Most Probable Mode (MPM) flag, and an MPM index.
- MPM Most Probable Mode
- the intra predictor 252 predicts sample values of the current block by using reconstructed samples located on the left and / or top of the current block as reference samples.
- reconstructed samples, reference samples, and samples of the current block may represent pixels.
- sample values may represent pixel values.
- the reference samples may be samples included in the neighboring block of the current block.
- the reference samples may be samples adjacent to the left boundary of the current block and / or samples adjacent to the upper boundary. Further, the reference samples are located on a line within a predetermined distance from the upper boundary of the current block and / or on a line within a predetermined distance from the left boundary of the current block among the samples of the neighboring blocks of the current block. May be samples.
- the neighboring block of the current block is a left (L) block, an upper (A) block, a lower left (BL) block, an upper right (AR) block, or an upper left (Above Left) adjacent to the current block.
- AL may include at least one of the blocks.
- the inter prediction unit 254 generates a prediction block by using the reference picture and inter encoding information stored in the decoded picture buffer 256.
- the inter encoding information may include a motion information set (reference picture index, motion vector information, etc.) of the current block with respect to the reference block.
- Inter prediction may include L0 prediction, L1 prediction, and bi-prediction.
- L0 prediction means prediction using one reference picture included in the L0 picture list
- L1 prediction means prediction using one reference picture included in the L1 picture list.
- one set of motion information eg, a motion vector and a reference picture index
- up to two reference regions may be used, and these two reference regions may exist in the same reference picture or may exist in different pictures, respectively.
- up to two sets of motion information may be used, and two motion vectors may correspond to the same reference picture index or may be different from each other. It may also correspond.
- the reference pictures may be displayed (or output) before or after the current picture in time.
- the inter predictor 254 may obtain a reference block of the current block by using the motion vector and the reference picture index.
- the reference block exists in the reference picture corresponding to the reference picture index.
- a sample value of the block specified by the motion vector or an interpolated value thereof may be used as a predictor of the current block.
- an 8-tap interpolation filter can be used for luma signals and a 4-tap interpolation filter can be used for chroma signals.
- the interpolation filter for motion prediction in the subpel unit is not limited thereto.
- the inter predictor 254 performs motion compensation to predict the texture of the current unit from the previously reconstructed picture. In this case, the inter predictor may use the motion information set.
- the predictor 250 may include an intra BC predictor (not shown).
- the intra BC prediction unit performs intra BC prediction from reconstructed samples in the current picture, and transmits the intra BC encoding information to the entropy coding unit 160.
- the intra BC predictor obtains a block vector value of the current region indicating a specific region in the current picture.
- the intra BC predictor may perform intra BC prediction using the obtained block vector value.
- the intra BC predictor transfers the intra BC encoding information to the entropy coding unit 160.
- the intra BC encoding information may include block vector information.
- the predictor output from the intra predictor 252 or the inter predictor 254 and the residual value output from the inverse transform unit 225 are added to generate a reconstructed video picture. That is, the video signal decoding apparatus 200 reconstructs the current block by using the prediction block generated by the predictor 250 and the residual obtained by the inverse transform unit 225.
- FIG. 2 illustrates a decoding apparatus 200 according to an embodiment of the present invention, in which blocks separately displayed are logically distinguished elements of the decoding apparatus 200. Therefore, the above-described elements of the decoding apparatus 200 may be mounted in one chip or in a plurality of chips according to the design of the device. According to an embodiment, the operation of each element of the above-described decoding apparatus 200 may be performed by a processor (not shown).
- FIG. 3 illustrates an embodiment in which a coding tree unit (CTU) is divided into coding units (CUs) in a picture.
- CTU coding tree unit
- CUs coding units
- a picture may be divided into a sequence of coding tree units (CTUs).
- the coding tree unit consists of an NXN block of luma samples and two blocks of corresponding chroma samples.
- the coding tree unit may be divided into a plurality of coding units.
- the coding tree unit may be a leaf node without splitting. In this case, the coding tree unit itself may be a coding unit.
- the coding unit refers to a basic unit for processing a picture in the processing of the video signal described above, that is, in the process of intra / inter prediction, transformation, quantization, and / or entropy coding.
- the size and shape of the coding unit in one picture may not be constant.
- the coding unit may have a square or rectangular shape.
- the rectangular coding unit (or rectangular block) includes a vertical coding unit (or vertical block) and a horizontal coding unit (or horizontal block).
- the vertical block is a block whose height is larger than the width
- the horizontal block is a block whose width is larger than the height.
- non-square blocks may refer to rectangular blocks in the present specification, the present invention is not limited thereto.
- a coding tree unit is first divided into a quad tree (QT) structure. That is, in a quad tree structure, one node having a size of 2NX2N may be divided into four nodes having a size of NXN.
- a quad tree may also be referred to as a quaternary tree. Quad tree splitting can be performed recursively, and not all nodes need to be split to the same depth.
- the above-described leaf node of the quad tree may be further divided into a multi-type tree (MTT) structure.
- MTT multi-type tree
- one node in a multi-type tree structure, one node may be divided into a binary or ternary tree structure of horizontal or vertical division. That is, there are four partition structures in the multi-type tree structure: vertical binary partition, horizontal binary partition, vertical ternary partition, and horizontal ternary partition.
- the width and height of each node in each tree structure may have a power of two.
- BT binary tree
- a 2NX2N sized node may be divided into two NX2N nodes by vertical binary division and two 2NXN nodes by horizontal binary division.
- a 2NX2N sized node is divided into nodes of (N / 2) X2N, NX2N and (N / 2) X2N by vertical ternary division, and the horizontal ternary By splitting, it can be split into nodes of 2NX (N / 2), 2NXN and 2NX (N / 2).
- This multi-type tree split may be performed recursively.
- Leaf nodes of the multi-type tree may be coding units. If no splitting for a coding unit is indicated or if the coding unit is not large relative to the maximum transform length, then that coding unit is used as the unit of prediction and transform without further splitting. Meanwhile, at least one of the following parameters in the aforementioned quad tree and multi-type tree may be previously defined or transmitted through an RBSP of a higher level set such as PPS, SPS, VPS, and the like.
- Preset flags may be used to signal the division of the aforementioned quad tree and multi-type tree.
- a flag 'qt_split_flag' indicating whether a quad tree node is split
- a flag 'mtt_split_flag' indicating whether a multi-type tree node is split
- a flag 'mtt_split_vertical_flag' indicating a split direction of a multi-type tree node
- at least one of a flag 'mtt_split_binary_flag' indicating a split shape of the multi-type tree node.
- a coding tree unit is a root node of a quad tree and may be first divided into quad tree structures.
- 'qt_split_flag' is signaled for each node 'QT_node'. If the value of 'qt_split_flag' is 1, the node is divided into 4 square nodes. If the value of 'qt_split_flag' is 0, the node becomes the leaf node 'QT_leaf_node' of the quad tree.
- Each quad tree leaf node 'QT_leaf_node' may be further divided into a multi-type tree structure.
- 'mtt_split_flag' is signaled for each node 'MTT_node'. If the value of 'mtt_split_flag' is 1, the node is divided into a plurality of rectangular nodes. If the value of 'mtt_split_flag' is 0, the node becomes the leaf node 'MTT_leaf_node' of the multi-type tree.
- the node 'MTT_node' is divided into two rectangular nodes, and when the value of 'mtt_split_binary_flag' is 0, the node 'MTT_node' is divided into three rectangular nodes.
- Picture prediction (motion compensation) for coding is directed to coding units (i.e. leaf nodes of the coding unit tree) that are no longer divided.
- the basic unit for performing such prediction is hereinafter referred to as a prediction unit or a prediction block.
- the term unit used in the present specification may be used as a term to replace the prediction unit, which is a basic unit for performing prediction.
- the present invention is not limited thereto and may be broadly understood as a concept including the coding unit.
- the intra predictor predicts the sample values of the current block using reconstructed samples located on the left and / or top of the current block as reference samples.
- FIG. 5 shows one embodiment of reference samples used for prediction of the current block in intra prediction mode.
- the reference samples may be samples adjacent to the left boundary of the current block and / or samples adjacent to the upper boundary.
- the size of the current block is WXH and samples of a single reference line adjacent to the current block are used for intra prediction, at most 2W + 2H + 1 located on the left and / or top of the current block.
- Reference samples may be set using the four peripheral samples.
- samples on the plurality of reference lines may be used for intra prediction of the current block.
- the plurality of reference lines may be composed of n lines located within a preset distance from the boundary of the current block.
- separate reference line information indicating at least one reference line used for intra prediction of the current block may be signaled.
- the reference line information may include an index indicating one of the plurality of reference lines.
- the intra predictor may obtain a reference sample by performing a reference sample padding process.
- the intra predictor may perform a reference sample filtering process to reduce the error of the intra prediction. That is, the filtered reference samples may be obtained by filtering the reference samples acquired by the neighboring samples and / or the reference sample padding process.
- the intra predictor predicts the samples of the current block using unfiltered reference samples or filtered reference samples.
- the peripheral samples may include samples on at least one reference line.
- the peripheral samples may include adjacent samples on a line adjacent to the boundary of the current block.
- intra prediction mode information indicating an intra prediction direction may be signaled.
- the intra prediction mode information indicates any one of a plurality of intra prediction modes constituting an intra prediction mode set. If the current block is an intra predicted block, the decoder receives the intra prediction mode information of the current block from the bitstream. The intra prediction unit of the decoder performs intra prediction on the current block based on the extracted intra prediction mode information.
- the intra prediction mode set may include all intra prediction modes (eg, a total of 67 intra prediction modes) used for intra prediction. More specifically, the set of intra prediction modes may include planar mode, DC mode, and a plurality of (eg, 65) angular modes (ie, directional modes). In some embodiments, the intra prediction mode set may be configured with some of all intra prediction modes. Each intra prediction mode may be indicated through a preset index (ie, an intra prediction mode index). For example, as shown in FIG. 6, the intra prediction mode index 0 indicates the planar mode, and the intra prediction mode index 1 indicates the DC mode. In addition, the intra prediction mode indexes 2 to 66 may indicate different angle modes, respectively.
- the intra prediction mode index 0 indicates the planar mode
- the intra prediction mode index 1 indicates the DC mode.
- the intra prediction mode indexes 2 to 66 may indicate different angle modes, respectively.
- the intra prediction mode index 2 indicates a horizontal diagonal (HDIA) mode
- the intra prediction mode index 18 indicates a horizontal (HOR) mode
- the intra prediction mode index 34 indicates a diagonal (Diagonal, DIA).
- the intra prediction mode index 50 indicates a vertical (VER) mode
- intra prediction mode index 66 indicates a vertical diagonal (VDIA) mode.
- the inter prediction method may include a general inter prediction method optimized for translation motion and an affine model based inter prediction method which will be described later with reference to FIGS. 31 to 52.
- the motion vector may include at least one of a general motion vector for motion compensation and a control point motion vector for affine motion compensation according to the general inter prediction method.
- the decoder may predict the current block with reference to reconstructed samples of another decoded picture.
- the decoder obtains a reference block 702 in the reference picture 720 based on the motion information set of the current block 701.
- the motion information set may include a reference picture index and a motion vector 703.
- the reference picture index indicates a reference picture 720 including a reference block for inter prediction of the current block in the reference picture list.
- the reference picture list may include at least one of the above-described L0 picture list or L1 picture list.
- the motion vector 703 represents the offset between the coordinate value of the current block 701 in the current picture 710 and the coordinate value of the reference block 702 in the reference picture 720.
- the decoder obtains the predictor of the current block 701 based on the sample values of the reference block 702 and uses the predictor to reconstruct the current block 701.
- the encoder may search for a block similar to the current block in the pictures whose reconstruction order is earlier to obtain the aforementioned reference block.
- the encoder may search for a reference block in which the sum of the difference between the current block and the sample value is the minimum in the preset search range.
- at least one of sum of absolute difference (SAD) or sum of Hadamard transformed difference (SATD) may be used to measure the similarity between samples of the current block and the reference block.
- SAD may be a value obtained by adding up the absolute values of the respective differences between the sample values included in the two blocks.
- the SATD may be a sum of all absolute values of Hadamard transform coefficients obtained by Hadamard transform of the difference between sample values included in two blocks.
- the current block may be predicted using one or more reference regions. As described above, the current block may be inter predicted through a bi-prediction scheme using two or more reference regions.
- the decoder may obtain two reference blocks based on two sets of motion information of the current block.
- the decoder may obtain a first predictor and a second predictor of the current block based on sample values of each of the two reference blocks obtained.
- the decoder may reconstruct the current block using the first predictor and the second predictor. For example, the decoder may reconstruct the current block based on a sample-averaged average of the first predictor and the second predictor.
- one or more sets of motion information may be signaled for motion compensation of the current block.
- similarity between motion information sets for motion compensation of each of the plurality of blocks may be used.
- the motion information set used for the prediction of the current block may be derived from the motion information set used for the prediction of any one of the other reconstructed samples. This allows the encoder and decoder to reduce signaling overhead.
- various embodiments in which the motion information set of the current block is signaled will be described.
- the motion vector of the current block may be derived from the motion vector predictor (MVP) of the current block.
- the motion vector predictor referenced to derive the motion vector of the current block may be obtained using a motion vector predictor (MVP) candidate list.
- the MVP candidate list may include a predetermined number of MVP candidates (Candidate 1, Candidate 2, ..., Candidate N).
- the MVP candidate list may include at least one of a spatial candidate or a temporal candidate.
- the spatial candidate may be a set of motion information used for prediction of neighboring blocks within a certain range from the current block within the current picture.
- the spatial candidate may be configured based on available neighboring blocks of neighboring blocks of the current block.
- the temporal candidate may be a set of motion information used for prediction of blocks in a picture different from the current picture.
- a temporal candidate may be configured based on a specific block corresponding to the position of the current block within a specific reference picture. In this case, the position of the specific block indicates the position of the top-left sample of the specific block within the reference picture.
- the MVP candidate list may include a zero motion vector.
- a rounding process for the MVP candidate included in the MVP candidate list of the current block may be performed.
- a resolution of the motion vector difference value of the current block which will be described later, may be used.
- MVP candidates of the current block may each be rounded based on the resolution of the motion vector difference value of the current block.
- ATMVP advanced temporal motion vector prediction
- STMVP subblock-based temporal motion vecto prediction
- the encoder 810 and the decoder 820 may construct an MVP candidate list for motion compensation of the current block. For example, there may be candidates corresponding to samples that may have been predicted based on a motion information set that is the same as or similar to the motion information set of the current block among samples reconstructed before the current block.
- the encoder 810 and the decoder 820 may construct an MVP candidate list of the current block based on the plurality of candidate blocks.
- the encoder 810 and the decoder 820 may configure the MVP candidate list according to a predefined rule between the encoder 810 and the decoder 820. That is, MVP candidate lists configured in each of the encoder 810 and the decoder 820 may be identical to each other.
- the predefined rule may vary according to the prediction mode of the current block.
- the encoder and the decoder may construct the MVP candidate list of the current block using a first method based on the affine model.
- the first method may be a method of obtaining a control point motion vector candidate list. This will be described in detail with reference to FIGS. 31 to 52.
- the encoder and the decoder may construct the MVP candidate list of the current block using a second method not based on the affine model. .
- the first method and the second method may be different methods.
- the decoder 820 may derive the motion vector of the current block based on any one of at least one MVP candidate included in the MVP candidate list of the current block.
- the encoder 810 may signal an MVP index indicating the motion vector predictor referenced to derive the motion vector of the current block.
- the decoder 820 may obtain a motion vector predictor of the current block based on the signaled MVP index.
- the decoder 820 may derive the motion vector of the current block using the motion vector predictor.
- the decoder 820 may use the motion vector predictor obtained from the MVP candidate list as the motion vector of the current block without a separate motion vector difference value.
- the decoder 820 may reconstruct the current block based on the motion vector of the current block.
- the inter prediction mode in which the motion vector predictor obtained from the MVP candidate list is used as the motion vector of the current block without a separate motion vector difference value may be referred to as a merge mode.
- the decoder 820 may obtain a separate motion vector difference value for the motion vector of the current block.
- the decoder 820 may obtain the motion vector of the current block by summing the motion vector predictor obtained from the MVP candidate list and the motion vector difference value of the current block.
- the encoder 810 may signal a motion vector difference value (MV difference) indicating a difference between the motion vector of the current block and the motion vector predictor.
- MV difference motion vector difference value
- the decoder 820 may obtain the motion vector of the current block based on the motion vector difference value (MV difference).
- the decoder 820 may reconstruct the current block based on the motion vector of the current block.
- a reference picture index for motion compensation of the current block may be signaled.
- the encoder 810 of the prediction mode of the current block may signal a reference picture index indicating a reference picture including the reference block.
- the decoder 820 may obtain a POC of the reference picture referred to for reconstruction of the current block based on the signaled reference picture index.
- the POC of the reference picture may be different from the POC of the reference picture corresponding to the MVP that is referenced to derive the motion vector of the current block.
- the decoder 820 may perform motion vector scaling. That is, the decoder 820 may obtain the MVP 'by scaling the MVP.
- the motion vector scaling may be performed based on the POC of the current picture, the POC of the signaled reference picture of the current block, and the POC of the reference picture corresponding to the MVP.
- the decoder 820 may use MVP 'as a motion vector predictor of the current block.
- the motion vector of the current block may be obtained by summing the motion vector predictor and the motion vector difference value of the current block.
- the motion vector difference value may be signaled from the encoder.
- the encoder may generate and signal information indicative of the motion vector difference value by encoding the motion vector difference value.
- the information representing the motion vector difference value may include at least one of absolute value information of the motion vector difference value or sign information of the motion vector difference value.
- the absolute value and the sign of the motion vector difference value may be encoded separately.
- the absolute value of the motion vector differential value may not be signaled by the value itself.
- the encoder can reduce the magnitude of the signaled value using at least one flag representing the nature of the absolute value of the motion vector differential value.
- the decoder may derive the absolute value of the motion vector differential value using at least one flag from the signaled value.
- the at least one flag may include a first flag indicating whether the absolute value of the motion vector difference value is greater than N.
- N may be an integer. If the magnitude of the absolute value of the motion vector difference value is greater than N, the value (absolute value of the motion vector difference value -N) with the activated first flag may be signaled.
- the activated flag may represent a case where the magnitude of the absolute value of the motion vector difference value is larger than N.
- the decoder may obtain an absolute value of the motion vector difference value based on the activated first flag and the signaled value.
- a second flag abs_mvd_greater0_flag indicating whether an absolute value of a motion vector difference value is greater than '0' may be signaled.
- the second flag abs_mvd_greater0_flag [] indicates that the absolute value of the motion vector difference value is not greater than '0'
- the absolute value of the motion vector difference value may be '0'.
- the decoder may obtain the absolute value of the motion vector difference value using other information about the motion vector difference value. have.
- a third flag (abs_mvd_greater1_flag) indicating whether the absolute value of the motion vector difference value is greater than '1' may be signaled.
- the decoder may determine that the absolute value of the motion vector difference value is '1'.
- the decoder may obtain the absolute value of the motion vector difference value using another information about the motion vector difference value.
- the value (abs_mvd_minus2) absolute value of the motion vector difference value-2) may be signaled. This is because the absolute value of the motion vector difference value may be 2 or more when the absolute value of the motion vector difference value is larger than '1'.
- the absolute value of the motion vector difference value of the current block may be modified in at least one flag.
- the modified absolute value of the motion vector difference value may represent (absolute value of the motion vector difference value-N) according to the magnitude of the motion vector difference value.
- the modified absolute value of the motion vector differential value may be signaled via at least one bit.
- the number of bits signaled to indicate the modified absolute value of the motion vector difference value may be variable.
- the encoder can encode the modified absolute value of the motion vector difference value using a variable length binarization method.
- the encoder may use at least one of the variable length binarization method of truncated unary binarization, unary binarization, truncated rice or exp-Golomb binarization.
- the sign of the motion vector difference value may be signaled through a sign flag (mvd_sign_flag). Meanwhile, the sign of the motion vector difference value may be implicitly signaled by sign-bit-hiding. This will be described with reference to FIGS. 23 to 28.
- the aforementioned motion vector difference value of the current block may be signaled in a specific resolution unit.
- the resolution of the motion vector difference value may indicate a unit in which the motion vector difference value is signaled. That is, in the present disclosure, the resolution excluding the resolution of the picture may indicate a precision to granularity in which a motion vector difference value is signaled.
- the resolution of the motion vector difference value may be expressed in units of samples or pixels. For example, the resolution of motion vector differential values may be expressed using units of samples, such as quarter, half, integer, two, four sample units. Also, as the resolution of the motion vector difference value of the current block is smaller, the precision of the motion vector difference value of the current block may increase.
- the motion vector difference value may be signaled based on various resolutions.
- the absolute value or the transformed absolute value of the motion vector differential value may be signaled as an integer sample unit value.
- the absolute value of the motion vector difference value may be signaled as a value of 1 / 2-subpel units. That is, the resolution of the motion vector difference value may be set differently depending on the situation.
- the encoder and the decoder according to an embodiment of the present invention can efficiently signal the motion vector difference value of the current block by appropriately utilizing various resolutions for the motion vector difference value.
- the resolution of the motion vector difference value may be set to a different value for each unit of at least one of a block, a coding unit, a slice, or a tile.
- the first resolution of the motion vector difference value of the first block may be 1/4 sample unit.
- '64' which is a value obtained by dividing the absolute value '16' of the motion vector difference value by the first resolution
- the second resolution of the motion vector difference value of the second block may be an integer sample unit.
- '16' which is a value obtained by dividing the absolute value '16' of the second motion vector difference value by the second resolution, may be signaled.
- the encoder may signal information indicative of the motion vector differential value based on the resolution of the motion vector differential value.
- the decoder may obtain a modified motion vector difference value from the signaled motion vector difference value.
- the decoder may modify the motion vector difference value based on the resolution of the resolution difference value.
- the relationship between the signaled motion vector difference value (valuePerResoultion) and the modified motion vector difference value (value Determined) of the current block is shown in Equation 1 below.
- the motion vector difference value represents a modified motion vector difference value (Determined).
- the signaled motion vector difference value represents a value before being corrected by resolution.
- resoultion represents a resolution of a motion vector difference value of the current block. That is, the decoder may obtain the corrected motion vector difference value by multiplying the signaled motion vector difference value and resolution of the current block. Next, the decoder may obtain the motion vector of the current block based on the modified motion vector difference value. Also, the decoder may reconstruct the current block based on the motion vector of the current block.
- the signaled value itself may be increased to increase signaling overhead for the motion vector difference value of the current block.
- the signaling overhead for the motion vector difference value can be reduced by reducing the size of the signaled value.
- the motion vector difference value of the current block may be signaled through fewer bits than when the resolution of the motion vector difference value of the current block is small.
- it may be difficult to express the motion vector difference value of the current block in detail.
- the encoder and decoder may select an advantageous resolution to signal a motion vector difference value according to the situation from among the plurality of resolutions.
- the encoder can signal the selected resolution based on the situation.
- the decoder may obtain a motion vector difference value of the current block based on the signaled resolution.
- the resolution of the motion vector difference value of the current block may be any one of a plurality of available resolutions included in the resolution set.
- the plurality of available resolutions may represent the resolutions available in a particular situation.
- the type and number of available resolutions included in the resolution set may vary depending on the situation.
- FIG. 10 is a diagram illustrating a method in which a resolution of a motion vector difference value of a current block is signaled according to an embodiment of the present invention.
- a resolution indicator indicating a resolution of the motion vector difference value of the current block among the plurality of available resolutions may be signaled.
- the encoder may signal a resolution indicator with information indicating the motion vector difference value.
- the decoder may obtain a resolution of the motion vector difference value of the current block based on a resolution indicator indicating any one of a plurality of available resolutions included in the resolution set of the current block.
- the decoder may obtain the motion vector difference value of the current block based on the resolution of the obtained motion vector difference value.
- the resolution indicator may be represented by a variable length bit.
- the resolution indicator may indicate any one of the resolution indices indicating each of the plurality of available resolutions in the resolution set of the current block.
- the resolution index may be represented by a variable length bit having a preset maximum length.
- the resolution indicator may include two or more flags each represented by one bit.
- the preset maximum length may be a length determined according to the number of available resolutions. For example, if the available resolution set includes three available resolutions, the preset maximum length may be '2'.
- the resolution index may be referred to as the value of the resolution indicator. Referring to FIG. 10, the value of the resolution indicator may be one of 0, 10, or 11.
- the resolution set for motion compensation of the current block may include available resolutions in units of 1/4, 1, 4 samples.
- the resolution of the motion vector difference value of the current block may be any one of the available resolutions 1/4, 1, and 4 shown in FIG. 10.
- the smallest available resolution (ie, the highest precision resolution) of the plurality of available resolutions may be signaled by the indicator value using the shortest bit length.
- an available resolution of 1/4 sample units which is the smallest value of available resolutions in units of 1/4, 1, and 4 samples, may be indicated by '0', which is an indicator value using the shortest bit length.
- the remaining available resolutions may be indicated by indicator values represented by '10' and '11', respectively.
- the signaling overhead may be reduced when the available resolution indicated by using the shortest length bit is used as the resolution of the motion vector difference value of the current block.
- the available resolution having a high probability of being selected as a resolution of the motion vector difference value of the current block may be set to be signaled using the shortest bit length. That is, the available resolution indicated by the resolution indicator of the same indicator value may vary depending on the situation. This will be described in detail with reference to FIGS. 11 to 12.
- the resolution set of the current block may consist of advantageous available resolutions depending on the situation. That is, the configuration of the plurality of available resolutions included in the resolution set of the current block may vary depending on the situation. This will be described in detail with reference to FIG. 13.
- FIG. 11 and 12 are diagrams illustrating a method in which a resolution of a motion vector difference value of a current block is signaled according to another embodiment of the present invention.
- FIG. 11 illustrates that the resolution set includes three available resolutions, the present disclosure is not limited thereto.
- the resolution set may include a first available resolution (Resolution 1), a second available resolution (Resolution 2), and a third available resolution (Resolution 3).
- the resolution indicator indicating each of the plurality of available resolutions included in the resolution set may be one of 0, 10, and 11.
- the available resolution indicated by the resolution indicator of the same indicator value may vary depending on the situation.
- an indicator value using the shortest bit of the values of the resolution indicator indicates the first available resolution in the first situation (case 1), and indicates the second available resolution in the second situation (case 2). can do.
- the first soluble resolution and the second soluble resolution may be different from each other.
- the first available resolution (Resolution 1), the second available resolution (Resolution 2), and the third available resolution (Resolution 3) are 0, 10, and 11 respectively. May be the available resolution indicated.
- the first available resolution (Resolution 1), the second available resolution (Resolution 2), and the third available resolution (Resolution 3) are respectively 10, It may be an available resolution indicated in the case of 0 and 11.
- the resolution of the motion vector difference value of the current block may be signaled by the method of FIG. 12 (a) or the method of FIG. 12 (b).
- the resolution set may include available resolutions in units of 1/4, 1 and 4 samples.
- each of the available resolutions may be indicated by different indicator values depending on the situation. For example, referring to FIG. 12A, available resolutions in units of 1/4, 1, and 4 samples may be signaled by 10, 0, and 11, respectively. That is, the smallest available resolution among the plurality of available resolutions may be indicated by an indicator value using the shortest bit length.
- This signaling method may be used in situations where it is advantageous to signal the motion vector differential value of the current block based on the smallest available resolution among the plurality of available resolutions.
- available resolutions in units of 1/4, 1, and 4 samples may be signaled by 10, 11, and 0, respectively. That is, according to an embodiment of the present invention, it may be advantageous to signal the motion vector difference value of the current block based on the available resolution rather than the smallest available resolution among the plurality of available resolutions according to the situation.
- the available resolution that is not the smallest available resolution among the plurality of available resolutions may be indicated by the indicator value using the shortest bit length.
- the largest available resolution among the plurality of available resolutions may be indicated by an indicator value using the shortest bit length.
- FIG. 13 is a diagram illustrating an embodiment in which a configuration of available resolutions included in a resolution set is changed.
- the resolution of the motion vector difference value in the first situation (case1) is obtained from the first situation resolution set
- the resolution of the motion vector difference value in the second situation (case2) is the second situation resolution. Can be obtained from a set.
- the first situation resolution set may include a first available resolution (Resolution 1), a second available resolution (Resolution 2), and a third available resolution (Resolution 3).
- the second situation resolution set may include a fourth available resolution (A), a fifth available resolution (B), and a sixth available resolution (C).
- some of the available resolutions included in the first situation resolution set and some of the available resolutions included in the second situation resolution set may be identical to each other. That is, certain available resolutions may be included in both the first situation resolution set and the second situation resolution set.
- the first situation resolution set may consist of available resolutions in units of 1/4, 1, 4 samples.
- the second situation resolution set may consist of available resolutions in units of 1/4, 1/2, 1 sample. That is, the second situation resolution set may include other available resolutions instead of the largest available resolution among the plurality of available resolutions included in the first situation resolution set.
- the other soluble resolution may be a smaller soluble resolution than the largest soluble resolution.
- the largest available resolution among the available resolutions included in the second situation resolution set may be smaller than the largest available resolution among the available resolutions included in the first situation resolution set.
- the first situation resolution set may be advantageous in a situation in which signaling overhead needs to be reduced compared to a situation in which the precision of the motion vector difference value needs to be increased.
- the second situation resolution set may be advantageous in situations where the precision of the motion vector differential value needs to be increased compared to the situation in which signaling overhead needs to be reduced.
- the precision of the required motion vector difference value may vary according to the prediction mode of the current block.
- motion compensation based on the affine model may be motion prediction for irregular motions other than translation motion. Accordingly, when the prediction mode of the current block is the motion compensation mode based on the affine model, it may be necessary to signal the motion vector difference value in detail compared to the conventional general inter prediction mode.
- the MVP candidate list of the current block may be configured in different ways according to the prediction mode of the current block. Accordingly, the configuration of the plurality of available resolutions included in the resolution set of the current block may vary depending on how the MVP candidate list for motion compensation of the current block is constructed.
- the probability that the similarity between the motion vector of the current block and the motion vector predictor is high may vary depending on how the MVP candidate list for motion compensation of the current block is constructed. Accordingly, the configuration of the plurality of available resolutions included in the resolution set of the current block may vary depending on how the MVP candidate list for motion compensation of the current block is constructed.
- the situation referred to in the above-described embodiments through FIGS. 10 to 13 may refer to a method in which an MVP candidate list of the current block is configured.
- the MVP candidate list for motion compensation of the current block may be configured based on any one of a plurality of methods.
- the MVP candidate list of the current block may be configured in different ways according to the prediction mode of the current block. That is, the situation mentioned in the above embodiments may be defined according to which of the plurality of methods the MVP candidate list for the motion compensation of the current block is configured.
- the configuration of the plurality of available resolutions included in the resolution set of the current block may vary according to a method of constructing an MVP candidate list of the current block.
- the encoder and the decoder may construct an MVP candidate list for motion compensation of the current block by using any one of the first method and the second method described above.
- the configuration of the plurality of available resolutions included in the resolution set of the current block may vary depending on which of the first and second methods described above is used to construct the MVP candidate list of the current block.
- resolution of the motion vector difference value of the current block may be obtained from the first resolution set.
- the resolution of the motion vector difference value of the current block may be obtained from the second resolution set.
- some of the plurality of available resolutions constituting the first resolution set and the plurality of available resolutions constituting the second resolution set may be different from each other.
- the second resolution set may include at least one other available resolution other than the plurality of available resolutions included in the first resolution set.
- the first method may be a method for constructing an MVP candidate list based on an affine model
- the second method may be a method for constructing an MVP candidate list based on an affine model.
- Motion compensation based on the affine model may be motion prediction for irregular motions other than translation motion. Accordingly, it may be necessary to signal the motion vector difference value in detail as compared with the conventional general inter prediction method.
- the first resolution set may include other available resolutions instead of the largest available resolution among the plurality of available resolutions included in the second resolution set.
- the other soluble resolution may be a smaller soluble resolution than the largest soluble resolution.
- the largest available resolution among the available resolutions included in the first resolution set may be smaller than the largest available resolution among the available resolutions included in the second resolution set.
- the largest available resolution among the available resolutions included in the first resolution set may be resolution of one sample unit.
- the largest available resolution among the available resolutions included in the second resolution set may be resolution of 4 sample units.
- the first resolution set may be composed of available resolutions in units of 1/4, 1/2, 1 sample.
- the second resolution set may be composed of available resolutions in units of 1/4, 1, 4 samples.
- the first resolution set may be composed of available resolutions in units of 1/16, 1/4, 1 sample.
- the second resolution set may be composed of available resolutions in units of 1/4, 1, 4 samples.
- the decoder may use the signaled resolution indicator to determine the resolution of the motion vector difference value of the current block. For example, the decoder may obtain a resolution indicator indicating a resolution of a motion vector difference value of the current block among a plurality of available resolutions included in either one of the first resolution set and the second resolution set. Also, the decoder may obtain the modified motion vector difference value of the current block based on the resolution indicator. The decoder may reconstruct the current block based on the modified motion vector difference value.
- the available resolution indicated by a particular value of resolution indicator values may vary depending on which of the first and second methods the MVP candidate list is constructed.
- the decoder may obtain a resolution indicator having the first value. If the MVP candidate list for motion compensation of the current block is configured using the first method, the available resolution indicated by the first value may be the seventh available resolution. If the MVP candidate list for motion compensation of the current block is configured using the second method, the available resolution indicated by the first value may be an eighth available resolution. In this case, the seventh soluble resolution and the eighth soluble resolution may be different resolutions.
- the seventh soluble resolution may be an soluble resolution that includes both the first resolution set and the second resolution set.
- the seventh available resolution may be indicated by a second value different from the first value.
- the first value may be any one of '10 and 11 'or one of '00 and 01'.
- the second value may be any one different from the first value among '10 and 11 'or one different from the first value among '00 and 01'.
- the smallest available resolution among the available resolutions included in the first resolution set may be smaller than the smallest available resolution among the available resolutions included in the second resolution set.
- the available resolutions included in the second resolution set may be relatively large resolutions. Accordingly, when the MVP candidate list for motion compensation of the current block is configured using the second method, it may be necessary to increase the precision of the motion vector difference value. As mentioned above, when there is a need to increase the precision of the motion vector difference value, it may be advantageous to signal the smallest available resolution using the shortest length of bits among the plurality of available resolutions.
- the third value may be a value expressed using a bit having the shortest length among the values of the resolution indicator.
- the third value may indicate the smallest available resolution among the plurality of available resolutions included in the second resolution set. Can be. According to one embodiment, the smallest available resolution among the available resolutions included in the second resolution set may be 1/4.
- the available resolutions included in the first resolution set may be relatively small resolutions. Accordingly, when the MVP candidate list for motion compensation of the current block is configured using the first method, it may be necessary to reduce signaling overhead for the motion vector difference value. Therefore, when the MVP candidate list for motion compensation of the current block is configured using the first method, the third value indicates an available resolution other than the smallest available resolution among the plurality of available resolutions included in the first resolution set. can do. According to one embodiment, the third value may indicate the largest available resolution, the second smallest available resolution, or the second largest available resolution among the available resolutions included in the first resolution set. For example, the available resolution other than the smallest available resolution among the plurality of available resolutions included in the first resolution set may be any one of 1/4, 1/2, 1, and 4.
- the configuration of available resolutions included in the resolution set of the current block may vary depending on the MVP index indicating the motion vector predictor of the current block.
- the MVP index may indicate the number of candidates in the MVP candidate list of the current block that is referenced to derive the motion vector of the current block.
- the decoder may obtain an MVP index indicating a motion vector predictor referenced for motion compensation of the current block from the MVP candidate list for motion compensation of the current block.
- the available resolution indicated by the specific value of the resolution indicator of the current block may vary depending on whether the MVP index is larger or smaller than the preset index.
- the motion vector predictor candidate corresponding to the small MVP index may have a higher probability of being similar to the motion vector of the current block.
- the absolute value of the motion vector difference value of the current block may be smaller. Accordingly, when the MVP index corresponding to the motion vector predictor of the current block is smaller than the preset MVP index, the smallest available resolution among the plurality of available resolutions included in the resolution set of the current block is the shortest among the values of the resolution indicator. It can be indicated by a value expressed using bits of length.
- a specific available resolution which is not the smallest available resolution among the plurality of available resolutions included in the resolution set of the current block, It may be indicated by a value expressed using the bit of the shortest length among the values.
- the specific available resolution may be the largest resolution among the plurality of available resolutions.
- the particular available resolution may be the second largest or second smallest resolution among the plurality of available resolutions.
- the resolution set of the current block may include available resolutions in units of 1/4, 1, and 4 samples.
- the MVP index for motion compensation of the current block is smaller than the preset MVP index (Candidate 1, Candidate 2)
- the bit with the shortest bit of resolution, 1/4 unit, which is the smallest available resolution among 1/4, 1, and 4 May be signaled using.
- the MVP index for motion compensation of the current block is greater than the preset MVP index (Candidate N)
- Resolution of 1 or 4 units of 1/4, 1, 4 may be signaled using the smallest number of bits. Can be.
- FIG. 15 is a diagram illustrating another embodiment of a method in which a resolution of a motion vector difference value is signaled according to a motion vector predictor of a current block. As described above with reference to FIG. 14, depending on the MVP index for the motion compensation of the current block, a method in which the resolution of the motion vector difference value of the current block is signaled may vary.
- the MVP candidate list for motion compensation of the current block may include candidates obtained through various methods.
- the MVP candidate list for motion compensation of the current block may include at least one of a spatial candidate, a temporal candidate, or a zero motion vector.
- the configuration of the plurality of available resolutions included in the resolution set of the current block may vary depending on how the motion vector predictor of the current block is obtained. This is because similarity with the current block estimated according to the motion vector predictor candidate may be different. For example, it may be estimated that the spatial candidate has a high probability of being similar to the current block.
- motion vector predictor candidates such as temporal candidates and zero motion vectors, may be estimated to be less likely to be similar to the current block than spatial candidates.
- the smallest available resolution among the plurality of available resolutions included in the resolution set of the current block uses the shortest length of the resolution indicator values. It can be indicated by the value expressed.
- a specific available resolution that is not the smallest available resolution among the plurality of available resolutions included in the resolution set of the current block is the shortest length among the values of the resolution indicator. It can be indicated by a value expressed using the bits of.
- the specific available resolution may be the largest resolution among the plurality of available resolutions.
- the particular available resolution may be the second largest or second smallest resolution among the plurality of available resolutions.
- different resolution sets are shown to include the same number of available resolutions, but the present disclosure is not limited thereto.
- different resolution sets may include different numbers of available resolutions.
- the first resolution set may include three available resolutions.
- the third resolution set used in the third situation may include two available resolutions.
- the encoder and decoder may configure a resolution set that includes different numbers of available resolutions depending on the situation.
- the motion information set may include a reference picture index that indicates a reference picture of the current block.
- the decoder may obtain the POC of the reference picture of the current block from the signaled reference picture index.
- the configuration of the plurality of available resolutions included in the resolution set of the current block may vary according to the POC of the current picture and the POC of the reference picture. According to one embodiment, based on the POC of the current picture and the POC of the reference picture, some of the available resolutions that make up the resolution set of the current block may be excluded.
- the resolution of the motion vector difference value of the current block may be obtained from the fourth resolution set.
- the resolution of the motion vector difference value of the current block may be obtained from the fifth resolution set.
- the fourth resolution set may be configured of the remaining available resolutions except the smallest available resolution among the available resolutions included in the fifth resolution set. That is, according to the POC of the current picture and the POC of the reference picture, the number of available resolutions constituting the resolution set of the current block may vary.
- the resolution of the motion vector difference value of the current block may be signaled in another way according to the quantization parameter (QP).
- QP quantization parameter
- any of the signaling methods described above with reference to FIGS. 11 through 15 may be determined according to the QP of the current block.
- the resolution of the motion vector difference value of the current block may be signaled using the determined signaling method.
- the smaller the QP of the current block the smaller the resolution of the motion vector difference value of the current block.
- the resolution of the motion vector difference value of the current block may be signaled in different ways according to the frame rate.
- any of the signaling methods described above with reference to FIGS. 11 through 15 may be determined according to a frame rate of a video signal including a current block.
- the resolution of the motion vector difference value of the current block may be signaled using the determined signaling method.
- the higher the frame rate of the video signal the shorter the time interval between the frames, the higher the probability that the motion vector is smaller. Accordingly, the higher the frame rate of the current block, the smaller the resolution of the motion vector difference value of the current block.
- the resolution of the motion vector difference value of the current block may be signaled in another way according to the size ratio or size difference between the current block and the neighboring blocks of the current block.
- any of the signaling methods described above with reference to FIGS. 11 through 15 may be determined according to a size ratio or a size difference between a current block and neighboring blocks of the current block.
- the above-described embodiments may be applied in the same or corresponding manner even when a motion vector that is not a motion vector difference value is directly signaled.
- the encoder and the decoder may modify the motion vector predictor before adding the motion vector difference value.
- modification may be performed to the motion vector predictor only when some of the motion vector predictor candidates included in the MVP candidate list of the current block are selected as the motion vector predictor of the current block. For example, when a motion vector predictor candidate corresponding to an MVP index smaller than a predetermined MVP index among the motion vector predictor candidates included in the MVP candidate list of the current block is used as the motion vector predictor of the current block, the corresponding motion vector Modifications to the predictor can be performed.
- a method of signaling a plurality of available resolutions included in the resolution set may vary depending on whether modification to the motion vector predictor is performed. For example, when the motion vector predictor of the current block is modified, the smallest available resolution among the plurality of available resolutions included in the resolution set may be signaled using the smallest number of bits. In addition, when the motion vector predictor of the current block is not modified, any one of the resolutions other than the smallest available resolution among the plurality of available resolutions included in the resolution set may be signaled using the least number of bits. .
- the motion vector predictor may be modified after adding the motion vector difference values.
- the resolution of the motion vector difference value of the current block may be signaled in a different way than if the motion vector predictor is modified before adding the motion vector difference value.
- the prediction error can be reduced through the motion vector correction process even if the precision of the motion vector difference value is low.
- any one of the other resolutions other than the smallest available resolution among the plurality of resolutions included in the resolution set has the least number of bits. May be signaled using.
- the motion vector predictor of the current block is not modified before adding the motion vector difference value, the smallest available resolution among the plurality of available resolutions included in the resolution set may be signaled using the least number of bits.
- the motion vector modification process performed later may vary depending on which candidate the motion vector or motion vector predictor of the current block is.
- the process of modifying the motion vector may include a process for searching for a more accurate motion vector.
- the decoder may search for a block matching the current block according to a predefined method from the reference point.
- the reference point may be a position corresponding to the determined motion vector or the motion vector predictor.
- Motion vector search can be performed by various methods. For example, template matching or bilateral matching may be used for the search. In this case, the degree of movement from the reference point may vary according to a predefined method. Different motion vector correction processes may be different degrees of movement from the reference point.
- the correct motion vector predictor candidate may begin with a detailed correction process and the incorrect motion vector predictor candidate may begin with a less detailed correction process.
- the correct motion vector predictor candidate and the incorrect motion vector predictor candidate may be determined according to a position in the MVP candidate list.
- the correct motion vector predictor candidate and the incorrect motion vector predictor candidate may be determined according to how each of the motion vector predictor candidates was generated. How the motion vector predictor candidate is generated may indicate which position among the spatial candidates of the current block.
- a more detailed and less detailed modification can be whether the block is searched little by little or a lot more.
- a process of searching by moving a little more may be added from the best matching block found while moving a lot.
- the above-described template matching method may be a method of obtaining a comparison target block having the smallest difference from the template of the current block based on a value difference between templates of the comparison target block to be compared with the template of the current block.
- the template of a particular block may be obtained based on the surrounding samples of the particular block.
- 16 is a diagram illustrating a method of obtaining a resolution of a motion vector difference value based on a template matching method according to an embodiment of the present invention.
- the resolution of the motion vector difference value of the current block may not be signaled.
- the decoder may obtain a resolution of the current block based on a cost calculation, such as a template matching method.
- the reference block may be obtained based on the motion vector predictor and the motion vector difference value.
- the motion vector difference value may be a motion vector difference value modified by the resolution of the motion vector difference value of the current block. Accordingly, the position of the reference block in the reference picture may vary according to the resolution of the motion vector difference value of the current block.
- the resolution set for motion compensation of the current block may be configured with preset available resolutions.
- the resolution set of the current block may include a first available resolution (Resolution 1), a second available resolution (Resolution 2), and a third available resolution (Resolution 3).
- a plurality of reference block candidates corresponding to each of the available resolutions included in the resolution set of the current block may be obtained based on the reference point 1601 indicated by the motion vector predictor of the current block.
- Reference block candidates of the available resolution number included in the resolution set may be obtained.
- the plurality of reference block candidates correspond to the first reference block candidate 1602 corresponding to the first available resolution, the second reference block candidate 1603 corresponding to the second available resolution, and the third available resolution.
- the third reference block candidate 1604 may be included.
- the decoder may use any one of the plurality of reference block candidates as a reference block of the current block. For example, the decoder may select a reference block candidate having the lowest cost as a reference block of the current block based on each of the plurality of reference block candidates and the current block based on a template matching result. Also, the decoder may reconstruct the current block based on the reference block.
- the resolution of the motion vector difference value of the current block may be signaled based on a template matching result between each of the aforementioned reference block candidates and the current block.
- the template matching operation described above may be performed in the same manner as in the decoder.
- the encoder may signal the available resolution corresponding to the lowest cost reference block candidate using the least number of bits based on the template matching result.
- the encoder and the decoder may perform template matching only on some of the plurality of reference block candidates.
- the template matching with the current block may be performed only.
- the bit having the shortest length among the available resolutions included in the resolution set of the current block is used.
- the available resolution that is signaled can be determined. Either of the first available resolution and the second available resolution may be signaled using the bit of the shortest length.
- the third available resolution corresponding to the reference block candidate that has not performed template matching with the other of the first available resolution and the second available resolution may be signaled using additional bits.
- the encoder and the decoder may reduce the amount of computation required for the template matching method.
- whether the embodiment described with reference to FIG. 16 may be applied may be determined according to the magnitude of the signaled motion vector difference value.
- the template matching method may be used only when the signaled motion vector difference value is larger than the preset value. This is because the template matching cost difference between reference block candidates according to resolution may not be obvious when the signaled motion vector difference value is smaller than the preset value.
- FIG. 17 is a diagram illustrating a method of obtaining a resolution of a motion vector difference value based on a bilateral matching method according to an embodiment of the present invention.
- the two-side matching method may be used in place of the template matching method described with reference to FIG. 16.
- the bilateral matching method represents a method of reconstructing a current block based on reference blocks of each of two or more reference pictures along a motion trajectory.
- the two-side matching method may be to obtain a set having the smallest difference based on the difference between the reference blocks of each of the two or more reference pictures.
- the current block when the current block is a pair prediction block, the current block may be reconstructed based on two or more reference blocks of two or more different reference pictures.
- reference block candidates corresponding to a specific available resolution may be configured for each of a first reference picture and a second reference picture.
- the encoder and decoder determine a reference in the first reference picture 1 based on a bilateral matching result between the reference block candidate in the first reference picture 1 and the reference block candidate in the second reference picture 2.
- Reference blocks within the block and the second reference picture 2 may be obtained. 17 may be applied to the embodiments of FIG. 17 in the same or corresponding manner.
- two motion vector difference values may be separately signaled.
- resolutions applied to each of the two motion vector difference values may be the same or different from each other.
- the resolution of the motion vector difference value for each reference picture list may be determined based on the above-described two-side matching method.
- resolution sets corresponding to each of the two reference picture lists may be configured independently of each other.
- the resolution set corresponding to the first reference picture list L0 may include m available resolutions.
- the resolution set corresponding to the second reference picture list L1 may include n available resolutions.
- the encoder and the decoder determine a motion vector difference value of each of the reference picture list based on a bilateral matching result between n reference block candidates corresponding to the first reference picture list and m reference block candidates corresponding to the second reference picture list. Resolution of can be obtained.
- the encoder and the decoder may need to perform (nxm) bilateral matching.
- a resolution set common to a plurality of reference picture lists may be used for the resolution of the motion vector difference value.
- a resolution set commonly used for the first reference picture list L0 and the second reference picture list L1 may include n available resolutions.
- the same resolution may be applied to the motion vector difference values corresponding to each of the first reference picture list L0 and the second reference picture list L1.
- the encoder and the decoder may obtain a resolution of motion vector difference values of each of the first reference picture list L0 and the second reference picture list L1 based on n two-sided matching results.
- the difference between the motion vector predictor corresponding to the specific reference picture list and the motion vector and the difference between the motion vector predictor corresponding to the other reference picture list and the motion vector may be similar.
- the resolution of the motion vector difference value corresponding to the specific reference picture list may be the same as the resolution of the motion vector difference value corresponding to the other reference picture list.
- the resolution of the motion vector difference value corresponding to the specific reference picture list of the current block may be the same as the resolution of the motion vector difference value corresponding to the other reference picture list of the current block.
- FIG. 18 is a diagram illustrating a method in which a resolution of a motion vector difference value is signaled for each reference picture list of a current block according to an embodiment of the present invention.
- a first list resolution indicator indicating a resolution of a motion vector difference value corresponding to the first reference picture list L0 and a second indicating a resolution of a motion vector difference value corresponding to the second reference picture list L1.
- the list resolution indicator may be signaled respectively.
- the decoder may obtain a resolution of the motion vector difference value corresponding to the first reference picture list based on the first list resolution set and the first list resolution indicator.
- the decoder may obtain a resolution of the motion vector difference value corresponding to the second reference picture list based on the second list resolution set and the second list resolution indicator.
- one of the available resolutions included in the second list resolution set may be resolution (L0 resolution) depending on the resolution of the motion vector difference value corresponding to the first reference picture list.
- the decoder may determine a motion vector corresponding to the second reference picture list based on the resolution of the motion vector difference value corresponding to the first reference picture list.
- the resolution of the difference value can be determined.
- the decoder may use the same resolution as the resolution of the motion vector difference value corresponding to the first reference picture list as the resolution of the motion vector difference value corresponding to the second reference picture list.
- the preset value may be a value expressed using the least number of bits among the values of the second list resolution indicator.
- other values of the second list resolution indicator may be used as indicator values indicating remaining available resolutions (Remaining resolution 1, Remaining resolution 2), respectively.
- the resolution of the motion vector difference value corresponding to the first reference picture list L0 is determined before the resolution of the motion vector difference value corresponding to the second reference picture list L1.
- the present disclosure is not limited thereto.
- the first list resolution set may include a resolution that depends on the resolution of the motion vector difference value corresponding to the second reference picture list L1.
- FIG. 19 is a diagram illustrating an embodiment of a method in which a resolution of a motion vector difference value of a current block is signaled according to a resolution of a picture.
- the resolution of the motion vector difference value of the current block may be signaled in another way according to at least one of the resolution or size of the picture.
- Information about the resolution or size of the picture may be signaled from the encoder.
- the decoder can obtain information about the resolution or size of the signaled picture.
- the resolution of the motion vector difference value of a specific block may be different in each of a low resolution picture and a high resolution picture. Referring to FIG.
- the distance is determined in the high resolution picture.
- the value to represent may be greater than the value to indicate the corresponding distance in the low resolution picture.
- the resolution of the motion vector difference value of the current block may be set to a value larger than the resolution of the motion vector difference value of another picture in which the resolution of the picture is lower than the current picture including the current block.
- the smallest available resolution among the plurality of available resolutions may not be indicated by a value expressed using the shortest bit length.
- the available resolution rather than the smallest available resolution among the plurality of available resolutions may be indicated by a value represented using the shortest bit length.
- the resolution of the motion vector difference value may be signaled based on the size of the reference picture of the current block.
- 20 shows reference block candidates corresponding to each of the available resolutions included in the resolution set of the current block based on the reference point 2001 indicated by the motion vector predictor of the current block.
- the third reference block candidate corresponding to the third available resolution 3 is located outside the reference picture.
- the available resolution may be excluded from the signaling target. That is, when the point indicated by the motion vector difference value modified based on the specific available resolution based on the reference point 2001 is outside the boundary of the current picture, the available resolution may not be signaled.
- a resolution set may include N available resolutions.
- a resolution indicator indicating any one of (N-M) except for M available resolutions among N available resolutions may be signaled.
- the reference block candidate corresponding to each of the M available resolutions may be a reference block candidate outside the boundary of the reference picture.
- the resolution set may include a first soluble resolution, a second soluble resolution, and a third soluble resolution.
- the encoder may signal a resolution indicator indicating any one of the first available resolution and the second available resolution except for the third available resolution.
- the encoder may signal a resolution indicator indicating one of the first available resolution and the second available resolution using one bit.
- the decoder may determine an available resolution to be excluded from the signaling object based on the size of the reference picture of the current block and the signaled motion vector difference value. In the embodiment of FIG. 20, the decoder may recognize that the third available resolution will not be signaled. The decoder may obtain a resolution of the motion vector difference value of the current block based on the resolution indicator signaled through one bit.
- whether or not to use the method described above with reference to FIG. 20 may be determined based on the position of the reference point indicated by the motion vector predictor. For example, when the position of the reference point is within a preset distance from the boundary of the reference picture, the method described with reference to FIG. 20 may be used.
- whether the embodiment described with reference to FIG. 20 may be applied may be determined according to the magnitude of the signaled motion vector difference value. For example, only when the signaled motion vector difference value is greater than the preset value, the encoder and decoder may examine whether there is an available resolution that generates a reference block candidate that deviates from the reference picture. When the signaled motion vector difference value is smaller than the preset value, the encoder and the decoder may not use the method described with reference to FIG. 20.
- a new available resolution may be used in place of the available resolution excluded from the signaling subject. For example, if a reference block candidate corresponding to a motion vector difference value modified based on a particular available resolution is located outside the boundary of the reference picture, an indicator value indicating a specific available resolution may be used to determine an available resolution that is different from the specific available resolution. Can be directed. For example, other soluble resolutions may be smaller than certain soluble resolutions.
- the resolution set of the current block may consist of available resolutions in units of 1/4, 1, 4 samples. At least a part of the reference block candidate corresponding to the available resolution in units of 4 samples may be located outside the boundary of the reference picture of the current block. In this case, the resolution indicator value indicating the available resolution in units of 4 samples may indicate the available resolution in units of 2 samples.
- the resolution set of the current block includes available resolutions in units of 1/4, 1, and 4 samples, the present disclosure is not limited thereto. For example, at least some of the available resolutions in 1/4, 1, 4 sample units may be replaced by some of the available resolutions in 1/2, 2, 1/8, 1/16 sample units.
- the decoder may parse the bitstream to obtain a signaled motion vector difference value of the current block (S2101).
- the signaled motion vector difference value may be a value expressed in a resolution unit of the motion vector difference value.
- the decoder may obtain a resolution indicator indicating a resolution of the motion vector difference value of the current block.
- the resolution indicator may indicate any one of a plurality of values represented by bits of variable length.
- the decoder may parse the first bit of the resolution indicator (S2103). Next, the decoder may determine whether the first bit of the resolution indicator is '0' (S2105). If the first bit is '0', an available resolution of 1/4 unit may be used as a resolution of the motion vector difference value of the current block. In this case, the resolution indicator may not include the second bit, which will be described later.
- the decoder may determine whether a reference block candidate corresponding to an available resolution in units of four samples is located within a boundary of the reference picture (S2107).
- the reference block candidate corresponding to the available resolution in units of 4 samples may be a reference block candidate indicated by the motion vector candidate obtained based on the available resolution in units of 4 samples.
- the motion vector candidate may be a value obtained by adding a motion vector difference value modified based on available resolution in units of 4 samples from the signaled motion vector difference value of step S2101 to the motion vector predictor of the current block.
- the available resolution in units of one sample may be used as a resolution of the motion vector difference value of the current block.
- the resolution indicator may not include the second bit, which will be described later.
- the decoder may parse the second bit of the resolution indicator (S2109). Next, the decoder may determine the resolution of the motion vector difference value of the current block based on the second bit of the resolution indicator (S2111). For example, the indicator value indicating the available resolution in units of one sample may be '10', and the indicator value indicating the available resolution in units of four samples may be '11'. When the second bit of the resolution indicator is '0', the decoder may use the available resolution of one sample unit as the resolution of the motion vector difference value of the current block. Conversely, when the second bit of the resolution indicator is '1', the decoder may use the available resolution of 4 samples as a resolution of the motion vector difference value of the current block.
- step S2101 the step of obtaining the signaled motion vector difference value (S2101) is shown to precede the step (S2103) of parsing the first bit of the resolution indicator, but the present disclosure is not limited thereto.
- step S2101 may follow step S2103.
- each bit may be implemented through a separate index or flag on a syntax for video signal processing.
- parsing the second bit of the resolution indicator may be performed after obtaining at least the motion vector predictor of the current block.
- the second bit of the resolution indicator may be determined whether to parse according to a position indicated by the motion vector predictor of the current block.
- signaling for the corresponding available resolution may be omitted. That is, the second bit of the resolution indicator on the syntax in which the video signal is encoded or decoded may be parsed later than the motion vector predictor information of the current block.
- parsing the second bit of the resolution indicator may be performed after obtaining at least the signaled motion vector differential value of the current block.
- the second bit of the resolution indicator may be determined whether to parse according to the signaled motion vector difference value of the current block. That is, the second bit of the resolution indicator on the syntax at which the video signal is encoded or decoded may be parsed later than the information indicating the motion vector difference value of the current block.
- a decoder may parse a bitstream to obtain a signaled motion vector difference value of a current block (2001).
- the signaled motion vector difference value may be a value expressed in a resolution unit of the motion vector difference value.
- the decoder may obtain a resolution indicator indicating a resolution of the motion vector difference value of the current block.
- the decoder may parse the nth bit of the resolution indicator (S2205).
- n may be an integer from 1 to N.
- n may be a value sequentially increasing from 1 to N in accordance with a loop operation. If the nth bit of the resolution indicator is '0', the decoder may use the nth available resolution as a resolution of the motion vector difference value of the current block. In this case, the nth available resolution may be an available resolution indicated by an nth indicator value among available resolutions included in the resolution set of the current block.
- the decoder may exclude the nth available resolution from the previous resolution set (S2207).
- the decoder may obtain the first current resolution set by excluding the nth available resolution from the previous resolution set (S2207).
- the decoder may obtain the first current resolution set by excluding the nth available resolution from the initial resolution set.
- the decoder may determine whether the number of available resolutions included in the first current resolution set is one (S2209). When the number of available resolutions included in the first current resolution set is one, the decoder may use the available resolutions included in the first current resolution set as a resolution of the motion vector difference value of the current block.
- the decoder may exclude the available resolutions corresponding to the reference block candidates located outside the boundary of the reference picture in the first current resolution set (S2211).
- the decoder may obtain the second current resolution set by excluding an available resolution corresponding to a reference block candidate located outside the boundary of the reference picture in the first current resolution set.
- the decoder may determine whether the number of available resolutions included in the second current resolution set is one (S2213). When the number of available resolutions included in the second current resolution set is one, the decoder may use the available resolutions included in the second current resolution set as the resolution of the motion vector difference value of the current block. If the number of available resolutions included in the first current resolution set is not one, the decoder may perform steps S2203 to 2013 again. In addition, the decoder may increase n by one. In this case, the decoder may use the second current resolution set as the previous resolution set in step S2207 of the next loop operation.
- the information representing the motion vector difference value of the current block may include first information about the motion vector difference value and second information about the motion vector difference value.
- the first information and the second information may be different information on the motion vector difference value, respectively.
- the decoder may parse first information about a motion vector difference value.
- the decoder may parse the second information about the motion vector difference value.
- the decoder may obtain the motion vector of the current block based on the first information on the motion vector difference value and the second information on the motion vector difference value.
- any one of parsing the first information or the second information on the motion vector difference value may be omitted.
- a description will be given of a condition in which the first information or the second information about the motion vector difference value of the current block is parsed.
- the information representing the motion vector difference value of the current block may include first information about the motion vector difference value and second information about the motion vector difference value.
- the motion vector of the current block may be determined through either one of the first information about the motion vector difference value and the second information about the motion vector difference value.
- the decoder may parse first information about a motion vector difference value.
- the decoder may obtain a plurality of reference block candidates using the first information about the motion vector difference value.
- the decoder may determine whether all of the plurality of reference block candidates are located within a boundary of the reference picture. When some of the plurality of reference block candidates are located outside the boundaries of the reference picture, the decoder may obtain the motion vector of the current block based on the first information about the motion vector difference value. If all of the plurality of reference block candidates are located within the boundary of the reference picture, the decoder may parse the second information about the motion vector difference value. Next, the decoder may obtain the motion vector of the current block based on the first information on the motion vector difference value and the second information on the motion vector difference value.
- the first information about the motion vector difference value of the current block may be information excluding the sign information of the motion vector difference value.
- the first information about the motion vector difference value of the current block may indicate an absolute value of the motion vector difference value of the current block.
- the second information about the motion vector difference value of the current block may indicate a sign of the motion vector difference value of the current block.
- the motion vector difference value of the specific block may be obtained without parsing the second information. Accordingly, the encoder and decoder can reduce the signaling overhead for motion vector difference values.
- a method of implicitly signaling the sign information of the motion vector difference value of the current block will be described in detail.
- FIG. 25 is a diagram illustrating a method in which a sign bit of a motion vector difference value of a current block is implicitly signaled according to an embodiment of the present invention.
- the information representing the motion vector difference value may include at least one of absolute value information of the motion vector difference value and sign information of the motion vector difference value.
- the sign information of the motion vector difference value may be either a negative sign ( ⁇ ) or a positive sign (+).
- the information representing the motion vector difference value may include absolute value information and sign information for each component.
- the motion vector difference value of the current block may consist of an x-axis component and a y-axis component.
- the x-axis component of the motion vector difference value may include a distance (absolute value) and direction (sign) on the x-axis between the reference point indicated by the motion vector predictor of the current block and the position of the reference block.
- the y-axis component of the motion vector difference value may include a distance (absolute value) and direction (sign) on the y-axis between the reference point indicated by the motion vector predictor of the current block and the position of the reference block.
- Four reference block candidates (Candidate reference block 1) may be obtained. Also, based on the x-axis component of the motion vector difference value of the current block to which the positive sign (+) is applied and the y-axis component of the motion vector difference value of the current block to which the positive sign (-) is applied, the fifth reference block candidate Candidate reference block 2 may be obtained.
- the motion of the current block may be heightened.
- the encoder may not encode the heighted sign information.
- the decoder may determine the code of the motion vector difference value corresponding to the coded coded information without performing a parsing process on the coded information.
- a fourth reference block candidate (Candidate reference block 1) may be located outside the boundary of the reference picture.
- the sign information of the x-axis component of the motion vector difference value of the current block may be heightened.
- the decoder may acquire sign information of the x-axis component of the motion vector difference value without parsing sign information of the x-axis component of the motion vector difference value.
- the decoder may use a positive sign as a sign of the x-axis component of the motion vector difference value.
- FIG. 26 is a diagram illustrating a method in which a sign bit of a motion vector difference value of a current block is implicitly signaled according to an embodiment of the present invention.
- the motion vector predictor of the current block may not be determined until the sign of the motion vector difference value of the current block is determined.
- the sign of the motion vector difference value of the current block may be determined before the MVP index indicating the MVP of the current block is parsed on the syntax for video signal processing.
- the decoder adds a motion vector difference value to which a negative sign or a positive sign is applied to each of the MVP candidates A and MVP candidate B, thereby adding a plurality of reference block candidates (Candidate reference block A-1 and Candidate). reference block A-2, Candidate reference block B-1, and Candidate reference block B-2).
- the decoder may determine whether all of the candidate reference block A-1 and Candidate reference block B-1 based on a specific component of a motion vector difference value with a negative sign are located outside the boundary of the reference picture. Can be. If all of the plurality of reference block candidates based on a particular component of the negative vectored motion vector difference value are located outside the boundary of the reference picture, the decoder does not parse the sign information of the specific component, and thus the motion vector difference value of the current block is determined. The sign of a particular component can be determined. In this case, the decoder may use a positive sign as a sign of a specific component of the motion vector difference value of the current block.
- the decoder may determine whether all of the plurality of reference block candidates (Candidate reference block A-2 and Candidate reference block B-2) based on a specific component of a motion vector difference value with a positive sign are located outside the boundary of the reference picture. have. If all of the plurality of reference block candidates based on the particular component of the positive vectored motion vector difference value are located outside the boundary of the reference picture, the decoder may determine the motion vector difference value of the current block without the operation of parsing the sign information of the specific component. The sign of a particular component can be determined. In this case, the decoder may use a negative sign as a sign of a specific component of the motion vector difference value of the current block.
- FIG. 27 is a diagram illustrating a method in which a sign bit of a motion vector difference value of a current block is implicitly signaled according to an embodiment of the present invention.
- the resolution of the motion vector difference value of the current block may not be determined until the component of the motion vector difference value of the current block is determined.
- the sign of the motion vector difference value of the current block may be determined before the resolution indicator indicating the resolution of the motion vector difference value of the current block on the syntax for video signal processing is parsed.
- the decoder multiplies either one of the plurality of available resolutions res2 and res2, and adds a motion vector difference value to which one of a negative sign and a positive sign is applied to the motion vector predictor of the current block.
- Reference block candidates (Candidate reference block 1-1, Candidate reference block 1-2, Candidate reference block 2-1, Candidate reference block 2-2) may be obtained.
- the decoder may determine whether all of the candidate reference block candidates Candidate reference block 1-1 based on a specific component of a motion vector difference value with a negative sign are located outside the boundary of the reference picture. Can be.
- the available resolutions applied to the motion vector difference values may be different from each other to configure each of the plurality of reference block candidates based on a specific component of the motion vector difference value to which a negative sign is applied. If all of the plurality of reference block candidates based on a particular component of the negative vectored motion vector difference value are located outside the boundary of the reference picture, the decoder does not parse the sign information of the specific component, and thus the motion vector difference value of the current block is determined. The sign of a particular component can be determined. In this case, the decoder may use a positive sign as a sign of a specific component of the motion vector difference value of the current block.
- the decoder may determine whether all of the plurality of reference block candidates (Candidate reference block 1-2 and Candidate reference block 2-2) based on a specific component of a motion vector difference value to which a positive sign is applied are located outside the boundary of the reference picture. have.
- the available resolutions applied to the motion vector difference values may be different to form each of the plurality of reference block candidates based on a specific component of the motion vector difference value to which a positive sign is applied. If all of the plurality of reference block candidates based on the particular component of the positive vectored motion vector difference value are located outside the boundary of the reference picture, the decoder may determine the motion vector difference value of the current block without the operation of parsing the sign information of the specific component. The sign of a particular component can be determined. In this case, the decoder may use a negative sign as a sign of a specific component of the motion vector difference value of the current block.
- 25 to 27 illustrate an x-axis component of a motion vector difference value as an example for convenience of description, but the present disclosure is not limited thereto.
- the above-described embodiments can be applied in the same or corresponding way to the y-axis component of the motion vector difference value.
- FIG. 28 is a diagram illustrating an example of syntax for the embodiments of FIGS. 25 to 27.
- the decoder may determine whether to parse the sign information of the motion vector difference value based on the absolute value (
- the decoder adds to the sign information of the motion vector difference value based on the absolute value (
- the decoder may generate a motion based on the absolute value of the motion vector difference value (
- FIG. 29 is a diagram illustrating a method of signaling a resolution and a MVP of a motion vector difference value of a current block according to an embodiment of the present invention.
- two or more information related to the motion vector may be signaled based on one unified indicator.
- the resolution of the motion vector difference value of the current block and the MVP of the current block may be signaled by one integration indicator (MVR Index).
- MVR Index integration indicator
- an available resolution mapped to each of the MVP indices may be preset.
- the encoder and decoder may share a table in which each of the MVP indices and available resolutions are mapped to each other.
- the encoder and the decoder may obtain a resolution of the MVP of the current block and the motion vector difference value of the current block based on the shared table and the merge indicator (MVR Index).
- the accuracy of the motion vector may vary depending on the resolution used to correct the motion vector difference value. For example, the larger the resolution used to correct the motion vector difference value, the lower the accuracy of the motion vector. Accordingly, when a specific available resolution is used as a resolution of the motion vector difference value of the current block, an additional motion vector difference value of the current block may be signaled.
- the additional motion vector difference value may be referred to as a second through n-th motion vector difference value.
- the existing motion vector difference value except for the additional motion vector difference value may be referred to as a first motion vector difference value.
- the motion vector of the current block may be obtained by using a plurality of motion vector difference values and corresponding resolutions, respectively.
- an additional motion vector difference value may be signaled.
- the resolution set of the current block may include available resolutions in units of 1/4, 1, 4 samples.
- the additional motion vector difference value may be signaled.
- the additional motion vector difference value may be signaled based on a resolution smaller than the resolution at which the existing motion vector difference value was signaled.
- R1 represents a resolution of the first motion vector difference value
- R2 represents a resolution of the second motion vector difference value
- MVDval1 represents a first motion vector difference value signaled in units of R1
- MVDval2 represents a second motion vector difference value signaled in units of R2.
- the decoder may additionally obtain the signaled second motion vector difference value MVDval2.
- the resolution R2 of the second motion vector difference value may be smaller than the resolution R1 of the first motion vector difference value of the current block.
- the inter prediction method or the motion compensation method for the current block may include an affine model based motion compensation (hereinafter, referred to as affine motion compensation).
- affine motion compensation an affine model based motion compensation
- the existing inter prediction method inter prediction is performed using only one motion vector for each L0 prediction and L1 prediction for the current block.
- the conventional general inter prediction method is optimized for the prediction of translation motion.
- reference blocks of various shapes and sizes need to be used.
- FIG. 31 is a diagram illustrating motion compensation based on an affine model according to an embodiment of the present invention.
- prediction of the current block 3101 may be performed using a reference block 3102 having a different size, shape, and / or direction than the current block 3101. That is, the reference block 3102 may have a non-rectangular shape and may be larger or smaller in size than the current block 3101.
- the reference block 3102 may be obtained by performing an affine transformation on the current block 3101. Scaling, rotation, shearing, reflection, or orthogonal projection of the current block may be performed through the affine transformation.
- the affine transformation may be performed using a plurality of control point motion vectors (CPMVs).
- CPMVs control point motion vectors
- the affine transformation may include a six-parameter affine transformation using three control point motion vectors and a four-parameter affine transformation using two control point motion vectors. Specific embodiments thereof will be described later.
- affine motion compensation may be performed using a predetermined number of control point motion vectors (CPMVs).
- the control point motion vector (CPMV) is a motion vector corresponding to a specific control point (or sample position) of the current block.
- the particular control point may include at least one of the corners of the current block.
- the CPMV corresponding to the upper left corner of the current block is v0 (or the first CPMV), and the CPMV corresponding to the upper right corner of the current block is v1 (or the second CPMV).
- Each CPMV corresponding to the lower left corner of the block is referred to as v2 (or third CPMV).
- a CPMV set including at least two CPMVs can be used for affine motion compensation.
- 4-parameter affine motion compensation may be performed using v0 and v1.
- the current block 3201 indicated by the solid line may be predicted using the reference block 3202 at the position indicated by the dotted line.
- Each sample of the current block 3201 may be mapped to different reference samples through an affine transformation.
- the motion vector (v x , v y ) at the sample position (x, y) of the current block 3201 may be derived by Equation 2 below.
- the sample position may indicate relative coordinates within the current block.
- the sample position (x, y) may be a coordinate that sets the position of the upper left sample of the current block as the origin (0, 0).
- (v 0x , v 0y ) is the first CPMV corresponding to the upper left corner of the current block 3201
- (v 1x , v 1y ) is the second CPMV corresponding to the upper right corner of the current block.
- w is the width of the current block 3201.
- affine motion compensation using three or more CPMVs can be performed.
- six-parameter affine motion compensation may be performed using three CPMVs, namely v0, v1, and v2.
- v0 is a CPMV corresponding to the upper left corner of the current block
- v1 is a CPMV corresponding to the upper right corner of the current block
- v2 is a CPMV corresponding to the lower left corner of the current block.
- the motion vector of each subblock of the current block may be calculated based on the v0, v1, and v2. According to the embodiment of FIG.
- the current block 3301 indicated by the solid line may be predicted using the reference block 3302 at the position indicated by the dotted line.
- Each sample of the current block 3301 may be mapped to different reference samples through an affine transformation. More specifically, the motion vector (mv x , mv y ) at the sample position (x, y) of the current block 3301 may be derived by Equation 3 below.
- (mv 0 x , mv 0 y ) is the first CPMV corresponding to the upper left corner of the current block 3301
- (mv 1 x , mv 1 y ) is the second CPMV corresponding to the upper right corner
- (mv 2 x , mv 2 y ) is the third CPMV corresponding to the lower left corner
- w is the width of the current block 3301
- h is the height of the current block 3301.
- the current block may include a plurality of subblocks.
- a representative motion vector of each subblock may be obtained based on the CPMV sets v0, v1, and v2.
- the representative motion vector of each subblock may be a motion vector corresponding to the center sample position of the subblock.
- a motion vector of higher accuracy than a general motion vector may be used for the motion vector of the subblock.
- a motion compensation interpolation filter may be applied.
- the size of the subblock in which the affine motion compensation is performed may be set in various ways.
- the subblock may have a preset size, such as 4X4 or 8X8.
- the size MXN of the subblock may be determined by Equation 4 below.
- (v 2x , v 2y ) is the third CPMV corresponding to the lower left corner of the current block.
- the third CPMV may be calculated by Equation 2 described above. max (a, b) returns the greater of a and b, and abs (x) returns the absolute value of x. Also, clip3 (x, y, z) returns x if z ⁇ x, y if z> y, and z otherwise.
- the decoder obtains the motion vector of each subblock of the current block using the CPMVs of the CPMV set.
- the decoder may obtain a predictor of each subblock of the current block by using the representative motion vector of each subblock.
- the predictor of the current block may be obtained by combining the predictors of each subblock, and the decoder may reconstruct the current block by using the predictor of the current block thus obtained.
- the CPMV set for affine motion compensation of the current block may be obtained in various ways. More specifically, the CPMV set for prediction of the current block may be obtained with reference to the motion vector information set of one or more neighboring blocks. Also, a motion vector information set refers to a collection of motion vector information of one or more blocks.
- the neighboring block may refer to a block including a preset peripheral position of the current block. In this case, the neighboring block may be a coding unit including a preset peripheral position or an area of a preset unit (eg, 4X4, 8X8) including the peripheral position.
- a CPMV indicator indicating a set of motion vector information to be referred to for deriving a motion vector of each subblock of the current block may be signaled.
- the encoder can signal the CPMV indicator.
- the CPMV indicator may indicate a motion vector information set of neighboring block (s) to be referred to to derive the motion vector of each subblock of the current block.
- the decoder may obtain the indicator and obtain each CPMV of the CPMV set for the current block by referring to the motion vector information set of the neighboring block (s) indicated by the indicator.
- the encoder and decoder may generate a CPMV candidate list composed of one or more motion vector information set candidates.
- Each motion vector information set candidate constituting the CPMV candidate list is a motion vector set of neighboring blocks usable for deriving the motion vector of the current block.
- the CPMV indicator may be an index indicating one set of motion vector information from the CPMV candidate list.
- the CPMVs of the current block may be obtained with reference to the set of motion vector information selected based on the CPMV indicator (ie, index) in the CPMV candidate list.
- various embodiments of a motion vector information set candidate that may be included in a CPMV candidate list for deriving motion vector information (or CPMV set) of a current block will be described.
- the CPMV set of the current block includes two CPMVs, that is, v0 and v1.
- the CPMV of the current block may be derived from the motion vector of the neighboring block adjacent to the point.
- v0 may be derived from a motion vector of any one of neighboring blocks A, B and C adjacent to the point
- v1 may be a motion vector of any one of neighboring blocks D and E adjacent to the point. Can be derived from.
- a motion vector information set that may be included in the CPMV candidate list may be derived as in Equation 5 below. Can be.
- a (v0, v1) pair consisting of v0 selected from vA, vB, and vC and v1 selected from vD and vE may be obtained.
- v0 is derived from the motion vector of the block adjacent to the upper left corner of the current block
- v1 is derived from the motion vector of the block adjacent to the upper right corner of the current block.
- motion vector scaling may be performed based on a picture order count (POC) of a current block, a POC of a reference picture of a neighboring block, and a POC of a reference picture of a current block.
- POC picture order count
- a CPMV candidate list including the motion vector information set candidate obtained as described above may be generated, and a CPMV indicator indicating any one of the CPMV candidate list may be signaled.
- the CPMV candidate list may include a motion vector information set candidate for another method of inter prediction.
- the CPMV candidate list may include a motion vector information set candidate obtained based on an MVP candidate for existing inter prediction.
- the decoder may derive the CPMVs of the current block based on the set of motion vector information obtained in the candidate list. According to an embodiment, the decoder may perform a merge merge by using the motion vectors of the motion vector information set obtained from the candidate list as the CPMV of the current block without a separate motion vector difference value.
- This affine motion compensation method may be referred to as affine merge prediction mode.
- the decoder may obtain a separate motion vector difference value for the CPMV of the current block.
- the decoder may add the motion vectors of the motion vector information set obtained from the CPMV candidate list with the motion vector difference value to obtain the CPMV of the current block.
- This affine motion compensation method may be referred to as affine inter prediction mode.
- a flag or index indicating whether the decoder uses a separate motion vector difference value for the affine motion compensation of the current block may be separately signaled.
- whether a separate motion vector difference value is used for affine motion compensation of the current block may be determined based on the size of the current block (eg, CU size). For example, when the size of the current block is greater than or equal to a preset size, the encoder and the decoder may be set to use separate motion vector difference values for affine motion compensation of the current block.
- the CPMV of the current block may be derived from the motion vector information of the neighboring block on which the affine motion compensation is performed. That is, the CPMV of the current block may be derived from the CPMV or motion vector of the neighboring block.
- the neighboring block may include a left neighboring block of the current block and an upper neighboring block of the current block. Referring to FIG. 36 (a), the left peripheral block includes blocks adjacent to the lower left corner of the current block, that is, the left block A and the lower left block D.
- the upper peripheral block includes a block adjacent to the upper left corner of the current block, that is, the upper left block E, and blocks adjacent to the upper right corner of the current block, that is, the upper block B and the upper right block C.
- the decoder checks whether the neighboring blocks have affine motion compensation performed in a predetermined order.
- the preset order may be A, B, C, D, E.
- the decoder obtains the CPMV set of the current block by using the CPMV set (or motion vector) of the neighboring block. Referring to the embodiment of FIG.
- the CPMV set of the left block A may be used to derive the CPMV set of the current block. That is, the CPMV set (v0, v1) of the current block may be obtained based on the CPMV sets (v2, v3, v4) of the left block A.
- each of the CPMV sets of neighboring blocks of the current block may be a motion vector information set candidate constituting the aforementioned CPMV candidate list according to a preset order. More specifically, the motion vector information set candidate is derived from the first candidate derived from the CPMVs (or motion vectors) of the left neighboring block of the current block, and from the CPMVs (or motion vectors) of the upper neighboring block of the current block.
- the second candidate may be included.
- the left peripheral block is a block adjacent to the lower left corner of the current block
- the upper peripheral block is a block adjacent to the upper left corner of the current block or a block adjacent to the upper right corner of the current block.
- a CPMV candidate list including the motion vector information set candidate obtained as described above may be generated, and a CPMV indicator indicating any one of the CPMV candidate list may be signaled.
- the CPMV indicator may indicate location information of the neighboring block (s) referenced to derive the motion vector of each subblock of the current block.
- the decoder may obtain the CPMV set of the current block by referring to the CPMV set (or motion vector) of the neighboring block indicated by the CPMV indicator.
- the CPMV of the current block may be derived based on the CPMV of the neighboring block close to the point.
- v0 may be obtained by referring to the CPMV of the left neighboring block
- v1 may be obtained by referring to the CPMV of the upper neighboring block.
- v0 may be obtained by referring to the CPMV of the neighboring block A, D or E
- v1 may be obtained by referring to the CPMV of the neighboring block B or C.
- the CPMV of the current block may be derived from the CPMV or motion vector of the block on which the affine motion compensation is performed.
- the CPMV of the current block may be derived from the CPMV set or at least one motion vector of the corresponding block.
- the preset positions may be A0 and A1 adjacent to the lower left corner of the current block, B0 and B1 adjacent to the upper right corner, and the upper left B2 position.
- the preset position may include a position not adjacent to the current block.
- the preset position may include a position corresponding to the position of the current block in a picture other than the current picture. That is, the CPMV set of the current block may be derived from a spatial candidate or a temporal candidate corresponding to a preset position.
- the motion information set candidate obtained by the method described with reference to FIG. 37 may be referred to as an inherited candidate or an affine merge candidate.
- the CPMV of the current block may be derived from the motion vector information of the neighboring block on which the affine motion compensation is performed.
- the CPMV set ((v_0x, v_0y), (v_1x, v_1y)) for 4-parameter affine motion compensation for the current block may be derived as shown in Equation 6.
- (v_E0x, v_E0y) represents the motion vector used for the affine motion compensation of the upper left block of the current block
- (v_E1x, v_E1y) represents the motion vector used for the affine motion compensation of the upper right block of the current block
- (V_E2x, v_E2y) may represent the motion vector used for the affine motion compensation of the lower left block of the current block.
- the CPMV of the current block may be obtained with reference to one or more motion vectors around the current block.
- the one or more motion vectors around the current block may include a motion vector other than the motion vector used for the affine motion compensation.
- the CPMV of the current block may be derived from a motion vector of a preset position based on the corresponding point.
- the preset position may be a position included in a block within a predetermined distance from a point corresponding to the CPMV to be derived.
- the first CPMV (mv0), the second CPMV (mv1), and the third CPMV (mv2) for affine motion compensation of the current block may be derived from the above-described motion vector of the predetermined position.
- the first CPMV (mv0) may be derived from motion vector information of positions A, B, and C around the upper left corner.
- the second CPMV mv1 may be derived from the motion vector information of the positions D and E around the upper right corner.
- the third CPMV (mv2) may be derived from the motion vector information of the positions F and G around the lower left corner.
- the decoder may check the availability of the motion vector around the CPMV in a predetermined order. If a usable motion vector is found, the decoder can obtain the CPMV using the motion vector. In addition, a predetermined combination of the peripheral positions referenced to derive the CPMV for each point of the current block may be used.
- the motion information set candidate obtained by the method described with reference to FIG. 38 may be referred to as a constructed candidate or an affine inter candidate.
- the motion vector information sets described with reference to FIGS. 35 to 38 may be motion vector information set candidates constituting a CPMV candidate list in a predetermined order.
- FIG. 39 is a diagram illustrating a method of obtaining a control point motion vector of a current block according to another embodiment of the present invention.
- a plurality of CPMVs may be used for affine motion compensation of the current block.
- some of the plurality of CPMVs included in the CPMV set for motion compensation of the current block may be derived based on the other part.
- the encoder and decoder can obtain CPMVs corresponding to each of the two points of the current block in the manner described above.
- the encoder and the decoder may derive the CPMV corresponding to another point of the current block from the previously obtained CPMV.
- a third CPMV (mv 2 x , mv 2 y ) is derived from the first CPMV (mv 0 x , mv 0 y ) and the second CPMV (mv 1 x , mv 1 y ), or the first CPMV (mv 0 x , mv 0 y )
- a second CPMV (mv 1 x , mv 1 y ) may be derived from CPMV (mv 0 x , mv 0 y ) and third CPMV (mv 2 x , mv 2 y ).
- w and h may each be the width and height of the current block.
- the CPMV set of the current block may consist of a plurality of CPMVs.
- the CPMV predictor may be obtained based on a difference value between the CPMV predictor and the motion vector.
- the motion vector difference value of the CPMV may be signaled from the encoder to the decoder. That is, the motion vector difference value used to derive the CPMV for each CPMV for the affine motion compensation of the current block may be signaled.
- the motion vector difference value of the CPMV may be referred to as a CPMV difference value.
- mv0, mv1, and mv2 indicated by the upper bars may represent CPMV predictors of the first CPMV (mv0), the second CPMV (mv1), and the third CPMV (mv2), respectively.
- FIG. 40 (a) illustrates how the first CPMV (mv0) and the second CPMV (mv1) of the current block are obtained when the 4-parameter affine motion compensation is performed.
- the first CPMV difference value mvd0 and the second CPMV difference value mvd1 for each of the first CPMV mv0 and the second CPMV mv1 may be signaled, respectively.
- FIG. 40 (b) shows how the first CPMV (mv0), the second CPMV (mv1), and the third CPMV (mv2) of the current block are obtained when 6-parameter affine motion compensation is performed.
- the first CPMV difference value (mvd0), the second CPMV difference value (mvd1), and the third CPMV difference value (mvd2) for the first CPMV (mv0), the second CPMV (mv1), and the third CPMV (mv2), respectively, Each may be signaled.
- the CPMV difference value of the current block may be signaled according to the syntax described above with reference to FIG. 9.
- the decoder may obtain the CPMV difference value (lMVD) of the current block based on at least one information on the signaled motion vector difference value.
- compIdx may be 0 or 1 as an index indicating a component of a motion vector difference value.
- compIdx may indicate any one of an x-axis component or a y-axis component of a motion vector difference value.
- the CPMV difference value of the current block may be different for each reference picture list.
- L0 represents a first reference picture list and L1 represents a second reference picture list.
- the CPMV difference value corresponding to a specific point of the current block may be similar to the CPMV difference value corresponding to another point of the current block. Accordingly, the CPMV difference value corresponding to the specific point of the current block may be obtained based on the CPMV difference value corresponding to another point of the current block. This allows the encoder and decoder to reduce the signaling overhead for CPMV differential values.
- a CPMV set for affine motion compensation of a current block may be derived based on at least one common CPMV difference value.
- the CPMV corresponding to a specific point of the current block may be obtained based on the CPMV difference value corresponding to another point of the current block.
- the encoder may signal one common CPMV differential value and at least one additional differential value for affine motion compensation of the current block.
- the decoder may obtain a CPMV set for affine motion compensation of the block by using one common CPMV difference value and at least one additional difference value.
- mv0, mv1, and mv2 indicated by the upper bars may represent CPMV predictors of the first CPMV (mv0), the second CPMV (mv1), and the third CPMV (mv2), respectively.
- FIG. 42A illustrates how the first CPMV (mv0) and the second CPMV (mv1) of the current block are obtained when 4-parameter affine motion compensation is performed.
- the first CPMV difference value mvd0 for the first CPMV mv0 may be signaled.
- a first additional difference value mvd1 ′ used to obtain a second CPMV difference value may be signaled.
- the second CPMV difference value may be expressed as a value obtained by adding the first additional difference value mvd1 'to the first CPMV difference value mvd0.
- the second CPMV mv1 may be obtained based on the second CPMV predictor, the first CPMV difference value mvd0, and the first additional difference value mvd1 ′.
- the first additional difference value mvd1 ' may be smaller than the second CPMV difference value. Accordingly, the encoder and decoder can reduce the signaling overhead for the CPMV difference value, compared to the method described with reference to FIG. 40.
- FIG. 42 (b) shows how the first CPMV (mv0), the second CPMV (mv1), and the third CPMV (mv2) of the current block are obtained when the 6-parameter affine motion compensation is performed.
- the first CPMV difference value mvd0 for the first CPMV mv0 may be signaled.
- a first additional difference value mvd1 'and a second additional difference value mvd2' used to obtain each of the second CPMV difference value and the third CPMV difference value may be signaled.
- the second CPMV difference value may be expressed as a value obtained by adding the first additional difference value mvd1 'to the first CPMV difference value mvd0.
- the third CPMV difference value may be expressed as a value obtained by adding a second additional difference value mvd2 'to the first CPMV difference value mvd0.
- FIG. 43 illustrates a method in which a control point motion vector difference value is signaled when a control point motion vector of a current block is obtained according to the embodiment described with reference to FIG. 42.
- the CPMV set for affine motion compensation of the current block may include a plurality of CPMVs.
- the CPMV difference value MvdLX of some of the plurality of CPMVs may be obtained based on the difference value and the additional difference value of another CPMV.
- lMvd may be either a difference value of a preset CPMV or at least one additional difference value.
- cpIdx may indicate a control point index of the current block.
- cpIdx when 4-parameter affine motion compensation is performed on the current block, cpIdx may be 0 or 1.
- 6-parameter affine motion compensation is performed for the current block, cpIdx may be 0, 1 or 2.
- the CPMV difference value MvdLx may be determined in different ways according to cpIdx. For example, when cpIdx is a preset value (eg, '0'), MvdLx may be a difference value (1Mvd [0] [compIdx]) of the preset CPMV.
- MvdLx may be a value obtained by adding an additional difference value corresponding to the corresponding index to the difference value (lMvd [0] [compIdx]) of the preset CPMV.
- MvdLx may represent a difference between the CPMV and the CPMV predictor. That is, MvdLx may be (CPMV-CPMV predictor).
- compIdx is an index indicating a component of a motion vector difference value and may be 0 or 1.
- compIdx may indicate any one of an x-axis component or a y-axis component of a motion vector difference value.
- the CPMV difference value of the current block may be different for each reference picture list.
- L0 represents a first reference picture list and L1 represents a second reference picture list.
- the CPMV difference value may be encoded in a similar manner to the signaling method of the motion vector difference value described above with reference to FIG. 9.
- the encoder may generate at least one information on the CPMV difference value by separately encoding the CPMV difference value according to the aforementioned control point index cpIdx.
- the encoder may signal at least one information about the encoded CPMV difference value.
- the decoder may obtain the CPMV difference value for each control point index cpIdx based on at least one piece of information on the CPMV difference value.
- Embodiments related to the resolution of the motion vector difference values described above may be applied in the same or corresponding manner to the CPMV difference values described through the embodiments of FIGS. 9, 43, and 44.
- the signaled CPMV difference value may be modified based on R.
- the decoder may obtain the modified CPMV difference value by multiplying the signaled CPMV difference value by the resolution (R).
- a CPMV difference value indicating a difference between a CPMV and a CPMV predictor of a current block may be determined based on the difference predictor mvdp.
- the difference predictor mvdp may represent a prediction value for the difference between the CPMV and the CPMV predictor.
- the CPMV difference value may be obtained based on the difference predictor mvdp and the additional difference values mvd0 ′′, mvd1 ′′, mvd2 ′′.
- the difference predictor mvdp and the additional difference values mvd0 ′′, mvd1 ′′, mvd2 ′′ may be signaled from the encoder to the decoder.
- Each of mvdp, mvd0 ", mvd1 ", and mvd2 " (when six-parameter affine motion compensation is performed) can be encoded or decoded in the manner described above with reference to FIG.
- mv0, mv1, and mv2 indicated by upper bars may represent CPMV predictors of each of the first CPMV (mv0), the second CPMV (mv1), and the third CPMV (mv2).
- the encoder and decoder can use the differential predictor mvdp to reduce the signaling overhead for the CPMV differential value.
- the difference predictor may be obtained based on at least one of the plurality of CPMVs included in the CPMV set of the current block.
- the difference predictor may be a CPMV difference value of any one of a plurality of CPMVs included in the CPMV set of the current block.
- a description will be given of how a differential predictor used to derive the CPMV set of the current block is obtained.
- the encoder and the decoder may obtain the difference predictor mvdp of the current block using at least one of mvd0, mvd1, and mvd2 (hereinafter, mvdx) of the current block.
- the difference predictor mvdp may be set to a value smaller than the absolute value of the smallest mvdx among the mvdx.
- the difference predictor mvdp may be set to a value larger than the absolute value of the largest mvdx among the mvdx.
- the signs of additional difference values (mvd0 ", mvd1 ", mvd2 " in FIG. 45) used to derive each of the plurality of CPMVs included in the CPMV set of the current block can match.
- the additional difference value may indicate a difference between mvdx and the difference predictor mvdp.
- the difference predictor mvdp is set to a value smaller than the absolute value of the smallest mvdx among the mvdx's, the difference predictor (mvvd) of mvd0 ", mvd1 ", mvd2 " The sign can be matched with a positive sign (+). Further, when the difference predictor mvdp is set to a value larger than the absolute value of the largest mvdx among the mvdx, the sign of the additional difference values (mvd0 '', mvd1 '', mvd2 '' in FIG. 45) Can be matched with a negative sign (-).
- the difference predictor mvdp may be set to a value smaller than the absolute value of the smallest mvdx among the mvdx.
- the horizontal broken line represents the smallest value of the absolute values of the x-axis component of each of the mvdx's
- the vertical broken line represents the smallest value of the absolute values of the y-axis component of each of the mvdx's.
- the value of the x-axis coordinate is larger as the right side
- the value of the y-axis coordinate is larger as the upper side.
- the difference predictor mvdp may be a value in the third quadrant mvdp area among the quadrants divided by the broken line.
- each of the difference predictor mvdp and the additional difference values mvdx '' of the current block may be derived as shown in Equation 7 below.
- information mvd_sign_flag indicating the sign of the difference predictor mvdp may be signaled.
- the encoder may signal sign information of the difference predictor.
- the decoder may obtain the CPMV set of the current block based on the sign information (mvd_sign_flag) of the difference predictor.
- information representing the sign of each of the additional difference values mvdx '' may not be signaled.
- an mvdp indicator indicating how to determine the difference predictor mvdp may be signaled.
- the mvdp indicator may be a flag indicating whether the difference predictor mvdp is determined to be smaller than the minimum value of the mvdx or larger than the maximum value.
- FIG. 47 is a diagram illustrating a method of obtaining a control point motion vector of a current block using a difference predictor according to another embodiment of the present invention.
- the difference predictor of the current block may be a CPMV difference value of any one of a plurality of CPMVs included in the CPMV set of the current block.
- a difference predictor may vary according to Method 0, Method 1, and Method 2.
- the difference predictor in Method 0 may be mvd0.
- the difference predictor may be mvd1.
- the difference predictor may be mvd2.
- an mvdp indicator (cpIdxPred) indicating which of the plurality of methods determines the difference predictor may be signaled.
- the plurality of methods may include at least one of the methods described with reference to Method 0, Method 1, Method 2, and FIG. 46 of FIG. 47.
- the encoder may signal an mvdp indicator (cpIdxPred) indicating any one of Method 0, Method 1, and Method 2.
- the decoder may determine any one of Method 0, Method 1, and Method 2 based on the mvdp indicator (cpIdxPred).
- the decoder may obtain the difference predictor of the current block according to the determined method.
- the decoder may obtain a current block CPMV set based on the obtained difference predictor.
- the mvdp indicator (cpIdxPred) may be implicitly signaled. That is, the encoder and decoder may determine the difference predictor of the current block without signaling for the mvdp indicator (cpIdxPred). This will be described in detail with reference to FIGS. 49 to 50.
- FIG. 48 is a diagram illustrating a method of obtaining a difference predictor according to an embodiment of the present invention.
- the difference predictor may be used as the difference value of the corresponding CPMV.
- the difference value of the corresponding CPMV may be obtained based on the additional difference value and the difference predictor corresponding to cpIdx.
- a mvdp indicator (cpIdxPred) indicating a method of high coding efficiency with respect to the motion vector difference value may be signaled.
- lMvd may represent either a difference predictor or additional difference values.
- MvdLX may represent a CPMV difference value.
- LX may represent a reference picture list L0 or L1.
- the mvdp indicator may be represented by a variable length bit.
- the mvdp indicator can be signaled via a truncated unary method.
- 46 to 48 may be performed for each component of a motion vector difference value.
- Embodiments related to the resolution of the motion vector difference values described above may be applied in the same or corresponding manner to the CPMV difference values described through the embodiments of FIGS. 46 to 48.
- the signaled CPMV difference value may be modified based on R.
- the decoder may obtain the modified CPMV difference value by multiplying the signaled CPMV difference value by the resolution (R).
- the mvdp indicator in a manner that reduces the signaling of the lMvd to the control point index other than the mvdp indicator (cpIdxPred).
- the mvdp indicator can be signaled so that the sign of lMvd for the control point index matches the mvdp indicator.
- the difference predictor may be determined without explicit signaling. This will be described later with reference to FIGS. 49 to 51.
- the difference predictor of the current block when the difference predictor of the current block is determined as the minimum value or the maximum value among the absolute values of the CPMV difference values of the current block, the signs between the lMvds for the control point indexes may match. In this case, when the control point index is different from the mvdp indicator, the sign information may not be signaled.
- the absolute value of the CPMV difference value is the minimum or maximum may mean that the absolute value of the specific component is the minimum or maximum. For example, if the mvdp indicator indicates any one of three values, one of the mvdp indicators may be signaled using one bit and two two bits in a cutting unary method.
- the mvdp indicator may be a CPMV difference value corresponding to a middle or middle value among absolute values of the CPMV difference value.
- one sign of lMvd may be (+) and one may be ( ⁇ ). Accordingly, one bit may be used to signal sign information of each of the two CPMV difference values.
- the encoder and the decoder may reduce signaling overhead for sign information of the CPMV difference value.
- the mvdp indicator (cpIdxPred) indicating a method of determining the difference predictor of the current block may be implicitly signaled.
- the method of determining the difference predictor of the current block may be determined based on other information. More specifically, the encoder and the decoder may determine the difference value of the CPMV having the largest absolute value among the CPMV difference values of the current block as the difference predictor. If the motion vector difference value is signaled, it may be advantageous that the greater the absolute value of the difference predictor used to derive the plurality of CPMVs.
- FIG. 49 illustrates a method of determining a difference vector predictor of a current block according to an embodiment of the present invention.
- FIG. 49 three CPMVs may be used for affine motion compensation of a current block.
- the x-axis component is described as an example for convenience of description, but the present disclosure is not limited thereto. Embodiments to be described later may be applied to the y-axis component in the same or corresponding method.
- the control point index indicating the CPMV of which the absolute value of the x-axis component among the CPMV difference values Mvd0, Mvd1, and Mvd2 of each of the CPMVs of the current block is minimum may be '1'.
- the broken line indicates the value of the x-axis component of the reference predictor.
- the encoder can omit signaling for the mvdp indicator.
- the decoder can derive the CPMV set of the current block without the mvdp indicator.
- FIG. 50 is a diagram illustrating how a control point motion vector difference value of a current block is signaled.
- signaling of sign information when the control point index and the mvdp indicator are different may be omitted.
- the sign information mvd_sign_flag of the motion vector difference value may be parsed when the control point index and the mvdp indicator are the same. Conversely, if the control point index and the mvdp indicator are different, they may not be performed.
- 0 and 1 in [0] and [1] represent a component index, and may represent an x-axis component and a y-axis component, respectively.
- the information on the motion vector difference value may be sequentially parsed according to a preset order.
- the preset order may be a preset order based on the control point index.
- the preset order may be an order determined based on the mvdp indicator.
- a function for coding a motion vector difference value there may be a function for coding a motion vector difference value.
- an example of a function for coding a motion vector difference value may be the mvd_coding syntax of FIG. 50.
- the decoder may parse information about a motion vector difference value according to the control point index.
- the mvd_coding syntax of FIG. 50 may be performed for each control point index.
- the preset order may be performed as in Equation 8 below. According to Equation 8, parsing may always be performed in the same order.
- mvd_coding (.., .., .., cpIdx 0)
- mvd_coding (.., .., .., cpIdx 1)
- mvd_coding (.., .., .., cpIdx 2)
- the information about the CPMV difference value corresponding to the mvdp indicator may be parsed before the information about the difference value of another CPMV not corresponding to the mvdp indicator.
- the CPMV difference value corresponding to the control point index can be calculated immediately.
- the information on the CPMV difference value corresponding to the mvdp indicator may not be parsed earlier than the information on the difference value of another CPMV not corresponding to the mvdp indicator. In this case, even after decoding the additional difference value corresponding to the specific control point index, it may take a wait time to calculate the CPMV difference value corresponding to the control point index.
- the mvd_coding syntax may be expressed by Equation 9 below.
- mvd_coding (.., .., .., cpIdx 1)
- mvd_coding (.., .., .., cpIdx 0)
- mvd_coding (.., .., .., cpIdx 2)
- the mvd_coding syntax may be expressed by Equation 10 below.
- mvd_coding (.., .., .., cpIdx 2)
- mvd_coding (.., .., .., cpIdx 0)
- mvd_coding (.., .., .., cpIdx 1)
- lMvd may represent a difference predictor or an additional difference value.
- a difference predictor may be calculated based on sign information. Alternatively, if the specific control point index is different from the mvdp indicator, the sign information may not be used to calculate the additional difference value.
- different resolutions may be used for each of the plurality of CPMVs for motion compensation of the current block.
- the resolution at which the CPMV difference value is signaled for each control point index may be different.
- a resolution of the motion vector difference value may be different for each of the plurality of CPMVs of the current block.
- the CPMV difference value of a specific control point index may be used as the difference predictor of the current block.
- a resolution for the CPMV difference value corresponding to the control point index may be signaled.
- the CPMV difference value corresponding to the control point index may be signaled based on the resolution.
- the CPMV difference value corresponding to the remaining control point index except for the control point index may be signaled based on a preset resolution.
- a resolution indicating a unit in which the CPMV difference value corresponding to the remaining control point index except for the corresponding control point index is signaled may not be signaled.
- the preset resolution may be a default value.
- the CPMV difference value used as the difference predictor of the current block may be signaled based on a resolution of a relatively small unit.
- the CPMV difference value of a control point other than the CPMV difference value used as the difference predictor of the current block may be signaled based on a resolution of a relatively large unit.
- a plurality of CPMVs for affine motion compensation of the current block may be obtained from a single CPMV predictor.
- the plurality of CPMVs may be derived using a single CPMV and a plurality of CPMV difference values.
- the encoder and the decoder may increase the coding efficiency of the CPMV difference value.
- the encoder and decoder can reduce the signaling overhead of CPMV differential values.
- a first CPMV difference value Mvd0 and a second CPMV difference value Mvd1 may be obtained based on a common difference predictor mvdp and a single absolute absolute value mvdd.
- the first CPMV difference value Mvd0 may be obtained based on the sum of mvdp and mvdd.
- the first CPMV difference value Mvd1 may be obtained based on the sum of mvdp and -mvdd.
- the encoder can signal a common difference predictor mvdp and an absolute difference value mvdd.
- the decoder may obtain CPMV difference values corresponding to each of the plurality of control points of the current block based on the common difference predictor mvdp and the absolute difference value mvdd. 52 is shown for four-parameter affine motion compensation, but the disclosure is not so limited. For example, when 6-parameter affine motion compensation is performed, some of the CPMVs included in the CPMV set of the current block may be derived using CPMV predictors and CPMV difference values of other CPMVs.
- the current block may be further divided according to the prediction mode of the current block.
- the encoder and the decoder may divide the current block into a plurality of subblocks and perform intra prediction on each subblock.
- the decoder may receive the above-described intra prediction mode information from the bitstream.
- the decoder may determine whether to divide the current block into a plurality of subblocks based on the intra prediction mode information. In this case, information on how the current block is divided into a plurality of subblocks may be additionally signaled.
- the encoder and the decoder may split the current block using a preset method between the encoder and the decoder according to the intra prediction mode information.
- the decoder may perform intra prediction on each of the current block or a plurality of sub blocks based on the intra prediction mode information of the current block.
- the current block may be used as a term indicating a coding unit.
- the SCUs (Sub-CUs) of FIGS. 53 to 60 represent a plurality of subblocks divided from the current block.
- a method of dividing the current block into a plurality of subblocks will be described in detail.
- 53 illustrates various embodiments in which a current block is divided into a plurality of subblocks.
- 53 (a) and 53 (b) show subblocks that are squarely divided from the current block.
- the current block may be divided into subblocks of a preset size.
- the preset size may be a size negotiated in advance between the encoder and the decoder.
- the preset size may be an NxN size having the same height and width.
- the preset size may be 4 ⁇ 4.
- the preset size may be a value set based on the size of a transform kernel.
- the preset size may be a value set based on the conversion unit.
- the preset size may be the size of the conversion unit.
- the current block may be divided into subblocks of a size determined according to the size of the current block. For example, when the size of the current block is larger than the first threshold, the current block may be divided into subblocks of a larger size than the blocks smaller in size than the first threshold.
- the operation of dividing into subblocks may be limited according to the size of the current block. For example, if the size of the current block is smaller than the second threshold, the encoder and decoder may not split the current block into a plurality of blocks. If the size of the current block is relatively small, compared to the case where the size of the current block is relatively large, the performance gain according to the method of performing intra prediction by dividing the current block may not be large.
- the form in which the subblocks are divided may be determined independently of the shape of the current block. For example, even when the current block is square, the shape of the plurality of subblocks divided from the current block may be non-square. 53 (c) and 53 (d) show subblocks divided into non-squares from the current block.
- the current block may be divided into non-square subblocks of a preset size. In this case, the height and the width of the above-described preset size may be different from each other.
- the preset size may be 4x8 or 8x4. As described above, the preset size may be a value set according to the size of the current block.
- the encoder and decoder may support a 4 ⁇ 8 or 8 ⁇ 4 nonsquare transform kernel.
- the preset size may be a value set based on the non-square transform unit.
- the current block may be divided into a plurality of subblocks in a form similar to that of the current block.
- 53 (e) and 53 (f) show subblocks divided from the current block when the current block is a non-square block.
- the current block may be divided into non-square subblocks similar to the shape of the current block.
- FIG. 53 (e) when the height of the current block is longer than the width, the current block may be divided into a plurality of sub blocks having a height that is longer than the width.
- the current block when the width of the current block is longer than the height, the current block may be divided into a plurality of sub blocks having a width longer than the height.
- the form in which the current block is divided may be determined based on the prediction mode of the current block. For example, at least one of the size or direction in which the current block is divided may vary according to the intra prediction mode (angle mode, DC mode, or planar mode) of the current block.
- 54 illustrates a method of dividing a current block according to an intra prediction mode of the current block. Referring to FIG. 54A, a plurality of intra prediction modes may be classified into an directional mode corresponding to an intra prediction mode index 2 to 66 and a non-directional mode such as a planar mode or a DC mode.
- the residual signal of the subblocks far from the reference samples of the current block among the subblocks divided from the current block may be relatively large. Accordingly, samples having similar distances from the reference sample of the current block may be divided to belong to the same subblock.
- the current block when the intra prediction mode of the current block is the non-directional mode, the current block may be divided into a plurality of square subblocks as shown in FIG. 54 (b).
- the intra prediction mode of the current block when the intra prediction mode of the current block is any one of the above-described horizontal diagonal mode, diagonal mode, and vertical diagonal mode, the current block may be divided into a plurality of square subblocks.
- the intra prediction mode of the current block when the intra prediction mode of the current block is an angle mode around any one of the horizontal diagonal mode, the diagonal mode, and the vertical diagonal mode, the current block may be divided into a plurality of square subblocks.
- the current block is divided into a plurality of non-square subblocks as shown in FIG. 54 (c) or 54 (d) according to the intra prediction mode of the current block.
- the intra prediction mode of the current block is the angular mode around one of the horizontal mode and the vertical mode
- the current block may be divided into a plurality of non-square subblocks. Through this, the current block may be divided such that samples having similar distances from the reference sample of the current block belong to the same subblock.
- the current block when the prediction mode of the current block is any one of the horizontal mode or the angular modes around the horizontal mode, the current block may be divided as shown in FIG. 54 (c). When the prediction mode of the current block is one of the vertical mode or the angular modes around the vertical mode, the current block may be divided as shown in FIG. 54 (d). Another prediction method may be applied to a subblock located far from the reference samples of the current block.
- the current block may be divided based on sample values of reference samples of the current block.
- the encoder and decoder may determine a reference sample edge based on the sample values of the reference samples of the current block.
- the reference sample edge may be a reference point for dividing an area where the sample value of the reference sample varies by more than a threshold value.
- the reference sample edge may represent a point at which a difference in sample values between reference samples adjacent to each other is greater than or equal to a threshold.
- the encoder and the decoder may compare the sample values of the reference samples of the current block to determine the reference sample edge of the current block. For example, the position of the reference sample whose difference from the average value of the predetermined number of reference samples around the specific reference sample is greater than or equal to the threshold may be determined as the reference sample edge.
- the encoder and the decoder may determine one or more reference sample edges for each of the upper reference sample set and the left reference sample set.
- the upper reference sample set of the current block may be a set including reference samples located in the upper line of the current block.
- the left reference sample set of the current block may be a set including reference samples located in the left line of the current block.
- the encoder and the decoder may split the current block based on a line segment connecting the reference sample edge of the upper reference sample set and the reference sample edge of the left reference sample set. For example, when one reference sample edge is detected for each of the upper reference sample set and the left reference sample set, the current block may be divided into a total of two subblocks SCU1 and SCU2. In addition, when two or more reference sample edges are detected for each of the upper reference sample set and the left reference sample set, the current block may be divided into a plurality of subblocks.
- the reference sample for intra prediction of the current block may include samples on the plurality of reference lines.
- a current block may be divided based on a sample value of reference samples on the plurality of reference lines.
- a reference sample edge of the current block may be determined based on the sample value of the reference samples on the plurality of reference lines.
- the encoder and the decoder may determine one or more reference sample edges per reference line.
- the encoder and the decoder may first segment a current block by extending a line segment connecting reference sample edges for each upper reference line.
- Two subblocks SCU1 and SCU2 may be obtained by the first partitioning.
- the encoder and the decoder may second segment the current block by extending a line segment connecting reference sample edges for each left reference line.
- Two subblocks SCU2 and SCU3 may be obtained by the second partitioning. Accordingly, the current block may be divided even when either the reference sample edge for each upper reference line or the reference sample edge for each left reference line is not detected.
- 55 (c) illustrates a method in which a current block is divided when either one of a reference sample edge per upper reference line or a reference sample edge per left reference line is not detected or the reference sample edges are not arranged in one straight line.
- a reference sample edge may not be detected in some of the left reference lines. If a reference sample edge is detected at at least two reference lines, the encoder and decoder may split the current block based on the corresponding reference sample edges.
- the above-described embodiment may be applied even when a reference sample edge is not detected in some of the upper reference lines.
- reference sample edges for each upper reference line may not be arranged in one straight line.
- the current block may be divided based on the median of the reference sample edges on the line not adjacent to the current block and the line segment passing the reference sample edge on the line adjacent to the current block.
- 55 (b) and 55 (c) illustrate an embodiment in which three reference lines are used, but the present disclosure is not limited thereto.
- the plurality of subblocks partitioned from the current block are primary sub-blocks (PSBs) that are first predicted according to the intra prediction mode of the current block, and second predicted later. It may be classified into secondary sub-blocks (SSBs).
- PSBs primary sub-blocks
- SSB group secondary subblock group
- a subblock group composed of PSBs may be referred to as a primary subblock group (hereinafter, referred to as a PSB group)
- a subblock group composed of SSBs may be referred to as a secondary subblock group (hereinafter referred to as an SSB group).
- the PSB group may be configured of subblocks within a predetermined distance from reference samples referenced to intra prediction of the current block among a plurality of subblocks divided from the current block.
- the SSB group may be configured of subblocks outside a preset distance from reference samples referenced to intra prediction of the current block among the plurality of subblocks.
- the current block may be divided into a total of 16 subblocks.
- the intra prediction mode of the current block is one of the horizontal diagonal mode, the vertical diagonal mode, and the angle modes around the horizontal diagonal mode and the vertical diagonal mode
- the PSB group and the SSB group of the current block are as shown in FIG. 56 (a). Can be determined. That is, among the 16 subblocks divided from the current block, four upper right subblocks may be SSBs, and the remaining subblocks except this may be PSBs.
- PSB group and the SSB group are determined when the intra prediction mode of the current block is any one of HDIA, HOR, DIA, VER, VDIA, and respective angular modes.
- the methods are shown.
- PSB and SSB may be distinguished in consideration of a relative distance from a reference sample to be used in each prediction mode.
- the present disclosure is not limited thereto, and other divisions in a form similar to the examples described in FIG. 56 are also possible.
- the encoder and decoder may first perform intra prediction on the PSBs based on the intra prediction mode of the current block. Next, the encoder and decoder may perform intra prediction on SSBs.
- intra prediction methods for the SSB of the current block will be described in detail.
- the encoder and the decoder may perform prediction for SSBs of the current block based on the reconstructed sample value of the PSBs of the current block. For example, the encoder and decoder may first reconstruct the PSBs of the current block based on the intra prediction mode and the reference samples of the current block. Next, the encoder and the decoder are adjacent to each of the SSBs of the current block, and may perform intra prediction on SSBs of the current block with reference to the reconstructed samples. The encoder and decoder may perform intra prediction on SSBs of the current block based on the intra prediction mode of the current block. In this case, the reconstructed samples may be samples included in each of the PSBs.
- Samples included in each of the PSBs may be samples closer to the SSB of the current block than the reference sample of the current block. Accordingly, even when the same prediction mode is used for the SSB of the current block, prediction accuracy for the SSB may be higher than that of the conventional method.
- the encoder and the decoder may predict using different intra prediction modes for each of the PSB group and the SSB group of the current block.
- the PSBs of the current block may be predicted based on a primary mode (PM), which is an intra prediction mode of the current block.
- the SSBs of the current block can be predicted based on a variable secondary mode (SM).
- the SM may be an intra prediction mode applied only to SSBs among a plurality of subblocks of the current block.
- the SM may be signaled separately.
- the SM may be signaled in the form of an offset based on the PM.
- the SM may be an intra prediction mode corresponding to an intra prediction mode index added by an offset based on the PM.
- the offset may be a value within a preset maximum value. This may reduce the amount of computation for the encoder to select a particular offset.
- the SSB of the current block can be predicted based on the opposite angle mode of the PM.
- the SM may be a vertical diagonal mode corresponding to the intra prediction mode index 66.
- the SM may be a horizontal diagonal mode corresponding to the intra prediction mode index 2.
- the SM may be a preset prediction mode.
- the SSB of the current block may be predicted based on a preset prediction mode.
- the SSB of the current block may be subblocks outside a preset distance from the reference samples of the current block. Accordingly, it may be advantageous in terms of the residual signal to predict the SSB of the current block based on the non-directional mode. That is, the preset SM may be either a planar mode or a DC mode.
- the final prediction block of the SSB of the current block may be obtained based on the first prediction SSB predicted based on the PM of the current block, and the second prediction SSB predicted based on the non-directional mode described above.
- the encoder and decoder may obtain a final prediction block corresponding to the SSB based on an average between the first prediction SSB and the second prediction SSB of the current block.
- the encoder and the decoder may reconstruct the SSB by summing up the last prediction block and the residual signal corresponding to the SSB.
- the current block may be divided into a total of four subblocks.
- the PSB group and the SSB group of the current block may be determined as shown in FIG. 57 (a). That is, among the four subblocks divided from the current block, the right lower subblock SCU 4 is the SSB of the current block, and the remaining subblocks SCU 1, SCU 2, and SCU 3 except for this are the PSBs of the current block. Can be.
- the SSB of the current block may be reconstructed with reference to samples included in each of the PSBs of the current block.
- the encoder and decoder may first reconstruct the PSBs of the current block based on the intra prediction mode and the reference samples of the current block.
- the encoder and the decoder may perform intra prediction on the SSB using the sample value of the samples adjacent to the SSB among the reconstructed samples of the PSBs of the current block.
- the SSB (SCU 4) of the current block may be reconstructed based on the sample value and the residual signal of the reconstructed samples of the PSBs SCU1, SCU 2, and SCU 3.
- the PSB group and the SSB group of the current block may be determined as shown in FIG. 57 (b). That is, among the four subblocks divided from the current block, the upper right subblock SCU 2 is the SSB of the current block, and the remaining subblocks SCU 1, SCU 3, and SCU 4 except for this are the PSBs of the current block. Can be.
- the SSB (SCU 2) of the current block is equal to the sample value of samples adjacent to the SSB (SCU 2) among the reconstructed samples of the PSBs SCU1, SCU 3, and SCU 4 of the current block. Can be restored on the basis of
- some of the reference samples of the current block may be adjacent to the SSB of the current block.
- some of the reference samples of the current block may be reference samples that are not used for intra prediction of the current block.
- the SSB of the current block may be predicted based on the SM, which is a prediction mode different from that of the current block. For example, when the PM of the current block is an angle mode, the SM of the current block may be an opposite angle mode of the PM. As shown in FIG. 57B, when the PM of the current block is in the horizontal diagonal mode, the SM may be in the vertical diagonal mode.
- the last predictive block of the SSB of the current block is the first predicted SSB predicted based on the PM of the current block, and the second predicted SSB predicted based on the opposite angle mode of the PM. It can be obtained based on. 56 (a) and (e), it is possible to use the angular mode in the opposite direction to the PM mode, and when the reference sample adjacent to the boundary of the SSB is present, the above-described embodiment can be applied.
- a picture may be divided into a sequence of coding tree units (CTUs).
- CTUs coding tree units
- 58 illustrates an order in which coding tree units are processed according to an embodiment of the present invention.
- the encoder and decoder may encode or decode per CTU within a slice / tile partitioned from a current picture or a current picture including the current block.
- the encoder and the decoder may encode or decode the plurality of CTUs according to a predefined processing order.
- the encoder may signal the corresponding order to the decoder.
- FIG. 58 (a) shows a raster scan sequence in which the CTUs of the next row are processed after the transverse processing is performed from the CTU of the top left of the picture, slice, or tile.
- 58 (b) shows an embodiment in which the position of the first block A (CTU) that is first processed in a picture, slice, or tile is explicitly signaled.
- the encoder can signal the location of the first CTU.
- the decoder may first process the CTU based on the position of the signaled first CTU.
- the decoder may decode the CTUs corresponding to the previous position in the raster scan order based on the position of the first CTU in the inverse-raster scan order.
- CTUs corresponding to subsequent positions in the raster scan order based on the position of the first CTU may be decoded according to the raster scan order described above.
- the CTUs processed according to the inverse raster scan order and the CTUs processed according to the raster scan order may be processed in the order of crossing each one CTU, or the CTUs in either direction may be preferentially processed. .
- the plurality of CTUs may include a second CTU (Blcok B) and a third CTU (Block C).
- the encoder may signal the location of each of the second CTU (Blcok B) and the third CTU (Block C).
- the position of the second CTU that is processed first among the plurality of CTUs that are processed first may be additionally signaled.
- the decoder may first decode a second CTU (Block B) based on the position of the signaled second CTU.
- the decoder may decode the third CTU (Block C).
- CTUs between the position of the second CTU and the position of the third CTU may be decoded.
- the decoder may decode CTUs following the second CTU to the CTU before the third CTU in the raster scan order according to the raster scan order or the reverse raster scan order.
- the decoder may decode the CTUs corresponding to the previous positions in the raster scan order based on the position of the second CTU (Block B) in the inverse-raster scan order.
- CTUs corresponding to subsequent positions in the raster scan order based on the position of the third CTU (Block C) may be decoded according to the above-described raster scan order.
- FIG. 58 (c) shows another embodiment in which a position of a plurality of CTUs that are preferentially processed in a picture, slice, or tile in a form similar to that of FIG. 58 (d) is explicitly signaled.
- the current block may be predicted using a bidirectional intra prediction method according to the distribution of usable reference samples of the current block.
- 56 and 58 when a plurality of subblocks divided from the current block or the current block are encoded or decoded, the previously reconstructed samples of the lower side and the right side of the block as well as the reconstructed samples of the left and upper sides of the block as well. Samples can be used as reference samples of the block.
- the specific block may be predicted according to the bi-directional intra prediction method using the reconstructed samples of the right and the bottom of the periphery of the block.
- a specific block represents a current block or a plurality of subblocks divided from the current block.
- a specific block may be divided into two parts based on the prediction mode of the current block.
- the prediction mode of the current block is the angular mode
- the specific block may be divided into two parts based on a line segment perpendicular to the prediction mode of the current block.
- the first portion of the bipartite specific block may be reconstructed based on the prediction mode and the first reference samples of the current block.
- the first part may be a part including upper and left sides of the specific block.
- the first reference samples may be reference samples of the left and upper lines of a particular block.
- the second portion of the bipartite specific block may be reconstructed based on the secondary prediction mode and the second reference samples.
- the second part may be a part including a right side and a lower side of a specific block.
- the second reference samples may be reference samples of the right and bottom lines of the particular block.
- the secondary prediction mode may be the SM described with reference to FIGS. 56 and 57.
- a specific block may not be further divided.
- the particular block may be reconstructed based on the first prediction block and the second prediction block.
- the first prediction block may be a prediction block predicted based on the prediction mode of the current block and the first reference samples.
- the second prediction block may be a prediction block predicted based on the secondary prediction mode and the first reference samples.
- the decoder may reconstruct a specific block by weighting the first prediction block and the second prediction block.
- 59 (c) and 59 (d) illustrate an embodiment of a method in which a current block is predicted when there are previously reconstructed samples only on three of four surfaces of a specific block.
- the particular block may be divided into two parts based on the prediction mode of the current block. For example, a region corresponding to a side where no pre-reconstructed samples exist among regions of a specific block may be predicted by extending a prediction mode from another side.
- the specific block is reconstructed based on a plurality of prediction blocks for the specific block without further dividing the specific block. An embodiment may be applied.
- a plurality of subblocks divided from the current block may be predicted based on an intra prediction mode used for prediction of neighboring blocks of the current block.
- FIG. 60 (a) shows the positions AL, A, AR, R, L, and BL of each of the plurality of neighboring blocks of the current block.
- the block of the position may be inter predicted or the decoding of the block of the position may not be performed according to the raster scan order or the CU processing order.
- the first subblock SCU1 may be predicted using an intra prediction mode corresponding to the upper left position AL closest to the first subblock SCU1.
- the second subblock SCU2 may be predicted using an intra prediction mode corresponding to the upper position A adjacent to the second subblock SCU2.
- the intra prediction mode corresponding to the upper position A does not exist, the second subblock SCU2 may be predicted using the intra prediction mode corresponding to another peripheral position (for example, the upper right position). Can be.
- the fourth subblock SCU4 when both the upper side and the left side are in the current block, the block may be predicted using the intra prediction mode of the neighboring block located on the remote straight line.
- the first subblock SCU1, the second subblock SCU2, and the third subblock SCU3 may be predicted based on the intra prediction mode of the current block.
- the first subblock SCU1, the second subblock SCU2, and the third subblock SCU3 may be the primary subblocks described above with reference to FIGS. 56 and 57.
- the fourth subblock SCU4 may be predicted based on an intra prediction mode different from the intra prediction mode of the current block.
- the fourth subblock SCU4 may be predicted using the intra prediction mode corresponding to the right position R.
- the fourth subblock SCU4 may be predicted using an intra prediction mode of a neighboring block located on a straight line remotely.
- Embodiments of the present invention described above may be implemented through various means.
- embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof.
- a method according to embodiments of the present invention may include one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), and Programmable Logic Devices (PLDs). It may be implemented by field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and the like.
- ASICs Application Specific Integrated Circuits
- DSPs Digital Signal Processors
- DSPDs Digital Signal Processing Devices
- PLDs Programmable Logic Devices
- FPGAs field programmable gate arrays
- processors controllers, microcontrollers, microprocessors, and the like.
- the method according to the embodiments of the present invention may be implemented in the form of a module, a procedure, or a function that performs the functions or operations described above.
- the software code may be stored in memory and driven by the processor.
- the memory may be located inside or outside the processor, and may exchange data with the processor by various known means.
- Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media.
- the computer readable medium may include both computer storage media and communication media.
- Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
- Communication media typically includes computer-readable instructions, data structures or other data in a modulated data signal such as program modules, or other transmission mechanisms, and includes any information delivery media.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims (32)
- 비디오 신호 처리 방법에 있어서,제1 방법 및 제2 방법 중 어느 하나를 사용하여 현재 블록의 모션 보상을 위한 모션 벡터 예측자(motion vector prediction, MVP) 후보 리스트를 구성하는 단계;상기 구성된 MVP 후보 리스트에 기초하여 현재 블록의 모션 벡터 예측자를 획득하는 단계;상기 현재 블록의 모션 벡터와 상기 모션 벡터 예측자 간의 차이를 나타내는 모션 벡터 차분 값을 획득하는 단계;상기 현재 블록의 모션 벡터 차분 값의 레졸루션(resolution)에 기초하여, 상기 모션 벡터 차분 값을 수정하는 단계, 상기 모션 벡터 차분 값의 레졸루션은 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 어느 하나이고, 상기 레졸루션 세트가 포함하는 복수의 가용 레졸루션들의 구성은 상기 제1 방법 및 상기 제2 방법 중에서 어느 방법을 사용하여 상기 현재 블록의 MVP 후보 리스트가 구성되는지에 따라 달라짐;상기 모션 벡터 예측자 및 상기 수정된 모션 벡터 차분 값에 기초하여 상기 현재 블록의 모션 벡터를 획득하는 단계; 및상기 획득된 모션 벡터에 기초하여 상기 현재 블록을 복원하는 단계를 포함하는, 비디오 신호 처리 방법.
- 제1 항에 있어서,상기 모션 벡터 차분 값의 레졸루션은 상기 현재 블록의 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라, 각각 제1 레졸루션 세트 및 제2 레졸루션 세트 중 어느 하나로부터 획득되고,상기 제2 레졸루션 세트는 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들이 아닌 다른 가용 레졸루션을 적어도 하나 포함하는, 비디오 신호 처리 방법.
- 제2 항에 있어서,상기 MVP 후보 리스트가 어파인(affine) 모델에 기반한 상기 제1 방법을 사용하여 구성되는 경우, 상기 모션 벡터 차분 값의 레졸루션은 상기 제1 레졸루션 세트로부터 획득되고,상기 MVP 후보 리스트가 상기 어파인 모델에 기반하지 않은 상기 제2 방법을 사용하여 구성되는 경우, 상기 모션 벡터 차분 값의 레졸루션은 상기 제2 레졸루션 세트로부터 획득되는, 비디오 신호 처리 방법.
- 제3 항에 있어서,상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제1 가용 레졸루션은, 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제2 가용 레졸루션 보다 작은, 비디오 신호 처리 방법.
- 제4 항에 있어서,상기 제1 가용 레졸루션은 1 샘플 단위의 레졸루션이고,상기 제2 가용 레졸루션은 4 샘플들 단위의 레졸루션인, 비디오 신호 처리 방법.
- 제2 항에 있어서,상기 모션 벡터 차분 값을 수정하는 단계는,상기 제1 레졸루션 세트 및 상기 제2 레졸루션 세트 중 어느 하나가 포함하는 복수의 가용 레졸루션들 중에서 상기 현재 블록의 모션 벡터 차분 값의 레졸루션을 지시하는 지시자를 획득하는 단계; 및상기 지시자가 지시하는 레졸루션에 기초하여 상기 모션 벡터 차분 값을 수정하는 단계를 포함하고,상기 지시자의 값이 제1 값인 경우, 상기 제1 값에 의해 지시되는 상기 레졸루션은 상기 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라 달라지는, 비디오 신호 처리 방법.
- 제6 항에 있어서,상기 MVP 후보 리스트가 상기 제1 방법을 사용하여 구성되는 경우, 상기 제1 값은 제1 레졸루션 세트가 포함하는 가용 레졸루션들 중 하나인 제1 가용 레졸루션을 지시하고,상기 MVP 후보 리스트가 상기 제2 방법을 사용하여 구성되는 경우, 상기 제1 값은 제2 레졸루션 세트가 포함하는 가용 레졸루션들 중 하나인 제2 가용 레졸루션 을 나타내며,상기 제1 가용 레졸루션과 상기 제2 가용 레졸루션은 서로 다른, 비디오 신호 처리 방법.
- 제7 항에 있어서,상기 제1 레졸루션 세트 및 상기 제2 레졸루션 세트는 모두 제1 가용 레졸루션을 포함하고,상기 MVP 후보 리스트가 상기 제2 방법을 사용하여 구성되는 경우, 상기 제1 가용 레졸루션은 상기 지시자의 상기 제1 값과 다른 값인 제2 값에 의해 지시되는, 비디오 신호 처리 방법.
- 제6 항에 있어서,상기 지시자는 가변 길이의 비트로 표현되며,상기 제1 값은 상기 가변 길이의 비트로 표현되는 복수의 값들 중 어느 하나인, 비디오 신호 처리 방법.
- 제9 항에 있어서,상기 지시자의 상기 제1 값과 다른 제3 값은 상기 복수의 값들 중 가장 짧은 길이의 비트로 표현되는 값이고,상기 MVP 후보 리스트가 상기 제2 방법으로 구성되는 경우, 상기 제3 값은 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션을 지시하고,상기 MVP 후보 리스트가 상기 제1 방법으로 구성되는 경우, 상기 제3 값은 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션 이외의 다른 가용 레졸루션을 지시하는, 비디오 신호 처리 방법.
- 제2 항에 있어서,상기 제1 레졸루션 세트가 포함하는 가용 레졸루션의 개수와 상기 제2 레졸루션 세트가 포함하는 가용 레졸루션의 개수는 서로 다른, 비디오 신호 처리 방법.
- 제11 항에 있어서,상기 레졸루션 세트를 구성하는 가용 레졸루션의 개수는 상기 현재 블록의 모션 보상을 위한 참조 픽쳐의 픽쳐 순서 카운트(picture order count, POC)에 따라 달라지는, 비디오 신호 처리 방법.
- 제12 항에 있어서,상기 현재 블록의 모션 보상을 위한 참조 픽쳐의 픽쳐 순서 카운트(picture order count, POC)가 상기 현재 블록을 포함하는 현재 픽쳐의 POC와 동일한 경우, 상기 제1 레졸루션 세트로부터 상기 현재 블록의 모션 벡터 차분 값의 레졸루션이 획득되고,상기 현재 블록의 모션 보상을 위한 참조 픽쳐의 픽쳐 순서 카운트가 상기 현재 블록을 포함하는 현재 픽쳐의 POC와 동일하지 않은 경우, 상기 제2 레졸루션 세트로부터 상기 현재 블록의 모션 벡터 차분 값의 레졸루션이 획득되고,상기 제1 레졸루션 세트는 상기 제2 레졸루션 세트가 포함하는 가용 레졸루션들 중에서 가장 작은 가용 레졸루션을 제외한 나머지 가용 레졸루션으로 구성된, 비디오 신호 처리 방법.
- 비디오 신호 디코딩 장치에 있어서,프로세서를 포함하고,상기 프로세서는,제1 방법 및 제2 방법 중 어느 하나를 사용하여 현재 블록의 모션 보상을 위한 모션 벡터 예측자(motion vector prediction, MVP) 후보 리스트를 구성하고,상기 구성된 MVP 후보 리스트에 기초하여 현재 블록의 모션 벡터 예측자를 획득하고,상기 현재 블록의 모션 벡터와 상기 모션 벡터 예측자 간의 차이를 나타내는 모션 벡터 차분 값을 획득하고,상기 현재 블록의 모션 벡터 차분 값의 레졸루션(resolution)에 기초하여, 상기 모션 벡터 차분 값을 수정하되, 상기 모션 벡터 차분 값의 레졸루션은 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 어느 하나이고, 상기 레졸루션 세트가 포함하는 복수의 가용 레졸루션들의 구성은 상기 제1 방법 및 상기 제2 방법 중에서 어느 방법을 사용하여 상기 현재 블록의 MVP 후보 리스트가 구성되는지에 따라 달라짐,상기 모션 벡터 예측자 및 상기 수정된 모션 벡터 차분 값에 기초하여 상기 현재 블록의 모션 벡터를 획득하고,상기 획득된 모션 벡터에 기초하여 상기 현재 블록을 복원하는, 비디오 신호 디코딩 장치.
- 제14 항에 있어서,상기 모션 벡터 차분 값의 레졸루션은 상기 현재 블록의 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라, 각각 제1 레졸루션 세트 및 제2 레졸루션 세트 중 어느 하나로부터 획득되고,상기 제2 레졸루션 세트는 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들이 아닌 다른 가용 레졸루션을 적어도 하나 포함하는, 비디오 신호 디코딩 장치.
- 제15 항에 있어서,상기 MVP 후보 리스트가 어파인(affine) 모델에 기반한 상기 제1 방법을 사용하여 구성되는 경우, 상기 모션 벡터 차분 값의 레졸루션은 상기 제1 레졸루션 세트로부터 획득되고,상기 MVP 후보 리스트가 상기 어파인 모델에 기반하지 않은 상기 제2 방법을 사용하여 구성되는 경우, 상기 모션 벡터 차분 값의 레졸루션은 상기 제2 레졸루션 세트로부터 획득되는, 비디오 신호 디코딩 장치.
- 제16 항에 있어서,상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제1 가용 레졸루션은, 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제2 가용 레졸루션 보다 작은, 비디오 신호 디코딩 장치.
- 제15 항에 있어서,상기 프로세서는,상기 제1 레졸루션 세트 및 상기 제2 레졸루션 세트 중 어느 하나가 포함하는 복수의 가용 레졸루션들 중에서 상기 현재 블록의 모션 벡터 차분 값의 레졸루션을 지시하는 지시자를 획득하고,상기 지시자가 지시하는 레졸루션에 기초하여 상기 모션 벡터 차분 값을 수정하며,상기 지시자의 값이 제1 값인 경우, 상기 제1 값에 의해 지시되는 상기 레졸루션은 상기 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라 달라지는, 비디오 신호 디코딩 장치.
- 제18 항에 있어서,상기 지시자는 가변 길이의 비트로 표현되며,상기 제1 값은 상기 가변 길이의 비트로 표현되는 복수의 값들 중 어느 하나인, 비디오 신호 디코딩 장치.
- 제19 항에 있어서,상기 지시자의 상기 제1 값과 다른 제2 값은 상기 복수의 값들 중 가장 짧은 길이의 비트로 표현되는 값이고,상기 MVP 후보 리스트가 상기 제2 방법으로 구성되는 경우, 상기 제2 값은 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션을 지시하고,상기 MVP 후보 리스트가 상기 제1 방법으로 구성되는 경우, 상기 제2 값은 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션 이외의 다른 가용 레졸루션을 지시하는, 비디오 신호 디코딩 장치.
- 비디오 신호 인코딩 장치에 있어서,프로세서를 포함하고,상기 프로세서는,현재 블록의 모션 보상을 위해 참조되는 참조 블록의 위치에 기초하여 상기 현재 블록의 모션 벡터를 획득하고,제1 방법 및 제2 방법 중 어느 하나를 사용하여 상기 현재 블록의 모션 보상을 위한 모션 벡터 예측자(motion vector prediction, MVP) 후보 리스트를 구성하고,상기 MVP 후보 리스트가 포함하는 복수의 후보들 중 어느 하나와 상기 현재 블록의 모션 벡터 간의 차이에 기초하여 모션 벡터 차분 값을 획득하고,상기 현재 블록의 모션 벡터 차분 값의 레졸루션(resolution)에 기초하여, 시그널링되는 모션 벡터 차분 값을 결정하되, 상기 모션 벡터 차분 값의 레졸루션은 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 어느 하나이고, 상기 레졸루션 세트가 포함하는 복수의 가용 레졸루션들의 구성은 상기 제1 방법 및 상기 제2 방법 중에서 어느 방법을 사용하여 상기 현재 블록의 MVP 후보 리스트가 구성되는지에 따라 달라짐,상기 시그널링되는 모션 벡터 차분 값을 포함하는 비트스트림을 생성하는, 비디오 신호 인코딩 장치.
- 제21 항에 있어서,상기 모션 벡터 차분 값의 레졸루션은 상기 현재 블록의 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라, 각각 제1 레졸루션 세트 및 제2 레졸루션 세트 중 어느 하나로부터 획득되고,상기 제2 레졸루션 세트는 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들이 아닌 다른 가용 레졸루션을 적어도 하나 포함하는, 비디오 신호 인코딩 장치.
- 제22 항에 있어서,상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제1 가용 레졸루션은, 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제2 가용 레졸루션 보다 작은, 비디오 신호 인코딩 장치.
- 제21 항에 있어서,상기 프로세서는,상기 제1 레졸루션 세트 및 상기 제2 레졸루션 세트 중 어느 하나가 포함하는 복수의 가용 레졸루션들 중 어느 하나를 지시하는 지시자를 결정하고,상기 지시자 및 상기 시그널링되는 모션 벡터 차분 값을 포함하는 비트스트림을 생성하되,상기 지시자의 값이 제1 값인 경우, 상기 제1 값에 의해 지시되는 상기 레졸루션은 상기 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라 달라지는, 비디오 신호 인코딩 장치.
- 제24 항에 있어서,상기 지시자는 가변 길이의 비트로 표현되며,상기 제1 값은 상기 가변 길이의 비트로 표현되는 복수의 값들 중 어느 하나인, 비디오 신호 인코딩 장치.
- 제25 항에 있어서,상기 지시자의 상기 제1 값과 다른 제2 값은 상기 복수의 값들 중 가장 짧은 길이의 비트로 표현되는 값이고,상기 MVP 후보 리스트가 상기 제2 방법으로 구성되는 경우, 상기 제2 값은 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션을 지시하고,상기 MVP 후보 리스트가 상기 제1 방법으로 구성되는 경우, 상기 제2 값은 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션 이외의 다른 가용 레졸루션을 지시하는, 비디오 신호 인코딩 장치.
- 비트스트림을 저장하는 컴퓨터로 판독 가능한 기록 매체에 있어서,상기 비트스트림은,현재 블록의 모션 벡터 차분 값의 레졸루션(resolution)에 기초하여 수정된 상기 현재 블록의 수정된 모션 벡터 차분 값을 포함하되,상기 모션 벡터 차분 값의 레졸루션은 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 어느 하나이고, 상기 레졸루션 세트가 포함하는 복수의 가용 레졸루션들의 구성은 제1 방법 및 제2 방법 중에서 어느 방법을 사용하여 상기 현재 블록의 모션 보상을 위한 모션 벡터 예측자(motion vector prediction, MVP) 후보 리스트가 구성되는지에 따라 달라지는, 컴퓨터로 판독 가능한 기록 매체.
- 제27 항에 있어서,상기 모션 벡터 차분 값의 레졸루션은 상기 현재 블록의 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라, 각각 제1 레졸루션 세트 및 제2 레졸루션 세트 중 어느 하나로부터 획득되고,상기 제2 레졸루션 세트는 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들이 아닌 다른 가용 레졸루션을 적어도 하나 포함하는, 컴퓨터로 판독 가능한 기록 매체.
- 제28 항에 있어서,상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제1 가용 레졸루션은, 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션들 중 가장 큰 제2 가용 레졸루션 보다 작은, 컴퓨터로 판독 가능한 기록 매체.
- 제28 항에 있어서,상기 비트스트림은,상기 제1 레졸루션 세트 및 상기 제2 레졸루션 세트 중 어느 하나가 포함하는 복수의 가용 레졸루션들 중 상기 현재 블록의 모션 벡터 차분 값의 레졸루션을 지시하는 지시자를 더 포함하고,상기 지시자의 값이 제1 값인 경우, 상기 제1 값에 의해 지시되는 상기 레졸루션은 상기 MVP 후보 리스트가 상기 제1 방법 및 상기 제2 방법 중 어느 방법을 사용하여 구성되는지에 따라 달라지는, 컴퓨터로 판독 가능한 기록 매체.
- 제30 항에 있어서,상기 지시자는 가변 길이의 비트로 표현되며,상기 제1 값은 상기 가변 길이의 비트로 표현되는 복수의 값들 중 어느 하나인, 컴퓨터로 판독 가능한 기록 매체.
- 제31 항에 있어서,상기 지시자의 상기 제1 값과 다른 제2 값은 상기 복수의 값들 중 가장 짧은 길이의 비트로 표현되는 값이고,상기 MVP 후보 리스트가 상기 제2 방법으로 구성되는 경우, 상기 제2 값은 상기 제2 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션을 지시하고,상기 MVP 후보 리스트가 상기 제1 방법으로 구성되는 경우, 상기 제2 값은 상기 제1 레졸루션 세트가 포함하는 복수의 가용 레졸루션 세트 중에서 가장 작은 가용 레졸루션 이외의 다른 가용 레졸루션을 지시하는, 컴퓨터로 판독 가능한 기록 매체.
Priority Applications (13)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410332393.XA CN118250474A (zh) | 2018-06-07 | 2019-06-07 | 使用自适应运动矢量分辨率的视频信号处理方法及装置 |
CN202410332230.1A CN118233652A (zh) | 2018-06-07 | 2019-06-07 | 使用自适应运动矢量分辨率的视频信号处理方法及装置 |
EP19814257.2A EP3806461A4 (en) | 2018-06-07 | 2019-06-07 | VIDEO SIGNAL PROCESSING METHOD AND APPARATUS USING ADAPTIVE MOTION VECTOR RESOLUTION |
CN201980038112.7A CN112237001B (zh) | 2018-06-07 | 2019-06-07 | 使用自适应运动矢量分辨率的视频信号处理方法及装置 |
CN202410332229.9A CN118233651A (zh) | 2018-06-07 | 2019-06-07 | 使用自适应运动矢量分辨率的视频信号处理方法及装置 |
KR1020207033872A KR102493418B1 (ko) | 2018-06-07 | 2019-06-07 | 적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 |
KR1020237002898A KR20230018548A (ko) | 2018-06-07 | 2019-06-07 | 적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 |
CN202410332398.2A CN118233653A (zh) | 2018-06-07 | 2019-06-07 | 使用自适应运动矢量分辨率的视频信号处理方法及装置 |
JP2020568219A JP7159354B2 (ja) | 2018-06-07 | 2019-06-07 | 適応的動きベクトル解像度を用いるビデオ信号処理方法及び装置 |
US17/113,215 US11166040B2 (en) | 2018-06-07 | 2020-12-07 | Video signal processing method and apparatus using adaptive motion vector resolution |
US17/460,117 US11706440B2 (en) | 2018-06-07 | 2021-08-27 | Video signal processing method and apparatus using adaptive motion vector resolution |
JP2022164143A JP2022185121A (ja) | 2018-06-07 | 2022-10-12 | 適応的動きベクトル解像度を用いるビデオ信号処理方法及び装置 |
US18/328,246 US20230308676A1 (en) | 2018-06-07 | 2023-06-02 | Video signal processing method and apparatus using adaptive motion vector resolution |
Applications Claiming Priority (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2018-0065688 | 2018-06-07 | ||
KR20180065688 | 2018-06-07 | ||
KR10-2018-0067864 | 2018-06-14 | ||
KR20180067864 | 2018-06-14 | ||
KR10-2018-0078513 | 2018-07-06 | ||
KR20180078513 | 2018-07-06 | ||
KR20180091270 | 2018-08-06 | ||
KR10-2018-0091270 | 2018-08-06 |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2019/006913 Continuation WO2019235896A1 (ko) | 2018-06-07 | 2019-06-07 | 적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2019/006913 Continuation WO2019235896A1 (ko) | 2018-06-07 | 2019-06-07 | 적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 |
US17/113,215 Continuation US11166040B2 (en) | 2018-06-07 | 2020-12-07 | Video signal processing method and apparatus using adaptive motion vector resolution |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019235896A1 true WO2019235896A1 (ko) | 2019-12-12 |
Family
ID=68770812
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/KR2019/006913 WO2019235896A1 (ko) | 2018-06-07 | 2019-06-07 | 적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 |
Country Status (6)
Country | Link |
---|---|
US (3) | US11166040B2 (ko) |
EP (1) | EP3806461A4 (ko) |
JP (2) | JP7159354B2 (ko) |
KR (2) | KR102493418B1 (ko) |
CN (5) | CN118250474A (ko) |
WO (1) | WO2019235896A1 (ko) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2022500909A (ja) * | 2018-09-19 | 2022-01-04 | 北京字節跳動網絡技術有限公司Beijing Bytedance Network Technology Co., Ltd. | 適応動きベクトル解像度によるアフィンモードへの構文の使用 |
JP2022521157A (ja) * | 2019-02-28 | 2022-04-06 | テンセント・アメリカ・エルエルシー | 映像復号のための方法、装置、及びコンピュータプログラム |
US20220124366A1 (en) * | 2019-06-27 | 2022-04-21 | Samsung Electronics Co., Ltd. | Method and apparatus for decoding video, and method and apparatus for encoding video |
US11477458B2 (en) | 2018-06-19 | 2022-10-18 | Beijing Bytedance Network Technology Co., Ltd. | Mode dependent motion vector difference precision set |
US11997286B2 (en) | 2020-04-10 | 2024-05-28 | Samsung Electronics Co., Ltd. | Device and method for encoding motion vector, and device and method for decoding motion vector |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020002373A1 (en) * | 2018-06-27 | 2020-01-02 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Contour mode prediction |
MX2020012688A (es) | 2018-06-27 | 2021-02-15 | Kt Corp | Metodo y aparato para procesar se?ales de video. |
KR20220051842A (ko) * | 2019-09-18 | 2022-04-26 | 삼성전자주식회사 | 움직임 정보의 부호화 장치 및 방법, 및 복호화 장치 및 방법 |
CA3227220A1 (en) * | 2021-09-28 | 2023-04-06 | Qualcomm Incorporated | Motion vector difference sign prediction for video coding |
US20230139186A1 (en) * | 2021-10-28 | 2023-05-04 | Tencent America LLC | Template-matching based adaptive motion vector resolution (amvr) |
US20230134017A1 (en) * | 2021-11-01 | 2023-05-04 | Tencent America LLC | Template-matching based adaptive motion vector resolution (amvr) for bi-prediction and an affine mode |
US20230199213A1 (en) * | 2021-12-17 | 2023-06-22 | Tencent America LLC | Template-matching based adaptive motion vector resolution by using an adaptive order of motion vector resolutions |
CN114826400B (zh) * | 2022-02-28 | 2023-08-08 | 北京邮电大学 | 一种基于可见光通信的信号补偿方法及相关设备 |
WO2023177799A1 (en) * | 2022-03-16 | 2023-09-21 | Beijing Dajia Internet Information Technology Co., Ltd. | Adaptive picture modifications for video coding |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017052000A1 (ko) * | 2015-09-24 | 2017-03-30 | 엘지전자 주식회사 | 영상 코딩 시스템에서 움직임 벡터 정제 기반 인터 예측 방법 및 장치 |
WO2017194773A1 (en) * | 2016-05-13 | 2017-11-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Motion vector difference coding and decoding |
US20180098063A1 (en) * | 2016-10-05 | 2018-04-05 | Qualcomm Incorporated | Motion vector prediction for affine motion models in video coding |
US20180098089A1 (en) * | 2016-10-04 | 2018-04-05 | Qualcomm Incorporated | Adaptive motion vector precision for video coding |
WO2018095313A1 (en) * | 2016-11-22 | 2018-05-31 | Mediatek Inc. | Method and apparatus for motion vector sign prediction in video coding |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10531116B2 (en) * | 2014-01-09 | 2020-01-07 | Qualcomm Incorporated | Adaptive motion vector resolution signaling for video coding |
CN111741312B (zh) * | 2014-10-31 | 2024-03-19 | 三星电子株式会社 | 用于对运动矢量进行编码/解码的方法和装置 |
EP3414900A4 (en) | 2016-03-15 | 2019-12-11 | Mediatek Inc. | METHOD AND DEVICE FOR VIDEO CODING WITH AFFINE MOTION COMPENSATION |
WO2017156705A1 (en) * | 2016-03-15 | 2017-09-21 | Mediatek Inc. | Affine prediction for video coding |
US11089323B2 (en) * | 2016-05-28 | 2021-08-10 | Mediatek Inc. | Method and apparatus of current picture referencing for video coding |
EP3264768A1 (en) * | 2016-06-30 | 2018-01-03 | Thomson Licensing | Method and apparatus for video coding with adaptive motion information refinement |
EP3497932A4 (en) | 2016-08-15 | 2020-03-25 | Nokia Technologies Oy | VIDEO CODING AND DECODING |
CN117221573A (zh) * | 2016-10-04 | 2023-12-12 | 英迪股份有限公司 | 图像解码方法、图像编码方法以及发送比特流的方法 |
-
2019
- 2019-06-07 CN CN202410332393.XA patent/CN118250474A/zh active Pending
- 2019-06-07 JP JP2020568219A patent/JP7159354B2/ja active Active
- 2019-06-07 WO PCT/KR2019/006913 patent/WO2019235896A1/ko unknown
- 2019-06-07 CN CN201980038112.7A patent/CN112237001B/zh active Active
- 2019-06-07 EP EP19814257.2A patent/EP3806461A4/en active Pending
- 2019-06-07 CN CN202410332230.1A patent/CN118233652A/zh active Pending
- 2019-06-07 CN CN202410332398.2A patent/CN118233653A/zh active Pending
- 2019-06-07 KR KR1020207033872A patent/KR102493418B1/ko active IP Right Grant
- 2019-06-07 CN CN202410332229.9A patent/CN118233651A/zh active Pending
- 2019-06-07 KR KR1020237002898A patent/KR20230018548A/ko active Application Filing
-
2020
- 2020-12-07 US US17/113,215 patent/US11166040B2/en active Active
-
2021
- 2021-08-27 US US17/460,117 patent/US11706440B2/en active Active
-
2022
- 2022-10-12 JP JP2022164143A patent/JP2022185121A/ja active Pending
-
2023
- 2023-06-02 US US18/328,246 patent/US20230308676A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2017052000A1 (ko) * | 2015-09-24 | 2017-03-30 | 엘지전자 주식회사 | 영상 코딩 시스템에서 움직임 벡터 정제 기반 인터 예측 방법 및 장치 |
WO2017194773A1 (en) * | 2016-05-13 | 2017-11-16 | Telefonaktiebolaget Lm Ericsson (Publ) | Motion vector difference coding and decoding |
US20180098089A1 (en) * | 2016-10-04 | 2018-04-05 | Qualcomm Incorporated | Adaptive motion vector precision for video coding |
US20180098063A1 (en) * | 2016-10-05 | 2018-04-05 | Qualcomm Incorporated | Motion vector prediction for affine motion models in video coding |
WO2018095313A1 (en) * | 2016-11-22 | 2018-05-31 | Mediatek Inc. | Method and apparatus for motion vector sign prediction in video coding |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11477458B2 (en) | 2018-06-19 | 2022-10-18 | Beijing Bytedance Network Technology Co., Ltd. | Mode dependent motion vector difference precision set |
US12022087B2 (en) | 2018-06-19 | 2024-06-25 | Beijing Bytedance Network Technology Co., Ltd | Mode dependent motion vector difference precision set |
JP2022500909A (ja) * | 2018-09-19 | 2022-01-04 | 北京字節跳動網絡技術有限公司Beijing Bytedance Network Technology Co., Ltd. | 適応動きベクトル解像度によるアフィンモードへの構文の使用 |
JP7212150B2 (ja) | 2018-09-19 | 2023-01-24 | 北京字節跳動網絡技術有限公司 | 適応動きベクトル解像度によるアフィンモードへの構文の使用 |
US11653020B2 (en) | 2018-09-19 | 2023-05-16 | Beijing Bytedance Network Technology Co., Ltd | Fast algorithms for adaptive motion vector resolution in affine mode |
JP2022521157A (ja) * | 2019-02-28 | 2022-04-06 | テンセント・アメリカ・エルエルシー | 映像復号のための方法、装置、及びコンピュータプログラム |
JP7125563B2 (ja) | 2019-02-28 | 2022-08-24 | テンセント・アメリカ・エルエルシー | 映像復号のための方法、装置、及びコンピュータプログラム |
US20220124366A1 (en) * | 2019-06-27 | 2022-04-21 | Samsung Electronics Co., Ltd. | Method and apparatus for decoding video, and method and apparatus for encoding video |
US11882307B2 (en) * | 2019-06-27 | 2024-01-23 | Samsung Electronics Co., Ltd. | Method and apparatus for decoding video, and method and apparatus for encoding video |
US11997286B2 (en) | 2020-04-10 | 2024-05-28 | Samsung Electronics Co., Ltd. | Device and method for encoding motion vector, and device and method for decoding motion vector |
Also Published As
Publication number | Publication date |
---|---|
CN118233652A (zh) | 2024-06-21 |
JP2021526340A (ja) | 2021-09-30 |
CN112237001B (zh) | 2024-04-12 |
EP3806461A1 (en) | 2021-04-14 |
KR102493418B1 (ko) | 2023-01-31 |
CN112237001A (zh) | 2021-01-15 |
US20210112268A1 (en) | 2021-04-15 |
KR20210006390A (ko) | 2021-01-18 |
US11706440B2 (en) | 2023-07-18 |
US11166040B2 (en) | 2021-11-02 |
US20210392365A1 (en) | 2021-12-16 |
EP3806461A4 (en) | 2022-03-16 |
CN118233651A (zh) | 2024-06-21 |
JP2022185121A (ja) | 2022-12-13 |
CN118250474A (zh) | 2024-06-25 |
CN118233653A (zh) | 2024-06-21 |
US20230308676A1 (en) | 2023-09-28 |
KR20230018548A (ko) | 2023-02-07 |
JP7159354B2 (ja) | 2022-10-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019235896A1 (ko) | 적응적 모션 벡터 레졸루션을 이용하는 비디오 신호 처리 방법 및 장치 | |
WO2020076143A1 (ko) | 다중 가정 예측을 사용하는 비디오 신호 처리 방법 및 장치 | |
WO2019182385A1 (ko) | 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체 | |
WO2018030599A1 (ko) | 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2018066867A1 (ko) | 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체 | |
WO2018030773A1 (ko) | 영상 부호화/복호화 방법 및 장치 | |
WO2017018664A1 (ko) | 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2017146526A1 (ko) | 비디오 신호 처리 방법 및 장치 | |
WO2018097692A2 (ko) | 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체 | |
WO2019083334A1 (ko) | 비대칭 서브 블록 기반 영상 부호화/복호화 방법 및 장치 | |
WO2017039117A1 (ko) | 영상의 부호화/복호화 방법 및 이를 위한 장치 | |
WO2018047995A1 (ko) | 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치 | |
WO2020085800A1 (ko) | 서브블록 기반의 모션 보상을 이용한 비디오 신호 처리 방법 및 장치 | |
WO2019240493A1 (ko) | 문맥 적응적 이진 산술 부호화 방법 및 장치 | |
WO2020171681A1 (ko) | 인트라 예측 기반 비디오 신호 처리 방법 및 장치 | |
WO2020111843A1 (ko) | 화면 내 예측 필터링을 이용한 비디오 신호 처리 방법 및 장치 | |
WO2020251330A1 (ko) | 단순화된 mpm 리스트 생성 방법을 활용하는 영상 부호화/복호화 방법, 장치 및 비트스트림을 전송하는 방법 | |
WO2017069505A1 (ko) | 영상의 부호화/복호화 방법 및 이를 위한 장치 | |
WO2019221465A1 (ko) | 영상 복호화 방법/장치, 영상 부호화 방법/장치 및 비트스트림을 저장한 기록 매체 | |
WO2020222588A1 (ko) | 적응적 모션 벡터 해상도를 이용한 비디오 신호 처리 방법 및 장치 | |
WO2019194425A1 (ko) | 영상 부호화 또는 복호화에 인공 신경망을 적용하는 장치 및 방법 | |
WO2018101700A1 (ko) | 영상 부호화/복호화 방법, 장치 및 비트스트림을 저장한 기록 매체 | |
WO2020017910A1 (ko) | 지역 조명 보상을 통한 효과적인 비디오 부호화/복호화 방법 및 장치 | |
WO2016190627A1 (ko) | 비디오 신호 처리 방법 및 장치 | |
WO2021172914A1 (ko) | 레지듀얼 코딩에 대한 영상 디코딩 방법 및 그 장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19814257 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20207033872 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2020568219 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2019814257 Country of ref document: EP Effective date: 20210111 |