WO2019212223A1 - Procédé de décodage d'image à l'aide d'un dmvr dans un système de codage d'image et dispositif associé - Google Patents

Procédé de décodage d'image à l'aide d'un dmvr dans un système de codage d'image et dispositif associé Download PDF

Info

Publication number
WO2019212223A1
WO2019212223A1 PCT/KR2019/005183 KR2019005183W WO2019212223A1 WO 2019212223 A1 WO2019212223 A1 WO 2019212223A1 KR 2019005183 W KR2019005183 W KR 2019005183W WO 2019212223 A1 WO2019212223 A1 WO 2019212223A1
Authority
WO
WIPO (PCT)
Prior art keywords
block
motion information
specific boundary
target block
prediction
Prior art date
Application number
PCT/KR2019/005183
Other languages
English (en)
Korean (ko)
Inventor
박내리
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Publication of WO2019212223A1 publication Critical patent/WO2019212223A1/fr

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/105Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117Filters, e.g. for pre-processing or post-processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/53Multi-resolution motion estimation; Hierarchical motion estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • H04N19/533Motion estimation using multistep search, e.g. 2D-log search or one-at-a-time search [OTS]

Definitions

  • the present invention relates to an image coding technique, and more particularly, to an image decoding method and apparatus using DMVR in an image coding system.
  • the demand for high resolution and high quality images such as high definition (HD) images and ultra high definition (UHD) images is increasing in various fields.
  • the higher the resolution and the higher quality of the image data the more information or bit rate is transmitted than the existing image data. Therefore, the image data can be transmitted by using a medium such as a conventional wired / wireless broadband line or by using a conventional storage medium. In the case of storage, the transmission cost and the storage cost are increased.
  • a high efficiency image compression technique is required to effectively transmit, store, and reproduce high resolution, high quality image information.
  • An object of the present invention is to provide a method and apparatus for improving image coding efficiency.
  • Another technical problem of the present invention is to provide a method and apparatus for performing a DMVR.
  • Another object of the present invention is to provide a method and apparatus for performing a DMVR based on a target block generated in consideration of a neighboring block.
  • an image decoding method performed by a decoding apparatus.
  • the method includes deriving motion information of a current block, deriving a target block based on the motion information, deriving motion information of a neighboring block with respect to the current block, Deriving a reference block based on motion information, and weighting sums of samples included in a specific boundary region in the target block and samples included in a specific boundary region in the reference block corresponding to the specific boundary region.
  • the method may include performing prediction on the current block, wherein the specific boundary area in the target block is an area adjacent to a specific boundary in the target block.
  • a decoding apparatus for performing image decoding.
  • the decoding apparatus derives motion information of a current block, derives a target block based on the motion information, derives motion information of a neighboring block with respect to the current block, and derives the motion information of the neighboring block.
  • a reference block is derived based on the modified result by weighted sums of the samples included in the specific boundary region in the target block and the samples included in the specific boundary region in the reference block corresponding to the specific boundary region.
  • Derive samples derive a modified target block including the modified samples, derive a reference block with the smallest SAD with the modified target block among the reference blocks in a search range, Derived motion information indicating a block as refined motion information, and based on the refined motion information, Including prediction section for performing a prediction and the target block in the particular border area is characterized in that within a certain area adjacent to the target block boundary.
  • a video encoding method performed by an encoding apparatus includes deriving motion information of a current block, deriving a target block based on the motion information, deriving motion information of a neighboring block with respect to the current block, Deriving a reference block based on motion information, and weighting sums of samples included in a specific boundary region in the target block and samples included in a specific boundary region in the reference block corresponding to the specific boundary region.
  • Deriving modified samples deriving a modified target block including the modified samples, and deriving a reference block having the smallest SAD with the modified target block among the reference blocks in a search range And deriving motion information indicating the reference block as refined motion information, based on the refined motion information.
  • a video encoding apparatus derives motion information of a current block, derives a target block based on the motion information, derives motion information of a neighboring block with respect to the current block, and moves the motion of the neighboring block.
  • a reference block is derived based on the information, and is modified by weighted sum of samples included in a specific boundary region in the target block and samples included in a specific boundary region in the reference block corresponding to the specific boundary region.
  • Deriving the modified samples deriving a modified target block including the modified samples, deriving a reference block having the smallest SAD with the modified target block among the reference blocks in a search range, Derived motion information indicating a reference block as refined motion information, and the current block based on the refined motion information.
  • a target block for performing a DMVR may be generated in consideration of the neighboring block of the current block, and through this, the DMVR may be performed in consideration of the neighboring block, thereby reducing discontinuity with the neighboring block.
  • Subjective picture quality can be improved.
  • the present invention it is possible to determine whether to perform a weighted summation process for deriving the modified target block according to a specific condition. Through this, the weighted summation process can be adaptively performed, thereby improving decoding accuracy while improving prediction accuracy. The complexity of the process can be reduced.
  • FIG. 1 is a diagram schematically illustrating a configuration of a video encoding apparatus to which the present invention may be applied.
  • FIG. 2 is a diagram schematically illustrating a configuration of a video decoding apparatus to which the present invention may be applied.
  • 3 shows an example of performing a DMVR process.
  • FIG. 4 illustrates an example of a DMVR that is generated based on a neighboring block and is performed based on the generated target block.
  • FIG. 5 illustrates an example of a DMVR that is generated based on the left neighboring block and the upper neighboring block, and is performed based on the generated target block.
  • FIG. 6 schematically illustrates an image encoding method by an encoding apparatus according to the present invention.
  • FIG. 7 schematically illustrates an encoding apparatus for performing an image encoding method according to the present invention.
  • FIG. 8 schematically illustrates an image decoding method by a decoding apparatus according to the present invention.
  • FIG 9 schematically illustrates a decoding apparatus for performing an image decoding method according to the present invention.
  • each configuration in the drawings described in the present invention are shown independently for the convenience of description of the different characteristic functions, it does not mean that each configuration is implemented by separate hardware or separate software.
  • two or more of each configuration may be combined to form one configuration, or one configuration may be divided into a plurality of configurations.
  • Embodiments in which each configuration is integrated and / or separated are also included in the scope of the present invention without departing from the spirit of the present invention.
  • the present invention relates to video / image coding.
  • the method / embodiment disclosed herein may be applied to the method disclosed in the versatile video coding (VVC) standard or the next generation video / image coding standard.
  • VVC versatile video coding
  • a picture generally refers to a unit representing one image of a specific time zone
  • a slice is a unit constituting a part of a picture in coding.
  • One picture may be composed of a plurality of slices, and if necessary, the picture and the slice may be mixed with each other.
  • a pixel or a pel may refer to a minimum unit constituting one picture (or image). Also, 'sample' may be used as a term corresponding to a pixel.
  • a sample may generally represent a pixel or a value of a pixel, and may only represent pixel / pixel values of the luma component, or only pixel / pixel values of the chroma component.
  • a unit represents the basic unit of image processing.
  • the unit may include at least one of a specific region of the picture and information related to the region.
  • the unit may be used interchangeably with terms such as block or area in some cases.
  • an M ⁇ N block may represent a set of samples or transform coefficients composed of M columns and N rows.
  • FIG. 1 is a diagram schematically illustrating a configuration of a video encoding apparatus to which the present invention may be applied.
  • the video encoding apparatus 100 may include a picture splitter 105, a predictor 110, a residual processor 120, an entropy encoder 130, an adder 140, and a filter 150. ) And memory 160.
  • the residual processing unit 120 may include a subtraction unit 121, a conversion unit 122, a quantization unit 123, a reordering unit 124, an inverse quantization unit 125, and an inverse conversion unit 126.
  • the picture divider 105 may divide the input picture into at least one processing unit.
  • the processing unit may be called a coding unit (CU).
  • the coding unit may be recursively split from the largest coding unit (LCU) according to a quad-tree binary-tree (QTBT) structure.
  • LCU largest coding unit
  • QTBT quad-tree binary-tree
  • one coding unit may be divided into a plurality of coding units of a deeper depth based on a quad tree structure and / or a binary tree structure.
  • the quad tree structure may be applied first and the binary tree structure may be applied later.
  • the binary tree structure may be applied first.
  • the coding procedure according to the present invention may be performed based on the final coding unit that is no longer split.
  • the maximum coding unit may be used as the final coding unit immediately based on coding efficiency according to the image characteristic, or if necessary, the coding unit is recursively divided into coding units of lower depths and optimized.
  • a coding unit of size may be used as the final coding unit.
  • the coding procedure may include a procedure of prediction, transform, and reconstruction, which will be described later.
  • the processing unit may include a coding unit (CU) prediction unit (PU) or a transform unit (TU).
  • the coding unit may be split from the largest coding unit (LCU) into coding units of deeper depths along the quad tree structure.
  • LCU largest coding unit
  • the maximum coding unit may be used as the final coding unit immediately based on coding efficiency according to the image characteristic, or if necessary, the coding unit is recursively divided into coding units of lower depths and optimized.
  • a coding unit of size may be used as the final coding unit. If a smallest coding unit (SCU) is set, the coding unit may not be split into smaller coding units than the minimum coding unit.
  • the final coding unit refers to a coding unit that is the basis of partitioning or partitioning into a prediction unit or a transform unit.
  • the prediction unit is a unit partitioning from the coding unit and may be a unit of sample prediction. In this case, the prediction unit may be divided into sub blocks.
  • the transform unit may be divided along the quad tree structure from the coding unit, and may be a unit for deriving a transform coefficient and / or a unit for deriving a residual signal from the transform coefficient.
  • a coding unit may be called a coding block (CB)
  • a prediction unit is a prediction block (PB)
  • a transform unit may be called a transform block (TB).
  • a prediction block or prediction unit may mean a specific area in the form of a block within a picture, and may include an array of prediction samples.
  • a transform block or a transform unit may mean a specific area in a block form within a picture, and may include an array of transform coefficients or residual samples.
  • the prediction unit 110 may perform a prediction on a block to be processed (hereinafter, referred to as a current block) and generate a predicted block including prediction samples of the current block.
  • the unit of prediction performed by the prediction unit 110 may be a coding block, a transform block, or a prediction block.
  • the prediction unit 110 may determine whether intra prediction or inter prediction is applied to the current block. As an example, the prediction unit 110 may determine whether intra prediction or inter prediction is applied on a CU basis.
  • the prediction unit 110 may derive a prediction sample for the current block based on reference samples outside the current block in the picture to which the current block belongs (hereinafter, referred to as the current picture). In this case, the prediction unit 110 may (i) derive the prediction sample based on the average or interpolation of neighboring reference samples of the current block, and (ii) the neighbor reference of the current block.
  • the prediction sample may be derived based on a reference sample present in a specific (prediction) direction with respect to the prediction sample among the samples. In case of (i), it may be called non-directional mode or non-angle mode, and in case of (ii), it may be called directional mode or angular mode.
  • the prediction mode may have, for example, 33 directional prediction modes and at least two non-directional modes.
  • the non-directional mode may include a DC prediction mode and a planner mode (Planar mode).
  • the prediction unit 110 may determine the prediction mode applied to the current block by using the prediction mode applied to the neighboring block.
  • the prediction unit 110 may derive the prediction sample for the current block based on the sample specified by the motion vector on the reference picture.
  • the prediction unit 110 may apply one of a skip mode, a merge mode, and a motion vector prediction (MVP) mode to derive a prediction sample for the current block.
  • the prediction unit 110 may use the motion information of the neighboring block as the motion information of the current block.
  • the skip mode unlike the merge mode, the difference (residual) between the prediction sample and the original sample is not transmitted.
  • the MVP mode the motion vector of the current block may be derived using the motion vector of the neighboring block as a motion vector predictor.
  • the neighboring block may include a spatial neighboring block existing in the current picture and a temporal neighboring block present in the reference picture.
  • a reference picture including the temporal neighboring block may be called a collocated picture (colPic).
  • the motion information may include a motion vector and a reference picture index.
  • Information such as prediction mode information and motion information may be encoded (entropy) and output in the form of a bitstream.
  • the highest picture on the reference picture list may be used as the reference picture.
  • Reference pictures included in a reference picture list may be sorted based on a difference in a picture order count (POC) between a current picture and a corresponding reference picture.
  • POC picture order count
  • the subtraction unit 121 generates a residual sample which is a difference between the original sample and the prediction sample.
  • residual samples may not be generated as described above.
  • the transform unit 122 generates transform coefficients by transforming the residual sample in units of transform blocks.
  • the transform unit 122 may perform the transform according to the size of the transform block and the prediction mode applied to the coding block or the prediction block that spatially overlaps the transform block. For example, if intra prediction is applied to the coding block or the prediction block that overlaps the transform block, and the transform block is a 4 ⁇ 4 residual array, the residual sample is configured to perform a discrete sine transform (DST) transform kernel.
  • the residual sample may be transformed using a discrete cosine transform (DCT) transform kernel.
  • DST discrete sine transform
  • DCT discrete cosine transform
  • the quantization unit 123 may quantize the transform coefficients to generate quantized transform coefficients.
  • the reordering unit 124 rearranges the quantized transform coefficients.
  • the reordering unit 124 may reorder the quantized transform coefficients in the form of a block into a one-dimensional vector form through a coefficient scanning method. Although the reordering unit 124 has been described in a separate configuration, the reordering unit 124 may be part of the quantization unit 123.
  • the entropy encoding unit 130 may perform entropy encoding on the quantized transform coefficients.
  • Entropy encoding may include, for example, encoding methods such as exponential Golomb, context-adaptive variable length coding (CAVLC), context-adaptive binary arithmetic coding (CABAC), and the like.
  • the entropy encoding unit 130 may encode information necessary for video reconstruction other than the quantized transform coefficient (for example, a value of a syntax element) together or separately. Entropy encoded information may be transmitted or stored in units of network abstraction layer (NAL) units in the form of bitstreams.
  • NAL network abstraction layer
  • the inverse quantization unit 125 inverse quantizes the quantized values (quantized transform coefficients) in the quantization unit 123, and the inverse transformer 126 inverse transforms the inverse quantized values in the inverse quantization unit 125 to obtain a residual sample.
  • the adder 140 reconstructs the picture by combining the residual sample and the predictive sample.
  • the residual sample and the predictive sample may be added in units of blocks to generate a reconstructed block.
  • the adder 140 may be part of the predictor 110.
  • the adder 140 may be called a restoration unit or a restoration block generation unit.
  • the filter unit 150 may apply a deblocking filter and / or a sample adaptive offset to the reconstructed picture. Through deblocking filtering and / or sample adaptive offset, the artifacts of the block boundaries in the reconstructed picture or the distortion in the quantization process can be corrected.
  • the sample adaptive offset may be applied on a sample basis and may be applied after the process of deblocking filtering is completed.
  • the filter unit 150 may apply an adaptive loop filter (ALF) to the reconstructed picture. ALF may be applied to the reconstructed picture after the deblocking filter and / or sample adaptive offset is applied.
  • ALF adaptive loop filter
  • the memory 160 may store reconstructed pictures (decoded pictures) or information necessary for encoding / decoding.
  • the reconstructed picture may be a reconstructed picture after the filtering process is completed by the filter unit 150.
  • the stored reconstructed picture may be used as a reference picture for (inter) prediction of another picture.
  • the memory 160 may store (reference) pictures used for inter prediction.
  • pictures used for inter prediction may be designated by a reference picture set or a reference picture list.
  • FIG. 2 is a diagram schematically illustrating a configuration of a video decoding apparatus to which the present invention may be applied.
  • the video decoding apparatus 200 may include an entropy decoding unit 210, a residual processor 220, a predictor 230, an adder 240, a filter 250, and a memory 260. It may include.
  • the residual processor 220 may include a rearrangement unit 221, an inverse quantization unit 222, and an inverse transform unit 223.
  • the video decoding apparatus 200 may restore video in response to a process in which video information is processed in the video encoding apparatus.
  • the video decoding apparatus 200 may perform video decoding using a processing unit applied in the video encoding apparatus.
  • the processing unit block of video decoding may be, for example, a coding unit, and in another example, a coding unit, a prediction unit, or a transform unit.
  • the coding unit may be split along the quad tree structure and / or binary tree structure from the largest coding unit.
  • the prediction unit and the transform unit may be further used in some cases, in which case the prediction block is a block derived or partitioned from the coding unit and may be a unit of sample prediction. At this point, the prediction unit may be divided into subblocks.
  • the transform unit may be divided along the quad tree structure from the coding unit, and may be a unit for deriving a transform coefficient or a unit for deriving a residual signal from the transform coefficient.
  • the entropy decoding unit 210 may parse the bitstream and output information necessary for video reconstruction or picture reconstruction. For example, the entropy decoding unit 210 decodes information in a bitstream based on a coding method such as exponential Golomb coding, CAVLC, or CABAC, quantized values of syntax elements necessary for video reconstruction, and residual coefficients. Can be output.
  • a coding method such as exponential Golomb coding, CAVLC, or CABAC, quantized values of syntax elements necessary for video reconstruction, and residual coefficients. Can be output.
  • the CABAC entropy decoding method receives a bin corresponding to each syntax element in a bitstream, and decodes syntax element information and decoding information of neighboring and decoding target blocks or information of symbols / bins decoded in a previous step.
  • the context model may be determined using the context model, the probability of occurrence of a bin may be predicted according to the determined context model, and arithmetic decoding of the bin may be performed to generate a symbol corresponding to the value of each syntax element. have.
  • the CABAC entropy decoding method may update the context model by using the information of the decoded symbol / bin for the context model of the next symbol / bean after determining the context model.
  • the information related to the prediction among the information decoded by the entropy decoding unit 210 is provided to the prediction unit 230, and the residual value on which the entropy decoding has been performed by the entropy decoding unit 210, that is, the quantized transform coefficient, is used as a reordering unit ( 221 may be input.
  • the reordering unit 221 may rearrange the quantized transform coefficients in a two-dimensional block form.
  • the reordering unit 221 may perform reordering in response to coefficient scanning performed by the encoding apparatus.
  • the rearrangement unit 221 has been described in a separate configuration, but the rearrangement unit 221 may be part of the inverse quantization unit 222.
  • the inverse quantization unit 222 may dequantize the quantized transform coefficients based on the (inverse) quantization parameter and output the transform coefficients.
  • information for deriving a quantization parameter may be signaled from the encoding apparatus.
  • the inverse transform unit 223 may inversely transform transform coefficients to derive residual samples.
  • the prediction unit 230 may perform prediction on the current block and generate a predicted block including prediction samples for the current block.
  • the unit of prediction performed by the prediction unit 230 may be a coding block, a transform block, or a prediction block.
  • the prediction unit 230 may determine whether to apply intra prediction or inter prediction based on the information about the prediction.
  • a unit for determining which of intra prediction and inter prediction is to be applied and a unit for generating a prediction sample may be different.
  • the unit for generating a prediction sample in inter prediction and intra prediction may also be different.
  • whether to apply inter prediction or intra prediction may be determined in units of CUs.
  • a prediction mode may be determined and a prediction sample may be generated in PU units
  • intra prediction a prediction mode may be determined in PU units and a prediction sample may be generated in TU units.
  • the prediction unit 230 may derive the prediction sample for the current block based on the neighbor reference samples in the current picture.
  • the prediction unit 230 may derive the prediction sample for the current block by applying the directional mode or the non-directional mode based on the neighbor reference samples of the current block.
  • the prediction mode to be applied to the current block may be determined using the intra prediction mode of the neighboring block.
  • the prediction unit 230 may derive the prediction sample for the current block based on the sample specified on the reference picture by the motion vector on the reference picture.
  • the prediction unit 230 may apply any one of a skip mode, a merge mode, and an MVP mode to derive a prediction sample for the current block.
  • motion information required for inter prediction of the current block provided by the video encoding apparatus for example, information about a motion vector, a reference picture index, and the like may be obtained or derived based on the prediction information.
  • the motion information of the neighboring block may be used as the motion information of the current block.
  • the neighboring block may include a spatial neighboring block and a temporal neighboring block.
  • the prediction unit 230 may construct a merge candidate list using motion information of available neighboring blocks, and may use information indicated by the merge index on the merge candidate list as a motion vector of the current block.
  • the merge index may be signaled from the encoding device.
  • the motion information may include a motion vector and a reference picture. When the motion information of the temporal neighboring block is used in the skip mode and the merge mode, the highest picture on the reference picture list may be used as the reference picture.
  • the difference (residual) between the prediction sample and the original sample is not transmitted.
  • the motion vector of the current block may be derived using the motion vector of the neighboring block as a motion vector predictor.
  • the neighboring block may include a spatial neighboring block and a temporal neighboring block.
  • a merge candidate list may be generated by using a motion vector of a reconstructed spatial neighboring block and / or a motion vector corresponding to a Col block, which is a temporal neighboring block.
  • the motion vector of the candidate block selected from the merge candidate list is used as the motion vector of the current block.
  • the information about the prediction may include a merge index indicating a candidate block having an optimal motion vector selected from candidate blocks included in the merge candidate list.
  • the prediction unit 230 may derive the motion vector of the current block by using the merge index.
  • a motion vector predictor candidate list may be generated using a motion vector of a reconstructed spatial neighboring block and / or a motion vector corresponding to a Col block, which is a temporal neighboring block.
  • the prediction information may include a prediction motion vector index indicating an optimal motion vector selected from the motion vector candidates included in the list.
  • the prediction unit 230 may select the predicted motion vector of the current block from the motion vector candidates included in the motion vector candidate list using the motion vector index.
  • the prediction unit of the encoding apparatus may obtain a motion vector difference (MVD) between the motion vector of the current block and the motion vector predictor, and may encode the output vector in a bitstream form. That is, MVD may be obtained by subtracting the motion vector predictor from the motion vector of the current block.
  • the prediction unit 230 may obtain a motion vector difference included in the information about the prediction, and derive the motion vector of the current block by adding the motion vector difference and the motion vector predictor.
  • the prediction unit may also obtain or derive a reference picture index or the like indicating a reference picture from the information about the prediction.
  • the adder 240 may reconstruct the current block or the current picture by adding the residual sample and the predictive sample.
  • the adder 240 may reconstruct the current picture by adding the residual sample and the predictive sample in block units. Since the residual is not transmitted when the skip mode is applied, the prediction sample may be a reconstruction sample.
  • the adder 240 has been described in a separate configuration, the adder 240 may be part of the predictor 230. On the other hand, the adder 240 may be called a restoration unit or a restoration block generation unit.
  • the filter unit 250 may apply the deblocking filtering sample adaptive offset, and / or ALF to the reconstructed picture.
  • the sample adaptive offset may be applied in units of samples and may be applied after deblocking filtering.
  • ALF may be applied after deblocking filtering and / or sample adaptive offset.
  • the memory 260 may store reconstructed pictures (decoded pictures) or information necessary for decoding.
  • the reconstructed picture may be a reconstructed picture after the filtering process is completed by the filter unit 250.
  • the memory 260 may store pictures used for inter prediction.
  • pictures used for inter prediction may be designated by a reference picture set or a reference picture list.
  • the reconstructed picture can be used as a reference picture for another picture.
  • the memory 260 may output the reconstructed picture in an output order.
  • a process of predicting motion information of the current block may be performed as described above, and the process is essentially applied to reduce the amount of bits for representing the motion information and the residual signal. It is becoming.
  • a merge mode for deriving motion information from neighboring blocks of the current block and saving information on the motion vector and the reference block of the current block is an example of a process of predicting the motion information.
  • a decoder-side motion vector refinement (DMVR) technique for improving accuracy by refining prediction information from limitedly derived motion information as a method of deriving motion information of the current block is proposed.
  • DMVR decoder-side motion vector refinement
  • the conventional inter prediction only limited derived motion information may be used.
  • the DMVR has been proposed, and the DMVR may be described later.
  • 3 shows an example of performing a DMVR process.
  • the DMVR may be performed when bi-prediction is applied to the current block. That is, the DMVR may be applied when the derived motion information of the current block is bi-predictive motion information.
  • the bi-prediction motion information may include L0 motion information and L1 motion information.
  • the L0 motion information may include an L0 reference picture index and a motion vector L0 (Motion Vector L0, MVL0) indicating an L0 reference picture included in the reference picture list L0 (List 0, L0) for the current block.
  • the L1 motion information may include an L1 reference picture index and an MVL1 indicating the L1 reference picture included in the reference picture list L1 (List 1, L1) for the current block.
  • motion information including only L0 motion information or L1 motion information may be referred to as unipredictive motion information.
  • LO prediction when performing inter prediction based on L0 motion information, it may be called LO prediction, and when performing inter prediction based on L1 motion information, it may be called L1 prediction.
  • bi-prediction when inter prediction is performed based on the L0 motion information and the L1 motion information, it may be referred to as bi-prediction.
  • the encoding device / decoding device may derive the L0 reference block indicated by the L0 motion information included in the motion information and the L1 reference block indicated by the L1 motion information, based on the L0 reference block and the L1 reference block.
  • a target block can be derived.
  • the decoding apparatus may derive the target block by averaging the L0 reference block and the L1 reference block. That is, the decoding apparatus may configure the target block by deriving an average between the L0 reference block and the corresponding samples of the L1 reference block as samples of the target block.
  • the decoding apparatus includes the refined L0 reference block having the smallest SAD with the target block among the L0 reference blocks included in the peripheral region of the L0 reference block and the L1 reference blocks included in the peripheral region of the L1 reference block. It is possible to derive a refined L1 reference block with the target block and the smallest SAD.
  • Refined L0 motion information indicating the refined L0 reference block and refined L1 motion information indicating the refined L1 reference block may be derived as refined motion information. That is, the refined motion information may include the refined L0 motion information and the refined L1 motion information.
  • the peripheral area of the L0 reference block may be referred to as a search range for L0
  • the peripheral area of the L1 reference block may be referred to as a search range for L1.
  • the search range for the L0 may be derived as a quadrangular region having a height and a width of N, centered on the location indicated by the L0 motion information
  • the search range for the L1 may be the L1 motion information. It can be derived from a rectangular area having a height and width N, centered on the position indicated by.
  • N may be 2, 4, or 5 integer pels.
  • the DMVR may be applied to motion information (ie, selected motion information) of the current block or merge candidate or MVP candidate of the current block.
  • motion information ie, selected motion information
  • a refine merge candidate or a refined MVP candidate including the refinement motion information may be derived, and the derived refine merge candidate or the refined MVP candidate may be derived from the current candidate. It may be added to the motion information candidate list (ie, the merge candidate list or the MVP candidate list) of the block.
  • the motion prediction and motion interpolation performance of the current block has been proposed, but motion information of neighboring blocks of the current block is not considered, and thus other motion information adjacent to the boundary of the current block is considered. There may be a discontinuity between the neighboring block having the current block and the current block, which may cause a decrease in the objective / subjective image quality.
  • the present invention can perform a motion information refinement process in consideration of the neighboring block of the current block by improving the target block in the DMVR, and improve the accuracy of the motion information for the current block through the refinement process. Suggest ways to do this.
  • FIG. 4 illustrates an example of a DMVR that is generated based on a neighboring block and is performed based on the generated target block.
  • the method of generating a target block by averaging existing prediction blocks in the L0 direction and the L1 direction is improved.
  • the target block is weighted by adding the reference block indicated by the motion vector of the neighboring block and the block indicated by the motion vector of the current block.
  • a method of generating a may be proposed.
  • the encoding device / decoding device may derive the L0 reference block indicated by the L0 motion information included in the motion information of the current block and the L1 reference block indicated by the L1 motion information, and the motion of the left neighboring block of the current block.
  • the L0 reference block indicated by the L0 motion information included in the information and the L1 reference block indicated by the L1 motion information may be derived, and the L0 reference block, the L1 reference block, and the left side derived based on the motion information of the current block.
  • a target block may be generated by weighting the L0 reference block and the L1 reference block derived based on motion information of a neighboring block.
  • the L0 reference block derived based on the motion information of the current block may be referred to as a first L0 reference block, and the L1 reference block derived based on the motion information of the current block is referred to as a first L1 reference block.
  • the L0 reference block derived based on the motion information of the left neighboring block may be referred to as a second L0 reference block, and the L1 reference block derived based on the motion information of the left neighboring block refers to a second L1. It can be referred to as a block.
  • the encoding device / decoding device may derive a first reference block by averaging the first L0 reference block and the first L1 reference block, and the second L0 reference block and the second L1 reference block.
  • a reference block may be averaged to derive a second reference block, and the target block may be derived by averaging the first reference block and the second reference block.
  • the above-described embodiment may represent a method of weighting the prediction block (ie, the first reference block) of the current block and the prediction block (ie, the second reference block) of the block located on the left side.
  • Other neighboring blocks adjacent to the current block may also be targets for weighted sum.
  • the encoding device / decoding device includes a first reference block indicated by the motion vector MVX of the current block, a second reference block indicated by the motion vector L_MVX of the left peripheral block, and a motion of the upper peripheral block.
  • a third reference block indicated by a vector A_MVX may be derived, and the boundary block of the first reference block is weighted based on the first reference block, the second reference block, and the third reference block, thereby generating the target block. Can be derived.
  • the decoding apparatus may derive the left region of the target block by weighting the left region adjacent to the left boundary of the first reference block and the left region adjacent to the left boundary of the second reference block, and the first region
  • An upper region of the target block may be derived by weighting the upper region adjacent to the upper boundary of the reference block and the upper region adjacent to the upper boundary of the third reference block.
  • Regions other than the left region and the upper region of the target block may be derived to regions other than the left region and the upper region of the first reference block.
  • reference blocks other than the reference block derived from the motion information of the neighboring blocks disclosed in the above-described embodiments may be used for the weighted sum.
  • the reference block indicated by the motion information of the neighboring block may be referred to as a neighboring prediction block.
  • Examples defined as the neighboring prediction blocks may be as follows.
  • the above-described methods are one embodiment, and a combination or partially used example of the above-described methods may be used as the reference block for the weighted polymerization.
  • a method of deriving a motion vector from a block unit such as an 8x8 size block or a 16x16 size block, rather than the 4x4 size block unit may be applied.
  • the position of the left peripheral block or the upper peripheral block may be changed.
  • an embodiment of selectively using a left neighboring block or an upper neighboring block may be proposed, and the left neighboring block and the upper neighboring are based on a difference between the motion vector of the left neighboring block or the upper neighboring block and the motion vector of the current block.
  • An embodiment of weighting using only one prediction block among the blocks may also be proposed. Also, an average motion vector of motion vectors of neighboring blocks may be used for deriving the prediction block, and an embodiment of deriving the prediction block using a median value of each of the motion vectors of the neighboring blocks is also proposed. Can be.
  • the weighted summation process between the reference blocks indicated by a plurality of motion vectors may be performed as follows.
  • the weighting of the reference blocks derived based on the motion information of the neighboring block may be weighted on a sample adjacent to a boundary to remove discontinuities between the reference blocks.
  • a weighted polymerization process may be performed on the left boundary region and the upper boundary region of the current block. That is, samples of the left boundary regions of the reference blocks may be weighted, and samples of the upper boundary regions of the reference blocks may be weighted.
  • the size of the current block is a WxH size
  • the size of the left boundary area may be 4xH size
  • the size of the upper boundary area may be Wx4 size.
  • the closer to the boundary of the block the larger the weight to other prediction blocks may be.
  • the target block may be derived through weighted summation, and a larger weight may be applied to a sample adjacent to a boundary among samples included in the left boundary region and the upper boundary region of the second reference block, and to a sample far from the boundary. For example, a small weight may be applied.
  • the 4xH size and the Wx4 size described above as the size of the boundary region of the block may be one example, and other sizes may be applied as the size of the boundary region.
  • the weighted application area ie, the boundary area
  • the boundary area may vary depending on the size of the current block and / or the ratio of the width of the current block to the height of the current block. That is
  • weights for the first reference block and the second reference block may be applied as follows.
  • Weighting factor of the first reference block indicated by the motion vector of the current block :
  • a weight value of the first reference block is greater than a weight value of the samples included in the boundary region of the first reference block and the weights of the samples included in the boundary region of the second reference block.
  • a larger value may be applied as the weight of the samples included in the boundary region of the second reference block is closer to the boundary. As the closer to the boundary of the block, the influence of the neighboring block increases. Able to know.
  • the following embodiments may be proposed to reduce an increased decoding complexity by performing a motion compensation process based on a reference block indicated by a plurality of motion vectors.
  • the weighting process between the above-described reference blocks may be omitted.
  • the reference picture for the current block and the neighboring block is different, that is, when the value of the reference picture index of the current block and the reference picture index of the neighboring block is different, the weighting process between the reference blocks may be omitted. have.
  • FIG. 6 schematically illustrates an image encoding method by an encoding apparatus according to the present invention.
  • the method disclosed in FIG. 6 may be performed by the encoding apparatus disclosed in FIG. 1.
  • S600 to S660 of FIG. 6 may be performed by the prediction unit of the encoding apparatus
  • S670 may be performed by the entropy encoding unit of the encoding apparatus.
  • a process of deriving a residual sample for the current block based on the original sample and the prediction sample for the current block may be performed by a subtractor of the encoding apparatus
  • the generating of the information about the residual on the basis of the current block may be performed by a converter of the encoding apparatus, and may include image information including information about the residual and information about prediction of the current block.
  • the encoding process may be performed by an entropy encoding unit of the encoding apparatus.
  • the encoding apparatus derives motion information of the current block (S600).
  • the encoding apparatus may derive the motion information of the current block.
  • the motion information may include a reference picture index and / or a motion vector.
  • the encoding apparatus may perform inter prediction on the current block.
  • the encoding apparatus may construct a motion information candidate list based on neighboring blocks, select a specific motion information candidate from among motion information candidates of the motion information candidate list, and use the selected motion information candidate as motion information for the current block. Can be derived.
  • the encoding apparatus may generate index information indicating the selected motion information.
  • Information on the prediction of the current block may include the index information.
  • the index information may be referred to as a merge index.
  • the encoding apparatus may select a specific motion information candidate from among motion information candidates of the motion information candidate list, derive the selected motion information candidate as a motion vector predictor (MVP) for the current block, wherein the MVP and Based on the motion vector difference (MVD) can be derived as the motion information for the current block.
  • MVP motion vector predictor
  • the encoding apparatus may generate index information indicating the selected motion information, a reference picture index indicating the reference picture for the current block, and / or the MVD.
  • Information about the prediction of the current block may include the index information, the reference picture index, and / or the MVD.
  • the index information may be referred to as an MVP index.
  • the encoding apparatus derives a target block based on the motion information (S610).
  • the encoding apparatus may derive the target block based on the motion information.
  • the encoding apparatus may derive the reference block indicated by the motion information as the target block.
  • the encoding apparatus may derive the L0 reference block indicated by the L0 motion information of the motion information and the L1 reference block indicated by the L1 motion information of the motion information, and refer to the L0.
  • the target block may be derived by averaging a block and the L1 reference block. That is, the encoding apparatus may configure the target block by deriving an average between the L0 reference block and the corresponding samples of the L1 reference block as the samples of the target block.
  • the encoding apparatus derives motion information of the neighboring block with respect to the current block (S620).
  • the encoding apparatus may derive motion information of the neighboring block with respect to the current block.
  • the neighboring block may be a left neighboring block of the current block, and motion information of the left neighboring block may be derived.
  • the left neighboring block may be a left neighboring block located at a lower end of the left neighboring blocks adjacent to a left boundary of the current block.
  • the neighboring block may be an upper neighboring block of the current block, and motion information of the upper neighboring block may be derived.
  • the upper peripheral block may be an upper peripheral block positioned at a right end among upper peripheral blocks adjacent to an upper boundary of the current block.
  • the neighboring block may include the left neighboring block and the upper neighboring block of the current block, and motion information of the left neighboring block and motion information of the upper neighboring block may be derived.
  • the left peripheral block may be a left peripheral block positioned at a lower end among left peripheral blocks adjacent to a left boundary of the current block, and the upper peripheral block is located at a right end of upper peripheral blocks adjacent to an upper boundary of the current block.
  • the upper peripheral block may be.
  • the neighboring block may be left neighboring blocks of 4x4 size adjacent to the left boundary of the current block, and the motion vector of the motion information may be derived as an average value of motion vectors of the left neighboring blocks of the 4x4 size. Can be.
  • the neighboring block may be upper neighboring blocks of 4x4 size adjacent to an upper boundary of the current block, and the motion vector of the motion information may be derived as an average value of motion vectors of the upper neighboring blocks of 4x4 size.
  • the neighboring block may be derived from left neighboring blocks having motion information about the same reference picture as the reference picture of the current block among 4 ⁇ 4 sized left neighboring blocks adjacent to the left boundary of the current block, and The motion vector of the motion information may be derived as an average value of motion vectors of the derived left neighboring blocks.
  • the neighboring block may be derived as upper neighboring blocks having motion information about the same reference picture as the reference picture of the current block among 4x4 sized upper neighboring blocks adjacent to the upper boundary of the current block, and
  • the motion vector of the motion information may be derived as an average value of motion vectors of the upper neighboring blocks.
  • the neighboring block may be derived as left neighboring blocks having motion information about a reference picture having a reference picture index of 0 among 4x4 sized left neighboring blocks adjacent to a left boundary of the current block,
  • the motion vector of the motion information may be derived as an average value of motion vectors of the derived left neighboring blocks.
  • the neighboring block may be derived as upper neighboring blocks having motion information on a reference picture having a reference picture index of 0 among upper neighboring blocks of 4x4 size adjacent to an upper boundary of the current block,
  • the motion vector of the motion information may be derived as an average value of motion vectors of the upper neighboring blocks.
  • 8x8 sized blocks or 16x16 sized blocks may be used instead of the above-described 4x4 sized blocks.
  • the encoding apparatus derives a reference block based on the motion information of the neighboring block (S630).
  • the encoding apparatus may derive the reference block indicated by the motion information of the neighboring block.
  • the encoding apparatus derives the modified samples by weighted sum of the samples included in the specific boundary region in the target block and the samples included in the specific boundary region in the reference block corresponding to the specific boundary region, A modified target block including the modified samples is derived (S640).
  • a sample modified by a sum of a value obtained by multiplying a sample included in the specific boundary region in the target block by a first weight and a value multiplied by a sample included in the specific boundary region in the reference block by a second weight can be derived. That is, the encoding apparatus may derive the modified samples by performing a weighted sum of the samples included in the specific boundary region in the reference block with respect to each of the samples included in the specific boundary region in the target block.
  • the modified target block may include the modified samples.
  • the modified target block may include samples of the target block included in an area other than the specific boundary area.
  • the specific boundary when the neighboring block is the left neighboring block of the current block, the specific boundary may be a left boundary of the target block.
  • the size of the specific boundary region when the size of the current block is WxH, the size of the specific boundary region may be 4xH.
  • the value of the first weight may be set to a larger value, and the sample included in the specific boundary region in the reference block may be specified.
  • the farther from the boundary, the value of the second weight may be set to a smaller value.
  • the first weight when the sample included in the specific boundary region in the target block is located in the first row in a left to right direction, the first weight may be 1/2, and the specific boundary region in the target block may be used.
  • the first weight When the sample included in the is located in the second row from left to right direction, the first weight may be 3/4, and the sample included in the specific boundary region in the target block is third from left to right direction.
  • the first weight may be 7/8.
  • the first weight is 15. / 16 may be.
  • the second weight may be 1/2 and included in the specific boundary region in the reference block. If the sample is located in the second row in the left to right direction, the second weight may be 1/4, and the sample included in the specific boundary region in the reference block is in the third row in the left to right direction. When positioned, the second weight may be 1/8. When the sample included in the specific boundary region in the reference block is located in the fourth row in a left to right direction, the second weight is 1/16. Can be.
  • the specific boundary may be an upper boundary of the target block.
  • the size of the specific boundary region may be Wx4.
  • the value of the first weight may be set to a larger value, and the sample included in the specific boundary region in the reference block may be specified.
  • the farther from the boundary, the value of the second weight may be set to a smaller value.
  • the first weight may be 1/2, and the sample is included in the specific boundary region in the target block.
  • the first weight may be 3/4, and the sample included in the specific boundary region in the target block is located in the third column from the top to the bottom
  • the first weight may be 7/8.
  • the first weight When the sample included in the specific boundary region in the target block is located in the fourth column from the top to the bottom, the first weight may be 15/16. have.
  • the second weight when the sample included in the specific boundary region in the reference block is located in the first column from the upper side to the downward direction, the second weight may be 1/2 and included in the specific boundary region in the reference block.
  • the second weight When the sample is located in the second column from the top to the bottom, the second weight may be 1/4, and when the sample included in the specific boundary region in the reference block is located in the third column from the top to the bottom The second weight may be 1/8.
  • the second weight When the sample included in the specific boundary area in the reference block is located in the fourth column from the top to the bottom, the second weight may be 1/16.
  • the specific boundary may be a left boundary and an upper boundary of the target block, and the specific boundary area is adjacent to an upper boundary. It may include an upper boundary region and a left boundary region adjacent to the left boundary.
  • the size of the current block is WxH
  • the size of the left boundary region may be 4xH
  • the size of the upper boundary region may be Wx4.
  • the encoding apparatus derives a reference block having the smallest sum of absolute differences (SAD) with the modified target block among the reference blocks within a search range, and refines the motion information indicating the reference block. Derived as motion information (S650).
  • the encoding apparatus may derive a SAD between the reference blocks within the search range and the modified target block, and may derive the reference block for the smallest SAD. Thereafter, the encoding apparatus may derive the motion information indicating the derived reference block as refined motion information.
  • the SAD may represent a sum of an absolute value of a difference between the modified target block and corresponding samples of a reference block within the search range.
  • a difference between corresponding samples between the modified target block and the reference block may be accumulated, and the accumulation of the difference may be used as a cost function for deriving the refined motion information of the current block.
  • the SAD may be represented as a cost of the reference block.
  • the search range may be derived as a quadrangular area having a height and a width N, centered on a position indicated by the motion information of the current block.
  • N may be 2, 4, or 5 integer pels.
  • the encoding apparatus may derive refined L0 motion information and refined L1 motion information.
  • the encoding apparatus may derive a SAD between L0 reference blocks within the L0 search range and the modified target block, and may derive an L0 reference block for the smallest SAD. Thereafter, the encoding apparatus may derive the motion information indicating the derived L0 reference block as refined L0 motion information.
  • the L0 search range may be derived as a rectangular area having a height and a width of N, centered on the location indicated by the L0 motion information of the current block.
  • N may be 2, 4, or 5 integer pels.
  • the encoding apparatus may derive a SAD between the L1 reference blocks within the L1 search range and the modified target block, and may derive the L1 reference block for the smallest SAD. Thereafter, the encoding apparatus may derive the motion information indicating the derived L1 reference block as refined L1 motion information.
  • the L1 search range may be derived as a rectangular region having a height and a width of N, centered on the position indicated by the L1 motion information of the current block.
  • N may be 2, 4, or 5 integer pels.
  • the encoding apparatus may determine whether to derive the modified target block. For example, when it is determined that the modified target block is derived, the encoding apparatus may derive the refined motion information based on the modified target block, and determine that the modified target block is not derived. In this case, the encoding apparatus may derive refined motion information based on the target block. For example, when the motion vector included in the motion information of the neighboring block is larger than the first specific value or smaller than the second specific value, the encoding apparatus may determine that the modified target block is not derived.
  • the encoding apparatus may determine that the modified target block is not derived.
  • the encoding apparatus may determine that the modified target block is derived.
  • the encoding apparatus performs prediction on the current block based on the refine motion information (S660).
  • the encoding apparatus may derive the prediction sample of the current block by performing prediction on the current block based on the refined motion information.
  • a prediction block of the current block may be derived based on the refinement motion information, and a reconstruction block may be derived based on the prediction block.
  • the encoding apparatus may derive a reference block within a reference picture based on the refine motion information.
  • the refined motion information may include a refined motion vector and a reference picture index.
  • the encoding apparatus encodes image information including information on prediction of the current block (S670).
  • the encoding apparatus may encode and output the video information including the information on the prediction of the current block in the form of a bitstream.
  • the bitstream may be transmitted to a decoding apparatus via a network or a storage medium.
  • the encoding apparatus may determine the prediction mode of the current block, and generate information indicating the prediction mode.
  • the information about the prediction may include index information indicating the selected motion information candidate among the motion information candidates of the motion information candidate list.
  • the information on the prediction of the current block may include a merge flag indicating whether a merge mode is applied to the current block.
  • the encoding apparatus may generate information about the residual based on the residual sample.
  • the image information may include information about the residual, and the information about the residual may include transform coefficients related to the residual sample.
  • the encoding device may encode the information about the residual and output the encoded information about the residual.
  • the bitstream may be transmitted to a decoding apparatus via a network or a storage medium.
  • FIG. 7 schematically illustrates an encoding apparatus for performing an image encoding method according to the present invention.
  • the method disclosed in FIG. 6 may be performed by the encoding apparatus disclosed in FIG. 7.
  • the prediction unit of the encoding apparatus of FIG. 7 may perform S600 to S660 of FIG. 6, and the entropy encoding unit of the encoding apparatus of FIG. 7 may perform S670 of FIG. 6.
  • a process of deriving a residual sample for the current block based on an original sample and a prediction sample for the current block may be performed by a subtraction unit of the encoding apparatus of FIG.
  • the generating of the information about the residual for the current block based on the residual sample may be performed by the converter of the encoding apparatus of FIG. 7, and the encoding of the information about the residual may be performed in FIG. 7. May be performed by an entropy encoding unit of the encoding apparatus.
  • FIG. 8 schematically illustrates an image decoding method by a decoding apparatus according to the present invention.
  • the method disclosed in FIG. 8 may be performed by the decoding apparatus disclosed in FIG. 2.
  • S800 to S860 of FIG. 8 may be performed by the prediction unit of the decoding apparatus.
  • a process of obtaining information on prediction and / or residual information of a current block through a bitstream may be performed by an entropy decoding unit of the decoding apparatus.
  • the process of deriving the residual sample for the current block may be performed by an inverse transform unit of the decoding apparatus, and the process of generating a reconstructed picture based on the prediction sample and the residual sample of the current block may be performed. It may be performed by an adder of the decoding apparatus.
  • the decoding apparatus derives motion information of the current block (S800).
  • the decoding apparatus may derive the motion information of the current block.
  • the motion information may include a reference picture index and / or a motion vector.
  • the decoding apparatus may perform inter prediction on the current block.
  • the decoding apparatus may construct a motion information candidate list based on neighboring blocks, select a specific motion information candidate from among motion information candidates of the motion information candidate list, and use the selected motion information candidate as motion information for the current block.
  • the decoding apparatus may obtain index information through the bitstream, and may derive the motion information candidate indicated by the index information among the motion information candidates of the motion information candidate list as the motion information for the current block.
  • the decoding apparatus may obtain index information and a motion vector difference (MVD) through a bitstream, and among the motion information candidates of the motion information candidate list, the motion information candidate indicated by the index information may be selected as an MVP for the current block.
  • MVP motion vector difference
  • Motion Vector Predictor may be derived as motion information for the current block based on the MVP and the MVD.
  • the motion information candidate list may indicate a merge candidate list or an MVP candidate list
  • the motion candidate may indicate a merge candidate or an MVP candidate.
  • the index information may indicate a merge index or an MVP index.
  • the decoding apparatus derives a target block based on the motion information (S810).
  • the decoding apparatus may derive the target block based on the motion information.
  • the decoding apparatus may derive the reference block indicated by the motion information as the target block.
  • the decoding apparatus may derive the L0 reference block indicated by the L0 motion information of the motion information and the L1 reference block indicated by the L1 motion information of the motion information, and refer to the L0.
  • the target block may be derived by averaging a block and the L1 reference block. That is, the decoding apparatus may construct the target block by deriving an average between the L0 reference block and the corresponding samples of the L1 reference block as the samples of the target block.
  • the decoding apparatus derives motion information of the neighboring block with respect to the current block (S820).
  • the decoding apparatus may derive motion information of the neighboring block with respect to the current block.
  • the neighboring block may be a left neighboring block of the current block, and motion information of the left neighboring block may be derived.
  • the left neighboring block may be a left neighboring block located at a lower end of the left neighboring blocks adjacent to a left boundary of the current block.
  • the neighboring block may be an upper neighboring block of the current block, and motion information of the upper neighboring block may be derived.
  • the upper peripheral block may be an upper peripheral block positioned at a right end among upper peripheral blocks adjacent to an upper boundary of the current block.
  • the neighboring block may include the left neighboring block and the upper neighboring block of the current block, and motion information of the left neighboring block and motion information of the upper neighboring block may be derived.
  • the left peripheral block may be a left peripheral block positioned at a lower end among left peripheral blocks adjacent to a left boundary of the current block, and the upper peripheral block is located at a right end of upper peripheral blocks adjacent to an upper boundary of the current block.
  • the upper peripheral block may be.
  • the neighboring block may be left neighboring blocks of 4x4 size adjacent to the left boundary of the current block, and the motion vector of the motion information may be derived as an average value of motion vectors of the left neighboring blocks of the 4x4 size. Can be.
  • the neighboring block may be upper neighboring blocks of 4x4 size adjacent to an upper boundary of the current block, and the motion vector of the motion information may be derived as an average value of motion vectors of the upper neighboring blocks of 4x4 size.
  • the neighboring block may be derived from left neighboring blocks having motion information about the same reference picture as the reference picture of the current block among 4 ⁇ 4 sized left neighboring blocks adjacent to the left boundary of the current block, and The motion vector of the motion information may be derived as an average value of motion vectors of the derived left neighboring blocks.
  • the neighboring block may be derived as upper neighboring blocks having motion information about the same reference picture as the reference picture of the current block among 4x4 sized upper neighboring blocks adjacent to the upper boundary of the current block, and
  • the motion vector of the motion information may be derived as an average value of motion vectors of the upper neighboring blocks.
  • the neighboring block may be derived as left neighboring blocks having motion information about a reference picture having a reference picture index of 0 among 4x4 sized left neighboring blocks adjacent to a left boundary of the current block,
  • the motion vector of the motion information may be derived as an average value of motion vectors of the derived left neighboring blocks.
  • the neighboring block may be derived as upper neighboring blocks having motion information on a reference picture having a reference picture index of 0 among upper neighboring blocks of 4x4 size adjacent to an upper boundary of the current block,
  • the motion vector of the motion information may be derived as an average value of motion vectors of the upper neighboring blocks.
  • 8x8 sized blocks or 16x16 sized blocks may be used instead of the above-described 4x4 sized blocks.
  • the decoding apparatus derives a reference block based on the motion information of the neighboring block (S830).
  • the decoding apparatus may derive the reference block indicated by the motion information of the neighboring block.
  • the decoding apparatus weights the samples included in the specific boundary region in the target block and the samples included in the specific boundary region in the reference block corresponding to the specific boundary region to derive the modified samples, and A modified target block including the modified samples is derived (S840).
  • a sample modified by a sum of a value obtained by multiplying a sample included in the specific boundary region in the target block by a first weight and a value multiplied by a sample included in the specific boundary region in the reference block by a second weight can be derived. That is, the decoding apparatus may derive the modified samples by performing a weighted sum of the samples included in the specific boundary region in the reference block with respect to each of the samples included in the specific boundary region in the target block.
  • the modified target block may include the modified samples.
  • the modified target block may include samples of the target block included in an area other than the specific boundary area.
  • the specific boundary when the neighboring block is the left neighboring block of the current block, the specific boundary may be a left boundary of the target block.
  • the size of the specific boundary region when the size of the current block is WxH, the size of the specific boundary region may be 4xH.
  • the value of the first weight may be set to a larger value, and the sample included in the specific boundary region in the reference block may be specified.
  • the farther from the boundary, the value of the second weight may be set to a smaller value.
  • the first weight when the sample included in the specific boundary region in the target block is located in the first row in a left to right direction, the first weight may be 1/2, and the specific boundary region in the target block may be used.
  • the first weight When the sample included in the is located in the second row from left to right direction, the first weight may be 3/4, and the sample included in the specific boundary region in the target block is third from left to right direction.
  • the first weight may be 7/8.
  • the first weight is 15. / 16 may be.
  • the second weight may be 1/2 and included in the specific boundary region in the reference block. If the sample is located in the second row in the left to right direction, the second weight may be 1/4, and the sample included in the specific boundary region in the reference block is in the third row in the left to right direction. When positioned, the second weight may be 1/8. When the sample included in the specific boundary region in the reference block is located in the fourth row in a left to right direction, the second weight is 1/16. Can be.
  • the specific boundary may be an upper boundary of the target block.
  • the size of the specific boundary region may be Wx4.
  • the value of the first weight may be set to a larger value, and the sample included in the specific boundary region in the reference block may be specified.
  • the farther from the boundary, the value of the second weight may be set to a smaller value.
  • the first weight may be 1/2, and the sample is included in the specific boundary region in the target block.
  • the first weight may be 3/4, and the sample included in the specific boundary region in the target block is located in the third column from the top to the bottom
  • the first weight may be 7/8.
  • the first weight When the sample included in the specific boundary region in the target block is located in the fourth column from the top to the bottom, the first weight may be 15/16. have.
  • the second weight when the sample included in the specific boundary region in the reference block is located in the first column from the upper side to the downward direction, the second weight may be 1/2 and included in the specific boundary region in the reference block.
  • the second weight When the sample is located in the second column from the top to the bottom, the second weight may be 1/4, and when the sample included in the specific boundary region in the reference block is located in the third column from the top to the bottom The second weight may be 1/8.
  • the second weight When the sample included in the specific boundary area in the reference block is located in the fourth column from the top to the bottom, the second weight may be 1/16.
  • the specific boundary may be a left boundary and an upper boundary of the target block, and the specific boundary area is adjacent to an upper boundary. It may include an upper boundary region and a left boundary region adjacent to the left boundary.
  • the size of the current block is WxH
  • the size of the left boundary region may be 4xH
  • the size of the upper boundary region may be Wx4.
  • the decoding apparatus derives a reference block having the smallest sum of absolute differences (SAD) with the modified target block among the reference blocks within a search range, and refines the motion information indicating the reference block.
  • step S850 motion information is derived.
  • the decoding apparatus may derive a SAD between the reference blocks within the search range and the modified target block, and may derive the reference block for the smallest SAD. Thereafter, the decoding apparatus may derive the motion information indicating the derived reference block as refined motion information.
  • the SAD may represent a sum of an absolute value of a difference between the modified target block and corresponding samples of a reference block within the search range.
  • a difference between corresponding samples between the modified target block and the reference block may be accumulated, and the accumulation of the difference may be used as a cost function for deriving the refined motion information of the current block.
  • the SAD may be represented as a cost of the reference block.
  • the search range may be derived as a quadrangular area having a height and a width N, centered on a position indicated by the motion information of the current block.
  • N may be 2, 4, or 5 integer pels.
  • the decoding apparatus may derive refined L0 motion information and refined L1 motion information.
  • the decoding apparatus may derive a SAD between L0 reference blocks within the L0 search range and the modified target block, and may derive an L0 reference block for the smallest SAD. Thereafter, the decoding apparatus may derive the motion information indicating the derived L0 reference block as refined L0 motion information.
  • the L0 search range may be derived as a rectangular area having a height and a width of N, centered on the location indicated by the L0 motion information of the current block.
  • N may be 2, 4, or 5 integer pels.
  • the decoding apparatus may derive a SAD between the L1 reference blocks within the L1 search range and the modified target block, and may derive the L1 reference block for the smallest SAD. Thereafter, the decoding apparatus may derive the motion information indicating the derived L1 reference block as refined L1 motion information.
  • the L1 search range may be derived as a rectangular region having a height and a width of N, centered on the position indicated by the L1 motion information of the current block.
  • N may be 2, 4, or 5 integer pels.
  • the decoding apparatus may determine whether to derive the modified target block. For example, when it is determined that the modified target block is derived, the decoding apparatus may derive the refined motion information based on the modified target block, and it is determined that the modified target block is not derived. In this case, the decoding apparatus may derive refined motion information based on the target block. For example, when the motion vector included in the motion information of the neighboring block is larger than the first specific value or smaller than the second specific value, the decoding apparatus may determine that the modified target block is not derived.
  • the decoding apparatus may determine that the modified target block is not derived.
  • the decoding apparatus may determine that the modified target block is derived.
  • the decoding apparatus performs prediction on the current block based on the refinement motion information (S860).
  • the decoding apparatus may derive the prediction sample of the current block by performing prediction on the current block based on the refined motion information.
  • a prediction block of the current block may be derived based on the refinement motion information, and a reconstruction block may be derived based on the prediction block.
  • the decoding apparatus may derive a reference block within a reference picture based on the refine motion information.
  • the refined motion information may include a motion vector and a reference picture index.
  • the decoding apparatus may derive the reference picture indicated by the reference picture index among the reference pictures of the reference picture list as the reference picture of the current block, and convert the block indicated by the motion vector in the reference picture as the reference block of the current block. Can be derived.
  • the decoding apparatus may generate a prediction sample based on the reference block, and may directly use the prediction sample as a reconstruction sample according to a prediction mode, or generate a reconstruction sample by adding a residual sample to the prediction sample. . If there is a residual sample for the current block, the decoding apparatus may obtain information about the residual for the current block from the bitstream. The information about the residual may include transform coefficients regarding the residual sample. The decoding apparatus may derive the residual sample (or residual sample array) for the current block based on the residual information. The decoding apparatus may generate a reconstructed sample based on the prediction sample and the residual sample, and may derive a reconstructed block or a reconstructed picture based on the reconstructed sample. Thereafter, as described above, the decoding apparatus may apply an in-loop filtering procedure, such as a deblocking filtering and / or SAO procedure, to the reconstructed picture in order to improve subjective / objective picture quality as necessary.
  • an in-loop filtering procedure such as a deblocking filtering
  • FIG. 9 schematically illustrates a decoding apparatus for performing an image decoding method according to the present invention.
  • the method disclosed in FIG. 8 may be performed by the decoding apparatus disclosed in FIG. 9.
  • the prediction unit of the decoding apparatus of FIG. 9 may perform S800 to S860 of FIG. 8.
  • a process of acquiring image information including information on prediction of a current block and information on residual through a bitstream may be performed by the entropy decoding unit of the decoding apparatus of FIG. 9.
  • Deriving the residual sample for the current block based on the residual information may be performed by an inverse transform unit of the decoding apparatus of FIG. 9, and based on the prediction sample and the residual sample
  • the process of generating may be performed by the adder of the decoding apparatus of FIG. 9.
  • the target block for performing the DMVR can be generated in consideration of the neighboring block of the current block, through which the DMVR can be performed in consideration of the neighboring block, thereby reducing discontinuity with the neighboring block.
  • Objective / subjective image quality can be improved.
  • the present invention it is possible to determine whether to perform a weighted summation process for deriving the modified target block according to a specific condition, thereby performing the weighted summation process adaptively, thereby improving prediction accuracy.
  • the complexity of the decoding process can be reduced.
  • the above-described method according to the present invention may be implemented in software, and the encoding device and / or the decoding device according to the present invention may perform image processing of, for example, a TV, a computer, a smartphone, a set-top box, a display device, and the like. It can be included in the device.
  • the above-described method may be implemented as a module (process, function, etc.) for performing the above-described function.
  • the module may be stored in memory and executed by a processor.
  • the memory may be internal or external to the processor and may be coupled to the processor by various well known means.
  • the processor may include application-specific integrated circuits (ASICs), other chipsets, logic circuits, and / or data processing devices.
  • the memory may include read-only memory (ROM), random access memory (RAM), flash memory, memory card, storage medium and / or other storage device. That is, the embodiments described in the present invention may be implemented and performed on a processor, a microprocessor, a controller, or a chip. For example, the functional units shown in each drawing may be implemented and performed on a computer, processor, microprocessor, controller, or chip.
  • the decoding apparatus and encoding apparatus to which the present invention is applied include a multimedia broadcasting transmitting and receiving device, a mobile communication terminal, a home cinema video device, a digital cinema video device, a surveillance camera, a video chat device, a real time communication device such as video communication, and mobile streaming.
  • the OTT video device may include a game console, a Blu-ray player, an internet access TV, a home theater system, a smartphone, a tablet PC, a digital video recorder (DVR), and the like.
  • the processing method to which the present invention is applied can be produced in the form of a program executed by a computer, and can be stored in a computer-readable recording medium.
  • Multimedia data having a data structure according to the present invention can also be stored in a computer-readable recording medium.
  • the computer readable recording medium includes all kinds of storage devices and distributed storage devices in which computer readable data is stored.
  • the computer-readable recording medium may be, for example, a Blu-ray disc (BD), a universal serial bus (USB), a ROM, a PROM, an EPROM, an EEPROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, and an optical disc. It may include a data storage device.
  • the computer-readable recording medium also includes media embodied in the form of a carrier wave (eg, transmission over the Internet).
  • the bitstream generated by the encoding method may be stored in a computer-readable recording medium or transmitted through a wired or wireless communication network.
  • an embodiment of the present invention may be implemented as a computer program product by program code, which may be performed on a computer by an embodiment of the present invention.
  • the program code may be stored on a carrier readable by a computer.
  • the content streaming system to which the present invention is applied may largely include an encoding server, a streaming server, a web server, a media storage, a user device, and a multimedia input device.
  • the encoding server compresses content input from multimedia input devices such as a smart phone, a camera, a camcorder, etc. into digital data to generate a bitstream and transmit the bitstream to the streaming server.
  • multimedia input devices such as smart phones, cameras, camcorders, etc. directly generate a bitstream
  • the encoding server may be omitted.
  • the bitstream may be generated by an encoding method or a bitstream generation method to which the present invention is applied, and the streaming server may temporarily store the bitstream in the process of transmitting or receiving the bitstream.
  • the streaming server transmits the multimedia data to the user device based on the user's request through the web server, and the web server serves as a medium for informing the user of what service.
  • the web server delivers it to a streaming server, and the streaming server transmits multimedia data to the user.
  • the content streaming system may include a separate control server.
  • the control server plays a role of controlling a command / response between devices in the content streaming system.
  • the streaming server may receive content from a media store and / or an encoding server. For example, when the content is received from the encoding server, the content may be received in real time. In this case, in order to provide a smooth streaming service, the streaming server may store the bitstream for a predetermined time.
  • Examples of the user device include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, a slate PC, Tablet PCs, ultrabooks, wearable devices (e.g., smartwatches, glass glasses, head mounted displays), digital TVs, desktops Computer, digital signage, and the like.
  • PDA personal digital assistant
  • PMP portable multimedia player

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un procédé de décodage d'image mis en œuvre par un dispositif de décodage consistant : à obtenir des informations de mouvement d'un bloc en cours ; à déduire un bloc cible en fonction des informations de mouvement ; à déduire un bloc de référence en fonction d'informations de mouvement d'un bloc voisin ; à déduire un bloc cible modifié comprenant des échantillons modifiés déduits en fonction du bloc de référence ; à déduire des informations de mouvement affinées en fonction du bloc cible modifié ; et à réaliser une prédiction pour le bloc en cours en fonction des informations de mouvement affinées.
PCT/KR2019/005183 2018-05-03 2019-04-30 Procédé de décodage d'image à l'aide d'un dmvr dans un système de codage d'image et dispositif associé WO2019212223A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862666101P 2018-05-03 2018-05-03
US62/666,101 2018-05-03

Publications (1)

Publication Number Publication Date
WO2019212223A1 true WO2019212223A1 (fr) 2019-11-07

Family

ID=68385964

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/005183 WO2019212223A1 (fr) 2018-05-03 2019-04-30 Procédé de décodage d'image à l'aide d'un dmvr dans un système de codage d'image et dispositif associé

Country Status (1)

Country Link
WO (1) WO2019212223A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11516490B2 (en) * 2018-07-16 2022-11-29 Lg Electronics Inc. Method and device for inter predicting on basis of DMVR

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090034697A (ko) * 2007-10-04 2009-04-08 삼성전자주식회사 부화소 움직임 추정을 이용한 인터 예측 부호화, 복호화방법 및 장치
KR101408698B1 (ko) * 2007-07-31 2014-06-18 삼성전자주식회사 가중치 예측을 이용한 영상 부호화, 복호화 방법 및 장치
US8761262B2 (en) * 2011-05-12 2014-06-24 Sunplus Technology Co., Ltd Motion vector refining apparatus
KR101432767B1 (ko) * 2009-10-20 2014-08-26 에스케이텔레콤 주식회사 움직임 정보 기반의 인접 화소를 이용한 인터 예측 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치
WO2018002021A1 (fr) * 2016-06-30 2018-01-04 Thomson Licensing Codage vidéo avec affinement adaptatif des informations de mouvement

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101408698B1 (ko) * 2007-07-31 2014-06-18 삼성전자주식회사 가중치 예측을 이용한 영상 부호화, 복호화 방법 및 장치
KR20090034697A (ko) * 2007-10-04 2009-04-08 삼성전자주식회사 부화소 움직임 추정을 이용한 인터 예측 부호화, 복호화방법 및 장치
KR101432767B1 (ko) * 2009-10-20 2014-08-26 에스케이텔레콤 주식회사 움직임 정보 기반의 인접 화소를 이용한 인터 예측 방법 및 장치와 그를 이용한 영상 부호화/복호화 방법 및 장치
US8761262B2 (en) * 2011-05-12 2014-06-24 Sunplus Technology Co., Ltd Motion vector refining apparatus
WO2018002021A1 (fr) * 2016-06-30 2018-01-04 Thomson Licensing Codage vidéo avec affinement adaptatif des informations de mouvement

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11516490B2 (en) * 2018-07-16 2022-11-29 Lg Electronics Inc. Method and device for inter predicting on basis of DMVR

Similar Documents

Publication Publication Date Title
WO2020036417A1 (fr) Procédé de prédiction inter faisant appel à un vecteur de mouvement fondé sur un historique, et dispositif associé
WO2019194440A1 (fr) Procédé de codage d'image à l'aide d'une table de consultation de mode d'intraprédiction et appareil associé
WO2020017840A1 (fr) Procédé et dispositif pour exécuter une prédiction inter sur la base d'un dmvr
WO2016204360A1 (fr) Procédé et dispositif de prédiction de bloc basée sur la compensation d'éclairage dans un système de codage d'image
WO2020009390A1 (fr) Procédé et dispositif de traitement d'image selon une prédiction inter dans un système de codage d'image
WO2020013480A1 (fr) Procédé de codage de mode d'intra-prédiction et dispositif associé
WO2018066791A1 (fr) Procédé et appareil de décodage d'image dans un système de codage d'images
WO2018212430A1 (fr) Procédé de filtrage de domaine de fréquence dans un système de codage d'image et dispositif associé
WO2020005002A1 (fr) Procédé et dispositif de dérivation d'une zone de modèle en fonction d'une prédiction inter dans un système de codage d'image
WO2020141932A1 (fr) Procédé et appareil de prédiction inter utilisant des mmvd de cpr
WO2020141928A1 (fr) Procédé et appareil de décodage d'image sur la base d'une prédiction basée sur un mmvd dans un système de codage d'image
WO2019212230A1 (fr) Procédé et appareil de décodage d'image à l'aide d'une transformée selon une taille de bloc dans un système de codage d'image
WO2020141885A1 (fr) Procédé et dispositif de décodage d'image au moyen d'un filtrage de dégroupage
WO2019209026A1 (fr) Procédé et appareil d'interprédiction dans un système de codage vidéo
WO2018084344A1 (fr) Procédé et dispositif de décodage d'image dans un système de codage d'image
WO2020251338A1 (fr) Prédiction inter dans un système de codage de vidéo ou d'image
WO2020145656A1 (fr) Procédé et dispositif pour signaler si un candidat de prédiction temporelle par vecteur de mouvement (tmvp) est disponible
WO2020141884A1 (fr) Procédé et appareil de codage d'image en utilisant une mmvd sur la base d'un cpr
WO2018128228A1 (fr) Procédé et dispositif de décodage d'image dans un système de codage d'image
WO2020004879A1 (fr) Procédé et dispositif de décodage d'image selon une prédiction inter à l'aide d'une pluralité de blocs voisins dans un système de codage d'image
WO2020004931A1 (fr) Procédé et dispositif pour traiter une image selon un mode d'inter-prédiction dans un système de codage d'image
WO2019225932A1 (fr) Procédé et appareil de décodage d'image à l'aide de dmvr dans un système de codage d'images
WO2019203533A1 (fr) Procédé d'inter-prédiction en fonction de modèles de mouvement multiples et dispositif correspondant
WO2019212223A1 (fr) Procédé de décodage d'image à l'aide d'un dmvr dans un système de codage d'image et dispositif associé
WO2021034158A1 (fr) Dispositif et procédé de prédiction intra basée sur une matrice

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19796899

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19796899

Country of ref document: EP

Kind code of ref document: A1