EP4124034B1 - Intra prediction in video coding - Google Patents

Intra prediction in video coding Download PDF

Info

Publication number
EP4124034B1
EP4124034B1 EP22194881.3A EP22194881A EP4124034B1 EP 4124034 B1 EP4124034 B1 EP 4124034B1 EP 22194881 A EP22194881 A EP 22194881A EP 4124034 B1 EP4124034 B1 EP 4124034B1
Authority
EP
European Patent Office
Prior art keywords
pixel
reference pixel
current block
current
prediction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP22194881.3A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP4124034A1 (en
Inventor
Yong Joon Jeon
Seung Wook Park
Jae Hyun Lim
Jung Sun Kim
Joon Young Park
Young Hee Choi
Jae Won Sung
Byeong Moon Jeon
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
LG Electronics Inc
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Publication of EP4124034A1 publication Critical patent/EP4124034A1/en
Application granted granted Critical
Publication of EP4124034B1 publication Critical patent/EP4124034B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/59—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Definitions

  • the present invention relates to an intra method and a device using the intra prediction method, and more particularly, to an encoding method and an encoding device.
  • the image compressing techniques include various techniques such as an inter prediction technique of predicting pixel values included in a current picture from previous or subsequent pictures of the current picture, an intra prediction technique of predicting pixel values included in a current picture using pixel information in the current picture, and an entropy encoding technique of assigning a short code to a value with a high appearance frequency and assigning a long code to a value with a low appearance frequency.
  • Image data can be effectively compressed and transferred or stored using such image compressing techniques.
  • Video coding technology proposal by Tandberg, Nokia, and Ericsson (UGUR K ET AL, 24 April 2010 ) refers to an intra planar mode, according to which, the predicted pixel values are calculated by bilinear interpolation between the top row (TR), bottom row (BR), left column (LC), and right column (RC) of pixels in the macroblock.
  • Spatial prediction based intra-coding (ZHANG NAN ET AL, 27 June 2004 ) refers to an intra prediction algorithm which comprises a first step of applying direction to the results of the DC prediction and a second step of using simplified modes to reduce computational complexity.
  • An object of the invention is to provide an intra prediction method which can enhance image encoding and decoding efficiency.
  • first and second can be used to describe various elements, but the elements are not limited to the terms. The terms are used only to distinguish one element from another element. For example, without departing from the scope of the invention, a first element may be named a second element and the second element may be named the first element similarly.
  • FIG. 1 is a block diagram illustrating an image encoding device according to an embodiment of the invention.
  • an image encoding device 100 includes a picture dividing module 105, a prediction module 110, a transform module 115, a quantization module 120, a rearrangement module 125, an entropy encoding module 130, an inverse quantization module 135, an inverse transform module 140, a filter module 145, and a memory 150.
  • the constituent modules shown in FIG. 1 are independently shown to represent different distinctive functions in the image encoding device.
  • Each constituent module is not constructed by an independent hardware module or software unit. That is, the constituent modules are independently arranged and at least two constituent modules may be combined into a single constituent module or a single constituent module may be divided into plural constituent modules to perform functions.
  • Embodiments in which the constituent modules are combined and embodiments in which the constituent modules are separated belong to the scope of the invention without departing from the concept of the invention.
  • constituents are not essential to the substantial functions in the invention and may be optional constituents for merely improving performance.
  • the invention can be embodied to include only constituents essential to embodiment of the invention, except for the constituents used to merely improve performance.
  • the structure including only the essential constituents except for the optical constituents used to merely improve performance belongs to the scope of the invention.
  • the picture dividing module 105 can divide an input picture into at least one process unit.
  • the process unit may be a prediction unit (PU), a transform unit (TU), or a coding unit (CU).
  • the picture dividing module 105 can divide a picture into combinations of plural coding units, prediction units, and transform units and can select a combination of coding units, prediction units, and transform units on the basis of a predetermined criterion (for example, a cost function) to encode the picture.
  • a predetermined criterion for example, a cost function
  • a picture can be divided into plural coding units.
  • a recursive tree structure such as a quad tree structure can be used to divide a picture into coding units.
  • a coding unit which is divided into different coding units with a picture or a coding unit of the largest size as a root can be divided with child nodes corresponding to the number of divided coding units.
  • a coding unit which cannot be divided any more in accordance with a predetermined limitation is a leaf node. That is, when it is assumed that a coding unit can be divided in only a square shape, a single coding unit can be divided into four different coding units.
  • a coding unit can be used to have a meaning of a unit to be decoded as well as a unit to be encoded.
  • a prediction unit can be divided in at least one square or rectangular shape with the same size in a coding unit, or can be divided in shapes such that the shape of one prediction unit out of the divided prediction units in a coding unit is different from the shape of another prediction unit.
  • the coding unit When a coding unit, which is used to generate a prediction unit to be subjected to intra prediction, is not a minimum coding unit, the coding unit can be subjected to intra prediction without being divided into plural prediction units (N ⁇ N).
  • the prediction module 110 includes an inter prediction module that performs inter prediction and an intra prediction module that performs intra prediction.
  • the prediction module can determine which of inter prediction or intra prediction should be performed on a prediction unit, and can determine specific information (for example, intra prediction mode, motion vector, and reference picture) of the determined prediction method.
  • the process unit on which the prediction is performed may be different from the process unit for which the prediction method and the specific information are determined.
  • the prediction method and the prediction mode may be determined for each prediction unit and the prediction may be performed for each transform unit. Residual values (residual block) between the generated predicted block and the original block are input to the transform module 115.
  • the prediction mode information, the motion vector information, and the like used for the prediction are encoded along with the residual values by the entropy encoding module 130 and are transmitted to the decoding device.
  • the original block may be encoded and transmitted to the decoding device without generating a predicted block through the use of the prediction module 110.
  • the inter prediction module can predict a prediction unit on the basis of information of at least one picture of a previous picture and a subsequent picture of a current picture.
  • the inter prediction module includes a reference picture interpolation module, a motion prediction module, and a motion compensation module.
  • the reference picture interpolation module is supplied with reference picture information from the memory 150 and generates pixel information less than an integer pixel from the reference picture.
  • a DCT-based 8-tap interpolation filter having different filter coefficients can be used to generate the pixel information less than an integer pixel in the unit of 1/4 pixel.
  • a DCT-based 4-tap interpolation filters having different filter coefficients can be used to generate the pixel information less than an integer pixel in the unit of 1/8 pixel.
  • the motion prediction module can perform motion prediction on the basis of the reference picture interpolated by the reference picture interpolation module.
  • Various methods such as FBMA (Full search-based Block Matching Algorithm), TSS (Three Step Search), and NTS (New Three-Step Search Algorithm) can be used to derive a motion vector.
  • a motion vector has a motion vector value in the unit of 1/2 or 1/4 pixel on the basis of the interpolated pixel.
  • the motion prediction module can predict a current prediction unit using different motion prediction methods.
  • Various methods such as a skip method, a merging method, and an AMVP (Advanced Motion Vector Prediction) method can be used as the motion prediction method.
  • AMVP Advanced Motion Vector Prediction
  • a method of constructing a predicted motion vector candidate list at the time of performing inter prediction using the AMVP method according to an embodiment of the invention will be described below.
  • the intra prediction module can generate a prediction unit on the basis of reference pixel information around a current block which is pixel information in the current picture.
  • the blocks around the current prediction unit are blocks having been subj ected to the inter prediction and a reference pixel is a pixel having been subjected to the inter prediction
  • reference pixels of the block having been subjected to the inter prediction can be replaced with the reference pixel information of the peripheral blocks having been subjected to the intra prediction. That is, when a reference pixel is not available, the reference pixel information not available can be replaced with at least one reference pixel of the available reference pixels.
  • the prediction mode of intra prediction includes a directive prediction mode in which reference pixel information is used depending on the prediction direction and a non-directive prediction mode in which directivity information is not used to perform prediction.
  • the mode for predicting luma information and the mode for predicting chroma information may be different from each other.
  • Intra prediction mode information obtained by luma information or predicted luma signal information may be used to predict the chroma information.
  • the intra prediction of the prediction unit can be performed on the basis of pixels located on the left side of the prediction unit, a pixel located at the left-top end, and pixels located at the top.
  • the intra prediction can be performed using reference pixels based on the transform unit. Intra prediction using N ⁇ N dividing for only the minimum coding unit can be performed.
  • an MDIS (Mode Dependent Intra Smoothing) filter is applied to reference pixels depending on the prediction mode and then a predicted block can be generated.
  • the type of the MDIS filter applied to the reference pixels may vary.
  • the intra prediction mode of a current prediction unit can be predicted from the intra prediction mode of a prediction unit located around the current prediction unit.
  • the prediction mode of the current prediction unit is predicted using the mode information predicted from the peripheral prediction units and the intra prediction modes of the current prediction unit and the peripheral prediction units are equal to each other, information representing that the prediction modes of the current prediction unit and the peripheral prediction units are equal to each other can be transmitted using predetermined flag information.
  • the prediction modes of the current prediction unit and the peripheral prediction units are different from each other, the prediction mode information of the current block can be encoded by performing entropy encoding.
  • a residual block including residual information which is a difference between a prediction unit subj ected to the prediction and the original block of the prediction unit can be generated on the basis of the prediction unit generated by the prediction module 110.
  • the generated residual block can be input to the transform module 115.
  • the transform module 115 can transform the original block and the residual block including the residual information of the prediction unit generated by the prediction module 110 using a transform method such as DCT (Discrete Cosine Transform) or DST (Discrete Sine Transform). Which of the DCT and the DST to use to transform the residual block can be determined on the basis of the intra prediction mode information of the prediction unit used to generate the residual block.
  • DCT Discrete Cosine Transform
  • DST Discrete Sine Transform
  • the quantization module 120 can quantize values transformed into the frequency domain by the transform module 115.
  • the quantization coefficients can be changed depending on the block or the degree of importance of a picture.
  • the values calculated by the quantization module 120 can be supplied to the inverse quantization module 135 and the rearrangement module 125.
  • the rearrangement module 125 can rearrange the coefficient values relative to the quantized residual values.
  • the rearrangement module 125 can change two-dimensional block type coefficients to one-dimensional vector type coefficients through the use of a coefficient scanning method. For example, the rearrangement module 125 can scan DC coefficients to coefficients of the high frequency domain using a zig-zag scanning method and can change the scanned coefficients to one-dimensional vector type coefficients.
  • a vertical scanning method of scanning two-dimensional block type coefficients in the column direction and a horizontal scanning method of scanning two-dimensional block type coefficients in the row direction can be used instead of the zig-zag scanning method depending on the size of a transform unit and the intra prediction mode. That is, which of the zig-zag scanning method, the vertical scanning method, and the horizontal scanning method to use can be determined depending on the size of a transform unit and the intra prediction mode.
  • the entropy encoding module 130 can perform entropy encoding on the basis of the values calculated by the rearrangement module 125.
  • Various encoding methods such as exponential golomb coding, VLC (Variable length Coding), and CABAC (Context-Adaptive Binary Arithmetic Coding) can be used for the entropy encoding.
  • the entropy encoding module 130 can encode a variety of information such as residual coefficient information and block type information of a coding unit, prediction mode information, dividing unit information, prediction unit information, transfer unit information, motion vector information, reference frame information, block interpolation information, and filtering information from the rearrangement module 125 and the prediction module 110.
  • the entropy encoding module 130 can entropy-encode coefficient values of the coding unit input from the rearrangement module 125.
  • the inverse quantization module 135 and the inverse transform module 140 inversely quantize the values quantized by the quantization module 120 and inversely transforms the values transformed by the transform module 115.
  • the residual values generated by the inverse quantization module 135 and the inverse transform module 140 can be merged with the prediction unit, which is predicted by the motion vector prediction module, the motion compensation module, and the intra prediction module of the prediction module 110, to generate a reconstructed block.
  • the filter module 145 can include at least one of a deblocking filter, an offset correction module, and an ALF (Adaptive Loop Filter).
  • the deblocking filter 145 can remove block distortion generated due to the boundary between blocks in the reconstructed picture. Whether the deblocking filter should be applied to a current block can be determined on the basis of the pixels included in several rows or columns of the block. When the deblocking filter is applied to a block, a strong filter or a weak filter can be applied depending on the necessary deblocking filtering strength. When performing horizontal filtering and vertical filtering for applying the deblocking filter, the horizontal filtering and the vertical filtering can be performed in parallel.
  • the offset correction module can correct an offset of the picture subj ected to the deblocking from the original picture in the unit of pixels.
  • a method of dividing the pixels of a picture into a predetermined number of regions, determining a region to be subj ected to the offset correction, and applying the offset correction to the determined region or a method of applying the offset correction in consideration of edge information of each pixel can be used to perform the offset correction on a specific picture.
  • the ALF Adaptive Loop Filter
  • the pixels included in a picture can be divided into predetermined groups, a filter to be applied to each group can be determined, and the filtering can be differently performed for each group.
  • Information on whether the ALF should be applied and luma signals can be transferred by the coding units (CU) and the size and coefficients of the ALF to be applied to each block can vary.
  • the ALF can have various types and the number of coefficients included in the corresponding filter can vary.
  • the filtering-related information (such as filter coefficient information, ALF ON/OFF information, and filter type information) of the ALF can be included and transferred in a predetermined parameter set of a bitstream.
  • the memory 150 can store the reconstructed block or picture calculated by the filter module 145 and the stored reconstructed block or picture can be supplied to the prediction module 110 when performing the intra prediction.
  • FIG. 2 is a block diagram illustrating an image decoding device according another embodiment of the invention.
  • an image decoding device 200 includes an entropy decoding module 210, a rearrangement module 215, an inverse quantization module 220, an inverse transform module 225, a prediction module 230, a filter module 235, and a memory 240.
  • the input bitstream can be decoded in the inverse order of that in the image encoding device.
  • the entropy decoding module 210 can perform entropy decoding in the inverse order of the order of performing the entropy encoding in the entropy encoding module of the image encoding device.
  • the residual values subj ected to the entropy decoding by the entropy decoding module can be input to the rearrangement module 215.
  • the entropy decoding module 210 can decode information associated with the intra prediction and the inter prediction performed by the encoding device. As described above, when the image encoding device has predetermined restrictions in performing the intra prediction and the inter prediction, the entropy decoding module can perform the entropy decoding based on the restrictions and can be supplied with the information of a current block associated with the intra prediction and the inter prediction.
  • the rearrangement module 215 can perform rearrangement on the bitstream entropy-decoded by the entropy decoding module 210 on the basis of the rearrangement method of the encoding module.
  • the rearrangement module can reconstruct and rearrange coefficients expressed in the form of one-dimensional vector into two-dimensional block type coefficients.
  • the rearrangement module can be supplied with information associated with the coefficient scanning performed by the encoding module and can perform the rearrangement using a method of inversely scanning the coefficients on the basis of the scanning order in which the scanning is performed by the corresponding encoding module.
  • the inverse quantization module 220 can perform inverse quantization on the basis of the quantization parameters supplied from the encoding device and the rearranged coefficient values of the block.
  • the inverse transform module 225 can perform the inverse DCT and inverse DST of the DCT and DST, which has been performed by the transform module, on the quantization result from the image encoding device.
  • the inverse transform can be performed on the basis of a transfer unit determined by the image encoding device.
  • the transform module of the image encoding device can selectively perform the DCT and DST depending on plural information elements such as the prediction method, the size of the current block, and the prediction direction, and the inverse transform module 225 of the image decoding device can perform the inverse transform on the basis of the transform information on the transform performed by the transform module of the image encoding device.
  • the inverse transform can be performed by the coding units instead of the transform units having been subj ected to the transform.
  • the prediction module 230 can generate a predicted block on the basis of predicted block generation information supplied from the entropy decoding module 210 and the previously-decoded block or picture information supplied from the memory 240.
  • the intra prediction on the prediction unit is performed on the basis of pixels located on the left side of the prediction unit, a pixel located at the top-left corner, and pixels located on the top side.
  • the intra prediction can be performed using reference pixels based on the transform unit. Intra prediction using N ⁇ N dividing for only the minimum coding unit can be performed.
  • the prediction module 230 includes a prediction unit determination module, an inter prediction module, and an intra prediction module.
  • the prediction unit determination module can receive a variety of information such as prediction unit information input from the entropy decoding module, prediction mode information of the intra prediction method, and motion prediction-related information of the inter prediction method, can separate a prediction unit from the current coding unit, and can determine which of the inter prediction and the intra prediction should be performed on the prediction unit.
  • the inter prediction module can perform the inter prediction on the current prediction unit on the basis of information included in at least one picture of a previous picture and a subsequent picture of the current picture including the current prediction unit using information necessary for the inter prediction of the current prediction unit supplied from the image encoding device.
  • a skip mode In order to perform the inter prediction, it can be determined which of a skip mode, a merging mode, and an AMVP mode is the motion prediction method of the prediction unit included in the coding unit on the basis of the coding unit.
  • the intra prediction module can generate a predicted block on the basis of pixel information in the current picture.
  • the intra prediction can be performed on the basis of the intra prediction mode information of the prediction unit supplied from the image encoding device.
  • the intra prediction module include an MDIS filter, a reference pixel interpolation module, and a DC filter.
  • the MDIS filter is a module that performs filtering on the reference pixels of the current block and can be applied by determining whether the filter should be applied depending on the prediction mode of the current prediction unit.
  • the MDIS filter can be performed on the reference pixels of the current block using the prediction mode of the prediction unit supplied from the image encoding device and the MDIS filter information. When the prediction mode of the current block is a mode in which the MDIS filtering is not performed, the MDIS filter may not be applied.
  • the reference pixel interpolation module can generate reference pixels in the unit of pixels less than an integer by interpolating the reference pixels.
  • the prediction mode of the current prediction unit is a prediction mode in which a predicted block is generated without interpolating the reference pixels
  • the reference pixels may not be interpolated.
  • the prediction mode of the current block is the DC mode
  • the DC filter can generate a predicted block through filtering.
  • the reconstructed block or picture can be supplied to the filter module 235.
  • the filter module 235 includes a deblocking filter, an offset correction module, and an ALF.
  • the deblocking filter of the image decoding device can be supplied with the deblocking filter-related information from the image encoding device and can perform deblocking filtering on the corresponding block in the decoding device.
  • the vertical deblocking filtering and the horizontal deblocking filter are first performed, where at least one of the vertical deblocking filtering and the horizontal deblocking filtering can be performed on an overlapping portion.
  • the vertical deblocking filtering or the horizontal deblocking filtering which is not previously performed can be performed on the portion in which the vertical deblocking filtering and the horizontal deblocking filtering overlap.
  • the parallel processing of the deblocking filtering processes can be performed through this deblocking filtering.
  • the offset correction module can perform offset correction on the reconstructed picture on the basis of the type of the offset correction applied to the picture in encoding and the offset value information.
  • the ALF can perform the filtering on the basis of the comparison result between the reconstructed picture subj ected to the filtering and the original picture.
  • the ALF can be applied to the coding unit on the basis of the ALF application information and the ALF coefficient information supplied from the encoding device.
  • the ALF information can be included and supplied in a specific parameter set.
  • the memory 240 can store the reconstructed picture or block for use as a reference picture or a reference block and can supply the reconstructed picture to an output module.
  • the coding unit is used as a term representing an encoding unit, but may be used as a unit of decoding as well as encoding.
  • An image encoding method and an image decoding method to be described later in the embodiments of the invention can be performed by the constituents of the image encoding device and the image decoding device described above with reference to FIGS. 1 and 2 .
  • the constituents may include software process units which can be performed through algorithms, as well as hardware constituents.
  • An intra prediction method may be used instead of the existing intra prediction method, or may be selectively used along with the existing intra prediction mode on the basis of flag information.
  • the intra prediction mode according to the embodiment of the invention can be called advanced intra prediction (AIP) mode.
  • Information of advanced_intra_pred_ flag which is information representing whether prediction should be performed using the advanced intra prediction (AIP) mode or using a conventional prediction method instead of the advanced intra prediction (AIP) mode can be transmitted in a state where the information is loaded onto a predetermined generic syntax structure such as a SPS (Sequence Parameter Set) or a PPS (Picture Parameter Set) or a slicer header.
  • the AIP mode can be transmitted for a luma signal or a chroma signal.
  • the AIP mode can be transmitted using advanced_intra_pred_ flag for the luma signal, and can be transmitted using advanced_intra_pred_chroma_flag for the chroma signal.
  • FIG. 3 is a diagram illustrating a prediction unit and reference pixels in the embodiment of the invention.
  • the reference pixels in the embodiment of the invention can be classified into top reference pixels 300, a top-left reference pixel 310, and left reference pixels 320.
  • a reference pixel located at a first position out of the top reference pixels is referred to as a first top reference pixel
  • a pixel located on the leftmost side is referred to as an n-th top reference pixel
  • a pixel located on the top out of the left reference pixels is referred to as a first left reference pixel
  • a pixel located on the bottom is referred to as an n-th left reference pixel.
  • a pixel located at the (n+1)-th position on the just right side of the n-th top reference pixel is referred to as an (n+1)-th top reference pixel 330, and a pixel located at the 2n-th position is referred to as a 2n-th top reference pixel 340.
  • an (n+1)-th pixel located just below the n-th left reference pixel is referred to as an (n+1)-th left reference pixel 350 and a pixel located at the 2n-th position is referred to as a 2n-th bottom reference pixel 360.
  • Columns and rows in a prediction unit can be expressed by first to n-th rows and first to n-th columns with respect to the row and column including pixels.
  • FIG. 4 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • a bottom-right pixel 410 is set to a DC-predicted value so as to perform intra prediction using a DC mode (400).
  • the DC-predicted value can be derived using the average value of the top reference pixels, the left reference pixels, and the top-left pixel, and this value can be used as the predicted value of the bottom-right pixel 410.
  • the predicted values of the n-th column can be derived using the bottom-right pixel 410 and the n-th top reference pixel 423, and the predicted values of the n-th row can be derived using the bottom-right pixel 410 and the n-th left reference pixel 426 (420).
  • Bidirectional linear prediction is performed to derive the predicted values of pixels included in the remaining prediction unit other than the n-th row and the n-th column (440).
  • the predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column can be generated by performing linear prediction on the top reference pixel 445 located on the top in the vertical direction, the pixel 450 in the n-th row located on the bottom in the vertical direction, the left reference pixel 455 located on the left in the horizontal direction, and the pixel 460 in the n-th column on the right side in the horizontal direction.
  • FIG. 5 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • a bottom-right pixel 520 is generated using the average value of the top-left reference pixel 505, the n-th top reference pixel 510, and the n-th left reference pixel 515 (500).
  • the generated bottom-right pixel 520 and the n-th top reference pixel 525 are interpolated to generate the predicted values of the pixels 530 included in the n-th column, and the generated bottom-right pixel 520 and the n-th left reference pixel 535 are interpolated to generate the predicted values of the pixels 537 included in the n-th row.
  • Linear interpolation is performed and predetermined weight values are given to the bottom-right pixel 520 and the n-th top reference pixel 525 to generate the predicted values of the pixels included in the n-th column.
  • the bottom-right pixel 520 and the n-th left reference pixel 535 are interpolated to generate the predicted values of the pixels included in the n-th row.
  • the predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column are derived by performing bidirectional linear prediction on the basis of the top reference pixels 545 located on the top in the vertical direction, the left reference pixels 550, the generated predicted values of the pixels 555 included in the n-th row, and the generated predicted values of the pixels 557 included in the n-th column (560).
  • FIG. 6 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the bottom-right pixel is set to a DC-predicted value (600).
  • the DC-predicted value of the bottom-right pixel 610 can be generated by calculating the average value of the top reference pixels, the left reference pixels, and the top-left pixel.
  • n-th top reference pixel 615 and the bottom-right pixel 610 are interpolated to generate the predicted values of the pixels included in the n-th column, and the n-th left reference pixels 617 and the bottom-right reference pixel 610 are interpolated to generate the predicted values of the pixels included in the n-th row (620).
  • the predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column are generated on the basis of the reference pixel values present in the diagonal direction and the predicted pixel values of the n-th row and the n-th column (640).
  • First predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column can be generated by performing linear interpolation using one pixel value present on the top-right side in the diagonal direction out of the existing reference pixel values and the pixel values of the n-th row and the n-th column and one pixel value present on the bottom-left side.
  • Second predicted values 670 are generated by performing bidirectional linear prediction using two pixels in the horizontal direction and two pixels in the vertical direction, which are present around the first predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column (660).
  • the pixel 675 located just above in the vertical direction of the current prediction pixel, the pixel 680 located just below in the vertical direction of the current prediction pixel, the pixel 685 located on the just left side in the horizontal direction of the current prediction pixel, and the pixel 690 located on the just right side in the horizontal direction of the current prediction pixel are interpolated to generate the second predicted values 670.
  • FIG. 7 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the bottom-right pixel 710 is generated (700) using the average of the top-left reference pixel 703, the n-th top reference pixel 706, and the n-th left reference pixel 709.
  • n-th top reference pixel 706 and the bottom-right pixel 710 are interpolated to generate the predicted values 713 of the pixels included in the n-th column, and the n-th left reference pixels 709 and the bottom-right pixel 710 are interpolated to generate the predicted values of the pixels 715 included in the n-th row (720).
  • the predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column are generated on the basis of the reference pixel values located in the diagonal direction and the predicted pixel values of the n-th row and the n-th column (740).
  • the first predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column can be generated by performing interpolation using one pixel value located on the top-right side in the diagonal direction (for example, 45 degrees) out of the existing reference pixel values and the predicted pixel values of the n-th row and the n-th column and one pixel value located on the bottom-left side.
  • the second predicted values are generated by performing bidirectional linear prediction using two pixels in the horizontal direction and two pixels in the vertical direction located around the first predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column (760).
  • the pixel 745 located just above in the vertical direction of the current prediction pixel, the pixel 750 located just below in the vertical direction of the current prediction pixel, the pixel 755 located on the just left side in the horizontal direction of the current prediction pixel, and the pixel 757 located on the just right side in the horizontal direction of the current prediction pixel are interpolated to generate the second predicted values 770.
  • FIG. 8 is a conceptual diagram illustrating an intra prediction method using an advanced vertical mode according to an example not according to the invention.
  • the average values of the n-th left reference pixel 810 and each of the top reference pixel values are inserted into the n-th row (800).
  • Each pixel included in the n-th row may have the average value of the value the pixel included in the same column out of the top reference pixels and the n-th bottom-left reference pixel.
  • the predicted values of the pixels included in the rows other than the n-th row are generated by interpolating the pixels included in the n-th row and the top reference pixel values (850).
  • FIG. 9 is a conceptual diagram illustrating an intra prediction method using an advanced horizontal mode according to an example not according to the invention.
  • the average values of the (n+1)-th top reference pixel and each of the left reference pixels are inserted into the n-th column (900).
  • Each pixel included in the n-th column may have the average value of the value of the pixel included in the same row out of the left reference pixels and the (n+1)-th top reference pixel.
  • the average pixel values of the n-th top reference pixel and each of the left reference pixels may be inserted into the n-th column (925).
  • each pixel included in the n-th column may have the average value of the pixel included in the same row out of the left reference pixels and the n-th top reference pixel.
  • the predicted values of the pixels included in the columns other than the n-th column by interpolating the pixels included in the n-th column and the top reference pixel values (950).
  • FIG. 10 is a conceptual diagram illustrating a method of deriving a prediction unit using an advanced planar mode according to an embodiment of the invention.
  • the predicted value of the bottom-right pixel 1000 is derived to perform intra prediction using the planar mode.
  • the interpolated value of the derived predicted value of the bottom-right pixel 1000 and the n-th left reference pixel 1010 is used as the predicted values of the pixels included in the n-th row
  • the interpolated value of the derived predicted value of the bottom-right pixel 1000 and the n-th top reference pixel 1020 is used as the predicted values of the pixels included in the n-th column.
  • the predicted values of the pixels included in the remaining prediction unit other than the n-th row and the n-th column can be derived by performing bidirectional interpolation on the basis of the top reference pixels, the left reference pixels, the top-left reference pixel, and the predicted pixel values of the n-th column and the n-th row generated in the previous step.
  • FIGS. 11 to 14 show methods of deriving the bottom-right pixel according to examples not according to the invention.
  • FIG. 11 is a conceptual diagram illustrating a method of deriving the bottom-right pixel in an intra prediction method using an advanced planar mode.
  • the bottom-right pixel can be derived from the average value of the n-th left reference pixel 1100 and the n-th top reference pixel 1110.
  • FIG. 12 is a conceptual diagram illustrating a method of deriving the bottom-right pixel in an intra prediction method using an advanced planar mode.
  • the bottom-right pixel can be derived from the average value the 2n-th top reference pixel 1200 and the 2n-th left reference pixel 1210.
  • the bottom-right pixel may be generated using the n-th left reference pixel value and the n-th top reference pixel value as shown in FIG. 11 , or the bottom-right pixel may be generated using another method.
  • FIG. 13 is a conceptual diagram illustrating a method of deriving the bottom-right pixel in an intra prediction method using an advanced planar mode.
  • the bottom-right pixel can be derived using a top average pixel 1320 generated on the basis of the average value of the n-th top reference pixel 1300 and the 2n-th top reference pixel 1310 and a left average pixel 1350 derived on the basis of the average value of the n-th left reference pixel 1330 and the 2n-th left reference pixel 1340.
  • the bottom-right pixel can be derived on the basis of the average value of the top average pixel 1320 and the left average pixel 1350.
  • the bottom-right pixel may be generated using the n-th left reference pixel value and the n-th top reference pixel value as shown in FIG. 11 , or the bottom-right pixel may be generated using another method.
  • FIG. 14 is a conceptual diagram illustrating a method of deriving the bottom-right pixel in an intra prediction method using an advanced planar mode.
  • the bottom-right pixel 1460 can be generated using the average value of a top middle pixel 1420 located in the middle between the n-th top reference pixel 1400 and the 2n-th top reference pixel 1410 and a left middle pixel 1450 located in the middle between the n-th left reference pixel 1430 and the 2n-th left reference pixel 1440.
  • the pixel located in the middle may be the (n+n/2)-th top or left reference pixel located at the (n+n/2)-th or ((n+n/2)+1)-th position, or may be the ((n+n/2)+1)-th top or left reference pixel.
  • the bottom-right pixel may be generated using the n-th left reference pixel value and the n-th top reference pixel value, or the bottom-right pixel may be generated using another method.
  • FIGS. 15 and 16 are conceptual diagrams illustrating a method of generating the n-th row and the n-th column included in a prediction unit by interpolation in performing an advanced planar prediction mode.
  • FIG. 15 is a conceptual diagram illustrating a method of generating the n-th row and the n-th column in performing an advanced planar mode according to an embodiment of the invention.
  • the predicted values of the pixels other than the bottom-right pixel included in the n-th column can be generated by copying the pixels of from the (n+1)-th top reference pixel to the (2n-1)-th top reference pixel.
  • the predicted values of the pixels other than the bottom-right pixel included in the n-th row can be generated by copying the pixels of from the (n+1)-th left reference pixel to the (2n-1)-th left reference pixel.
  • the predicted value of the bottom-right pixel can be generated by calculating the average value of the 2n-th top Pixel and the 2n-th left pixel.
  • FIG. 16 is a conceptual diagram illustrating a method of generating the n-th row and the n-th column in performing an advanced planar mode.
  • the predicted values of the n-th column can be generated using the pixels generated by linearly predicting the pixels of from the (n+1)-th top reference pixel to the (2n-1)-th top reference pixel and the pixels of from the (n+1)-th left reference pixel to the (2n-1)-th left reference pixel depending on the distance therebetween.
  • the predicted value of the second pixel 1600 in the n-th column can be generated by linearly interpolating the (n+2)-th top reference pixel and the (n+2)-th left reference pixel.
  • the predicted values of the n-th row can be generated using the pixels generated by linearly predicting the pixels of from the (n+1)-th top reference pixel to the (2n-1)-th top reference pixel and the pixels of from the (n+1)-th left reference pixel to the (2n-1)-th left reference pixel depending on the distance therebetween.
  • the predicted value of the second pixel in the n-th row can be generated by linearly interpolating the (n+2)-th top reference pixel and the (n+2)-th left reference pixel.
  • the predicted pixel values of the n-th row and the n-th column can be generated so as to have a more influence on a pixel value having a smaller distance and then prediction using the planar mode can be performed.
  • FIG. 17 is a conceptual diagram illustrating an intra prediction method using an advanced planar mode.
  • four pixels can be used to generate the predicted value of each pixel included in a prediction unit.
  • the first pixel 1700 may be one pixel out of from the first top reference pixel to the n-th top reference pixel located above in the vertical direction of a prediction target pixel.
  • the second pixel 1720 may be a pixel located below in the vertical direction of the prediction target pixel and may have a value obtained by copying the 2n-th left reference pixel 1725.
  • the third pixel 1740 may be one pixel out of from the first left reference pixel to the n-th left reference pixel located on the left side in the horizontal direction of the prediction target pixel.
  • the fourth pixel 1760 may be a pixel located on the right side in the horizontal direction of the prediction target pixel and may have a value obtained by copying the 2n-th top reference pixel 1765.
  • the predicted values of the pixels included in the prediction unit can be generated using a method of performing bidirectional linear interpolation on the first pixel to the fourth pixel.
  • FIG. 18 is a conceptual diagram illustrating an intra prediction method using a planar mode according to an embodiment of the invention.
  • weight values of a predetermined ratio may be given to the predicted value in the horizontal direction and the predicted value in the vertical direction to generate the predicted values of the prediction unit when performing prediction using a planar mode.
  • the predicted value in the horizontal direction can be derived by interpolating the value of the pixel located in the same row as the prediction target pixel out of the left reference pixels and the n-th top reference pixel (1800).
  • the predicted value in the vertical direction can be derived by interpolating the value of the pixel located in the same column as the prediction target pixel out of the top reference pixels and the n-th left reference pixel (1850).
  • the predicted value in the horizontal direction and the predicted value in the vertical direction can be generated by multiplying them by weight values.
  • Mathematical Expression 1 represents that a predicted value is generated on the basis of a weight value.
  • P x y y + 1 x + y + 2 ⁇ Horz + x + 1 x + y + 2 ⁇ Vert
  • FIG. 19 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the top reference pixels and the left reference pixels may be copied to the pixels of the first row and the first column of the prediction unit so as to minimize discontinuity from neighboring prediction units.
  • the predicted value of the pixel located in the first row and the first column can be derived using the first pixel value of the top reference pixels or the first pixel value of the left reference pixels, the first pixel value of the top reference pixels or the first pixel value of the left reference pixels.
  • the predicted values of the pixels other than the first row and the second column can be generated by performing the intra prediction using the DC mode on the basis of the predicted values of the first row and the first column of the prediction unit.
  • FIG. 20 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the predicted values can be generated by calculating the average value of the first top reference pixel which is the first pixel of the top reference pixels, the n-th top reference pixel which is the n-th pixel of the top reference pixels, the first left reference pixel which is the first pixel of the left reference pixels, and the n-th left reference pixel which is the n-th pixel of the left reference pixels. That is, it is possible to reduce calculation complexity when performing an intra prediction through the use of a method of deriving the predicted values of the pixels included in a prediction unit using only partial pixels of the reference pixels.
  • the predicted values can be generated by calculating the average value of the n-th top reference pixel which is the n-th pixel of the top reference pixels, the n-th left reference pixel which is the n-th pixel of the left reference pixels, and the top-left reference pixel. That is, similarly to the left part of FIG. 20 , it is possible to reduce calculation complexity by using only partial pixels of the reference pixels.
  • FIG. 21 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the pixels of the first column and the first row are set to the DC-predicted values derived using the reference pixels (2100).
  • the DC-predicted values included in the first row and the first column may be the average values of the top reference pixels, the top-left reference pixel, and the left reference pixels.
  • a filtering operation is performed using the top reference pixels, the left reference pixels, and the top-left reference pixel (2120).
  • the pixels included in the first column and the first row other than the pixel located at the intersection of the first row and the first column in a prediction unit can be filtered using the reference pixels and a 2-tap filter.
  • the pixel located at the intersection of the first row and the first column in the prediction unit can be filtered on the basis of the first top reference pixel and the first left reference pixel using a 3-tap filter.
  • the intra prediction using the DC mode is performed on the basis of the filtered pixels included in the first column and the first row to generate the predicted values of the pixels included in the prediction unit (2140).
  • the intra prediction using the DC mode can be performed using the average value of the filtered pixels located in the first column and the first row.
  • FIG. 22 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the pixel values included in the first row and the first column of the prediction unit can be predicted by performing an intra prediction using a DC mode on the basis of the reference pixels (2200).
  • the intra-predicted values in the DC mode may be the average values of the top reference pixels, the top-left reference pixel, and the left reference pixels as shown in FIG. 21 .
  • a filtering operation is performed using the top reference pixels, the left reference pixels, the top-left reference pixel, and the generated pixels included in the first row and the first column (2220).
  • the predicted pixels of the first column and the first row can be filtered using a 2-tap filter and the reference pixel values.
  • the pixel located at the intersection of the first row and the first column can be filtered on the basis of the first top reference pixel and the first left reference pixel using a 3-tap filter.
  • the predicted values of the pixels included in the prediction unit other than the first row and the first column can be generated by calculating the average values of the pixel values located on the top and left sides (2240).
  • FIG. 23 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the top reference pixels and the left reference pixels are used as the predicted pixels of the prediction unit (2300).
  • the top reference pixels and the left reference pixels can be used as the predicted values of the pixels included in the first column and the first row of the prediction unit.
  • the predicted values of the pixels of the first row and the first column may be derived on the basis of at least one of the first left reference pixels value and the first top reference pixel value.
  • first predicted values can be derived by performing DC mode prediction on the basis of the pixel values of the first row and the first column (2320).
  • second predicted values can be generated by calculating the average values of the pixel values located on the top and left sides (2340).
  • FIG. 24 is a conceptual diagram illustrating an intra prediction method using an advanced DC mode according to an embodiment of the invention.
  • the predicted values in the DC mode are derived using the reference pixels.
  • the DC-predicted values can be derived by calculating the average values of the top reference pixels, the top-left reference pixel, and the left reference pixels.
  • Mathematical Expression 2 represents a method of deriving a predicted value using a DC mode.
  • DC pred P ⁇ 1 , H ⁇ 1 + ... + P ⁇ 1,0 + P ⁇ 1 , ⁇ 1 + P 0 , ⁇ 1 + ... + P W ⁇ 1 , ⁇ 1 / W + H + 1
  • a Deviation value between the predicted value using a DC mode for each reference pixel and the value of the corresponding reference pixel can be derived.
  • Mathematical Expression 3 represents the value of the reference pixel and the predicted value using the DC mode.
  • the predicted values of the pixels included in a prediction unit can be derived using the DC-predicted values derived by Mathematical Expression 2 and the average values of the x-direction deviations and the y-direction deviations derived by Mathematical Expression 3.
  • FIG. 25 is a conceptual diagram illustrating an intra prediction method using an advanced planar mode.
  • vertical interpolation can be performed using the pixel 2500 located above in the vertical direction in the same column as the current prediction pixel and included in the top reference pixels and the 2n-th left reference pixel 2510 which is the 2n-th pixel of the left reference pixels.
  • Horizontal interpolation can be performed using the left reference pixel value 2520 located on the left side in the horizontal direction of the current prediction pixel and included in the same row as the current prediction pixel and the 2n-th top reference pixel 2530 which is the 2n-th reference pixel of the top reference pixels.
  • the horizontal interpolation or the vertical interpolation can be performed using the n-th left reference pixel or the n-th top reference pixel.
  • FIG. 26 is a conceptual diagram illustrating a method of performing a planar mode prediction when the 2n-th left reference pixel or the 2n-th top reference pixel are not present according to an embodiment of the invention.
  • the left part of FIG. 26 shows a case where at least one of the 2n- left reference pixel and the 2n-th top reference pixel is not present.
  • the interpolation can be performed using the n-th left reference pixel instead of the 2n-th left reference pixel.
  • the interpolation can be performed using the n-th top reference pixel instead of the 2n-th top reference pixel.
  • the right part of FIG. 26 shows a case where the 2n-th left reference pixel and the 2n-th top reference pixel are not present.
  • the planar mode can be performed using the n-th left reference pixel and the n-th top reference pixel.
  • the image encoding method and the image decoding method described above can be embodied by the constituent modules of the image encoding device and the image decoding device described above with reference to FIGS. 1 and 2 .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
EP22194881.3A 2010-12-22 2011-12-21 Intra prediction in video coding Active EP4124034B1 (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201061426480P 2010-12-22 2010-12-22
US201161451121P 2011-03-10 2011-03-10
US201161471185P 2011-04-03 2011-04-03
US201161475636P 2011-04-14 2011-04-14
US201161476311P 2011-04-17 2011-04-17
PCT/KR2011/009954 WO2012087034A2 (ko) 2010-12-22 2011-12-21 화면 내 예측 방법 및 이러한 방법을 사용하는 장치
EP11850923.1A EP2658263B1 (en) 2010-12-22 2011-12-21 Intra prediction method and apparatus using the method

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
EP11850923.1A Division EP2658263B1 (en) 2010-12-22 2011-12-21 Intra prediction method and apparatus using the method
EP11850923.1A Division-Into EP2658263B1 (en) 2010-12-22 2011-12-21 Intra prediction method and apparatus using the method

Publications (2)

Publication Number Publication Date
EP4124034A1 EP4124034A1 (en) 2023-01-25
EP4124034B1 true EP4124034B1 (en) 2023-08-23

Family

ID=46314639

Family Applications (2)

Application Number Title Priority Date Filing Date
EP11850923.1A Active EP2658263B1 (en) 2010-12-22 2011-12-21 Intra prediction method and apparatus using the method
EP22194881.3A Active EP4124034B1 (en) 2010-12-22 2011-12-21 Intra prediction in video coding

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP11850923.1A Active EP2658263B1 (en) 2010-12-22 2011-12-21 Intra prediction method and apparatus using the method

Country Status (11)

Country Link
US (6) US9693054B2 (ko)
EP (2) EP2658263B1 (ko)
KR (3) KR101883932B1 (ko)
CN (1) CN103283237B (ko)
ES (2) ES2934221T3 (ko)
FI (1) FI2658263T3 (ko)
HR (1) HRP20230003T1 (ko)
HU (2) HUE060871T2 (ko)
PL (2) PL2658263T3 (ko)
SI (1) SI2658263T1 (ko)
WO (1) WO2012087034A2 (ko)

Families Citing this family (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SI2860980T1 (sl) * 2010-09-30 2017-08-31 Samsung Electronics Co., Ltd Postopek interpoliranja podob z uporabo gladilnega interpolacijskega filtra
PL2658263T3 (pl) * 2010-12-22 2023-03-13 Lg Electronics Inc. Sposób predykcji wewnątrzramkowej i urządzenie wykorzystujące ten sposób
WO2012096150A1 (ja) * 2011-01-12 2012-07-19 三菱電機株式会社 動画像符号化装置、動画像復号装置、動画像符号化方法及び動画像復号方法
US9420294B2 (en) 2011-02-23 2016-08-16 Lg Electronics Inc. Intra-prediction method using filtering, and apparatus using the method
HRP20230648T1 (hr) 2011-10-18 2023-09-29 Lg Electronics, Inc. Postupci unutarnjeg predviđanja i medij za pohranu
CN104160701B (zh) * 2012-01-27 2017-06-30 太阳专利托管公司 图像编码方法、图像解码方法、图像编码装置、及图像解码装置
WO2014003421A1 (ko) * 2012-06-25 2014-01-03 한양대학교 산학협력단 비디오 부호화 및 복호화를 위한 방법
CN103152540B (zh) * 2013-03-11 2016-01-20 深圳创维－Rgb电子有限公司 分辨率转换方法及装置、超高清电视机
US9571809B2 (en) 2013-04-12 2017-02-14 Intel Corporation Simplified depth coding with modified intra-coding for 3D video coding
WO2014168643A1 (en) * 2013-04-12 2014-10-16 Intel Corporation Coding unit size dependent simplified depth coding for 3d video coding
KR102281282B1 (ko) * 2013-12-26 2021-07-23 삼성전자주식회사 서브블록 기반 예측을 수행하는 인터 레이어 비디오 복호화 방법 및 그 장치 및 서브블록 기반 예측을 수행하는 인터 레이어 비디오 부호화 방법 및 그 장치
US9504038B2 (en) 2014-12-25 2016-11-22 Intel Corporation Apparatus, method and system of communicating a wide-bandwidth data frame
CN107852492A (zh) * 2015-05-12 2018-03-27 三星电子株式会社 用于对图像进行编码和解码的方法和设备
WO2016200235A1 (ko) * 2015-06-11 2016-12-15 엘지전자(주) 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치
WO2017018664A1 (ko) * 2015-07-28 2017-02-02 엘지전자(주) 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치
US10750174B2 (en) 2015-08-28 2020-08-18 Kt Corporation Method and device for deriving a prediction sample in decoding/encoding video signal using binary and quad trees
WO2017052118A1 (ko) * 2015-09-23 2017-03-30 엘지전자 주식회사 영상 코딩 시스템에서 인트라 예측 방법 및 장치
WO2017069505A1 (ko) * 2015-10-19 2017-04-27 엘지전자(주) 영상의 부호화/복호화 방법 및 이를 위한 장치
KR20180107097A (ko) * 2016-02-16 2018-10-01 삼성전자주식회사 비디오 복호화 방법 및 그 장치 및 비디오 부호화 방법 및 그 장치
KR102346713B1 (ko) * 2016-04-12 2022-01-03 세종대학교산학협력단 인트라 예측 기반의 비디오 신호 처리 방법 및 장치
US11503315B2 (en) 2016-08-19 2022-11-15 Lg Electronics Inc. Method and apparatus for encoding and decoding video signal using intra prediction filtering
CN107801039B (zh) * 2016-08-30 2020-04-14 华为技术有限公司 运动补偿预测方法和装置
CN116980592A (zh) 2016-08-31 2023-10-31 株式会社Kt 用于处理视频信号的方法和设备
WO2018047995A1 (ko) * 2016-09-08 2018-03-15 엘지전자(주) 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치
ES2711473R1 (es) 2016-09-20 2021-04-07 Kt Corp Metodo y aparato para procesar una senal de video
WO2018062702A1 (ko) * 2016-09-30 2018-04-05 엘지전자 주식회사 영상 코딩 시스템에서 인트라 예측 방법 및 장치
EP3516875A1 (en) * 2016-10-14 2019-07-31 Huawei Technologies Co., Ltd. Distance weighted bi-directional intra prediction
WO2018070898A1 (en) * 2016-10-14 2018-04-19 Huawei Technologies Co., Ltd Devices and methods for video coding
US10681354B2 (en) 2016-12-05 2020-06-09 Lg Electronics Inc. Image encoding/decoding method and apparatus therefor
WO2018124850A1 (ko) * 2017-01-02 2018-07-05 한양대학교 산학협력단 예측 블록의 중복성을 고려한 화면 내 예측 방법 및 화면 내 예측을 수행하는 영상 복호화 장치
CN110583021B (zh) * 2017-01-31 2023-06-02 夏普株式会社 用于执行平面帧内预测视频编码的系统和方法
WO2018174354A1 (ko) * 2017-03-21 2018-09-27 엘지전자 주식회사 영상 코딩 시스템에서 인트라 예측에 따른 영상 디코딩 방법 및 장치
WO2018174358A1 (ko) * 2017-03-21 2018-09-27 엘지전자 주식회사 영상 코딩 시스템에서 인트라 예측에 따른 영상 디코딩 방법 및 장치
CN116668722A (zh) 2017-05-17 2023-08-29 株式会社Kt 用于解码视频的方法和用于编码视频的方法
WO2018219925A1 (en) * 2017-05-31 2018-12-06 Interdigital Vc Holdings, Inc. Method and apparatus for signalling bi-directional intra prediction in video encoding and decoding
EP3410724A1 (en) * 2017-05-31 2018-12-05 Thomson Licensing Method and apparatus for signalling bi-directional intra prediction in video encoding and decoding
KR102426387B1 (ko) 2017-06-19 2022-07-28 엘지전자 주식회사 인트라 예측 모드 기반 영상 처리 방법 및 이를 위한 장치
US11831910B2 (en) 2017-08-21 2023-11-28 Electronics And Telecommunications Research Institute Method and apparatus for encoding/decoding video, and recording medium storing bit stream
CN107302689B (zh) * 2017-08-24 2018-05-18 北京顺顺通科技有限公司 枪式摄像机自适应开关系统
CN107392942B (zh) * 2017-08-28 2018-06-05 广州文冠信息科技有限公司 人体目标实时分析系统
CN107563321B (zh) * 2017-08-28 2018-07-13 深圳市奥丝卡生物科技有限公司 一种人体目标实时分析方法
KR102389868B1 (ko) 2017-09-28 2022-04-22 삼성전자주식회사 영상 부호화 방법 및 장치, 영상 복호화 방법 및 장치
US20190110052A1 (en) * 2017-10-06 2019-04-11 Futurewei Technologies, Inc. Bidirectional intra prediction
US10484695B2 (en) 2017-10-23 2019-11-19 Google Llc Refined entropy coding for level maps
KR102641362B1 (ko) 2017-11-30 2024-02-27 엘지전자 주식회사 비디오 신호의 처리 방법 및 장치
US10869060B2 (en) * 2018-01-30 2020-12-15 Google Llc Efficient context model computation design in transform coefficient coding
KR20190110041A (ko) 2018-03-19 2019-09-27 주식회사 케이티 비디오 신호 처리 방법 및 장치
KR20240055111A (ko) * 2018-03-30 2024-04-26 광동 오포 모바일 텔레커뮤니케이션즈 코포레이션 리미티드 인트라 예측 기반 영상/비디오 코딩 방법 및 그 장치
US10645381B2 (en) 2018-04-30 2020-05-05 Google Llc Intra-prediction for smooth blocks in image/video
CN112272950A (zh) * 2018-06-18 2021-01-26 交互数字Vc控股公司 帧内预测中的平面和dc模式的边界滤波
WO2019245342A1 (ko) * 2018-06-21 2019-12-26 주식회사 케이티 비디오 신호 처리 방법 및 장치
MX2021001570A (es) 2018-08-09 2021-04-13 Guangdong Oppo Mobile Telecommunications Corp Ltd Metodo y aparato de prediccion de componentes de imagen de video, y medio de almacenamiento informatico.
US11159789B2 (en) 2018-10-24 2021-10-26 City University Of Hong Kong Generative adversarial network based intra prediction for video coding
WO2020125803A1 (en) * 2018-12-21 2020-06-25 Beijing Bytedance Network Technology Co., Ltd. Intra prediction using polynomial model
CN110072112B (zh) * 2019-03-12 2023-05-12 浙江大华技术股份有限公司 帧内预测方法、编码器及存储装置
CN113170101A (zh) * 2019-03-12 2021-07-23 Oppo广东移动通信有限公司 帧内预测方法及装置、计算机可读存储介质
US11640649B2 (en) * 2019-06-19 2023-05-02 Samsung Electronics Co., Ltd. Methods and apparatus for efficient range calculation
US11277616B2 (en) * 2019-06-20 2022-03-15 Qualcomm Incorporated DC intra mode prediction in video coding
US11388419B2 (en) 2020-02-05 2022-07-12 Apple Inc. Smoothed directional and DC intra prediction
US11962784B2 (en) 2020-09-23 2024-04-16 Ofinno, Llc Intra prediction
WO2024039132A1 (ko) * 2022-08-18 2024-02-22 삼성전자 주식회사 영상 복호화 장치 및 방법, 및 영상 부호화 장치 및 방법

Family Cites Families (49)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100281967B1 (ko) 1998-08-31 2001-02-15 전주범 공간 상관성을 이용한 영상 부호화 장치 및 그 방법
US7649943B2 (en) * 2000-04-21 2010-01-19 Microsoft Corporation Interface and related methods facilitating motion compensation in media processing
EP1411729B1 (en) * 2002-04-19 2016-03-23 Panasonic Intellectual Property Corporation of America Motion vector calculating method
US7289674B2 (en) * 2002-06-11 2007-10-30 Nokia Corporation Spatial prediction based intra coding
CN1843038B (zh) * 2003-08-26 2010-09-22 汤姆森特许公司 用于解码混合内部-相互编码块的方法和装置
KR100723403B1 (ko) * 2005-02-28 2007-05-30 삼성전자주식회사 컬러 성분간 단일 부호화 모드를 이용한 예측영상 생성 방법 및 장치와, 그를 이용한 영상 및 비디오 부호화/복호화방법 및 장치
KR100703200B1 (ko) 2005-06-29 2007-04-06 한국산업기술대학교산학협력단 인트라 부호화 장치 및 방법
JP2007259306A (ja) * 2006-03-24 2007-10-04 Univ Waseda 予測器及び画像符号化器
JP4802944B2 (ja) * 2006-08-31 2011-10-26 大日本印刷株式会社 補間演算装置
US8650238B2 (en) * 2007-11-28 2014-02-11 Qualcomm Incorporated Resolving buffer underflow/overflow in a digital system
EP2081386A1 (en) * 2008-01-18 2009-07-22 Panasonic Corporation High precision edge prediction for intracoding
KR20090097688A (ko) * 2008-03-12 2009-09-16 삼성전자주식회사 영상의 인트라 예측 부호화/복호화 방법 및 장치
PL2288163T3 (pl) 2008-05-07 2015-11-30 Lg Electronics Inc Sposób i urządzenie do dekodowania sygnału wideo
KR101361005B1 (ko) * 2008-06-24 2014-02-13 에스케이 텔레콤주식회사 인트라 예측 방법 및 장치와 그를 이용한 영상부호화/복호화 방법 및 장치
KR101517768B1 (ko) 2008-07-02 2015-05-06 삼성전자주식회사 영상의 부호화 방법 및 장치, 그 복호화 방법 및 장치
US9049450B2 (en) * 2010-04-05 2015-06-02 Samsung Electronics Co., Ltd. Method and apparatus for encoding video based on internal bit depth increment, and method and apparatus for decoding video based on internal bit depth increment
US8982961B2 (en) * 2010-04-05 2015-03-17 Samsung Electronics Co., Ltd. Method and apparatus for encoding video by using transformation index, and method and apparatus for decoding video by using transformation index
KR101772459B1 (ko) * 2010-05-17 2017-08-30 엘지전자 주식회사 신규한 인트라 예측 모드
PL3457689T3 (pl) * 2010-05-25 2020-12-28 Lg Electronics Inc. Nowy tryb predykcji planarnej
US8917774B2 (en) * 2010-06-30 2014-12-23 Warner Bros. Entertainment Inc. Method and apparatus for generating encoded content using dynamically optimized conversion
US20120134425A1 (en) * 2010-11-29 2012-05-31 Faouzi Kossentini Method and System for Adaptive Interpolation in Digital Video Coding
PL2658263T3 (pl) * 2010-12-22 2023-03-13 Lg Electronics Inc. Sposób predykcji wewnątrzramkowej i urządzenie wykorzystujące ten sposób
EP4250732B1 (en) * 2011-01-07 2024-03-20 Nokia Technologies Oy Motion prediction in video coding
WO2012097376A1 (en) * 2011-01-14 2012-07-19 General Instrument Corporation Spatial block merge mode
US9930366B2 (en) * 2011-01-28 2018-03-27 Qualcomm Incorporated Pixel level adaptive intra-smoothing
CN103444182B (zh) * 2011-02-09 2017-09-12 Lg电子株式会社 存储运动信息的方法和使用该方法导出时间运动矢量预测值的方法
WO2012114712A1 (ja) * 2011-02-25 2012-08-30 パナソニック株式会社 画像符号化方法および画像復号化方法
CN103563382A (zh) * 2011-03-11 2014-02-05 三星电子株式会社 用于对图像进行编码的方法和设备以及用于进行解码的方法和设备
US9288500B2 (en) * 2011-05-12 2016-03-15 Texas Instruments Incorporated Luma-based chroma intra-prediction for video coding
US9313494B2 (en) * 2011-06-20 2016-04-12 Qualcomm Incorporated Parallelization friendly merge candidates for video coding
EP2750387B1 (en) * 2011-09-22 2019-06-19 LG Electronics Inc. Video decoding method and video decoding apparatus
US9883203B2 (en) * 2011-11-18 2018-01-30 Qualcomm Incorporated Adaptive overlapped block motion compensation
US9426463B2 (en) * 2012-02-08 2016-08-23 Qualcomm Incorporated Restriction of prediction units in B slices to uni-directional inter prediction
US9451277B2 (en) * 2012-02-08 2016-09-20 Qualcomm Incorporated Restriction of prediction units in B slices to uni-directional inter prediction
US9143781B2 (en) * 2012-04-03 2015-09-22 Qualcomm Incorporated Weighted prediction parameter coding
GB2501535A (en) * 2012-04-26 2013-10-30 Sony Corp Chrominance Processing in High Efficiency Video Codecs
US9635356B2 (en) * 2012-08-07 2017-04-25 Qualcomm Incorporated Multi-hypothesis motion compensation for scalable video coding and 3D video coding
EP2904803A1 (en) * 2012-10-01 2015-08-12 GE Video Compression, LLC Scalable video coding using derivation of subblock subdivision for prediction from base layer
US9693060B2 (en) * 2012-11-16 2017-06-27 Qualcomm Incorporated Device and method for scalable coding of video information
US9357212B2 (en) * 2012-12-07 2016-05-31 Qualcomm Incorporated Advanced residual prediction in scalable and multi-view video coding
US9237345B2 (en) * 2013-02-26 2016-01-12 Qualcomm Incorporated Neighbor block-based disparity vector derivation in 3D-AVC
US9800857B2 (en) * 2013-03-08 2017-10-24 Qualcomm Incorporated Inter-view residual prediction in multi-view or 3-dimensional video coding
US9491460B2 (en) * 2013-03-29 2016-11-08 Qualcomm Incorporated Bandwidth reduction for video coding prediction
US9554152B2 (en) * 2013-07-12 2017-01-24 Qualcomm Incorporated Concurrent processing of horizontal and vertical transforms
US9451254B2 (en) * 2013-07-19 2016-09-20 Qualcomm Incorporated Disabling intra prediction filtering
US9560358B2 (en) * 2013-07-22 2017-01-31 Qualcomm Incorporated Device and method for scalable coding of video information
US9554150B2 (en) * 2013-09-20 2017-01-24 Qualcomm Incorporated Combined bi-predictive merging candidates for 3D video coding
US9967592B2 (en) * 2014-01-11 2018-05-08 Qualcomm Incorporated Block-based advanced residual prediction for 3D video coding
US10362336B2 (en) * 2014-03-25 2019-07-23 Qualcomm Incorporated Palette predictor signaling with run length code for video coding

Also Published As

Publication number Publication date
EP4124034A1 (en) 2023-01-25
KR20150140848A (ko) 2015-12-16
FI2658263T3 (fi) 2023-01-13
PL2658263T3 (pl) 2023-03-13
CN103283237B (zh) 2017-03-22
ES2955938T3 (es) 2023-12-11
US9860557B2 (en) 2018-01-02
HUE063154T2 (hu) 2023-12-28
US20200228829A1 (en) 2020-07-16
KR101883932B1 (ko) 2018-07-31
US20210235115A1 (en) 2021-07-29
US20190089980A1 (en) 2019-03-21
EP2658263A4 (en) 2016-12-28
US20130272405A1 (en) 2013-10-17
KR101579356B1 (ko) 2015-12-21
US10609410B2 (en) 2020-03-31
PL4124034T3 (pl) 2024-01-03
SI2658263T1 (sl) 2023-03-31
WO2012087034A2 (ko) 2012-06-28
HUE060871T2 (hu) 2023-04-28
CN103283237A (zh) 2013-09-04
EP2658263B1 (en) 2022-12-14
ES2934221T3 (es) 2023-02-20
KR20130133250A (ko) 2013-12-06
US20180124426A1 (en) 2018-05-03
US10136158B2 (en) 2018-11-20
WO2012087034A3 (ko) 2012-09-07
US20170280157A1 (en) 2017-09-28
KR20170102385A (ko) 2017-09-08
KR101774392B1 (ko) 2017-09-04
US9693054B2 (en) 2017-06-27
US11622129B2 (en) 2023-04-04
EP2658263A2 (en) 2013-10-30
US11006145B2 (en) 2021-05-11
HRP20230003T1 (hr) 2023-02-17

Similar Documents

Publication Publication Date Title
US11622129B2 (en) Intra prediction method and apparatus using the method
US11272208B2 (en) Intra-prediction method using filtering, and apparatus using the method
CN106878743B (zh) 解码视频信号的方法
US20200092581A1 (en) Method for setting motion vector list and apparatus using same
US20180048911A1 (en) Intra prediction method of chrominance block using luminance sample, and apparatus using same
CN113873243B (zh) 用于对视频进行解码的方法和用于对视频进行编码的方法
US20190104304A1 (en) Method and apparatus for processing intra-prediction-based video signal
KR20230054805A (ko) 비디오 신호의 복호화 방법 및 이의 장치
KR102523384B1 (ko) 비디오 신호의 복호화 방법 및 이의 장치
KR102125969B1 (ko) 화면 내 예측 방법 및 이러한 방법을 사용하는 장치
KR20180000886A (ko) 비디오 신호 처리 방법 및 장치

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220909

AC Divisional application: reference to earlier application

Ref document number: 2658263

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 19/182 20140101ALI20230313BHEP

Ipc: H04N 19/70 20140101ALI20230313BHEP

Ipc: H04N 19/105 20140101ALI20230313BHEP

Ipc: H04N 19/61 20140101ALI20230313BHEP

Ipc: H04N 19/80 20140101ALI20230313BHEP

Ipc: H04N 19/593 20140101ALI20230313BHEP

Ipc: H04N 19/159 20140101ALI20230313BHEP

Ipc: H04N 19/11 20140101AFI20230313BHEP

INTG Intention to grant announced

Effective date: 20230329

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AC Divisional application: reference to earlier application

Ref document number: 2658263

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011074208

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2955938

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20231211

REG Reference to a national code

Ref country code: SK

Ref legal event code: T3

Ref document number: E 42503

Country of ref document: SK

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230823

REG Reference to a national code

Ref country code: HU

Ref legal event code: AG4A

Ref document number: E063154

Country of ref document: HU

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1603934

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230823

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SK

Payment date: 20231213

Year of fee payment: 13

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231124

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20231130

Year of fee payment: 13

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231223

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231226

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231123

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231223

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20231124

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: HU

Payment date: 20231215

Year of fee payment: 13

Ref country code: FR

Payment date: 20231130

Year of fee payment: 13

Ref country code: DE

Payment date: 20231221

Year of fee payment: 13

Ref country code: CZ

Payment date: 20231208

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20231214

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20240118

Year of fee payment: 13

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230823