Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/103—Selection of coding mode or of prediction mode
  • H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/103—Selection of coding mode or of prediction mode
  • H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
  • H04N19/129—Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/146—Data rate or code amount at the encoder output
  • H04N19/147—Data rate or code amount at the encoder output according to rate distortion criteria
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
  • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
  • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
  • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
  • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
  • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
  • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques

Definitions

• the field of the invention is that of coding and decoding of images or sequences of images, and in particular of video streams.
• the invention relates to the compression of images or sequences of images using a block representation of the images.
• the invention can in particular be applied to image or video coding implemented in current or future coders (JPEG, MPEG, H.264, HEVC, etc. and their amendments), and to the corresponding decoding.
• JPEG Joint Photographic Experts Group
• MPEG MPEG
• H.264 High Efficiency Video Coding
• HEVC High Efficiency Video Coding
• Digital images and image sequences occupy a lot of memory space, which means that when transmitting these images, they must be compressed to avoid congestion problems on the network used for this transmission.
• HEVC compression standard High Efficiency Video Coding, Coding Tools and Specification
• Matthias Wien, Signais and Communication Technology proposes to implement a pixel prediction of a current image compared to other pixels belonging to the same image (intra prediction) or to a previous or next image (inter prediction).
• intra prediction exploits spatial redundancies within an image.
• the images are cut into blocks of pixels.
• the pixel blocks are then predicted using information already reconstructed, corresponding to the blocks previously coded / decoded in the current image according to the order of traversal of the blocks in the image.
• the coding of a current block is carried out using a prediction of the current block, known as the predictor block, and of a prediction residue or "residual block", corresponding to a difference between the current block and the predictor block.
• the residual block obtained is then transformed, for example by using a transform of the DOT type (transformed into discrete cosine).
• the coefficients of the transformed residual block are then quantified, then coded by an entropy coding and transmitted to the decoder, which can reconstruct the current block by adding this residual block to the predictor block.
• Decoding is done image by image, and for each image, block by block. For each block, the corresponding elements of the flow are read. The inverse quantization and the inverse transformation of the coefficients of the residual block are carried out. Then the prediction of the block is calculated to obtain the predictor block and the current block is reconstructed by adding the prediction (ie the predictor block) to the decoded residual block.
• a DPCM (for Differential Dist Code Modulation) coding technique for coding blocks in Intra mode is inserted in a HEVC coder.
• One such technique consists in predicting a set of pixels of an intra block by another set of pixels of the same block which have been previously reconstructed.
• a set of pixels of the intra block to be coded corresponds to a line of the block, or a column or a line and a column and the intra prediction used to predict the set of pixels is one of the intra directional predictions defined in the HEVC standard.
• the reconstruction of a set of pixels of the intra block corresponds either to the addition of a prediction residue in the case of lossless coding, therefore offering a fairly low compression rate, or to the addition a prediction residue after inverse transformation and / or inverse quantization of said other set of pixels serving as prediction.
• Such a technique therefore does not make it possible to predict each pixel of the intra block using a local prediction function and to reconstruct the predicted pixel before predicting a next pixel.
• this technique requires to reconstruct a set of pixels (row / column of the block for example) to predict another set of pixels. In other words, each time a part of the block is predicted and reconstructed, several pixels of the block are predicted and reconstructed.
• the invention improves the state of the art. To this end, it relates to a method for decoding a stream of coded data representative of at least one image divided into blocks, the decoding method comprises, for at least one block of the image, known as the current block:
• the decoding of the current block comprising:
• the decoding of the current block comprising:
• At least part of the syntax elements of an existing coding mode can be used. This allows data processing to be shared, since the same processing unit can be used, and to reduce implementation costs, both at the hardware level and at the software level.
• the first group of syntax elements and the second group of syntax elements are distinct. Indeed, the second group of syntax elements being a subgroup of the first group, it comprises at least one syntax element of said first group.
• the second group of syntax elements differs from the first group in that it does not include all of the syntax elements in the first group. Indeed, the second group of syntax elements comprises a number of syntax elements strictly less than the number of syntax elements of the first group. Thus the second group of syntax elements is a strict subgroup of the first group of syntax elements.
• the invention thus makes it possible to adapt the coding of the prediction residue obtained according to the second coding mode to the statistics of the coefficients to be coded. Indeed, such a statistic differs from the statistic of the coefficients of the prediction residue obtained according to the first coding mode. Data compression is thus improved.
• the invention also relates to a method for coding a stream of coded data representative of at least one image divided into blocks.
• the coding method comprises, for at least one block of the image, called the current block:
• the coding of the current block comprising:
• the coding of the current block comprising:
• the invention also relates to a coded data stream representative of at least one image divided into blocks.
• the coded data stream comprises, for at least one block of the image, known as the current block:
• a prediction residue according to the first coding mode coded using a first group of syntax elements the prediction residue according to the first coding mode being obtained from a prediction of the current block from reconstructed pixels of a previously decoded block
• Such a data stream can be stored on any recording medium, for example a memory, or transmitted in the form of an electrical or optical signal, which can be routed via an electrical or optical cable, by radio or by other means.
• the first group of syntax elements comprises localization syntax elements indicating the localization of a first non-zero coefficient of the prediction residue associated with said current block, according to a traversing order determined coefficients of said prediction residue, and said second group of syntax elements does not include said localization syntax elements.
• the prediction residue is traversed from the first non-zero coefficient of the prediction residue to the last coefficient of the prediction residue according to said order of determined route.
• the prediction residue is then traversed from the first coefficient of the prediction residue to the last coefficient the prediction residue according to said determined route order.
• This particular embodiment of the invention makes it possible to reduce the cost of coding the prediction residue according to the second coding mode when the first non-zero coefficient corresponds to the first coefficient of the prediction residue.
• the prediction residue associated with the current block comprising at least one sub-block of coefficients
• said first group of syntax elements comprises a sub-block syntax element associated with said at least one sub-block of coefficients, said sub-block syntax element indicating whether at least one coefficient of the sub-block is non-zero, and for each sub-block of coefficients of the prediction residue comprising at least one non-zero coefficient, a syntax element of significance for each coefficient of the sub-block, said element of syntax of significance indicating whether said coefficient is zero or not.
• the second group of syntax elements comprises a significant syntax element for each coefficient of the prediction residue.
• the coefficients of the prediction residue associated with the current block are not grouped by sub-block and the element of sub-block syntax n is not included in the second group of syntax elements.
• the first group of syntax elements comprises, for each non-zero coefficient of the prediction residue traversed according to a determined traversing order:
• the second group of syntax elements comprises for each non-zero coefficient of the prediction residue traveled according to a determined route order, a syntax element indicating the absolute value of the coefficient, and said syntax element indicating whether the coefficient is positive or negative.
• the invention also relates to a decoding device configured to implement the decoding method according to any one of the particular embodiments defined above.
• This decoding device could of course include the various characteristics relating to the decoding method according to the invention.
• the characteristics and advantages of this decoding device are the same as those of the decoding method, and are not described in more detail.
• the decoding device notably comprises a processor configured for, for at least one block of the image, called the current block:
• such a decoding device is included in a terminal.
• the invention also relates to an encoding device configured to implement the encoding method according to any one of the particular embodiments defined above.
• This coding device could of course include the various characteristics relating to the coding method according to the invention. Thus, the characteristics and advantages of this coding device are the same as those of the coding method, and are not described in more detail.
• the coding device notably comprises a processor configured for, for at least one block of the image, known as the current block:
• such a coding device is included in a terminal, or a server.
• the decoding method, respectively the coding method, according to the invention can be implemented in various ways, in particular in wired form or in software form.
• the decoding method, respectively the coding method is implemented by a computer program.
• the invention also relates to a computer program comprising instructions for implementing the decoding method or the coding method according to any one of the particular embodiments described above, when said program is executed by a processor.
• Such a program can use any programming language. It can be downloaded from a communication network and / or saved on a computer-readable medium.
• This program can use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable form.
• the invention also relates to a recording medium or information medium readable by a computer, and comprising instructions of a computer program as mentioned above.
• the recording media mentioned above can be any entity or device capable of storing the program.
• the media can include a storage means such as a memory.
• the recording media can correspond to a transmissible medium such as an electrical or optical signal, which can be routed via an electrical or optical cable, by radio or by other means.
• the program according to the invention can in particular be downloaded from a network of the Internet type.
• the recording media can correspond to an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the process in question.
• FIG. 1 presents steps of the coding method according to a particular embodiment of the invention
• FIG. 2 illustrates an example of the position of the neighboring blocks of a current block for determining an intra prediction mode according to a particular embodiment of the invention
• FIG. 3 illustrates an example of the position of the reference pixels used to predict pixels of a current block according to a particular embodiment of the invention
• FIG. 4 presents steps of the decoding method according to a particular embodiment of the invention
• FIG. 5 illustrates an example of a signal comprising coded data representative of at least one block of an image according to a particular embodiment of the invention
• FIG. 6 shows the simplified structure of a coding device suitable for implementing the coding method according to any one of the particular embodiments of the invention
• FIG. 7 shows the simplified structure of a decoding device suitable for implementing the decoding method according to any one of the particular embodiments of the invention
• FIG. 8 illustrates the division into sub-blocks of a block of coefficients.
• the general principle of the invention is to allow the use of part of a group of syntax elements used to code a prediction residue obtained from a coding mode using a pixel prediction from '' at least one block previously reconstructed, to code a prediction residue resulting from an intra pixel based prediction, ie a prediction of the pixels of the block to be coded from pixels of the block to be coded previously reconstructed.
• the invention thus makes it possible to improve the compression performance of the intra pixel based coding mode and to reduce the costs of implementing this new coding mode, in particular by making it possible to reuse part of the elements of syntax already used by a other coding mode.
• FIG. 1 presents steps of the coding method according to a particular embodiment of the invention.
• a sequence of images l ; l 2 , ..., l N b in the form of a STR coded data stream according to a particular embodiment of the invention is implemented by a coding device as described below with reference to FIG. 6.
• a sequence of images h, l 2 , ..., l Nb , Nb being the number of images of the sequence to be coded, is supplied at the input of the coding method.
• the coding method outputs a stream of STR coded data representative of the sequence of images supplied as input.
• the coding of the sequence of images h, l 2 , ..., l N b is done image by image according to a coding order previously established and known to the coder.
• the images can be coded in time order h, l 2 , ..., l N b or in another order, for example I 1 3, I2,, I Nb -
• an image I, to be coded of the sequence of images, l 2 , ..., l Nb is cut into blocks, for example into blocks of size 32 ⁇ 32, or 64 ⁇ 64 pixels or more.
• Such a block can be subdivided into square or rectangular sub-blocks, for example of size 16 ⁇ 16, 8 ⁇ 8, 4x4, 16 ⁇ 8, 8 ⁇ 16, etc.
• a first block or sub-block X b to code of the image I is selected according to a direction of travel of the image I predetermined. For example, it can be the first block in the lexicographic order of the image.
• the encoder will choose the coding mode for coding the current block X b .
• the encoder selects the coding mode for coding the current block X b from a first coding mode M1 and a second coding mode M2. Additional coding modes (not described here) can be used.
• the first coding mode M1 corresponds to the coding of the current block by intra classical prediction, for example as defined according to the HEVC standard and the second coding mode M2 corresponds to the coding by In Loop Residual prediction (ILR).
• the coder can perform a bit rate / distortion optimization to determine the best coding mode for coding the current block.
• bit rate / distortion optimization additional coding modes distinct from the first and second coding modes can be tested, for example a coding mode in inter mode.
• the coder simulates the coding of the current block X b according to the different coding modes available in order to determine the bit rate and the distortion associated with each coding mode and selects the coding mode offering the best compromise.
• bit rate / distortion for example according to the function D + 2R, where R represents the bit rate necessary to code the current block according to the coding mode evaluated, D the distortion measured between the decoded block and the original current block and l a Lagrangian multiplier, for example entered by the user or defined at the encoder.
• step E20 information indicating the coding mode selected for the current block is coded in the data stream STR.
• the method goes to step E21 of coding the block according to M1. If the current block X b is coded according to the second coding mode M2, the method goes to step E22 of coding the block according to M2.
• the first coding mode corresponds to an intra classical prediction, such as that defined in the HEVC standard.
• a quantization step 3 ⁇ 4 is determined.
• the quantization step 3 ⁇ 4 can be set by the user, or calculated using a quantization parameter setting a compromise between compression and quality and entered by the user or defined by the coder.
• a quantization parameter can be the parameter L, used in the rate-distortion cost function D + l .R, where D represents the distortion introduced by the coding and R the bit rate used to code. This function is used to make coding choices. Conventionally, we are looking for the way to code the image which minimizes this function.
• the quantification parameter can be QP, corresponding to the quantification parameter conventionally used in AVC or HEVC standards.
• a prediction of the current block is determined using an intra-classical prediction mode. According to this intra-classical prediction, each predicted pixel is calculated only from the decoded pixels from the neighboring blocks (reference pixels) located above the current block, and to the left of the current block. How the pixels are predicted from the reference pixels depends on a prediction mode that is passed to the decoder, and which is chosen by the coder from a predetermined set of modes known to the coder and the decoder.
• HEVC there are 35 possible prediction modes: 33 modes which interpolate the reference pixels in 33 different angular directions, and 2 other modes: the DC mode in which each pixel of the predicted block is produced from the average reference pixels, and PLANAR mode, which performs plane and non-directional interpolation.
• This so-called “intra classical prediction” approach is well known and also used in the ITU-T H.264 standard (where there are only 9 different modes) as well as in the experimental JEM software available at the internet address (https : // i vet. hhi .f rau nh of er. de /), where there are 67 different prediction modes.
• the intra classical prediction respects the two aspects mentioned above (pixel prediction from neighboring blocks and transmission to the decoder of an optimal prediction mode).
• the coder therefore chooses one of the prediction modes available from the predetermined list of prediction modes.
• One way of choosing is, for example, to evaluate all the prediction modes and to keep the prediction mode which minimizes a cost function such as, conventionally, the bit rate-distortion cost.
• the prediction mode chosen for the current block is coded from the neighboring blocks of the current block.
• FIG. 2 illustrates an example of the position of the neighboring blocks A b and B b of the current block X b for coding the prediction mode of the current block X b .
• the intra prediction mode chosen for the current block is coded using the intra prediction modes associated with the neighboring blocks.
• such an approach consists in identifying the intra m A prediction mode associated with the block A b located above the current block, and the intra m B prediction mode associated with the block B b located just to the left of the current block.
• MPM for Most Probable Mode
• non-BPM list containing the 32 other prediction modes
• syntax elements are transmitted:
• a predicted block P is constructed as a function of the prediction mode chosen in step E21 1. Then the prediction residue R is obtained by calculating the difference for each pixel, between the predicted block P and the original current block.
• the prediction residue R is transformed into R T.
• a frequency transform is applied to the block of residue R so as to produce the block R T comprising transformed coefficients.
• the transform could be a DCT type transform for example. It is possible to choose the transform to be used in a predetermined set of transforms E T and to signal the transform used to the decoder.
• the transformed residue block R T is quantified using for example a scalar quantization of quantization step This produces the quantized transformed prediction residue block R TQ .
• the coefficients of the quantized block R TQ are coded by an entropy coder.
• an entropy coder One can for example use the entropy coding specified in the HEVC standard. In this case, the coding of the coefficients of the residue R TQ works as follows.
• An order of traversal of the coefficients is determined. This order of travel is the same for the coder and the decoder. It is for example defined by default within the coder and the decoder. For example, it is a scan of the current quantized block R TQ line by line and column by column.
• Elements of syntax are transmitted to indicate the location of the first non-zero coefficient encountered according to the order of travel. These syntax elements will be called LastX and LastY (indicating the coordinates of said coefficient in the current quantized current block RTQ).
• the coefficients are then traversed from said first non-zero coefficient to the last coefficient of the current quantized block R TQ .
• the coefficients of the current quantized block R TQ are grouped into sub-blocks. For example, the coefficients are grouped into 4x4 size sub-blocks contained in the current quantized block R TQ , as illustrated in FIG. 8 showing a block of transformed prediction residue cut into sub-blocks of 4x4 coefficients. Other sizes of sub-blocks are of course possible.
• an element of syntax coded_sub_block_flag is transmitted, indicating whether this sub-block consists entirely of zeros or not.
• this syntax element takes the value 0 if all the coefficients of the sub-block are harmful and the value 1 otherwise (at least one coefficient of the subgroup is different from 0).
• an element of syntax sig_coeff_flag is transmitted for each coefficient (located after the last coefficient of the sub-block indicated by LastX and LastY according to the order of traversal determined), this syntax element indicating whether the coefficient is zero or not. Such a syntax element is not transmitted for the first non-zero coefficient identified by LastX and LastY since the coder already knows that this coefficient is non-zero.
• an element of syntax coeff_abs_level_greater1_flag is transmitted, indicating whether the coefficient is equal to 1 or not.
• an element of syntax coeff_abs_level_greater2_flag is transmitted, indicating whether the coefficient is equal to 2 or not.
• an element of coeff_abs_level_remaining syntax is transmitted, indicating the amplitude of the coefficient reduced by 3.
• an element of syntax coeff_sign_flag is transmitted to indicate whether the coefficient is positive or negative.
• the current block is decoded by de-quantizing the coefficients of the quantized block R TQ , then by applying the inverse transform to the de-quantized coefficients to obtain the decoded prediction residue.
• the prediction is then added to the decoded prediction residue in order to reconstruct the current block and obtain its decoded version.
• the decoded version of the current block can then be used later to spatially predict other neighboring blocks of the image or else to predict blocks of other images by inter-image prediction.
• step E22 of coding the block according to the second coding mode M2 is described below, according to a particular embodiment of the invention.
• the second coding mode corresponds to coding by ILR prediction.
• a local predictor PL for the current block is determined.
• the pixels of the current block are predicted by pixels previously reconstructed from a neighboring block of the current block or of the current block itself.
• the first coding mode uses a first group of intra prediction modes, for example the intra prediction modes defined by the HEVC standard, and the second coding mode, here the ILR mode, uses a second group of prediction modes distinct from the first group of intra prediction modes.
• the local predictor PL can be unique or it can be selected from a set of predetermined local predictors (second group of prediction modes). According to an alternative embodiment, 4 local predictors are defined. Thus, if X is called a current pixel to predict from the current block, A the pixel located immediately to the left of X, B the pixel located immediately to the left and above X, C the pixel located immediately above X, as illustrated in FIG. 3 showing a current block X b . 4 local predictors PL1, PL2, PL3, PL4 can be defined as follows:
• min (A, B) corresponds to the function returning the smallest value between the value of A and the value of B and max (A, B) corresponds to the function returning the largest value between the value of A and the value of B.
• step E220 it is determined which local predictor PL to use for the current block.
• the same local predictor will be used for all the pixels of the current block, i.e. the same prediction function.
• the coding of the current block with each of the predictors can be simulated (similar to an optimization for choosing a coding mode for the current block), and the local predictor which optimizes a cost function (for example, which minimizes the function D + AR, where R is the bit rate used to code the block, D is the distortion of the decoded block compared to the original block, and l is a parameter set by the user) is selected.
• a cost function for example, which minimizes the function D + AR, where R is the bit rate used to code the block, D is the distortion of the decoded block compared to the original block, and l is a parameter set by the user
• an orientation of the texture of the previously coded pixels is analyzed. For example, the pixels previously coded in the block which are located above or to the left of the current block are analyzed using a Sobel operator. If it is determined that:
• the local predictor PL2 is selected
• the local predictor PL3 is selected
• the local predictor PL4 is selected
• the local predictor PL1 is selected.
• a syntax element is coded in the STR data stream to indicate to the decoder which local predictor was used to predict the current block.
• a quantization step d 2 is determined.
• the quantization step d 2 depends on the same quantization parameter as the quantization step ⁇ which would be determined in step E210 if the current block was coded according to the first coding mode.
• a prediction residue R1 is calculated for the current block. To do this, once the local predictor has been chosen, for each current pixel of the current block:
• the current pixel X of the current block is predicted by the local predictor PL selected, using either pixels outside the block and already reconstructed (and therefore available with their decoded value), or pixels previously reconstructed in the current block, either of the two, in order to obtain a predicted value PRED.
• the predictor PL uses previously reconstructed pixels.
• FIG. 3 it can be seen that the pixels of the current block situated on the first line and / or the first column of the current block will use as reference pixels (to construct the predicted value PRED) pixels external to the block and already reconstructed (pixels in gray in FIG. 3) and possibly already reconstructed pixels of the current block.
• the reference pixels used to construct the predicted value PRED are located inside the current block;
• Q (X) is the quantized residue associated with X. It is calculated in the spatial domain, ie calculated directly from the difference between the predicted PRED value of the pixel X and the original value of X. Such a quantized residue Q (X ) for the pixel X is stored in a quantized prediction residue block R1 Q , which will be coded later;
• the decoded predicted value P1 (X) of X is calculated by adding to the predicted value PRED the de-quantized value of the quantized residue Q (X).
• ScalarDequant (A, x) D x x.
• the decoded predicted value P1 (X) thus makes it possible to predict possible pixels which remain to be processed in the current block. Furthermore, the block P1 comprising the decoded / reconstructed values of the pixels of the current block constitutes the predictor ILR of the current block (as opposed to the intra-classical predictor).
• the sub-steps described above are performed for all the pixels of the current block, in a traversing order which ensures that the pixels used for the prediction chosen from PL1, ..., PL4 are available.
• the order of traversal of the current block is the lexicographic order, ie from left to right, and from top to bottom.
• several travel orders of the current block can be used, for example:
• step E222 the quantized residue block R1 Q has been determined. This quantized residue block R1 Q must be coded to be transmitted to the decoder. The predictor P1 of the current block was also determined.
• the quantized residue block R1 Q is coded in order to transmit it to the decoder. It is possible to use any known approach, such as the method described in HEVC to code the quantized coefficients of a classical prediction residue.
• the values of the quantized residue block R1 Q are coded using an entropy coder in the STR data stream using at least part of the syntax elements used to code a prediction residue from the coding mode M1.
• the coding of the residue R1 Q is done by omitting the elements of syntax LastX and LastY and by systematically traversing all the coefficients of the block of quantified prediction residue R1 Q.
• An order of traversal of the coefficients is determined.
• the coefficients are traversed from the first coefficient of the quantized residue block R1 Q to the last coefficient of the quantized residue block R1 Q.
• the rest of the entropy coding of the coefficients is similar to that described in the case of the coding of a transformed prediction residue resulting from the coding mode M1.
• coefficients are grouped by sub-blocks, for example 4x4-sized sub-blocks contained in the current quantized residue block R1 Q. Other sizes of sub-blocks are of course possible.
• an element of syntax coded_sub_block_flag is transmitted, indicating whether this sub-block consists entirely of zeros or not.
• an element of syntax sig_coeff_flag is transmitted for each coefficient, this element of syntax indicating whether the coefficient is zero or not.
• an element of syntax coeff_abs_level_greater1_flag is transmitted, indicating whether the coefficient is equal to 1 or not.
• an element of syntax coeff_abs_level_greater2_flag is transmitted, indicating whether the coefficient is equal to 2 or not.
• an element of coeff_abs_level_remaining syntax is transmitted, indicating the amplitude of the coefficient reduced by 3.
• an element of syntax coeff_sign_flag is transmitted to indicate whether the coefficient is positive or negative.
• the coding of the quantized residue R1 Q is done by omitting the elements of syntax LastX and LastY and by systematically traversing all the coefficients of the block of quantized residue R1 Q , and by omitting the coded_sub_block_flag element.
• a significance value sig_coeff_flag is therefore systematically coded for each coefficient of the quantized residue block R1 Q.
• the coding of the coefficients of the residue R1 Q operates as follows. An order of traversal of the coefficients is determined. The coefficients are traversed from said first coefficient of the quantized residue block R1 Q to the last coefficient of the quantized residue block R1 Q according to the determined order of travel. For this purpose, for each coefficient, an element of syntax sig_coeff_flag is transmitted, this element of syntax indicating whether the coefficient is zero or not. For each non-zero coefficient, an element of syntax coeff_abs_level_greater1_flag is transmitted, indicating whether the coefficient is equal to 1 or not.
• an element of syntax coeff_abs_level_greater2_flag is transmitted, indicating whether the coefficient is equal to 2 or not.
• an element of coeff_abs_level_remaining syntax is transmitted, indicating the amplitude of the coefficient reduced by 3.
• an element of syntax coeff_sign_flag is transmitted to indicate whether the coefficient is positive or negative.
• the coding of the residue R1 Q is carried out only using the elements of syntax coeff_abs_level_remaining and coeff_sign_flag.
• all the coefficients of the block are systematically traversed and the value of each coefficient is coded.
• the coding of the coefficients of the residue R1 Q works as follows. An order of traversal of the coefficients is determined. The coefficients are traversed from the first coefficient of the quantized residue block R1 Q to the last coefficient of the quantized residue block R1 Q.
• an element of coeff_abs_level_remaining syntax is transmitted, indicating the amplitude of the coefficient, and for each non-zero coefficient, an element of syntax coeff_sign_flag is transmitted in order to indicate whether the coefficient is positive or negative.
• the coding of the prediction residue R1 Q is carried out on the basis of a group of syntax elements which is a strict subset (that is to say not equal) and not empty of the syntax elements used for the "classical" residue R TQ .
• an additional prediction residue R2 from the predictor ILR obtained for the current block.
• the coding of an additional prediction residue R2 is however optional. It is indeed possible to simply code the current block by its predicted version P1 and the quantized residue R1 q .
• the following steps correspond to the conventional steps of coding this residue R2.
• the residue R2 is transformed using a frequency transform so as to produce the block of coefficients R2 T.
• the transform can be a DCT type transform for example. It is possible to choose the transform to be used in a predetermined set of transforms E T2 and to signal the transform used to the decoder. In this case, the set E T2 can be different from the set E T , in order to adapt to the particular statistics of the residue R2.
• the block of coefficients R2 T is quantized, for example using a scalar quantization of quantization step d. This produces the R2 TQ block.
• the quantization step d can be set by the user, it can also be calculated using another parameter l fixing the compromise between compression and quality and entered by user or coder.
• the quantization step d may correspond to the quantization step 3 ⁇ 4 or be determined in a similar manner to this.
• the coefficients of the quantized block R2 TQ are then transmitted in a coded manner.
• the coding specified in the HEVC standard can be used.
• the current block is decoded by de-quantizing the coefficients of the quantized block R2 TQ , then by applying the inverse transform to the de-quantized coefficients to obtain the decoded prediction residue.
• the prediction P1 is then added to the decoded prediction residue in order to reconstruct the current block and to obtain its decoded version X rec .
• the decoded version X rec of the current block can then be used later to spatially predict other neighboring blocks of the image or else to predict blocks of other images by inter-image prediction.
• step E23 it is checked whether the current block is the last block of the image to be processed by the coding method, taking into account the travel order defined above. If so, the method proceeds to coding (step E25) of the next image of the video if necessary. If not, during a step E24, the next block of the image to be processed is selected according to the path of the image defined above and the coding method goes to step E2, where the selected block becomes the current block treat.
• FIG. 4 presents steps of the method of decoding a stream STR of coded data representative of a sequence of images 1 ; l 2 , ..., l N b to be decoded according to a particular embodiment of the invention.
• the STR data stream was generated via the coding method presented in relation to FIG. 1.
• the data stream STR is supplied at the input of a decoding device DEC, as described in relation to FIG. 7.
• the decoding method decodes the image-by-image stream and each image is decoded block by block.
• an image I, to be decoded is subdivided into blocks.
• Each block will undergo a decoding operation consisting of a series of steps which are detailed below.
• the blocks can be the same size or different sizes.
• a first block or sub-block X b to be decoded from the image I is selected as the current block according to a direction of travel of the image I, which is predetermined. For example, it can be the first block in the lexicographic order of the image.
• step E42 information indicating an encoding mode for the current block is read from the data stream STR.
• this information indicates whether the current block is coded according to a first coding mode M1 or according to a second coding mode M2.
• the first coding mode M1 corresponds to the coding of the current block by intra classical prediction, for example as defined according to the HEVC standard
• the second coding mode M2 corresponds to the coding by In Loop prediction Residual (ILR).
• ILR In Loop prediction Residual
• the information read from the stream STR can also indicate the use of other coding modes for coding the current block (not described here).
• step E43 of decoding the current block is described when the current block is coded according to the first coding mode M1.
• a quantization step 3 ⁇ 4 is determined.
• the quantization step 3 ⁇ 4 is determined from the quantization parameter QP read from the data stream STR or in a similar manner to what was done at the coder.
• the quantization step 3 ⁇ 4 can be calculated using the quantization parameter QP read from the data stream STR.
• the QP quantization parameter can be the quantification parameter conventionally used in AVC or HEVC standards.
• the prediction mode used to code the current block is decoded from the neighboring blocks. For this, like what was done at the coder, the intra prediction mode chosen for the current block is decoded, using the intra prediction modes associated with the neighboring blocks of the current block.
• the binary indicator and the prediction mode index are therefore read for the current block from the STR data stream, to decode the intra prediction mode of the current block.
• the decoder constructs a predicted block P for the current block from the decoded prediction mode.
• the decoder decodes the coefficients of the quantized block R TQ from the data stream STR, for example using the decoding specified in the HEVC standard.
• the decoding of the coefficients of the residue R TQ works as follows. A travel order of the coefficients is determined corresponding to the travel order used at the coder. LastX and LastY syntax elements indicating the coordinates of the first nonzero coefficient in the residue block R TQ according to the determined order of traversal, are decoded. The coefficients are traversed from the first non-zero coefficient to the last coefficient of the block.
• these coefficients are grouped into 4x4 size sub-blocks contained in the current quantized residue block R TQ .
• an element of syntax coded_sub_block_flag is decoded, indicating whether this sub-block consists entirely of zeros or not.
• an element of syntax sig_coeff_flag is decoded for each coefficient (located after the last coefficient of the block indicated by LastX and LastY), this element of syntax indicating whether the coefficient is zero or not.
• an element of syntax coeff_abs_level_greater1_flag is decoded, indicating whether the coefficient is equal to 1 or not.
• an element of syntax coeff_abs_level_greater2_flag is decoded, indicating whether the coefficient is equal to 2 or not.
• an element of coeff_abs_level_remaining syntax is decoded, indicating the amplitude of the coefficient reduced by 3.
• an element of syntax coeff_sign_flag is decoded to indicate whether the coefficient is positive or negative.
• the decoded block R TQ is de-quantized, for example using a scalar de-quantization of quantization step This produces the block of RTQD- quantized coefficients
• an inverse frequency transform is applied to the block of de-quantified coefficients R T Q D so as to produce the block of decoded prediction residue RTQDI.
• the transform could be a reverse DCT type transform for example. It is possible to choose the transform to be used in a predetermined set of transforms by decoding an indicator from the data stream STR.
• step E44 describes the decoding of the current block when the current block is coded according to the second coding mode M2.
• the local predictor PL used to predict the pixels of the current block is determined.
• the local predictor is for example defined by default at the level of the decoder and no element of syntax needs to be read in the stream STR to determine it.
• a syntax element is decoded from the data stream STR to identify which local predictor was used to predict the current block.
• the local predictor is therefore determined from this decoded syntax element.
• the quantization step d 2 is determined, in a similar manner to what has been done at the coder.
• the quantized residue R1 Q is decoded from the data stream STR.
• the values of the quantized residue block R1 Q are decoded from the data stream STR using at least part of the syntax elements used to decode a prediction residue from the coding mode M1.
• a subgroup of the group of syntax elements used for the residue R TQ is used.
• the decoding of the residue R1 Q is done by omitting the elements of syntax LastX and LastY and by systematically traversing all the coefficients of the block of quantized residue R1 Q.
• the decoding of the coefficients of the residue R1 Q works as follows. A travel order of the coefficients is determined, corresponding to the travel order determined by the coder. The coefficients are traversed from the first coefficient of the quantized residue block R1 Q to the last coefficient of the quantized residue block R1 Q. To this end, these coefficients are grouped into 4x4 size sub-blocks contained in the quantized residue block R1 Q.
• an element of syntax coded_sub_block_flag is decoded, indicating whether this sub-block consists entirely of zeros or not.
• an element of syntax sig_coeff_flag is decoded for each coefficient, this element of syntax indicating whether the coefficient is zero or not.
• an element of syntax coeff_abs_level_greater1_flag is decoded, indicating whether the coefficient is equal to 1 or not. For each non-zero coefficient not equal to
• an element of coeff_sign_flag syntax is decoded in order to indicate whether the coefficient is positive or negative.
• the decoding of the residue R1 Q is done by omitting the elements of syntax LastX and LastY and by systematically traversing all the coefficients of the block of quantized residue R1 Q , and by omitting the element of syntax coded_sub_block_flag and therefore in systematically decoding a value for each coefficient of the block.
• the decoding of the coefficients of the residue R TQ works as follows. An order of traversal of the coefficients is determined. The coefficients are traversed from the first coefficient of the quantized residue block R1 Q to the last coefficient of the quantized residue block R1 Q. For each coefficient, an element of syntax sig_coeff_flag is decoded, this element of syntax indicating whether the coefficient is zero or not. For each non-zero coefficient, an element of syntax coeff_abs_level_greater1_flag is decoded, indicating whether the coefficient is equal to 1 or not. For each non-zero coefficient not equal to
• the decoding of the residue R1 Q is done only using the elements of syntax coeff_abs_level_remaining and coeff_sign_flag.
• the decoding of the coefficients of the residue R1 Q works as follows. An order of traversal of the coefficients is determined. The coefficients are traversed from the first coefficient of the quantized residue block R1 Q to the last coefficient of the quantized residue block R1 Q. For this purpose, for each coefficient an element of syntax coeff_abs_level_remaining is decoded, indicating the amplitude of the coefficient and for each coefficient not zero, an element of syntax coeff_sign_flag is decoded in order to indicate whether the coefficient is positive or negative.
• the quantized residue block R1 Q is de-quantified using the quantization step d 2 , so as to produce the de-quantized residue block R1 QD .
• step E444 when the de-quantized residue block R1 QD is obtained, the predicted block P1 is constructed using the local predictor PL determined during step E440.
• each pixel of the current block is predicted and reconstructed as follows:
• the current pixel X of the current block is predicted by the predictor PL selected, using either pixels outside the block and already decoded, or pixels previously reconstructed from the current block, or both, to obtain a predicted PRED value. In all cases, the predictor PL uses previously decoded pixels;
• the route order is the lexicographic order (from left to right, then the lines from top to bottom).
• the predicted block P1 comprising the decoded predicted values P1 (X) of each pixel of the current block here constitutes the decoded current block X rec .
• an additional prediction residue has been coded for the current block. It is therefore necessary to decode this additional prediction residue in order to reconstruct the decoded version of the current block X rec .
• this other particular embodiment can be activated or not by default at the level of the coder and the decoder.
• an indicator can be encoded in the data stream with the block level information to indicate for each block encoded according to the ILR encoding mode whether an additional prediction residue is encoded.
• an indicator can be coded in the data stream with the image level or image sequence information to indicate for all the blocks of the image or of the image sequence coded according to the ILR coding mode if a additional prediction residue is coded.
• the coefficients of the quantized prediction residue R2 TQ are decoded from the data stream STR, using means adapted to those implemented to the coder, for example the means implemented in a HEVC decoder.
• the block of quantized coefficients R2 TQ is de-quantified, for example using a scalar de-quantization of quantization step This produces the block of unquantified coefficients R2 TQD .
• an inverse frequency transform is applied to the block R2 TQD so as to produce the block of decoded prediction residue R2 TQD
• the reverse transform could be a reverse DCT type transform for example.
• the transform to be used in a predetermined set of transforms E T2 and to decode the information signaling the transform to be used at the decoder.
• the set E T2 is different from the set E T , in order to adapt to the particular statistics of the residue R2.
• the current block is reconstructed by adding the predicted block P1 obtained during the step E444 to the decoded prediction residue R2 TQDL
• step E45 it is checked whether the current block is the last block of the image to be processed by the decoding method, taking into account the course order defined above. If so, the method proceeds to decoding (step E47) of the next image of the video if necessary. If not, during a step E46, the next block of the image to be processed is selected according to the path of the image defined above and the decoding method proceeds to step E42, the selected block becoming the current block to treat.
• FIG. 5 illustrates an example of a STR signal comprising coded data representative of at least one block of an image according to a particular embodiment of the invention.
• the signal STR comprises a coded indicator TY indicating for a block of an image, a coding mode for this block.
• the signal then comprises quantized prediction residue values R1 Q coded using a group of syntax elements which is a subgroup of the group of syntax elements used to code prediction residue values from the first coding mode.
• a subgroup includes elements of syntax as described in relation to FIG. 1 or 4 when the current block is coded according to the second coding mode.
• the signal optionally includes coded values of quantized transformed prediction residues R2 TQ .
• the signal also includes a coded local predictor indicator PL.
• the signal When the TY indicator indicates that the block is coded according to the first coding mode, here the intra classical prediction mode, the signal then comprises quantized transformed prediction residue values R TQ coded using a group d elements of syntax as described in relation to FIGS. 1 or 4 when the current block is coded according to the first coding mode, a binary indicator Î M PM indicating whether the prediction mode to be coded for the current block is in the list MPM or not, and an idx MpM index indicating the index of the prediction mode of the current block in the corresponding list.
• FIG. 6 presents the simplified structure of a COD coding device suitable for implementing the coding method according to any one of the particular embodiments of the invention.
• the steps of the coding method are implemented by computer program instructions.
• the coding device COD has the conventional architecture of a computer and notably comprises a memory MEM, a processing unit UT, equipped for example with a processor PROC, and controlled by the computer program PG stored in MEM memory.
• the computer program PG includes instructions for implementing the steps of the coding method as described above, when the program is executed by the processor PROC.
• the code instructions of the computer program PG are for example loaded into a memory RAM (not shown) before being executed by the processor PROC.
• the processor PROC of the processing unit UT implements in particular the steps of the coding method described above, according to the instructions of the computer program PG.
• FIG. 7 shows the simplified structure of a DEC decoding device suitable for implementing the decoding method according to any one of the particular embodiments of the invention.
• the DEC decoding device has the conventional architecture of a computer and in particular comprises a MEMO memory, a UTO processing unit, equipped for example with a PROCO processor, and controlled by the PGO computer program stored in MEMO memory.
• the PGO computer program includes instructions for implementing the steps of the decoding method as described above, when the program is executed by the PROCO processor.
• the code instructions of the PGO computer program are for example loaded into a RAM memory (not shown) before being executed by the PROCO processor.
• the processor PROCO of the processing unit UTO implements in particular the steps of the decoding method described above, according to the instructions of the computer program PGO.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Compression Or Coding Systems Of Tv Signals (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=65494290

Family Applications (1)

Country Status (8)

Family Cites Families (12)

• 2018
  • 2018-09-21 FR FR1858572A patent/FR3086486A1/fr not_active Withdrawn
• 2019
  • 2019-09-03 CN CN201980062059.4A patent/CN112740692B/zh active Active
  • 2019-09-03 CN CN202410416849.0A patent/CN118354067A/zh active Pending
  • 2019-09-03 WO PCT/FR2019/052023 patent/WO2020058593A1/fr active Application Filing
  • 2019-09-03 JP JP2021515494A patent/JP2022500944A/ja active Pending
  • 2019-09-03 KR KR1020217008025A patent/KR20210058848A/ko active Search and Examination
  • 2019-09-03 US US17/277,938 patent/US11985355B2/en active Active
  • 2019-09-03 EP EP19774169.7A patent/EP3854088A1/fr active Pending
  • 2019-09-03 BR BR112021003210-0A patent/BR112021003210A2/pt unknown
• 2024
  • 2024-03-26 US US18/616,937 patent/US20240244266A1/en active Pending

Also Published As

Similar Documents

Legal Events