EP3991433A1 - Method for encoding and decoding an image of a video sequence, and associated device - Google Patents
Method for encoding and decoding an image of a video sequence, and associated deviceInfo
- Publication number
- EP3991433A1 EP3991433A1 EP20734037.3A EP20734037A EP3991433A1 EP 3991433 A1 EP3991433 A1 EP 3991433A1 EP 20734037 A EP20734037 A EP 20734037A EP 3991433 A1 EP3991433 A1 EP 3991433A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- block
- component
- image
- chrominance
- mode
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 96
- 238000000638 solvent extraction Methods 0.000 claims description 24
- 238000011156 evaluation Methods 0.000 claims description 22
- 238000005070 sampling Methods 0.000 claims description 5
- 239000004098 Tetracycline Substances 0.000 claims description 2
- 239000001095 magnesium carbonate Substances 0.000 claims 1
- 238000012360 testing method Methods 0.000 description 12
- 102100033934 DNA repair protein RAD51 homolog 2 Human genes 0.000 description 11
- 101001132307 Homo sapiens DNA repair protein RAD51 homolog 2 Proteins 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 239000010451 perlite Substances 0.000 description 7
- 238000007906 compression Methods 0.000 description 5
- 230000006835 compression Effects 0.000 description 5
- 238000004590 computer program Methods 0.000 description 5
- 238000013139 quantization Methods 0.000 description 5
- 101100194362 Schizosaccharomyces pombe (strain 972 / ATCC 24843) res1 gene Proteins 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- VBRBNWWNRIMAII-WYMLVPIESA-N 3-[(e)-5-(4-ethylphenoxy)-3-methylpent-3-enyl]-2,2-dimethyloxirane Chemical compound C1=CC(CC)=CC=C1OC\C=C(/C)CCC1C(C)(C)O1 VBRBNWWNRIMAII-WYMLVPIESA-N 0.000 description 2
- 102100031437 Cell cycle checkpoint protein RAD1 Human genes 0.000 description 2
- 101001130384 Homo sapiens Cell cycle checkpoint protein RAD1 Proteins 0.000 description 2
- 101100194363 Schizosaccharomyces pombe (strain 972 / ATCC 24843) res2 gene Proteins 0.000 description 2
- 239000000728 ammonium alginate Substances 0.000 description 2
- 235000010407 ammonium alginate Nutrition 0.000 description 2
- 230000000717 retained effect Effects 0.000 description 2
- 239000000661 sodium alginate Substances 0.000 description 2
- 235000010413 sodium alginate Nutrition 0.000 description 2
- 239000004099 Chlortetracycline Substances 0.000 description 1
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 239000004100 Oxytetracycline Substances 0.000 description 1
- 239000000783 alginic acid Substances 0.000 description 1
- 235000010443 alginic acid Nutrition 0.000 description 1
- 239000001099 ammonium carbonate Substances 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000000648 calcium alginate Substances 0.000 description 1
- 235000010410 calcium alginate Nutrition 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000000593 degrading effect Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000000737 potassium alginate Substances 0.000 description 1
- 235000010408 potassium alginate Nutrition 0.000 description 1
- BWHMMNNQKKPAPP-UHFFFAOYSA-L potassium carbonate Substances [K+].[K+].[O-]C([O-])=O BWHMMNNQKKPAPP-UHFFFAOYSA-L 0.000 description 1
- CDBYLPFSWZWCQE-UHFFFAOYSA-L sodium carbonate Substances [Na+].[Na+].[O-]C([O-])=O CDBYLPFSWZWCQE-UHFFFAOYSA-L 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/119—Adaptive subdivision aspects, e.g. subdivision of a picture into rectangular or non-rectangular coding blocks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
Definitions
- the present invention relates generally to the technical field of video compression.
- It relates in particular to a method for encoding and decoding an image of a video sequence and associated device.
- Video compression standards such as HEVC and post HEVC ("High Efficiency Vido Coding” standards, described for example in “High Efficiency Video Coding, Coding Tools and Specification", Matthias Wien, Signais and Communication Technology, 2015) describe a step of prediction of part of the image to be coded from a reference image. This can be located in the same image as the zone considered (INTRA prediction mode), or in another image of the video sequence (INTER prediction mode).
- a mode of prediction of the elements of a block comprises a prediction of the value of a pixel of an image from that (s) of one or more of its neighbors. Different variants of this mode exist.
- a first variant is based on the prediction of a quantified residue as described in “CE8-related: Quantized residual BDPCM, Marta Karczewicz, Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO / IEC JTC 1 / SC 29 / WG 1 1, 14th Meeting: Geneva, CH, 19-27 March 2019 ”.
- a second variant is based on the values of reconstructed pixels, located in the vicinity of the considered area, as described in “CE8: BDPCM with horizontal / vertical predictor and independently decodable areas (test 8.3. 1b), Mohsen Abdoli, Gordon Clare, Félix Henry, Pierrick Philippe, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO / IEC JTC 1 / SC 29 / WG 1 1, 13th Meeting: Marrakech, MA, 9-18 Jan. 2019 ”.
- the invention proposes a method for coding an image of a video sequence, the image comprising at least two components, including a component representative of the luminance and a component representative of the chrominance, each component being partitioned into blocks, the method comprising coding of at least one block of the chrominance component, using a so-called BDPCM mode.
- Using the BDPCM mode for encoding a block of the chrominance component can improve the compression gain of the image.
- At least one block of the chrominance component can be encoded using the BDPCM mode when a predetermined criterion is satisfied.
- the predetermined criterion is satisfied when said two components are of identical size.
- the criterion can also be an encoding criterion indicative of a choice made by an encoder able to implement the encoding method.
- This choice made by the encoder results, for example, from an analysis of the video sequence.
- the choice of the encoder can thus be a function of a histogram, in other words a statistical graph, representing the distribution of the intensities of the pixels of one or more images of the video sequence, that is to say the number of pixels for each light intensity.
- the encoding may further comprise the encoding of information indicative of the BDPCM mode used to encode the block of the chrominance component.
- an indicator indicating the use of the BDPCM mode, is coded for the block of the chrominance component.
- the invention also proposes a method for coding an image of a video sequence, the image comprising at least two components, including a component representative of the luminance and a component representative of the chrominance, each component being partitioned into blocks, the method comprising for at least one block of the chrominance component, an evaluation of a so-called BDPCM mode and another mode for encoding said block, and depending on the result of the evaluation, a selection of one of the modes to encode said block, and an encoding of information representative of the mode selected to encode said block.
- the BDPCM mode By evaluating the BDPCM mode for at least one block of the chrominance component, the BDPCM mode can be applied if the result of the evaluation is satisfactory. The gain in compression of the image is thus improved. The chrominance components for which it is not relevant to apply the BDPCM mode can thus be discarded, if the evaluation does not give a satisfactory result.
- the BDPCM mode and the other mode can be evaluated for at least one block of the chrominance component when a predetermined criterion is satisfied.
- the predetermined criterion can be satisfied when said two components are of identical size.
- the encoding may further comprise the encoding of information indicating the sampling format of the image, said information being indicative of the sizes of said components.
- the evaluation can include coding of the block of the chrominance component considered according to the BDPCM mode on the one hand and according to the other mode on the other hand, and according to another criterion. predetermined (for example a rate-distortion cost), a selection of the block encoded according to the BDPCM mode or of the block encoded according to the other mode.
- the method can further comprise, for at least one block of the luminance component, an evaluation of the so-called BDPCM mode and of the other mode for encoding said block of the luminance component, and as a function of from the result of the evaluation, a coding of information representative of one of the modes for coding said block of the luminance component.
- the components preferably have the same partitioning into blocks, the coding of the image being carried out block by block.
- the coding of the image can be carried out component by component.
- the coding can also comprise, for the image considered,
- the method can comprise, for at least one block of the chrominance component, if the second information relating to said image indicates that the BDPCM mode can be used to code at least one block of the chrominance component. of the image, the encoding of an indicator relating to at least one block of the chrominance component, indicating that the BDPCM mode is used to encode said block of the chrominance component.
- the method can comprise for at least one block of the chrominance component, if said criterion is satisfied, the coding of an indicator relating to said block, indicating that the BDPCM mode is used to code said block. of the chrominance component.
- the image further comprises a second chrominance component having the same partitioning as the other chrominance component, and if the BDPCM mode is selected for the block of the other chrominance component, said information relating to the block of the other chrominance component may include an indicator indicating that the BDPCM mode is selected for the block of the other chrominance component and the corresponding block of the second chrominance component, and a direction indicator, allowing determining a block predictor for the block of the other chrominance component and the corresponding block of the second chrominance component.
- a block is formed of elements
- the coding of a block using the BDPCM mode can comprise, for at least one element of the block, the coding of a quantized value of a residue , representative of a difference between a first and a second value, the first value corresponding to a value quantified of a difference between the value of the element considered and a reference element whose position is indicated by the given direction, and the second value corresponding to the quantized value of a difference between said other element and another element of reference signaled by the given direction.
- the invention also proposes a method of coding an image of a video sequence comprising at least two components, including a component representative of the luminance and a component representative of the chrominance, the components of luminance and of chrominance having the same partitioning into blocks, the method can comprise for at least one block of the luminance component, an evaluation of a mode called BDPCM and of another mode for encoding said block, and
- said information relates to the block of the luminance component, and comprises an indicator indicating that the mode selected for the block of the luminance component and for the corresponding block of the chrominance component is the BDPCM mode and a direction indicator for determining a block predictor for the block of the luminance component and for the corresponding block of the chrominance component.
- the invention also proposes a method for decoding an encoded image, from a stream of encoded video data, the image comprising at least two components, including a component representative of the luminance and a component. representative of the chrominance, each component being partitioned into blocks, the method comprising a decoding of information indicating for at least one block of the chrominance component, whether or not it is encoded using a mode called BDPCM .
- the decoded value of said information may also be used to indicate whether the corresponding block of the second chrominance component is encoded using a so-called BDPCM mode.
- Said decoded value of said information may also indicate a direction, making it possible, on the basis of respective block predictors, a function of said direction, to decode the block of said (first) chrominance component and the corresponding block of the second chrominance component.
- the invention also proposes a method for decoding an encoded image, from a stream of encoded video data, the image comprising at least two components, including a component representative of the luminance and a component. representative of the chrominance, each component being partitioned into blocks, the method comprising a decoding of a first item of information representative of an encoding criterion, and if the decoded value of the information indicates that the encoding criterion is satisfied, decoding of a second item of information indicating, for at least one block of the chrominance component, whether or not it is encoded using a so-called BDPCM mode.
- the image can further comprise a second chrominance component having the same partitioning as the other chrominance component, and the decoded value of the second information is also used for indicate whether the corresponding block of the second chrominance component is encoded using a so-called BDPCM mode, said decoded value of the second information being able also to indicate a direction, allowing from respective block predictors, a function of said direction, to decode the block of the other chrominance component and the corresponding block of the second chrominance component.
- the method may further comprise decoding other information indicating for at least one block of the chrominance component, whether it is encoded using a so-called BDPCM mode.
- the encoding criterion may for example be indicative of a choice made by an encoder having encoded said video data stream. This choice made by the encoder may result from an analysis of the video data stream.
- the invention also proposes a method of decoding an encoded image, from a stream of encoded video data, the image comprising at least two components, including a component representative of the luminance and a component representative of the chrominance, each component being partitioned into blocks, the method comprising a decoding of a first item of information relating to at least said image, indicating that the BDPCM mode can be used to decode at least one block of at least one component of the image, and if the first item of information indicates that the BDPCM mode can be used to decode at least one block of at least one component of the image, decoding of a second item of information relating to at least said image, indicating that the BDPCM mode can be used to decode at least one block of the chrominance component of the picture.
- the method can also comprise, if the second information relating to said image indicates that the BDPCM mode can be used to decode at least one block of the chrominance component of the image, the decoding an indicator relating to said at least one block of the chrominance component, indicating that the BDPCM mode can be used to decode said block of the chrominance component.
- the invention also proposes a method for decoding an encoded image, from a stream of encoded video data, the image comprising at least two components, including a component representative of the luminance and a component. representative of the chrominance having the same partitioning into blocks, the method comprising a decoding of a first item of information representative of an encoding criterion, and if the decoded value of the information indicates that the encoding criterion is satisfied, a decoding of a second item of information relating to at least one block of the luminance component indicating whether the block of the luminance component and the corresponding block of the chrominance component are or are not encoded using a so-called BDPCM mode .
- the invention also proposes a device for encoding an image of a video sequence, the image comprising at least two components, including a component representative of the luminance and a component representative of the chrominance, each component being partitioned into blocks, the device comprising at least one microprocessor configured to implement an encoding of at least one block of the chrominance component, using a mode called BDPCM.
- the invention also proposes a device for decoding an encoded image from a stream of encoded video data, the image comprising at least two components, including a component representative of the luminance and a component representative of the chrominance, each component being partitioned into blocks, the device comprising at least one microprocessor configured to implement a decoding of information indicating for at least one block of the chrominance component, whether it is encoded or not using a mode called BDPCM.
- FIG. 2 illustrates different color components according to a given color format
- FIG. 3 shows a first mode of implementation of a coding method according to the invention
- FIG. 4 shows a second embodiment of a coding method according to the invention
- FIG. 5 shows a third embodiment of a coding method according to the invention
- FIG. 6 shows a fourth embodiment of a coding method according to the invention.
- FIG. 7 shows a fifth embodiment of an encoding method according to the invention.
- FIG. 8 shows a first mode of implementation of a decoding method according to the invention
- FIG. 9 shows a second embodiment of a decoding method according to the invention.
- FIG. 10 illustrates an exemplary implementation of a step of an embodiment of an encoding / decoding method according to the invention.
- FIG. 11 schematically illustrates an embodiment of a device according to the invention.
- FIG. 1 illustrates for a given color standard (for example for the “YUV” or “YCbCr” standard), different sampling patterns which can be applied to components representative of the chrominance of an image.
- an image comprises a component representative of the luminance referenced Y here (hereinafter called “luminance component” or “luma” for the purposes of simplification), and two chrominance components (hereinafter called “chrominance component” or “chroma” for simplicity).
- luminance component or “luma” for the purposes of simplification
- chrominance component” or “chroma” chroma
- Figure 1 illustrates three formats, each associated with a sampling pattern, for an image area consisting of 8 pixels Pxi, forming two blocks of 2 pixels by 2 pixels. Since human vision is less sensitive to color than to brightness, less chrominance information is generally retained than luminance information without degrading the perceived quality of the image.
- Each pixel Pxi comprises three color components.
- the chrominance components are downsampled for every other pixel.
- Each component is partitioned into BLC blocks.
- the partitioning into blocks may be identical for each of the components as illustrated in FIG. 2 or particular for one or a set of components.
- a step E1 it is proposed to code, during a step E1, at least one block of the chrominance component according to a mode called BDPCM (for “Block Differential Poise Code Modulation”) , in particular when a predetermined criterion CT is satisfied.
- BDPCM Block Differential Poise Code Modulation
- the BDPCM mode can for example be applied by default.
- encoding criteria are not linked to the quality of the compression itself, but to a decision by the encoder to use or not a tool depending on considerations such as: encoding time, relevance of the tool in question for the type of content to be encoded, the energy consumption, or the targeted bit rate (this list is not exhaustive).
- an encoding criterion is a general choice of the encoder, in relation to an encoding context that can evolve from one content to another or in relation to a targeted performance to another. It is thus distinguished from a criterion which is based solely on local information specific to a given block or which results from an implementation choice made by a user.
- a direction information item for example a indicator
- the indicator is representative of a vertical or horizontal direction.
- an INTRA type prediction is performed on the elements of the block considered initially. This prediction is identical to that described in the HEVC standard. Thus, if the direction indicator for the block corresponds to a horizontal direction, it is the horizontal INTRA prediction which is applied, i.e. the value of the element of the considered block is predicted ( or one of its components), from the value of the neighboring element, to the left of this element. Otherwise, the vertical INTRA prediction is applied, i.e. the value of the element of the block considered (or of one of its components) is predicted from the value of a neighboring element above this element.
- the value of the element of the luminance component of the predicted considered block, located in row i and column j of the block, is referenced by P (i, j), the elements of a block being organized in rows and columns (i and j being integers).
- the prediction residue RES1 of each element P (i, j) is calculated as below:
- PRED1 (i, j) is a predictor equal to the element to the left of P (i, j), REFLEFT (i, j), if the prediction direction defined is horizontal or to the element above P (i, j), REFTOP (ij), if the prediction direction defined is vertical.
- R (i, 0) QRES1 (i, 0)
- R (i, j) QRES1 (i, j) - QRES1 (i, j-1) for 10
- R (i, j) QRES1 (i, j) - QRES1 (i-1, j) for i 10
- a direction information item for example an indicator
- the elements are processed one after the other, in a predefined order. If the direction indicator matches the horizontal prediction direction, then all items in the first column of the block (left) are processed first, then all samples in the second column, and so on until the last column of the block. Within a column, the elements can be processed in parallel or in any order.
- a reference element called the predictor element, PRED2 (i, j) makes it possible to predict the element of the considered block located at the i th row of the j th column. He comes:
- REFLEFT (i) is the reference element (i.e. belonging to the decoded neighboring block) to the left of the block and to the i th line, and
- REC2 (i, j-1) is the reconstructed element of the considered block located at the i th row and at the j-1 th column (that is to say immediately to the left of the considered element).
- the predictor element PRED2 (i, j) to predict the element located at the i th row of the j th column of the block considered is obtained as follows:
- REFTOP (i) is the reference element (that is to say belonging to the decoded neighboring block) above the considered block and at the j th column;
- REC2 (i-1, j) is the decoded (or reconstructed) element of the considered block located at the i-1 st row and at the j th column (therefore, immediately above the current element).
- a corresponding residue RES2 (i, j) is then calculated by the difference between the original value of the element located at the i th row of the j th column of the block considered and PRED (ij).
- the residue RES2 (i, j) is quantified so as to obtain a quantified residue: QRES2 (i, j).
- the quantized residue obtained from an encoded video stream, transmitted to a decoder is then dequantized to obtain a dequantized residue: DQRES2 (i, j).
- REC2 (i, j) PRED2 (i, j) + DQRES2 (i, j), PRED2 (i, j). Note that REC2 (i, j) is used to predict the next element in the order of element processing.
- the quantization used in the aforementioned variants is a uniform scalar quantization
- the first and the second variant are equivalent. Indeed, if we assume that the prediction is horizontal (the reasoning is the same if it is vertical), and that the uniform scalar quantization uses a quantization step d. In this case, according to the first variant, a reconstructed element
- the reconstructed element is equal to the value of the reference element REFLEFT (i), to which is added the sum of the quantized values of the residues of the previously reconstructed elements, multiplied by the quantization step.
- REFLEFT the reference element
- the predetermined criterion CT to be satisfied may relate to the color format of the image. For example, when the image or several images or all the images of the video sequence is (are) not downsampled, the encoding of at least one block of the chrominance component (s) of one or more images is achieved using BDPCM mode.
- Another predetermined criterion CT may be a function of the overall content of one or more images or of the content of one of its components. The overall content can be analyzed by the encoder, using a histogram for example. Depending on the result of the analysis, the encoder chooses whether or not to implement a coding mode.
- an image or component of the image comprises images of a certain format such as “Screen Content” (literally “screen content” in French)
- the coding of at least one block of the chrominance component (s) of the image is performed using BDPCM mode.
- Another predetermined criterion may be the gain produced if the BDPCM mode is used to encode the block of the chrominance component, namely whether it is greater than a predetermined threshold or not.
- the list of criteria set out above is not exhaustive. Those skilled in the art will be able to use another criterion not mentioned here, which, when it is satisfied, involves the coding of at least one block of a chrominance component of an image.
- FIG. 4 illustrates another embodiment of the invention, comprising, in addition to step E1, a step E2 of encoding information indicative of the BDPCM mode used to encode the block of the chrominance component.
- This information can be a block-level binary indicator (that is to say relating to the block considered), which when activated for a block of the chrominance component, indicates that the BDPCM mode is used to encode the block in question.
- the information relating to a block of one chrominance component can also be valid for the corresponding block of the other chrominance component, if the two chrominance components have the same partitioning into blocks.
- a single indicator is reported at the block level of the first chrominance component. In other words, a single indicator indicates whether BDPCM mode is used to encode on the one hand a block of a (first) chrominance component and on the other hand the corresponding block in the other (or second) chrominance component.
- said information may further be indicative of a prediction direction, vertical or horizontal, as explained above.
- the direction information may be a binary indicator reported only for the block of the first chrominance component and also valid for the corresponding block of the second chrominance component.
- FIG. 5 illustrates another embodiment of the invention.
- This mode of implementation comprises a step E10 comprising, in particular if the criterion CT is satisfied, an evaluation of the BDPCM mode and of another mode for coding a block of the chrominance component.
- step E10 may be independent of criterion CT.
- the evaluation can be made on the corresponding luminance block and the selected mode can then be directly used to code the chrominance component.
- the other mode can be, for example, a coding mode with only an INTRA prediction or an INTER prediction mode as described for the HEVC standard.
- the evaluation here includes coding of the chrominance component of the block considered according to the BDPCM mode on the one hand and according to the other mode on the other hand.
- the block of the chrominance component encoded according to the BDPCM mode or the other mode is selected.
- This other predetermined criterion may for example be the bit rate-distortion cost. If this cost is greater than a given threshold, in this case the BDPCM mode is not used for encoding the chrominance component of the block considered.
- Step E11 then comprises an encoding of information representative of the other encoding mode for the block of the chrominance component.
- step E12 comprises encoding information representative of the BDPCM mode to encode the block of the chrominance component.
- Steps E1 1 and E12 may further include coding of information representative of the CT criterion, if this is taken into account in the previous step. For example, if the criterion to be satisfied is to have an identical size for the luminance and chrominance components, the steps E1 1 and E12 can also comprise the coding of information indicating the sampling format of the image. . If this information indicates that the color format is 4: 4: 4, then the CT criterion is satisfied, because the color components have the same size in this format.
- the information in a video sequence can potentially be in 4: 4: 4 or 4: 2: 0 format
- the information can be a binary indicator which when activated, signals that the image (or sequence if used at sequence level) is in 4: 4: 4 aspect ratio.
- FIG. 6 illustrates a mode of implementation of a coding of several components of a block of the image.
- the coding is carried out here component by component. All the blocks of the same component are coded before coding the blocks of another component.
- This mode of implementation is particularly suitable if the components do not have the same partitioning.
- a first component is considered, for example the luminance component. Then for this selected luminance component, we consider the first block, E401. This is coded according to a method chosen in step E402. For example, the method may include evaluating the BDPCM mode and another mode, then selecting the code block that results in the lowest bit rate-distortion cost. During a T2 test, it is verified that the coded block is the last of the component. If this is not the case, we go to the next block in step E403 until all the blocks of the luminance component are encoded.
- step E404 the first chrominance component for example.
- the first block of the new component is selected in step E401. Then this block is coded using one of the methods described above.
- the coding here can be a function of a predetermined criterion CT.
- the encoding of this chroma component may include an evaluation of the BDPCM mode and another mode, if the color aspect ratio of the whole picture or video clip is 4: 4: 4.
- the chrominance component block may be encoded using the selected mode to encode the corresponding luminance component block.
- the mode selected for the luminance component block is BDPCM mode, that is used by default to encode the corresponding block of the chrominance component.
- test T2 we go to the next block E403. The process is repeated until all the blocks of the last component are processed, test T3.
- the process can be repeated for all the images making up the video sequence.
- FIG. 7 illustrates another embodiment for the coding of several components of a block of the image.
- the coding is carried out here block by block. All the components of the same block are coded before coding the next block.
- the components preferably have the same partitioning into blocks.
- a first block is obtained (for example, located at the top left of the image).
- the order of travel of the blocks is assumed to be known here.
- the luminance component of this block is encoded in step E501.
- the first chrominance component of this block is in turn encoded in step E502 according to one of the methods described above, possibly according to a CT criterion.
- the second chrominance component is encoded in step E503 according to one of the methods described above, possibly according to a CT criterion.
- the encoding mode used for the first chrominance component of the block is used by default for the encoding of the second chrominance component of the block.
- test T5 we consider the next block. The process is repeated until the last block.
- the chrominances of the block can be encoded using the mode selected to encode the luminance of the block. For example, if the mode selected to encode the luminance component of the block is BDPCM mode, this is automatically used to encode the chrominance components of the block.
- At least two components of the block considered are coded in parallel.
- the process can be repeated for all the images making up the video sequence.
- the coding according to the embodiments of FIGS. 6 and 7 in particular, can comprise, for each image or for the whole of the video sequence, the coding of information indicating whether the criterion CT is satisfied or not.
- This information to be an indicator of the color format of the image or (all) images in the video sequence.
- the indicator can signal that the input image is in 4: 2: 0 format (CT criterion not satisfied) or 4: 4: 4 format (CT criterion satisfied).
- the embodiments of FIGS. 6 and 7 can comprise, for at least one image, the coding of a first item of information, indicating that the BDPCM mode can be used to encode at least one block of at least one component. of the image.
- the first information indicates that the BDPCM mode can be used to encode at least one block of at least one component of the image
- an encoding of a second information relating to at least said image indicating that the BDPCM mode can be used to encode at least one block of the chrominance component of the image.
- the first and second information can relate to each frame of a video sequence for better dynamics, or to the entire video sequence.
- a flag can be encoded for the block in question. This indicator, when activated, indicates that BDPCM mode is used for the block in question.
- FIG. 10 illustrates an example of implementation of this first and this second information at image level.
- FL1, FL2, FL3 and FL4 are considered here.
- BDPCM mode can be used for at least one component of the image.
- the BDPCM mode can be used for at least one block of a chrominance component of the image.
- Another flag, FL3, can be used to signal the use of another encoding mode.
- the other encoding mode can be a default mode. In this case, no indicator is used.
- the FL1 and FL2 flags are both turned on.
- the indicators FL3 and FL4 for a block of the luminance component Y of this image IM1 can then take the values 0 and 1 respectively, indicating that the BDPCM mode is used to code the block concerned.
- the FL3 and FL4 indicators for a block of the chrominance component here Cb of this image IM1 can take the values “0” and “1” respectively, indicating that the BDPCM mode is used to encode the block concerned.
- the FL1 flag is enabled for an IM2 image.
- the FL2 flag is off.
- the indicators FL3 and FL4 for a block of the luminance component Y of this image IM1 can then take the values 0 and 1 respectively, indicating that the BDPCM mode is used to code the block concerned.
- Only one FL3 flag is encoded for the block of the chrominance component here Cb, of the image IM2, because the FL2 flag does not allow the use of the BDPCM mode to encode a block of the chrominance component.
- the FL3 flag is activated indicating that INTRA mode is being used to encode this block. If it was disabled, another encoding mode could be used (eg INTER mode). Alternatively, no flag is encoded for this block of the chrominance component.
- the encoding mode is a default mode.
- FL1 and FL2 flags avoids encoding (and subsequently decoding) one flag for each block of luminance and / or chrominance, when BDPCM mode is not used in the picture .
- the coding can comprise, for each image or for the whole of the video sequence, the coding of information indicating that the partitioning of the components is identical or not for luminance and chrominances. This flag may signal a first partitioning for the luminance component and a second partitioning for the two chrominance components.
- the coding of the blocks according to the embodiments of Figures 6 and 7 can include if the BDPCM mode is selected for a component, a coding of a coding direction (vertical or horizontal). This direction can be coded for the block of luminance and a single chrominance component. The direction coded for the block of the chrominance component is by default valid for the corresponding block of the second chrominance component.
- the coding according to the embodiments of FIGS. 6 and 7 can further comprise the coding of a first item of information relating to the image, capable of indicating whether the BDPCM mode can be used to encode at least one component of minus one block of the image, and if the first information indicates that the BDPCM can be used to encode at least one component of at least one block of the image, an encoding of a second item of information relating to said image, capable of indicating that the BDPCM mode can be used to encode the chrominance component d 'at least one block of the image.
- this information may include a first indicator indicating the mode used for the luminance component block and a second indicator indicating the mode used for the chrominance component block.
- this information may comprise a single indicator indicating the mode used for the block of the luminance component and the mode used for the block of the chrominance component (s).
- this information may include a first indicator indicating the mode used for the block of the luminance component and a single second indicator indicating the mode used for the block of the two chrominance components.
- FIGS. 8 and 9 illustrate two embodiments of a method for decoding a stream of encoded data representative of the image or images of a video sequence, according to the invention. These figures correspond respectively to the embodiments of Figures 6 and 7.
- the mode of implementation can comprise beforehand a step E599 of decoding a first coded information item, relating to the image (or to the video sequence) to which the component belongs, indicating whether the BDPCM mode is used or not for coding at least one component of at least one block of the image.
- This first information corresponds to the FL1 indicator in figure 10.
- a second information relating to said image is decoded.
- This second piece of information corresponding to the FL2 flag in Figure 10, indicates that BDPCM mode was used to encode the chrominance component of at least one block of the image.
- the prior step E599 may comprise a decoding of information representative of a predetermined criterion, for example the color format of the considered image (or of all the images of the video sequence).
- a predetermined criterion for example the color format of the considered image (or of all the images of the video sequence).
- the BDPCM mode may or may not have been used for encoding a chrominance component of a block, and corresponding information may be decoded for the block of this chrominance component.
- step E599 the decoding is carried out here component by component. All the blocks of the same component are decoded before decoding the blocks of another component.
- a first step E600 the encoded data representative of a first component, for example the luminance component, is considered. Then for this luminance component, we consider the encoded data of the first block in the order of decoding, in step E601.
- an item of information for example the indicators FL3, FL4 in FIG. 10 indicating for this block of the luminance component, if it is encoded using a so-called mode. BDPCM or other mode.
- the block of the luminance component is decoded with one or the other mode. During a T6 test, it is verified that the decoded block is not the last of the processed component. If not, we go to the next block in step E603 until all the blocks of the luminance component are decoded.
- the encoded data of another component is obtained in step E604, the first chrominance component for example.
- the coded data relating to the first block of the new component are selected in step E601.
- Information representative of the coding mode used for the block of the considered chrominance component can be is decoded (for example an indicator FL3 or the indicators FL3, FL4 of FIG. 10). If authorized by the second information decoded during step E599, this information representative of the encoding mode can indicate the BDPCM mode. If not authorized by the second information decoded during step E599, this information representative of the encoding mode can signal another mode as explained with reference to FIG. 10.
- the encoding mode used can be a default mode, for example the INTRA mode.
- the chrominance block can be decoded using the mode that was used to encode the corresponding luminance component block.
- test T6 we go to the next block E603. The process is repeated until all the blocks of the last component are processed, test T7.
- the process is repeated here so that all of the encoded data of the video data stream is processed.
- FIG. 9 illustrates another mode of implementation for the decoding of several components of a block of the image.
- the decoding is done here block by block. All the components of the same block are decoded before decoding the next block.
- the components preferably have the same partitioning.
- the method may include a preliminary step E699, similar to step E599 described above.
- the coded data corresponding to a first block are obtained E700.
- the order of travel of the blocks is assumed to be known here.
- Information indicative of the encoding mode which was used to encode the luminance component is decoded (eg FL3, FL4).
- the luminance component of this block is decoded in step E701 from this decoded encoding mode information.
- the information decoded during the decoding of the luminance component can also indicate the encoding mode of the chrominance component of the block considered, if for example it is encoded on two bits or then by being a default mode for all the components. of the block concerned.
- the first chrominance component of this block is in turn decoded in step E702 using the mode indicated by the decoded information item, this mode possibly being the BDPCM mode.
- the second chrominance component is decoded in step E703 according to one of the methods described above.
- the encoding mode used for the first chrominance component of the block is automatically used for the decoding of the second chrominance component of the block.
- test T5 we consider the next block. The process is repeated until the last block.
- At least two components of the block considered are decoded in parallel. The process is repeated here so that all of the encoded data of the video data stream is processed.
- the steps of the coding method are implemented by computer program instructions.
- the coding device 800 or the decoding device 900 has the conventional architecture of a computer and includes in particular a MEM memory 801, 901, a processing unit UT 802, 902, equipped for example with at least one microprocessor P 1, and controlled by the computer program Pg 803 stored in memory MEM.
- the computer program Pg comprises instructions for implementing the steps of the encoding or decoding method as described above, when the program is executed by the microprocessor.
- the code instructions of the computer program Pg are for example loaded into a RAM memory before being executed by the processor.
- the processor of the processing unit UT notably implements the steps of the encoding or decoding method described above in these various variant embodiments, according to the instructions of the computer program Pg.
- the device 800, 900 can be arranged to cooperate at least with the following modules of an AND terminal:
- a data transmission / reception I / R module by means of which a binary stream or a compressed file FC is transmitted in a telecommunications network, for example a wired network or a wireless network; and a module M for storing the image or the sequence of images to be encoded, the encoded data stream / file obtained or the image or the sequence of images decoded.
- the device 800 for coding an image of a video sequence comprises at least two components, including a component representative of the luminance and a component representative of the chrominance, each component being partitioned into blocks, comprises at least one microprocessor configured to implement a coding of at least one block of the chrominance component, using a so-called BDPCM mode.
- the device 800 for coding an image of a video sequence comprises at least one microprocessor configured to implement for at least one block of the chrominance component, an evaluation of a so-called BDPCM mode and of another mode for encoding said block, and as a function of the result of the evaluation, selection of one of the modes for coding said block, and coding of information representative of the mode selected for coding said block.
- the device 900 for decoding an image encoded from a stream of encoded video data comprising at least two components, including a component representative of the luminance and a component representative of the chrominance , each component being partitioned into blocks, the device comprising at least one microprocessor configured to implement a decoding of information indicating for at least one block of the chrominance component, whether it is encoded or not using d 'a mode called BDPCM.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Color Television Systems (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1906871A FR3098073B1 (en) | 2019-06-25 | 2019-06-25 | Method for encoding and decoding an image of a video sequence and associated device |
PCT/EP2020/067741 WO2020260412A1 (en) | 2019-06-25 | 2020-06-24 | Method for encoding and decoding an image of a video sequence, and associated device |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3991433A1 true EP3991433A1 (en) | 2022-05-04 |
Family
ID=68072754
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20734037.3A Pending EP3991433A1 (en) | 2019-06-25 | 2020-06-24 | Method for encoding and decoding an image of a video sequence, and associated device |
Country Status (7)
Country | Link |
---|---|
US (1) | US12113961B2 (en) |
EP (1) | EP3991433A1 (en) |
KR (1) | KR20220024714A (en) |
CN (1) | CN114051729A (en) |
BR (1) | BR112021025469A2 (en) |
FR (1) | FR3098073B1 (en) |
WO (1) | WO2020260412A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114930841A (en) * | 2020-01-10 | 2022-08-19 | Lg 电子株式会社 | BDPCM-based image decoding method for luminance component and chrominance component and apparatus thereof |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2531004A (en) * | 2014-10-06 | 2016-04-13 | Canon Kk | Residual colour transform signalled at sequence level for specific coding modes |
FR3046321B1 (en) | 2015-12-29 | 2018-01-26 | B<>Com | DIGITAL IMAGE ENCODING METHOD, DECODING METHOD, DEVICES, USER TERMINAL, AND ASSOCIATED COMPUTER PROGRAMS |
WO2017206803A1 (en) | 2016-05-28 | 2017-12-07 | Mediatek Inc. | Method and apparatus of current picture referencing for video coding |
FR3053555A1 (en) | 2016-06-29 | 2018-01-05 | B<>Com | METHOD FOR ENCODING A DIGITAL IMAGE, DECODING METHOD, DEVICES, TERMINAL AND COMPUTER PROGRAMS |
CA3137163C (en) | 2019-04-24 | 2024-05-14 | Bytedance Inc. | Constraints on quantized residual differential pulse code modulation representation of coded video |
-
2019
- 2019-06-25 FR FR1906871A patent/FR3098073B1/en active Active
-
2020
- 2020-06-24 US US17/622,094 patent/US12113961B2/en active Active
- 2020-06-24 CN CN202080046806.8A patent/CN114051729A/en active Pending
- 2020-06-24 EP EP20734037.3A patent/EP3991433A1/en active Pending
- 2020-06-24 WO PCT/EP2020/067741 patent/WO2020260412A1/en unknown
- 2020-06-24 BR BR112021025469A patent/BR112021025469A2/en unknown
- 2020-06-24 KR KR1020227001846A patent/KR20220024714A/en unknown
Also Published As
Publication number | Publication date |
---|---|
JP2022539552A (en) | 2022-09-12 |
FR3098073B1 (en) | 2021-09-24 |
KR20220024714A (en) | 2022-03-03 |
FR3098073A1 (en) | 2021-01-01 |
WO2020260412A1 (en) | 2020-12-30 |
BR112021025469A2 (en) | 2022-05-17 |
US12113961B2 (en) | 2024-10-08 |
CN114051729A (en) | 2022-02-15 |
US20220368889A1 (en) | 2022-11-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2446629B1 (en) | Methods of coding and decoding images, corresponding devices for coding and decoding, and computer program | |
EP2304963B1 (en) | Method and device for encoding images using improved prediction, and corresponding decoding method and device, signal and computer software | |
US20100104027A1 (en) | Adaptive preprocessing method using feature-extracted video maps | |
EP2446630B1 (en) | Encoding and decoding a video image sequence by image areas | |
FR2941581A1 (en) | Video image sequence coding method, involves identifying better candidate zone in set of candidate zones, minimizing reconstruction error with respect to target zone, and determining indication representing identified better candidate zone | |
EP2443835B1 (en) | Motion vector coding by competition within a set of predictors | |
EP3349446A1 (en) | Method and device for controlled dynamic encoding of a multidimensional digital signal, in particular an image signal, and corresponding decoding method and device | |
EP3991433A1 (en) | Method for encoding and decoding an image of a video sequence, and associated device | |
WO2018002474A1 (en) | Method for intra-coding of a digital image and corresponding decoding method | |
EP3238449A1 (en) | Method for encoding a digital image and associated decoding method, devices and computer programs | |
EP1714498B1 (en) | Method for determining the optimal prediction direction for video intra-prediction coding | |
EP4140136A1 (en) | Methods and devices for coding and decoding a multi-view video sequence | |
EP2160837B1 (en) | Selection of decoding functions distributed to the decoder | |
FR3103342A1 (en) | DIGITAL IMAGE COMPRESSION METHOD AND DEVICE AND ASSOCIATED DECOMPRESSION METHOD AND DEVICE | |
WO2004107761A1 (en) | Method for encoding and/or decoding groups of images | |
WO2020094703A1 (en) | Method and device for coding and decoding an image by block cutting into zones | |
FR3047381A1 (en) | METHOD AND DEVICE FOR ENCODING A MULTIDIMENSIONAL DIGITAL SIGNAL, IN PARTICULAR AN IMAGE SIGNAL, AND CORRESPONDING DECODING METHOD AND DEVICE | |
FR3098070A1 (en) | Video encoding and decoding method by signaling a candidate subset | |
WO2016132074A1 (en) | Encoding of images by vector quantization | |
EP1779663B1 (en) | Method for reducing the size of an image or video digital file | |
FR3046711A1 (en) | COMPRESSION AND DECOMPRESSION OF VIDEO DATA | |
FR2739234A1 (en) | Coding table device for HDTV variable length decoder | |
FR2987966A1 (en) | Method for coding e.g. H.264 coding, of video signal, involves assigning spatial prediction mode to set of pixels of image, and using assigned spatial prediction mode as predictor for spatial prediction mode for another set of pixels | |
FR3098071A1 (en) | Low latency video encoding and decoding process | |
EP4109900A1 (en) | Methods for decoding and encoding an image, associated devices and signal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20211217 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20240710 |