WO2011064926A1 - Dispositif de codage d'image, dispositif de décodage d'image, procédé de codage d'image, procédé de décodage d'image - Google Patents
Dispositif de codage d'image, dispositif de décodage d'image, procédé de codage d'image, procédé de décodage d'image Download PDFInfo
- Publication number
- WO2011064926A1 WO2011064926A1 PCT/JP2010/005547 JP2010005547W WO2011064926A1 WO 2011064926 A1 WO2011064926 A1 WO 2011064926A1 JP 2010005547 W JP2010005547 W JP 2010005547W WO 2011064926 A1 WO2011064926 A1 WO 2011064926A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- quantization parameter
- block
- image
- parameter corresponding
- quantization
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- the present invention relates to an image encoding device and an image encoding method for encoding an image, and an image decoding device and an image decoding method for decoding an image encoded by the image encoding device.
- FIG. 2 is an explanatory diagram showing a state of quantization processing described in a H.264 (MPEG-4AVC) recommendation (ITU-T Rec. H.264).
- H.264 a frame or field to be encoded is divided into blocks called “macroblocks” composed of pixels of 16 pixels ⁇ 16 lines, and a quantization parameter QP that can be changed for each macroblock is used. Quantize the orthogonally transformed coefficients.
- QP quantization parameter
- FIG. 2 is an explanatory diagram illustrating a partition of a macroblock used when performing motion compensation prediction processing defined in H.264.
- H. In H.264 as shown in FIG. 2, four types of block configurations are defined as macroblock partitions. That is, one block composed of 16 pixels ⁇ 16 lines, two blocks composed of 16 pixels ⁇ 8 lines, two blocks composed of 8 pixels ⁇ 16 lines, and four blocks composed of 8 pixels ⁇ 8 lines. Configuration is specified.
- sub-macroblock partitions are defined as shown in FIG. That is, the configuration of two blocks of 8 pixels ⁇ 4 lines, two blocks of 4 pixels ⁇ 8 lines, and four blocks of 4 pixels ⁇ 4 lines is defined.
- the number in the partition of the sub macroblock is a block index for specifying the position of the partition. Even if the sub-macroblock partitions are different, the quantization for orthogonal transform blocks in the same macroblock is always performed using the same quantization parameter.
- the subjective image quality of the part can be improved if the quantization parameter of the block including each pattern can be changed.
- the quantization parameter is changed for each subblock (orthogonal transform block, macroblock partition, or submacroblock partition) in the macroblock, the amount of information for the quantization parameter to be transmitted increases.
- Patent Document 1 discloses a method for changing a quantization parameter for an orthogonal transform block.
- FIG. 27 is a table showing variation values from quantization parameters for four orthogonal transform blocks of 8 ⁇ 8 pixels indicated by block numbers in a macroblock.
- the quantized code index determined to be optimal is transmitted for each slice (area composed of one or more continuous macroblocks defined in H.264) or for each macroblock. Is done.
- FIG. 28 is an explanatory diagram showing a quantization method for the orthogonal transform block.
- QP is a quantization parameter transmitted for each macroblock
- each of the 8 ⁇ 8 pixel orthogonal transform blocks is quantized with quantization parameters of QP + 1, QP + 1, QP-1, and QP-1.
- the 4 ⁇ 4 pixel orthogonal transform block indicates that the quantization is performed using the quantization parameter of the 8 ⁇ 8 pixel orthogonal transform block including the 4 ⁇ 4 pixel orthogonal transform block.
- FIG. 29 is a block diagram showing a conventional image encoding device, which realizes the quantization method described above. The outline of the operation of this image encoding apparatus will be described below.
- the prediction signal generation unit 201 inputs an input image to be encoded in units of macroblocks, the prediction signal generation unit 201 receives the H.264 signal. A prediction image is generated in all prediction modes defined in H.264, and a difference image between the prediction image and the input image is output to the orthogonal transform unit 203 via the quantization set selection unit 202.
- the orthogonal transform unit 203 Upon receiving the difference image between the predicted image and the input image, the orthogonal transform unit 203 performs orthogonal transform on the difference image and outputs the transform coefficient of the difference image to the quantization unit 204.
- the quantization unit 204 receives the transform coefficient of the difference image from the orthogonal transform unit 203, the quantization unit 204 refers to the quantization code table set by the encoding control unit 206 and performs the orthogonal transform when the orthogonal transform unit 203 performs the orthogonal transform.
- a quantization parameter corresponding to the orthogonal transform block to be used is acquired, and the transform coefficient of the difference image is quantized in units of orthogonal transform blocks using the quantization parameter.
- variable length coding section 205 receives the quantized transform coefficient from quantization section 204, variable length coding section 205 performs variable length coding on the transform coefficient.
- the transform coefficient of the difference image is quantized in units of orthogonal transform blocks, but is quantized in units of sub-macroblocks used when performing motion compensation prediction processing that significantly reflects the design. It is not a thing.
- a quantization code table must be created by always using four 8 ⁇ 8 pixel orthogonal transform blocks in a macroblock as a set, and the number of combinations of quantization parameter variation values is increased. As a result, the number of indexes in the quantization code table becomes enormous. Conversely, if the number of indexes in the quantization code table is reduced, the number of combinations of variation values of quantization parameters is extremely reduced.
- the block unit to be intra-coded is the same as that of the macroblock.
- the intra-code is used for each block in the macroblock. It is also possible to perform the conversion.
- a block to be encoded with intra and a block to be encoded with inter are mixed.
- intra coding and inter coding due to the difference in coding efficiency, if quantization is performed using the same quantization parameter, a large difference occurs in the amount of generated code.
- the quantization parameter cannot be changed in units of sub-macroblocks used when performing motion compensation prediction processing that significantly reflects the pattern. Also, unless the number of indexes in the quantization code table is increased enormously, the number of combinations of quantization parameter fluctuation values cannot be increased. For this reason, there is a problem that it is difficult to improve the image quality of the sub-macroblock whose image quality is visually significantly deteriorated in the macroblock.
- the intra block and the inter block are included in the same macro block.
- the blocks are mixed, it is difficult to control the code amount, and there is a problem that the image quality may be deteriorated.
- the present invention has been made to solve the above-described problems, and an image encoding device and an image encoding method capable of improving the image quality of a sub-block that is visually noticeably deteriorated in a macro block.
- the purpose is to obtain.
- Another object of the present invention is to obtain an image decoding device and an image decoding method applicable to the image encoding device.
- the present invention provides an image encoding device capable of preventing image quality deterioration by performing quantization on each block with different quantization parameters when an intra block and an inter block are mixed in the same macro block.
- An object is to obtain an image decoding device, an image encoding method, and an image decoding method.
- the image coding apparatus records a correspondence relationship between a quantization parameter corresponding to a macroblock and a quantization parameter corresponding to the subblock for each of various subblocks having a size smaller than that of the macroblock.
- a motion compensation prediction process performed when a prediction image is generated by the difference image generation unit among the conversion table storage unit storing the conversion table and the plurality of conversion tables stored by the conversion table storage unit.
- a quantization parameter conversion unit that converts a quantization parameter corresponding to the macroblock into a quantization parameter corresponding to the subblock with reference to a conversion table related to the subblock to be used, and the quantization unit generates a difference image
- the difference image generated by the means is orthogonally transformed and transformed by the quantization parameter transformation means Using a quantization parameter corresponding to the sub-blocks, the transform coefficients of the difference image is obtained so as to quantization.
- the conversion table that records the correspondence between the quantization parameter corresponding to the macro block and the quantization parameter corresponding to the sub-block is stored.
- Sub-table used in motion compensation prediction processing performed when a prediction image is generated by the difference image generation means among the plurality of conversion tables stored by the conversion table storage means and the conversion table storage means A quantization parameter conversion unit that converts a quantization parameter corresponding to the macroblock into a quantization parameter corresponding to the sub-block with reference to the conversion table related to the block, and the quantization unit is generated by the difference image generation unit;
- the sub-blocks obtained by orthogonal transformation of the difference image and transformed by the quantization parameter transformation means Since the conversion coefficient of the difference image is quantized using the quantization parameter corresponding to the image, the image quality of the sub-block where the image quality degradation is visually noticeable in the macro block can be improved. effective.
- H. 2 is an explanatory diagram illustrating a partition of a macroblock used when performing a motion compensation prediction process defined in H.264.
- H. 2 is an explanatory diagram showing sub-block partitions used when performing motion compensation prediction processing defined in H.264.
- FIG.2 (b) which consists of two 16x8 blocks.
- It is explanatory drawing which shows the example in which characters, such as a caption superimposition, are multiplexed on the input image (moving image).
- H. 2 is an explanatory diagram illustrating an intra prediction type defined in H.264. It is explanatory drawing which shows table ID corresponding to an intra prediction type and a division
- H It is explanatory drawing which shows the mode of the quantization process described in the H.264 recommendation. It is explanatory drawing which shows the orthogonal transformation block which performs quantization inside a macroblock. It is a table figure which shows the variation value from the quantization parameter with respect to four 8x8 orthogonal transformation blocks shown by a block number within a macroblock. It is explanatory drawing which shows the method of quantization with respect to an orthogonal transformation block. It is a block diagram which shows the conventional image coding apparatus.
- FIG. 1 is a block diagram showing an image coding apparatus according to Embodiment 1 of the present invention.
- H.264 which is an international standard for image coding systems.
- An example of an image encoding apparatus applied to H.264 (MPEG-4AVC) is shown, but an image encoding apparatus applied to another image encoding method may be used.
- an encoding unit 1 performs an encoding process on an input image in units of macroblocks under the instruction of the encoding control unit 2.
- the encoding control unit 2 performs quantization corresponding to a sub-block used when the motion compensation prediction process is performed by the encoding unit 1 and an orthogonal transform block used when a differential image described later is orthogonally transformed. Processing such as outputting parameters to the encoding unit 1 is performed.
- the intra prediction unit 11 of the encoding unit 1 selects an optimal intra prediction mode for each macroblock with respect to the input image, and local decoded images (encoded codes) that have already been encoded according to the intra prediction mode.
- a prediction image is generated from a local decoded image of a block or macroblock in the vicinity of the conversion target block, and a process of generating a difference image between the input image and the prediction image is performed.
- the motion search unit 12 performs a motion search by comparing the locally decoded image stored in the frame memory 23 with respect to the input image in units of macroblocks, and performs a process of calculating a motion vector.
- the motion compensated prediction unit 13 uses the motion vector calculated by the motion search unit 12 for the locally decoded image stored in the frame memory 23 in units of subblocks that are the same as the macroblock or smaller in size than the macroblock. By performing the motion compensation prediction process, a process for generating a predicted image is performed. In addition, a process of outputting partition information indicating a sub-block used when performing the motion compensation prediction process to the quantization control unit 33 of the encoding control unit 2 is performed.
- the differentiator 14 performs a process of generating a difference image by obtaining a difference between the input image and the predicted image generated by the motion compensation prediction unit 13.
- the intra prediction unit 11, the motion search unit 12, the motion compensation prediction unit 13, and the differentiator 14 constitute a difference image generation unit.
- the intra / inter determination unit 15 compares the prediction image generated by the intra prediction unit 11 with the prediction image generated by the motion compensation prediction unit 13 to determine an optimal prediction image, and the optimal prediction image is added to the adder 21. While outputting, the process which outputs the determination result which shows an optimal estimated image to the switch 16 and the entropy encoding part 24 is implemented. If the switch 16 indicates that the determination result output from the intra / inter determination unit 15 indicates that the prediction image generated by the intra prediction unit 11 is an optimal prediction image, the difference generated by the intra prediction unit 11 If an image is selected and output to the orthogonal transform unit 17 and indicates that the prediction image generated by the motion compensation prediction unit 13 is an optimal prediction image, the difference image generated by the subtractor 14 is selected. The process of outputting to the orthogonal transform unit 17 is performed.
- the orthogonal transform unit 17 performs orthogonal transform on the difference image output from the switch 16, outputs the transform coefficient of the difference image to the quantization unit 18, and uses the orthogonal transform block used when the difference image is orthogonally transformed.
- the process which outputs the orthogonal transformation block information which shows to the quantization control part 33 of the encoding control part 2 is implemented.
- the quantization unit 18 uses the quantization parameter corresponding to the orthogonal transform block transformed by the quantization control unit 33 of the encoding control unit 2 to convert the transform coefficient of the difference image output from the orthogonal transform unit 17 into the orthogonal transform block.
- a process of quantizing in units is performed. Note that the orthogonal transform unit 17 and the quantization unit 18 constitute quantization means.
- the inverse quantization unit 19 performs a process of inversely quantizing the transform coefficient quantized by the quantization unit 18 and outputting the transform coefficient corresponding to the transform coefficient output from the orthogonal transform unit 17 to the inverse orthogonal transform unit 20.
- the inverse orthogonal transform unit 20 performs an inverse orthogonal transform on the transform coefficient output from the inverse quantization unit 19 and outputs a difference image corresponding to the difference image output from the switch 16 to the adder 21.
- the adder 21 performs processing for adding the difference image output from the inverse orthogonal transform unit 20 and the prediction image selected by the intra / inter determination unit 15 to generate a local decoded image.
- the deblocking filter unit 22 performs a deblocking filter process on the local decoded image generated by the adder 21, compensates for distortion due to compression, and stores the local decoded image after distortion compensation in the frame memory 23. To do.
- the frame memory 23 is a recording medium that stores a locally decoded image after distortion compensation.
- the entropy encoding unit 24 is a set of a transform coefficient quantized by the quantization unit 18 and a table ID and a table offset value indicating a transform table output from the quantization control unit 33 of the encoding control unit 2, a flag, and a macro
- the quantization parameter QP corresponding to the block, the determination result output from the intra / inter determination unit 15, and the prediction image generation information used for generating the optimal prediction image (output from the intra / inter determination unit 15) If the determination result indicates that the prediction image generated by the intra prediction unit 11 is the optimal prediction image, the intra prediction mode selected by the intra prediction unit 11 and the prediction generated by the motion compensation prediction unit 13 If the image indicates that it is an optimal predicted image, the motion vector calculated by the motion search unit 12) And copy coding carries out a process of generating a bitstream.
- the entropy encoding unit 24 constitutes entropy encoding means.
- the transmission buffer 25 is connected to an external transmission means such as a line or a storage medium, for example, and temporarily holds the bit stream generated by the entropy encoding unit 24 and then performs processing for outputting the bit stream. To do.
- the character detection unit 31 of the encoding control unit 2 detects a character included in an input image in units of frames or macroblocks, for example, specifies a sub-block around the upper end of a character that generates a lot of mosquito noise. Then, processing for outputting character detection information of a block index indicating the presence / absence of character detection, the type of sub-block including the character when the character is detected, and the position of the sub-block is performed.
- the conversion table storage unit 32 stores a conversion table that records the correspondence between the quantization parameter corresponding to the macroblock and the quantization parameter corresponding to the subblock for each of the various subblocks having a size smaller than the macroblock.
- the conversion table storage unit 32 constitutes conversion table storage means.
- the quantization control unit 33 determines the quantum corresponding to the macro block from the buffer amount of the bit stream accumulated by the transmission buffer 25, the target code amount for each macro block, the code amount of the bit stream actually generated, and the like. A process for determining the activation parameter is performed. Also, the quantization control unit 33 refers to the conversion table related to the subblock indicated by the partition information output from the motion compensation prediction unit 13 among the plurality of conversion tables stored in the conversion table storage unit 32, and The quantization parameter corresponding to the block is converted into the quantization parameter corresponding to the subblock, or the macro is referred to by referring to the conversion table related to the orthogonal transform block indicated by the orthogonal transform block information output from the orthogonal transform unit 17.
- a process of converting the quantization parameter corresponding to the block into a quantization parameter corresponding to the orthogonal transform block is performed.
- the quantization parameter corresponding to the macroblock is changed to the quantization parameter corresponding to the subblock with reference to the conversion table related to the subblock indicated by the partition information output from the motion compensation prediction unit 13.
- the obtained quantization parameter is commonly used for all orthogonal transform blocks included in the partition.
- the quantization control unit 33 stores the type of the subblock including the character and the block index indicating the position of the subblock for one frame. To do. In the frame, the sub-block type and the block index of the sub-block are ranked in descending order of the number of detected characters. A table offset value indicating the amount of change in the correspondence between the quantization parameter corresponding to the macroblock and the quantization parameter corresponding to the subblock for all subblock types and the block index of the subblock according to the order. To decide. A corresponding table offset value is obtained from the determined table offset values based on the type of sub-block input from the motion compensation prediction unit 13 and its sub-block index (partition information).
- the correspondence relationship between the quantization parameter corresponding to the macroblock and the quantization parameter corresponding to the sub-block is changed according to the change amount indicated by the table offset value, and the quantization corresponding to the macroblock is changed according to the changed correspondence relationship.
- the parameter is converted into a quantization parameter corresponding to the sub-block.
- the quantization control unit 33 constitutes a quantization parameter conversion unit.
- the character detection unit 31 gives a table offset value to the quantization control unit 33, but a sub-block whose image quality is deteriorated compared to other sub-blocks is specified, and A processing unit other than the character detection unit 31 may be mounted as long as it is a processing unit that gives the type of sub-block and its sub-block index to the quantization control unit 33.
- the table offset value is determined before the encoding of the encoding target frame or slice is started.
- the table offset value determined for the frame or slice is applied.
- the table offset value determined by the character detection information of the previous frame is used.
- FIG. 7 is a block diagram showing an image decoding apparatus according to Embodiment 1 of the present invention.
- the reception buffer 51 performs a process of receiving the bit stream generated by the image encoding device of FIG. 1 and outputting the bit stream to the entropy decoding unit 52.
- the entropy decoding unit 52 entropy-decodes the bit stream output from the reception buffer 51, and dequantizes the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG.
- the quantization parameter corresponding to the table ID and table offset value set indicating the conversion table output from the quantization control unit 33, the flag, and the macroblock is output to the inverse quantization parameter generation unit 54.
- the process of outputting the determination result of the intra / inter determination unit 15 to the switch 59 is performed.
- the intra prediction mode that is the prediction image generation information is set to intra prediction. If it is output to the image generation unit 57 and the determination result of the intra / inter determination unit 15 indicates that the prediction image generated by the motion compensation prediction unit 13 is an optimal prediction image, the prediction image generation information is used.
- a process of outputting the type of a certain sub-block and its block index and motion vector to the inter predicted image generation unit 58 is performed.
- the entropy decoding unit 52 constitutes entropy decoding means.
- the conversion table storage unit 53 is a recording medium that stores the same conversion table as the conversion table storage unit 32 in the image encoding device of FIG. That is, for each of the various sub-blocks having a size smaller than the macro block, a conversion table that records the correspondence between the quantization parameter corresponding to the macro block and the quantization parameter corresponding to the sub-block is stored. This is a recording medium that stores a conversion table in which a correspondence relationship between a quantization parameter corresponding to a macroblock and a quantization parameter corresponding to the orthogonal transform block is stored for each of various orthogonal transform blocks.
- the conversion table storage unit 53 constitutes a conversion table storage unit.
- the inverse quantization parameter generation unit 54 selects a conversion table corresponding to the type of sub-block output from the inter prediction image generation unit 58 and the block index information among the plurality of conversion tables stored in the conversion table storage unit 53. Referring to FIG. 4, a process for converting the quantization parameter corresponding to the macroblock output from the entropy decoding unit 52 into a quantization parameter corresponding to the sub-block or the orthogonal transform block is performed.
- the dequantization parameter generation unit 54 outputs a set of table IDs and table offset values indicating the conversion table from the entropy decoding unit 52, and the types of sub-blocks output from the inter-predicted image generation unit 58 and their blocks
- the index information corresponds to the table ID indicating the conversion table
- the quantization parameter corresponding to the macroblock and the quantization parameter corresponding to the subblock are determined according to the change amount indicated by the table offset value.
- the quantization parameter corresponding to the macroblock is converted into the quantization parameter corresponding to the sub-block according to the changed correspondence.
- the inverse quantization parameter generation unit 54 constitutes a quantization parameter conversion unit.
- the inverse quantization unit 55 uses the quantization parameter corresponding to the sub-block or orthogonal transform block transformed by the inverse quantization parameter generation unit 54 to inverse the transform coefficient output from the entropy decoding unit 52 in units of orthogonal transform blocks.
- a process of quantizing and outputting a transform coefficient corresponding to the transform coefficient output from the orthogonal transform unit 17 in the image encoding device of FIG. 1 to the inverse orthogonal transform unit 56 is performed.
- the inverse orthogonal transform unit 56 performs inverse orthogonal transform on the transform coefficient output from the inverse quantization unit 55, and outputs a difference image corresponding to the difference image output from the switch 16 in the image encoding device in FIG. 1 to the adder 60. Perform the process.
- the inverse quantization unit 55 and the inverse orthogonal transform unit 56 constitute inverse quantization means.
- the intra prediction image generation unit 57 uses the decoded image generated by the adder 60 in the intra prediction mode, by the intra prediction unit 11 in the image encoding device in FIG. A process of generating a predicted image corresponding to the generated predicted image is performed.
- the inter prediction image generation unit 58 performs a motion compensation prediction process on the decoded image stored in the frame memory 62 in units of sub-blocks, so that the image code of FIG. The process which produces
- the switch 59 If the determination result of the intra / inter determination unit 15 output from the entropy decoding unit 52 indicates that the prediction image generated by the intra prediction unit 11 is the optimal prediction image, the switch 59 generates an intra prediction image.
- the prediction image generated by the unit 57 is output to the adder 60, and the determination result of the intra / inter determination unit 15 indicates that the prediction image generated by the motion compensation prediction unit 13 is the optimal prediction image.
- generation part 58 to the adder 60 is implemented.
- the intra predicted image generation unit 57, the inter predicted image generation unit 58, and the switch 59 constitute a predicted image generation unit.
- the adder 60 performs a process of adding the predicted image output from the switch 59 and the difference image output from the inverse orthogonal transform unit 56 to generate a decoded image.
- the adder 60 constitutes a decoded image generating means.
- the deblocking filter unit 61 performs a deblocking filter process on the decoded image generated by the adder 60 to compensate for distortion accompanying compression, and stores the decoded image after distortion compensation in the frame memory 62.
- the frame memory 62 is a recording medium for storing the decoded image after distortion compensation.
- the switch 63 performs a process of selecting the decoded image after distortion compensation by the deblocking filter unit 61 or the decoded image stored in the frame memory 62 in the display order and outputting the selected decoded image.
- the intra prediction unit 11 of the encoding unit 1 selects an optimal intra prediction mode for each macroblock with respect to the input image, and predicts the predicted image from the local decoded images in the vicinity that have already been encoded by the intra prediction mode. Is generated (step ST1 in FIG. 8).
- a technique for generating a predicted image by selecting an optimal intra prediction mode is a known technique, a detailed description thereof is omitted (see, for example, H.264).
- the intra prediction unit 11 When the intra prediction unit 11 generates a prediction image from a peripheral local decoded image that has already been encoded, the intra prediction unit 11 generates a difference image between the input image and the prediction image, and outputs the difference image to the switch 16 (step ST2). .
- the optimal intra prediction mode is output to the entropy encoding unit 24.
- the motion search unit 12 performs motion search by comparing the input image and the locally decoded image stored in the frame memory 23 in units of macro blocks, and calculates a motion vector. Since the motion vector calculation process is also a known technique, a detailed description thereof will be omitted (see, for example, H.264).
- the motion compensation prediction unit 13 uses the motion vector to be stored in the frame memory 23 in units of subblocks that are the same as the macroblock or smaller in size than the macroblock.
- a prediction image is generated by performing motion compensation prediction processing on the local decoded image (step ST3). Since the motion compensation prediction process is also a known technique, a detailed description thereof is omitted (for example, see H.264).
- FIG. 2 is an explanatory diagram illustrating a partition of a macroblock used when performing motion compensation prediction processing defined in H.264.
- A shows an example in which a macroblock is composed of one partition, and the partition is a 16 ⁇ 16 block.
- B shows an example in which a macroblock is composed of two partitions, and the two partitions are 16 ⁇ 8 blocks.
- C shows an example in which the macroblock is composed of two partitions, and the two partitions are 8 ⁇ 16 blocks.
- D shows an example in which a macroblock is composed of four partitions, and the four partitions are 8 ⁇ 8 blocks.
- the numbers in the macroblock partitions are block indexes for specifying the positions of the partitions.
- FIG. 2 is an explanatory diagram showing sub-block partitions used when performing motion compensation prediction processing defined in H.264.
- A shows an example in which a sub-block is composed of one partition and the partition is an 8 ⁇ 8 block.
- B shows an example in which the sub-block is composed of two partitions, and the two partitions are 8 ⁇ 4 blocks.
- C shows an example in which the sub-block is composed of two partitions, and the two partitions are 4 ⁇ 8 blocks.
- D shows an example in which the sub-block is composed of four partitions, and the four partitions are 4 ⁇ 4 blocks.
- the numbers in the sub-block partitions are block indexes for specifying the positions of the partitions.
- the motion compensation prediction unit 13 can perform motion compensation prediction that remarkably reflects the pattern even if the motion compensation prediction process is performed in units of macroblocks. If the motion compensation prediction process in units of subblock partitions as shown in FIG. 3 is also performed, the pattern can be reflected more remarkably. Therefore, in the first embodiment, the motion compensation prediction unit 13 performs motion compensation prediction in subblock units (macroblock partition units as shown in FIG. 2 or subblock partition units as shown in FIG. 3). It is assumed that a partition smaller than a macroblock or a sub-block partition is selected as the optimum motion compensation prediction.
- the quantization control of the coding control unit 2 indicates partition information indicating the sub-block (partition) used when performing the motion compensated prediction process.
- the difference unit 14 When the motion compensation prediction unit 13 generates a prediction image, the difference unit 14 generates a difference image by obtaining a difference between the input image and the prediction image, and outputs the difference image to the switch 16 (step ST4).
- the intra / inter determination unit 15 compares the two prediction images and determines an optimal prediction image.
- the most widely used method for determining the optimum predicted image is to use the value obtained by accumulating the absolute value of the difference or square of the difference of the pixel at the same pixel position in the input image and the predicted image as the evaluation value. To do. In this case, the smaller evaluation value is selected. Details are omitted.
- the intra / inter determination unit 15 determines an optimum predicted image
- the intra / inter determination unit 15 outputs the predicted image to the adder 21.
- the determination result indicating the optimum predicted image is output to the switch 16 and the entropy encoding unit 24.
- the switch 16 determines that the intra prediction unit 11 Is selected and output to the orthogonal transform unit 17 (step ST6).
- the determination result indicates that the prediction image generated by the motion compensation prediction unit 13 is an optimal prediction image (step ST5)
- the difference image generated by the differentiator 14 is selected and orthogonally transformed. It outputs to the part 17 (step ST7).
- the orthogonal transformation unit 17 When the orthogonal transformation unit 17 receives the difference image from the switch 16, it orthogonally transforms the difference image in units of orthogonal transformation blocks (4 ⁇ 4 blocks or 8 ⁇ 8 blocks) as shown in FIG.
- the conversion coefficient of the difference image is output to the quantization unit 18 (step ST8).
- orthogonal transform block information indicating an orthogonal transform block used when orthogonally transforming the difference image is output to the quantization control unit 33 of the encoding control unit 2.
- the quantization control unit 33 of the encoding control unit 2 determines the bitstream buffer amount accumulated by the transmission buffer 25, the target code amount for each macroblock, the bitstream code amount actually generated, and the like. Then, the quantization parameter QP corresponding to the macroblock is determined (step ST9). As a process for determining the quantization parameter QP corresponding to the macroblock, for example, there is a method called TM5 used in the MPEG-2 verification test (for example, the Journal of the Television Society, April 1995, Vol49, See No4). When determining the quantization parameter QP corresponding to the macroblock, the quantization control unit 33 converts the quantization parameter QP into a quantization parameter corresponding to the sub-block or the orthogonal transform block (step ST10). Hereinafter, the processing content of the quantization control part 33 is demonstrated concretely.
- the conversion table storage unit 32 of the encoding control unit 2 stores the quantization corresponding to the macroblock for each macroblock partition as shown in FIG. 2 or for each subblock partition as shown in FIG. It stores a conversion table that records the correspondence between parameters and quantization parameters corresponding to the partition.
- a conversion table that stores a correspondence relationship between the quantization parameter corresponding to the macro block and the quantization parameter corresponding to the orthogonal transform block is stored.
- QP indicates a quantization parameter corresponding to a macroblock
- the character detection unit 31 of the encoding control unit 2 inputs an image in units of one frame or a macro block, for example, a lot of mosquito noise is generated by detecting characters included in the input image. Identifies the sub-block around the top of the character. Since various techniques have been reported for character detection processing, detailed description thereof will be omitted. For example, when the character detection unit 31 identifies a sub-block around the upper end of a character that generates a lot of mosquito noise, the character detection unit 31 quantizes character detection information of a block index indicating the type of sub-block including the character and the position of the sub-block. Output to the control unit 33.
- FIG. 5 is an explanatory diagram showing an example in which characters such as a caption superimpose are multiplexed on an input image (moving image).
- the letter “B” is multiplexed, and the positional relationship between the 16 ⁇ 16 macroblock (the block indicated by the bold line) and the letter “B” is shown.
- four 8 ⁇ 8 blocks are selected as the optimum macroblock partitions from the result of motion compensation prediction, and the upper two 8 ⁇ 8 blocks are two in each case.
- An example in which the block is divided into sub-blocks (8 ⁇ 4 blocks) is shown.
- the numbers on the left in parentheses of each block indicate the block index that identifies the partition that constitutes the macroblock, and the numbers on the right indicate the block index that identifies the partition that constitutes the sub-block. .
- the quantization parameter corresponding to the partition of the 8 ⁇ 4 block (0, 1) (1, 1), which is a sub-block including the upper periphery of the character is smaller than the quantization parameter corresponding to the other partition.
- the table offset value is set as described above, it is possible to improve the deterioration of the sub-block including the vicinity of the upper end of the character.
- the quantization parameter of the macroblock itself is lowered in order to lower the quantization parameter corresponding to the subblock including the upper end of the character, the code amount in the subblocks other than the subblock including the upper end of the character is reduced. To increase. For this reason, since it is necessary to suppress the increase in the code amount, the quantization parameter corresponding to the macroblocks subsequent to the macroblock is increased, so that the image quality of other regions is deteriorated.
- the character detection unit 31 outputs to the quantization control unit 33 character detection information of a block index indicating the type of sub-block including the character and the position of the sub-block. To do.
- the character detection unit 31 provides the character detection information to the quantization control unit 33, but a subblock whose image quality is deteriorated compared to other subblocks is specified.
- the processing unit provides the quantization control unit 33 with the deterioration information of the block index indicating the type of sub-block and the position of the sub-block in which significant deterioration is detected, the processing unit other than the character detection unit 31 has a table offset. Information for changing the value may be given to the quantization control unit 33.
- the quantization control unit 33 identifies a conversion table to be referred to when converting the quantization parameter corresponding to the sub-block from the plurality of conversion tables stored in the conversion table storage unit 32. That is, if the sub-block (partition) indicated by the partition information output from the motion compensation prediction unit 13 is, for example, an 8 ⁇ 4 block (0, 1), the quantization control unit 33 uses an 8 ⁇ 4 block (0 , 1), for example, if it is 8 ⁇ 8 block (2, ⁇ ), the conversion table related to 8 ⁇ 8 block (2, ⁇ ) is referred to.
- the quantization control unit 33 specifies the conversion table to be referred to, based on the quantization parameter QP corresponding to the macroblock, the character detection information output from the character detection unit 31, deterioration information, and the like, as shown below. Is added with a predetermined table offset value to calculate the table index QP_table_index of the conversion table.
- QP_table_index QP + table offset value
- the sub-block in which the upper end of the character is most detected is detected.
- a table for lowering the quantization parameter such as “ ⁇ 5”
- An offset value is determined in advance.
- the sub-block indicated by the partition information output from the motion compensation prediction unit 13 is an 8 ⁇ 4 sub-block (0, 1) or (1, 1)
- “ ⁇ 5” is set as the table offset value. use.
- the quantization control unit 33 After calculating the table index QP_table_index of the conversion table, the quantization control unit 33 acquires the quantization parameter corresponding to the sub-block (partition) indicated by the partition information from the conversion table to be referenced using the table index QP_table_index as a key. To do. For example, when the conversion table shown in FIG. 4 is a conversion table to be referenced, if the table index QP_table_index is “20”, the quantization parameter corresponding to the sub-block is “18”. If the table index QP_table_index is “25”, the quantization parameter corresponding to the sub-block is “22”.
- the quantization control unit 33 When acquiring the quantization parameter corresponding to the sub-block indicated by the partition information, the quantization control unit 33 outputs the quantization parameter to the quantization unit 18. Further, the quantization control unit 33 refers to the table ID table of FIG. 6 stored by the conversion table storage unit 32, and refers to the conversion table that is determined in advance to use a table offset value other than “0”. A set of a table ID and a table offset value indicating the target conversion table is output to the entropy encoding unit 24 for each picture or slice. For example, if the sub block indicated by the partition information is 8 ⁇ 4 block (0, 1), the macro block partition is 8 ⁇ 8 block, the sub block partition is 8 ⁇ 4 block, and the block index is “1”. Therefore, the table ID is “7”.
- the reason why the set of the table offset value and the table ID indicating the conversion table using the table offset value is transmitted for each picture or slice is that the amount of bits is greatly increased if it is transmitted for each macroblock.
- the set of table ID and table offset value is multiplexed and transmitted in the picture header or slice header.
- the table offset value of the conversion table that has not been transmitted is used as a default value determined in advance between the encoding device and the decoding device, for example, “0”.
- a method of transmitting all table offset values of the conversion table for all sub-blocks in a predetermined order without assigning a table ID is also conceivable.
- a flag A indicating whether or not to convert from a quantization parameter corresponding to a macroblock to a quantization parameter corresponding to a sub-block is transmitted to the image decoding apparatus side.
- transforming When transforming is performed, the above-described operation is performed.
- sub-block quantization is performed using a quantization parameter corresponding to a macroblock.
- the flag A may be transmitted using one bit for each macroblock, and application / non-application may be switched for each macroblock.
- application is selected for a macroblock in which a character is detected by the character detection unit 31, and is not applied to a macroblock that has not been detected. Deterioration can be improved and adverse effects on other parts can be minimized.
- the quantization control unit 33 can change the quantization parameter for the sub-block in the sub-block unit in the motion compensation prediction in the quantization unit 18.
- the quantization parameter corresponding to the macroblock corresponds to the sub-block.
- the macro block is referred to with reference to the transform table related to the orthogonal transform block.
- the quantization parameter corresponding to is converted to the quantization parameter corresponding to the orthogonal transform block.
- a flag B indicating which conversion is to be performed is set to a picture or slice Transmit every time. Note that the method for converting to the quantization parameter corresponding to the orthogonal transform block is the same as the method for converting to the quantization parameter corresponding to the sub-block, and thus the description thereof is omitted.
- the quantization unit 18 When the quantization unit 18 receives the transform coefficient of the difference image from the orthogonal transform unit 17, the quantization unit 18 orthogonally transforms the transform coefficient of the difference image using the quantization parameter corresponding to the sub-block output from the quantization control unit 33. Quantization is performed in units of blocks (step ST11). The same quantization parameter is used for all orthogonal transform blocks included in the same sub-block.
- the inverse quantization unit 19 When the quantization unit 18 quantizes the transform coefficient of the difference image, the inverse quantization unit 19 inversely quantizes the transform coefficient so that the transform coefficient corresponding to the transform coefficient output from the orthogonal transform unit 17 is inverted. Output to the orthogonal transform unit 20.
- the inverse orthogonal transform unit 20 receives the transform coefficient from the inverse quantization unit 19, the inverse orthogonal transform is performed on the transform coefficient to output a difference image corresponding to the difference image output from the switch 16 to the adder 21. .
- the adder 21 adds the difference image output from the inverse orthogonal transform unit 20 and the prediction image selected by the intra / inter determination unit 15 to generate a local decoded image.
- the generated local decoded image is output to the deblocking filter unit 22 and is also output to the intra prediction unit 11 for generating a predicted image in intra prediction.
- the deblocking filter unit 22 performs deblocking filter processing on the local decoded image to compensate for distortion due to compression, and the distortion-compensated local decoded image is stored in the frame memory 23. To store.
- the entropy encoding unit 24 entropy encodes the following information to generate a bit stream (step ST12).
- a conversion coefficient quantized by the quantization unit 18 A table ID and table offset value set indicating a conversion table using a table offset value (a table ID indicating a conversion table and a set of table offset values are set for each picture or slice) (Entropy encoding is performed only when the picture header or slice header is transmitted.)
- the determination result of the intra / inter determination unit 15 The prediction image generation information used for generating the optimal prediction image (the prediction result generated by the intra prediction unit 11 based on the determination result output from the intra / inter determination unit 15) If the image indicates that it is an optimal prediction image, it indicates that the intra prediction mode selected by the intra prediction unit 11 and that the prediction image generated by the motion compensation prediction unit 13 is the optimal prediction image. For example, the motion vector calculated by the motion search unit 12) Other information (for example, flags A and B, quantization parameter QP corresponding to macroblock, etc.)
- the transmission buffer 25 temporarily holds the bit stream, and then transmits the bit stream to the image decoding device via an external transmission unit such as a line. Send.
- the correspondence between the quantization parameter corresponding to the macroblock and the quantization parameter corresponding to the subblock is provided.
- Motion compensation that is performed when a predicted image is generated from among a plurality of conversion tables stored in the conversion table storage unit 32 and a conversion table storage unit 32 that stores a conversion table that records the relationship.
- a quantization control unit 33 that converts a quantization parameter corresponding to the macroblock into a quantization parameter corresponding to the subblock with reference to a conversion table related to the subblock used in the prediction processing is provided.
- the orthogonal transformation unit 17 Since it is configured to quantize the orthogonal coefficient of the output difference image with orthogonal transform block brings in the macroblock, the effect that can be visually image deterioration to improve the image quality of significant sub-blocks.
- the reception buffer 51 receives the bit stream transmitted from the image encoding device in FIG. 1 and outputs the bit stream to the entropy decoding unit 52.
- the entropy decoding unit 52 performs entropy decoding on the bit stream (step ST21 in FIG. 9).
- the entropy decoding unit 52 outputs, to the inverse quantization unit 55, the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG.
- a table ID and table offset value set indicating the conversion table, flags A and B, quantization parameters corresponding to the macroblock, and the like are output to the inverse quantization parameter generation unit 54.
- the determination result of the intra / inter determination unit 15 is output to the switch 59. Furthermore, if the determination result of the intra / inter determination unit 15 indicates that the prediction image generated by the intra prediction unit 11 is an optimal prediction image, the intra prediction mode that is the prediction image generation information is intra predicted.
- the prediction image generation information is used.
- the type of a certain sub-block, its block index, and motion vector are output to the inter predicted image generation unit 58.
- the conversion table storage unit 53 stores the type of subblock output from the inter prediction image generation unit 58 and its block index information. Among the plurality of conversion tables (the conversion table storage unit 53 stores the same conversion table as the conversion table storage unit 32 in the image encoding device in FIG. 1), the corresponding conversion table is specified.
- a sub table is generated from the quantization parameter corresponding to the macroblock by the conversion table (conversion table referred to when converting the quantization parameter) indicated by the table ID.
- conversion table conversion table referred to when converting the quantization parameter
- conversion is performed using the table offset value received at the same time.
- the table offset value is used as a default value common to the encoding device and the decoding device, for example, “0”. For example, if the table ID is “7”, a conversion table having a macroblock partition of 8 ⁇ 8 blocks, a subblock partition of 8 ⁇ 4 blocks, and a block index of “1” is shown.
- the quantization control unit in the image encoding device in FIG. Similarly to 33, the quantization table parameter QP_table_index of the conversion table is calculated by adding the quantization parameter QP corresponding to the macroblock and the table offset value.
- QP_table_index QP + table offset value
- quantization such as “ ⁇ 5”
- a table offset value for lowering the parameter is transmitted from the image coding apparatus in FIG.
- the table offset value is not transmitted from the image coding apparatus in FIG.
- the inverse quantization parameter generation unit 54 After calculating the table index QP_table_index of the conversion table, the inverse quantization parameter generation unit 54 acquires the quantization parameter corresponding to the sub block from the conversion table using the table index QP_table_index as a key, and reverses the quantization parameter. It outputs to the quantization part 55 (step ST22). For example, when the conversion table shown in FIG. 4 is a conversion table to be referenced, if the table index QP_table_index is “20”, the quantization parameter corresponding to the sub-block is “18”. If the table index QP_table_index is “25”, the quantization parameter corresponding to the sub-block is “22”. When the flag A indicates that the quantization parameter corresponding to the macroblock is not converted to the quantization parameter corresponding to the sub-block, the quantization parameter corresponding to the macroblock is output to the inverse quantization unit 55.
- the inverse quantization parameter generation unit 54 converts the quantization parameter corresponding to the macro block into the quantization parameter corresponding to the sub block in the sub quantization unit 55 in the sub quantization unit 55.
- the inverse quantization unit 55 when the quantization parameter corresponding to the macro block is converted into the quantization parameter corresponding to the orthogonal transform block in units of the orthogonal transform block (the flag B is the quantization corresponding to the orthogonal transform block).
- the quantization parameter corresponding to the macroblock is converted into the orthogonal transformation block by referring to the transformation table related to the orthogonal transformation block based on the orthogonal transformation block size information output from the entropy decoding unit 52. Convert to the corresponding quantization parameter.
- the method for converting to the quantization parameter corresponding to the orthogonal transform block is the same as the method for converting to the quantization parameter corresponding to the sub-block, and thus the description thereof is omitted.
- the inverse quantization unit 55 uses the quantization parameter to convert the transform output from the entropy decoding unit 52.
- the inverse quantization unit 55 uses the quantization parameter to convert the transform output from the entropy decoding unit 52.
- transform coefficients corresponding to transform coefficients output from the orthogonal transform unit 17 in the image coding apparatus in FIG. 1 are output to the inverse orthogonal transform unit 56 (step ST23). .
- the transform coefficient output from the entropy decoding unit 52 is inversely quantized in units of orthogonal transform blocks using the quantization parameter.
- the transform coefficient corresponding to the transform coefficient output from the orthogonal transform unit 17 in the image encoding device in FIG. 1 is output to the inverse orthogonal transform unit 56.
- the inverse orthogonal transform unit 56 When receiving the transform coefficient from the inverse quantization unit 55, the inverse orthogonal transform unit 56 performs inverse orthogonal transform on the transform coefficient, thereby obtaining a difference corresponding to the difference image output from the switch 16 in the image encoding device in FIG. The image is output to the adder 60 (step ST24).
- the intra prediction image generation unit 57 uses the decoded image generated by the adder 60 in the intra prediction mode in the image encoding device of FIG.
- a prediction image corresponding to the prediction image generated by the intra prediction unit 11 is generated (step ST25).
- the inter prediction image generation unit 58 receives the motion vector as the prediction image generation information from the entropy decoding unit 52, the inter prediction image generation unit 58 performs a motion compensation prediction process on the decoded image stored in the frame memory 62 in units of sub-blocks.
- a prediction image corresponding to the prediction image generated by the motion compensation prediction unit 13 in the image encoding device of FIG. 1 is generated (step ST26).
- the switch 59 (step ST27).
- the prediction image generated by the intra prediction image generation unit 57 is output to the adder 60 (step ST28), and the determination result of the intra / inter determination unit 15 is the optimal prediction image generated by the motion compensation prediction unit 13. If it shows that it is a prediction image (step ST27), the prediction image produced
- the adder 60 adds the predicted image output from the switch 59 and the difference image output from the inverse orthogonal transform unit 56 to generate a decoded image, and outputs the decoded image to the deblocking filter unit 61 ( Step ST30).
- the deblocking filter unit 61 performs a deblocking filter process on the decoded image, compensates for distortion due to compression, and stores the decoded image after distortion compensation in the frame memory 62.
- the switch 63 selects the decoded image generated by the adder 60 or the decoded image stored in the frame memory 62 in the display order, and outputs the selected decoded image.
- the correspondence between the quantization parameter corresponding to the macroblock and the quantization parameter corresponding to the subblock is made.
- the sub-block output from the inter prediction image generation unit 58 An inverse quantization parameter generation unit 54 that converts a quantization parameter corresponding to a macroblock into a quantization parameter corresponding to a sub-block with reference to a conversion table indicated by the type and its block index information, and an inverse quantization unit 55 corresponds to the sub-block transformed by the inverse quantization parameter generation unit 54 Since the transform coefficient output from the entropy decoding unit 52 is inversely quantized using the orthogonalization block unit by using the child parameter, the image quality of the sub-block that is visually noticeably degraded in the macroblock. There is an effect that can be improved.
- H.264 is used.
- the example applied to the encoding based on H.264 has been described.
- the orthogonal transform block in the macroblock is fixed to one of 4 ⁇ 4 block and 8 ⁇ 8 block.
- other sizes of orthogonal transform blocks such as 16 ⁇ 16, 32 ⁇ 32, 64 ⁇ 64, 128 ⁇ 128, or 16 ⁇ 8, 4 ⁇ 16, 32 ⁇ 16, etc.
- a plurality of types of orthogonal transform blocks may be mixed in a macro block including a rectangular orthogonal transform block.
- each orthogonal transform block is not increased so much in bit amount. Therefore, quantization can be performed with a quantization parameter different from the quantization parameter corresponding to the macroblock, and the method can be applied to a future encoding method.
- the ability to change the quantization parameter in units of sub-blocks is more effective in improving image quality.
- Embodiment 2 FIG.
- the image encoding device and the image decoding device hold a common conversion table, and the quantization parameter corresponding to the sub-block (orthogonal transform block) recorded by the common conversion table is not updated.
- the quantization parameter corresponding to the sub-block recorded by the conversion table may be updated as necessary.
- 51 quantization parameters are stored in the column QP_part16 ⁇ 8_idx0 as quantization parameters corresponding to the partition (16 ⁇ 8 block) with the block index “0”. 45 quantization parameters) are recorded, but these 51 quantization parameters may be updated in units of pictures or slices.
- the conversion table storage unit 32 of the image encoding device and the conversion table storage unit 53 of the image decoding device separately record the contents of 51 quantization parameters recorded in the conversion table shown in FIG. 4 as default values. .
- the quantization control unit 33 of the image encoding device among the plurality of conversion tables stored by the conversion table storage unit 32 is the update target.
- the conversion table is specified, and the 51 quantization parameters recorded by the conversion table are updated as appropriate (overwrite the updated 51 quantization parameters to the conversion table).
- the method for updating the quantization parameter is not particularly limited. For example, when it is necessary to change the maximum value of the quantization parameter, the quantization parameter may be updated under a user instruction.
- parameter update information indicating the updated 51 quantization parameters in a set with the table ID (including information for specifying a conversion table to be changed). Is output to the entropy encoding unit 24.
- the entropy encoding unit 24 performs entropy encoding by multiplexing the table ID and the parameter update information as a set in the picture header or slice header. And parameter update information is transmitted to the image decoding apparatus in units of pictures or slices.
- the entropy decoding unit 52 of the image decoding apparatus performs entropy decoding on the bit stream, and outputs the table ID and parameter update information in the decoded data of the bit stream to the inverse quantization parameter generation unit 54.
- the inverse quantization parameter generation unit 54 receives the parameter update information as a set with the table ID from the entropy decoding unit 52, the inverse quantization parameter generation unit 54 refers to the parameter update information, identifies the conversion table to be changed, and according to the parameter update information, The 51 quantization parameters recorded by the conversion table are updated (overwrite 51 updated quantization parameters to the conversion table).
- the inverse quantization parameter generation unit 54 updates the 51 quantization parameters recorded by the conversion table as described above. If update information is not transmitted as a set with the table ID, the 51 quantization parameters recorded by the conversion table are returned to the default values separately recorded at the period of the I picture or I slice. To.
- the quantization control unit 33 does not update the 51 quantization parameters recorded by the conversion table and does not transmit the parameter update information as a set with the table ID, the cycle of the I picture or I slice
- the 51 quantization parameters recorded by the conversion table are returned to the default values recorded separately. Accordingly, the 51 quantization parameters in the conversion tables stored in the conversion table storage units 32 and 53 are returned to the default values unless they are newly updated at the cycle of the I picture or I slice. .
- the quantization controller 33 updates the quantization parameter corresponding to the sub-block recorded by the conversion table
- the entropy encoder 24 updates the quantization parameter updated by the quantization controller 33.
- the parameter update information indicating the content of the parameter is entropy-encoded
- the entropy decoding unit 52 entropy-decodes the bitstream and outputs the parameter update information
- the inverse quantization parameter generation unit 54 is output from the entropy decoding unit 52 Since the quantization parameter corresponding to the sub-block recorded by the conversion table is updated according to the parameter update information, the conversion table held in common by the image encoding device and the image decoding device can be used as necessary. Can be updated to optimize the quantization parameter. It achieves the effect that.
- the conversion table storage unit 32 of the image encoding device and the conversion table storage unit 53 of the image decoding device store one conversion table for each of various sub-blocks and orthogonal transform blocks.
- a plurality of conversion tables may be stored for each of various sub-blocks and orthogonal transform blocks.
- the plurality of conversion tables stored in the conversion table storage unit 32 of the image encoding device and the plurality of conversion tables stored in the conversion table storage unit 53 of the image decoding device are common conversion tables. It is.
- the quantization control unit 33 of the image encoding device when a plurality of conversion tables are stored in the conversion table storage unit 32 for each of various sub-blocks and orthogonal transform blocks, determines the resolution of the input image (horizontal pixels). Number, the number of lines in the vertical direction), the size of the macroblock (or the macroblock size for each frame when the macroblock size changes for each frame), or the encoding rate to be selected. .
- the inverse quantization parameter generation unit 54 of the image decoding device also stores a plurality of conversion tables for each sub-block and orthogonal transform block by the conversion table storage unit 53. If stored, the conversion table to be referred to is selected according to the resolution of the decoded image, the size of the macroblock, or the encoding rate.
- (1) a conversion table corresponding to a resolution of 720 pixels ⁇ 480 lines or less
- (2) a conversion table corresponding to a resolution from 720 pixels ⁇ 480 lines to 1920 pixels ⁇ 1080 lines
- (3) 1920 pixels ⁇ 1080 lines are stored in the conversion table storage units 32 and 53.
- the conversion table of (2) is referred to if it corresponds to the resolution of (2)
- the conversion table of (3) is referred to if it corresponds to the resolution of (3).
- a parameter for specifying a conversion table to be referred to from the outside may be given for each picture or slice.
- the quantization control unit 33 and the inverse quantization parameter generation unit 54 may determine the resolution, macroblock size, and coding rate, and select a conversion table to be referred to.
- the image resolution Since the conversion table to be referred to is selected according to the macroblock size or coding rate, the optimum conversion table is referenced even if the image resolution, macroblock size or coding rate changes. As a result, the quantization parameter corresponding to the sub-block or the orthogonal transform block can be obtained.
- FIG. 10 is a block diagram showing an image coding apparatus according to Embodiment 4 of the present invention.
- the table ID table storage unit 71 is a recording medium that stores the table ID table of FIG.
- the quantization control unit 72 is similar to the quantization control unit 33 in FIG. 1, the buffer amount of the bit stream accumulated by the transmission buffer 25, the target code amount for each macroblock, and the bit stream actually generated The process of determining the quantization parameter QP corresponding to the macroblock from the code amount of the.
- the quantization control unit 72 also includes a transition value (a quantization parameter corresponding to a macroblock and a quantization parameter corresponding to a sub-block used when the motion compensation prediction process is performed by the motion compensation prediction unit 13). Is input to the quantization parameter QP corresponding to the macroblock, the quantization parameter corresponding to the sub-block is calculated, and the quantization parameter is input to the quantization unit 18. Perform the output process. Note that the quantization control unit 72 constitutes a quantization parameter calculation unit.
- the entropy encoding unit 73 corresponds to the transform coefficient quantized by the quantization unit 18, the set of table ID and transition value output from the quantization control unit 72 of the encoding control unit 2, flags A and B, and the macroblock. Quantization parameter QP to be performed, the determination result output from the intra / inter determination unit 15, and the prediction image generation information used for generating the optimal prediction image (the determination result output from the intra / inter determination unit 15 is If the prediction image generated by the intra prediction unit 11 indicates that it is an optimal prediction image, the intra prediction mode selected by the intra prediction unit 11 and the prediction image generated by the motion compensation prediction unit 13 are optimal.
- the motion vector calculated by the motion search unit 12) is entropy-encoded and the bit stream is stored. It carries out a process of generating an over arm.
- the entropy encoding unit 73 constitutes entropy encoding means.
- FIG. 11 is a block diagram showing an image decoding apparatus according to Embodiment 4 of the present invention.
- the table ID table storage unit 81 is a recording medium that stores the table ID table of FIG.
- the entropy decoding unit 82 entropy-decodes the bit stream output from the reception buffer 51, and outputs the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG. 10 to the inverse quantization unit 55.
- the quantization parameter corresponding to the table ID and transition value set, flag, and macroblock output from the quantization control unit 72 is output to the inverse quantization parameter generation unit 83, and the determination result of the intra / inter determination unit 15 is switched to the switch 59.
- the intra prediction mode that is the prediction image generation information is set to intra prediction. If it is output to the image generation unit 57 and the determination result of the intra / inter determination unit 15 indicates that the prediction image generated by the motion compensation prediction unit 13 is an optimal prediction image, the prediction image generation information is used.
- generation part 58 is implemented.
- the entropy decoding unit 82 constitutes entropy decoding means.
- the inverse quantization parameter generation unit 83 calculates the quantization parameter corresponding to the sub-block by adding the transition value output from the entropy decoding unit 82 to the quantization parameter QP corresponding to the macroblock, and the quantization parameter Is output to the inverse quantization unit 55.
- the inverse quantization parameter generation unit 83 constitutes a quantization parameter calculation unit.
- the image encoding device and the image decoding device are mounted with the conversion table storage units 32 and 53 storing the conversion table, and the quantization control unit 33 and the inverse quantization parameter generation unit 54 are An example of converting a quantization parameter corresponding to a macroblock into a quantization parameter corresponding to the subblock with reference to a conversion table related to the subblock used in the motion compensation prediction process has been described.
- the image decoding apparatus adds the quantization parameter QP corresponding to the macroblock and the transition value without mounting the conversion table storage units 32 and 53 storing the conversion table, so that the quantum corresponding to the sub-block is added.
- An optimization parameter may be calculated.
- the quantization control unit 72 of the image coding apparatus determines the quantization parameter QP corresponding to the macroblock in the same manner as the quantization control unit 33 in FIG.
- the quantization control unit 72 adds the transition value given from the outside to the quantization parameter QP corresponding to the macroblock, thereby subblock
- the quantization parameter corresponding to is calculated, and the quantization parameter is output to the quantization unit 18.
- Quantization parameter corresponding to sub-block QP + transition value
- the quantization parameter corresponding to the sub-block obtained by adding the QP value and the transition value is used, it is stored in the table ID table storage unit 71 of FIG.
- the table ID and transition value of the table ID table are set and output to the entropy encoding unit 73.
- the transition value is set to “0”, and the QP value itself is set as a quantization parameter corresponding to the sub-block.
- the set of table ID and transition value is not transmitted.
- the set of table IDs and transition values is transmitted for each picture or slice for all sub-blocks using transition values other than “0”.
- the transition value takes a positive or negative value, and when the transition value exceeds a specified value, it is limited by the specified value.
- the transition value is assumed to be given from the outside, but it may be set in advance, or the quantization control unit 72 may calculate the transition value according to, for example, the degradation state of the image.
- the entropy encoding unit 73 entropy-encodes the set of the table ID and the transition value output from the quantization control unit 72 instead of the table offset value to generate a bitstream.
- the entropy decoding unit 82 of the image decoding apparatus receives the bit stream from the reception buffer 51 and entropy decodes the bit stream, and among the decoded data of the bit stream, FIG.
- the transform coefficient quantized by the quantization unit 18 of the image encoding device is output to the inverse quantization unit 55.
- the table ID and transition value set output from the quantization control unit 72, the flags A and B, the quantization parameter corresponding to the macroblock, and the like are output to the inverse quantization parameter generation unit 83.
- the determination result of the intra / inter determination unit 15 is output to the switch 59.
- the intra prediction mode that is the prediction image generation information is intra predicted. If it is output to the image generation unit 57 and the determination result of the intra / inter determination unit 15 indicates that the prediction image generated by the motion compensation prediction unit 13 is an optimal prediction image, the prediction image generation information is used. A certain motion vector is output to the inter prediction image generation unit 58.
- the inverse quantization parameter generation unit 83 receives the quantization parameter corresponding to the set of the table ID and the transition value, the flags A and B, and the macroblock from the entropy decoding unit 82, the flag A is quantized corresponding to the macroblock.
- the quantization value corresponding to the sub-block is added by adding the transition value to the quantization parameter QP corresponding to the macro-block as shown below. The parameter is calculated, and the quantization parameter is output to the inverse quantization unit 55.
- the table ID table indicates which sub-block the quantization parameter corresponding to the sub-block obtained by adding the QP value and the received transition value is used. Based on the table ID table of FIG. 6 stored in the storage unit 81, it can be specified from the received transition value and the set table ID. For a sub-block for which a set of table ID and transition value is not received, the transition value is “0” and the QP value itself is a quantization parameter corresponding to the sub-block. In this way, quantization parameters for all sub-block types and their block indexes are obtained, and the sub-block types output from the inter prediction image generation unit 58 and the quantization parameters corresponding to the block index information are reversed. It outputs to the quantization part 55.
- the image encoding device and the image decoding device support macroblocks without mounting the conversion table storage units 32 and 53 storing the conversion table. Since the quantization parameter corresponding to the sub-block is calculated by adding the quantization parameter QP and the transition value, the same effects as those of the first embodiment are obtained. Also, the difference between the quantization parameter QP corresponding to the macroblock and the quantization parameter corresponding to the sub-block is always constant, and the degree of freedom is slightly lower than that in the first embodiment, but it is necessary for transmission. The effect is that the amount of information is reduced.
- FIG. 12 is a block diagram showing an image coding apparatus according to Embodiment 5 of the present invention.
- the same reference numerals as those in FIG. Similar to the intra / inter determination unit 15 in FIG. 1, the intra / inter determination unit 91 compares the predicted image generated by the intra prediction unit 11 and the prediction image generated by the motion compensation prediction unit 13 to obtain an optimal predicted image. And the process of outputting the optimum predicted image to the adder 21 is performed. In the previous embodiments, it was determined whether to perform intra coding or inter coding in units of macroblocks.
- the determination is performed for each subblock in the macroblock. . That is, the intra / inter determination unit 91 determines whether the optimal prediction image is an intra block or an inter block, based on the prediction image in units of sub-blocks generated by the intra prediction unit 11 and the motion compensation prediction unit 13. The determination result is output to the switch 16, the quantization control unit 92, and the entropy encoding unit 93.
- the intra / inter determination unit 91 constitutes a block determination unit.
- the quantization control unit 92 is similar to the quantization control unit 33 in FIG. 1, the buffer amount of the bit stream stored in the transmission buffer 25, the target code amount for each macroblock, and the bit stream actually generated
- the quantization parameter QP corresponding to the macroblock is determined from the code amount of the image, and the quantization parameter QP corresponding to the macroblock is output to the entropy encoding unit 93 at the start timing of the macroblock, and the start of the picture or slice At timing, a process of outputting a transition value QP_offset for quantization parameter conversion described below to the entropy encoding unit 93 is performed.
- the quantization parameter conversion transition value QP_offset (transition value QP_offset is For example, it is a fixed value determined in advance according to the encoding rate or the like, or a variation value that is adaptively changed according to the buffer amount of the transmission buffer 25.
- the quantization parameter QP corresponding to the macroblock is converted into the quantization parameter QP_intra corresponding to the subblock, and the converted quantization parameter QP_intra is output to the quantization unit 18. Perform the process.
- the quantization parameter QP corresponding to the macroblock is changed to the quantization parameter QP_inter that corresponds to the sub-block.
- the quantization control unit 92 constitutes a quantization parameter conversion unit.
- the quantization control unit 92 when a sub-block in a macro block is encoded with an inter block, the quantization control unit 92 outputs a quantization parameter QP corresponding to the macro block as a quantization parameter QP_inter corresponding to the sub-block.
- the quantization parameter corresponding to the sub-block determined by any of the methods described in the first to fourth embodiments may be output to the quantization unit 18.
- the quantization control unit 92 has a plurality of conversion tables stored by the conversion table storage unit 32.
- the quantization parameter QP corresponding to the macroblock is determined by referring to the conversion table related to the sub-block used in the motion compensation prediction process performed when the motion compensation prediction unit 13 generates the prediction image.
- the quantization parameter corresponding to the sub-block is converted, and the converted quantization parameter is output to the quantization unit 18.
- the quantization control unit 92 and the quantization parameter QP corresponding to the macroblock and the motion compensation prediction unit 13 is used to input a transition value with a quantization parameter corresponding to a sub-block used in the motion compensated prediction process performed when a prediction image is generated by 13, and the transition value is a quantization parameter QP corresponding to a macroblock.
- the quantization parameter corresponding to the sub-block is calculated, and the quantization parameter corresponding to the sub-block is output to the quantization unit 18.
- the entropy encoding unit 93 includes the transform coefficient quantized by the quantization unit 18, the transition value QP_offset, the determination result of the intra / inter determination unit 91, and the prediction image generation information used to generate the optimal prediction image. (If the determination result output from the intra / inter determination unit 91 indicates that the sub-block in the macroblock is to be encoded with the intra block, the intra prediction mode and macroblock selected by the intra prediction unit 11) If it is indicated that the sub-block is to be encoded with the inter block, the motion vector calculated by the motion search unit 12) and the quantization parameter QP corresponding to the macro block (or corresponding to the macro block).
- the entropy encoding unit 93 constitutes entropy encoding means.
- FIG. 14 is a block diagram showing an image decoding apparatus according to Embodiment 5 of the present invention.
- the entropy decoding unit 101 performs entropy decoding on the bit stream output from the reception buffer 51, and dequantizes the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG.
- the quantization parameter QP corresponding to the transition value QP_offset and the macroblock output from the quantization control unit 92 and the quantization parameter QP corresponding to the macroblock and the macroblock adjacent to the left are output to the quantization unit 55
- the entropy decoding unit 101 sets the intra prediction mode that is the prediction image generation information to the intra prediction image.
- the motion vector that is the prediction image generation information is generated as the inter prediction image. Processing to be output to the unit 58 is performed.
- the entropy decoding unit 101 constitutes entropy decoding means.
- the inverse quantization parameter generation unit 102 performs quantization corresponding to the macroblock according to the transition value QP_offset output from the entropy decoding unit 101.
- the parameter QP is converted into a quantization parameter QP_intra corresponding to the subblock, the converted quantization parameter QP_intra is output to the inverse quantization unit 55, and the determination result output from the entropy decoding unit 101 is an inter block.
- the quantization parameter QP corresponding to the macroblock is output to the inverse quantization unit 55 as the quantization parameter QP_inter corresponding to the subblock.
- the inverse quantization parameter generation unit 102 constitutes a quantization parameter conversion unit.
- the inverse quantization parameter generation unit 102 sets the quantization parameter QP corresponding to the macro block to the sub block.
- the quantization parameter corresponding to the sub-block determined by any method described in the first to fourth embodiments is output to the inverse quantization unit 55 You may do it.
- the inverse quantization parameter generation unit 102 performs motion compensation among a plurality of conversion tables stored in the conversion table storage unit 53.
- the quantization parameter QP corresponding to the macroblock is associated with the subblock with reference to the conversion table related to the subblock used in the motion compensated prediction process performed when the prediction image is generated by the prediction unit 13.
- the data is converted into a quantization parameter, and the converted quantization parameter is output to the inverse quantization unit 55.
- the dequantization parameter generation unit 102 receives the quantization parameter QP and the prediction image corresponding to the macroblock from the entropy decoding unit 101.
- a transition value with a quantization parameter corresponding to a sub-block used in the motion compensated prediction process performed at the time of generation is input, and the transition value is added to a quantization parameter QP corresponding to a macroblock to obtain a sub-block.
- the quantization parameter corresponding to the block is calculated, and the quantization parameter corresponding to the sub-block is output to the inverse quantization unit 55.
- the image encoding device in FIG. 12 uses the character detection unit 31, the conversion table storage unit 32, and the partition in FIG. No information is required. Further, in the image decoding apparatus in FIG. 14, the conversion table storage unit 53 in FIG. 7 and the types of sub-blocks and signals of the block indexes (signals notified from the inter prediction image generation unit 58 to the inverse quantization parameter generation unit 54). Is unnecessary.
- FIG. 13 is an explanatory diagram showing an example of an intra block in a macro block.
- the sub-blocks with hatching are blocks (intra blocks) that perform intra coding.
- a white sub-block that is not shaded is a block (inter-block) that performs inter-coding.
- the intra / inter determination unit 91 is generated by the motion compensation prediction unit 13 and an intra block that is a prediction image in units of sub-blocks generated by the intra prediction unit 11, similarly to the intra / inter determination unit 15 of FIG. 1.
- the inter-block which is a predicted image in sub-block units is compared to determine an optimal predicted image, and the optimal predicted image is output to the adder 21.
- the intra / inter determination unit 91 outputs a determination result indicating whether the optimum predicted image is an intra block or an inter block to the switch 16, the quantization control unit 92, and the entropy encoding unit 93.
- the quantization control unit 92 is the buffer amount of the bit stream accumulated by the transmission buffer 25, the target code amount for each macroblock, and the bits that are actually generated.
- the quantization parameter QP corresponding to the macro block is determined from the code amount of the stream.
- the quantization control unit 92 receives the determination result from the intra / inter determination unit 91, when the determination result indicates that the sub-block in the macroblock is an intra block, the following equation (1) ),
- the quantization parameter QP corresponding to the macroblock is converted into the quantization parameter QP_intra corresponding to the sub-block in accordance with the transition value QP_offset for the quantization parameter conversion, and the quantized post-conversion
- the parameter QP_intra is output to the quantization unit 18.
- QP_intra QP + QP_offset (1)
- the converted quantization parameter QP_intra exceeds the specified value determined by the standard, the specified value is output to the quantization unit 18 as the converted quantization parameter QP_intra.
- the quantization control unit 92 sets the quantization parameter QP corresponding to the macro block to the sub block. Is output to the quantization unit 18 as a quantization parameter QP_inter that corresponds to.
- the quantization parameter in which the transition value QP_offset for quantization parameter conversion is added to the quantization parameter QP corresponding to the macro block is If the subblock in the macroblock is an inter block, the quantization parameter QP corresponding to the macroblock is used as the quantization parameter corresponding to the subblock. It is output to the quantization unit 18.
- the quantization unit 18 When the quantization unit 18 receives a quantization parameter (quantization parameter QP_intra or quantization parameter QP_inter) corresponding to the sub-block from the quantization control unit 92, the quantization unit 18 uses the quantization parameter corresponding to the sub-block to perform orthogonality.
- the transform coefficient of the difference image output from the transform unit 17 is quantized in units of orthogonal transform blocks, and the quantized transform coefficient is output to the entropy coding unit 93.
- the quantization unit 18 quantizes the transform coefficient of the difference image using the quantization parameter QP_intra, the size of the block to be subjected to the intra coding, the prediction type of the intra coding, the transform in the intra coded block Regardless of the type of block, for the block to be intra-encoded within the same macroblock, quantization is performed with the common quantization parameter QP_intra obtained by the above equation.
- the entropy encoding unit 93 is for generating a prediction image used for generating the optimal prediction image, the transform coefficient quantized by the quantization unit 18, the transition value QP_offset, the determination result of the intra / inter determination unit 91, and the like.
- Information (If the determination result output from the intra / inter determination unit 91 indicates that the sub-block in the macro block is an intra block, the intra prediction mode selected by the intra prediction unit 11, the macro block If the sub-block indicates that it is an inter-block, a bit stream is generated by entropy encoding the motion vector calculated by the motion search unit 12) and the quantization parameter QP corresponding to the macroblock, and the bit The stream is stored in the transmission buffer 25.
- transition value QP_offset for quantization parameter conversion may be multiplexed, for example, at a predetermined position in the header information and transmitted to the image decoding apparatus in units of pictures or slices.
- an intra block table ID shown in FIG. 6 may be added and transmitted as a set with the table ID.
- the entropy decoding unit 101 of the image decoding apparatus When the entropy decoding unit 101 of the image decoding apparatus stores the bit stream transmitted from the image encoding apparatus in the reception buffer 51, the entropy decoding unit 101 performs entropy decoding on the bit stream stored in the reception buffer 51.
- the entropy decoding unit 101 outputs the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG. 12 among the decoded data of the bitstream to the inverse quantization unit 55 and outputs from the quantization control unit 92.
- the transition value QP_offset and the quantization parameter QP corresponding to the macro block and the determination result of the intra / inter determination unit 91 are output to the inverse quantization parameter generation unit 102.
- the determination result of the intra / inter determination unit 91 is output to the switch 59.
- the entropy decoding unit 101 performs intra prediction on the intra prediction mode that is information for generating a predicted image. If output to the image generation unit 57 and the determination result of the intra / inter determination unit 91 indicates that the sub-block in the macroblock is an inter block, the motion vector that is the prediction image generation information is used as the inter prediction image. The data is output to the generation unit 58. Note that the transition value QP_offset for quantization parameter conversion is received from the image coding apparatus in units of pictures or slices, and is thus output to the inverse quantization parameter generation unit 102 in units of pictures or slices.
- the inverse quantization parameter generation unit 102 calculates the entropy by calculating the above equation (1) as in the case of the image encoding device.
- the quantization parameter QP corresponding to the macroblock is converted into the quantization parameter QP_intra corresponding to the subblock, and the converted quantization parameter QP_intra is inversely quantized.
- the quantization parameter QP corresponding to the macroblock is output to the inverse quantization unit 55 as the quantization parameter QP_inter corresponding to the subblock. To do.
- the inverse quantization unit 55 When the inverse quantization unit 55 receives the quantization parameter (quantization parameter QP_intra or quantization parameter QP_inter) corresponding to the sub block from the inverse quantization parameter generation unit 102, the inverse quantization unit 55 uses the quantization parameter corresponding to the sub block. Then, the transform coefficient output from the entropy decoding unit 101 is inversely quantized in units of orthogonal transform blocks, so that the transform coefficient corresponding to the transform coefficient output from the orthogonal transform unit 17 in the image encoding device in FIG. It outputs to the orthogonal transformation part 56.
- the quantization parameter quantization parameter QP_intra or quantization parameter QP_inter
- the quantization parameter QP_intra corresponding to the intra block is calculated by adding the quantization parameter QP corresponding to the macro block and the transition value QP_offset.
- the quantization parameter QP_intra may be obtained via a conversion table. In that case, both the image encoding device and the image decoding device need to hold the conversion table.
- the quantization parameter QP_intra is obtained via the conversion table
- the methods described in the second and third embodiments can be applied.
- the quantization is performed using the quantization parameter QP corresponding to the macro block.
- the methods described in the first to fourth embodiments are applied. It is also possible.
- the present invention can also be applied to the case where the entire macroblock is encoded intra.
- the effect when the entire macroblock is encoded intra will be described.
- the quantization parameter of the intrablock (in this case, the macroblock) can be changed by changing the quantization parameter QP corresponding to the macroblock.
- the quantization parameter QP of the macroblock to be encoded is different from the quantization parameter of the left macroblock that has already been encoded, the difference between the quantization parameters. Need to be transmitted.
- the macroblock to be encoded is encoded using the quantization parameter of the macroblock on the left side.
- the quantization parameter QP of the macroblock to be encoded (the same quantization parameter as the macroblock on the left)
- the quantization parameter of the intra block (in this case, the macro block) can be changed.
- the code amount is reduced.
- intra macroblocks are scattered in a frame, the effect of reducing the code amount is further increased.
- the method described here can also be applied to an example of changing the intra quantization parameter after the fifth embodiment.
- FIG. FIG. 15 is a block diagram showing an image encoding apparatus according to Embodiment 6 of the present invention.
- the table ID table storage unit 94 stores a table ID table indicating a table ID corresponding to an intra prediction type and a divided block (a sub-block that is a unit for performing prediction within a macroblock defined for each intra prediction type). Recording medium.
- the quantization control unit 95 When the intra / inter determination unit 91 determines that the sub-block in the macroblock is to be encoded with the intra block, the quantization control unit 95 performs the change for the quantization parameter conversion as in the quantization control unit 92 of FIG. In accordance with the value QP_offset, the quantization parameter QP corresponding to the macroblock is converted to the quantization parameter QP_intra corresponding to the subblock, and the converted quantization parameter QP_intra is output to the quantization unit 18 To do. However, unlike the quantization control unit 92 of FIG. 12, the quantization control unit 95 converts the quantization parameter corresponding to the sub-block into the quantization parameter corresponding to the intra prediction type and the divided block.
- the quantization parameter QP corresponding to the macroblock is set in the same manner as the quantization control unit 92 in FIG. Processing to output to the quantization unit 18 as the quantization parameter QP_inter corresponding to the sub-block is performed.
- the quantization control unit 95 constitutes a quantization parameter conversion unit.
- the entropy encoding unit 96 includes a transform coefficient quantized by the quantization unit 18, a set of a table ID and a transition value QP_offset indicating the transform table output from the quantization control unit 95, and a quantization parameter corresponding to the macroblock.
- the entropy encoding unit 96 constitutes entropy encoding means.
- FIG. 20 is a block diagram showing an image decoding apparatus according to Embodiment 6 of the present invention.
- the entropy decoding unit 103 entropy-decodes the bit stream output from the reception buffer 51, and dequantizes the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG. To the conversion unit 55.
- the table ID indicating the conversion table output from the quantization control unit 95 and the transition value QP_offset, and the quantization parameter QP corresponding to the macroblock (or the quantization parameter QP corresponding to the macroblock are adjacent to the left).
- the determination result output from the intra / inter determination unit 91 the determination result output from the intra / inter determination unit 91, and the intra prediction type output from the intra prediction unit 11.
- a process of outputting the determination result of the intra / inter determination unit 91 to the switch 59 is performed.
- the entropy decoding unit 103 indicates an intra prediction type and intra prediction mode that are prediction image generation information.
- the entropy decoding unit 103 constitutes entropy decoding means.
- the dequantization parameter generation unit 104 When the dequantization parameter generation unit 104 indicates that the determination result output from the entropy decoding unit 103 is an intra block, the dequantization parameter generation unit 104 outputs from the entropy decoding unit 103 as in the case of the dequantization parameter generation unit 102 of FIG. A process of converting the quantization parameter QP corresponding to the macroblock into the quantization parameter QP_intra corresponding to the sub-block according to the transition value QP_offset and outputting the converted quantization parameter QP_intra to the inverse quantization unit 55 carry out. However, unlike the inverse quantization parameter generation unit 102 in FIG.
- the inverse quantization parameter generation unit 104 converts the quantization parameter corresponding to the sub block into the quantization parameter corresponding to the intra prediction type and the divided block.
- the quantization parameter QP corresponding to the macroblock is set in the sub-block as in the inverse quantization parameter generation unit 102 of FIG. A process of outputting the corresponding quantization parameter QP_inter to the inverse quantization unit 55 is performed.
- the inverse quantization parameter generation unit 104 constitutes a quantization parameter conversion unit.
- FIG. 2 is an explanatory diagram illustrating an intra prediction type defined in H.264.
- intra prediction types There are three types of intra prediction types: intra 4 ⁇ 4 prediction, intra 8 ⁇ 8 prediction, and intra 16 ⁇ 16 prediction.
- 16 ⁇ 16 macroblocks are subjected to predictive coding in units of blocks each divided into 16 4 ⁇ 4 blocks, 4 8 ⁇ 8 blocks, and 16 ⁇ 16 blocks. Is. Each divided block is assigned a block number to indicate its position.
- the prediction encoding method itself is described in H.264. Since the contents are defined in the H.264 standard, detailed description thereof is omitted.
- FIG. 17 is an explanatory diagram showing an intra prediction type and a table ID corresponding to a divided block.
- the corresponding table ID and transition value QP_offset are set and transmitted to the image decoding apparatus in units of pictures or slices.
- the quantization parameter changed by the transition value QP_offset is used to quantize all the divided blocks in the intra block that is encoded by intra 4 ⁇ 4 prediction.
- the table ID is “3”
- quantization is performed using the quantization parameter changed by the transition value QP_offset on the divided block of block number 0 in the intra block to be encoded by intra 4 ⁇ 4 prediction.
- FIG. 18 is an explanatory diagram illustrating an example in which quantization is performed using a quantization parameter to which the transition value QP_offset is applied to a divided block in a block to be encoded intra.
- the thick line frame in the figure is a 16 ⁇ 16 macroblock, and the macroblock on which a number is written is encoded intra.
- the transition value QP_offset is applied to the divided blocks that are shaded. That is, the transition value QP_offset is applied to the divided blocks of block numbers 3 and 6 in intra 4 ⁇ 4 prediction and the divided block of block number 2 in intra 8 ⁇ 8 prediction.
- the quantization parameter QP corresponding to the macroblock is used.
- the table IDs “6”, “9”, and “21” corresponding to the intra prediction type and the block numbers 3, 6, and 2 are set in units of pictures or slices.
- the value QP_offset is transmitted to the image decoding device.
- the method for converting the quantization parameter QP corresponding to the macroblock into the quantization parameter corresponding to the sub-block using the transition value QP_offset is the same as the method shown in the fifth embodiment.
- the quantization parameter corresponding to the sub-block is applied to the divided block in which the transition value QP_offset is transmitted as a set with the table ID from the image encoding apparatus, by applying the transition value QP_offset.
- the quantization parameter QP corresponding to the macroblock is used for the divided block for which the transition value QP_offset has not been transmitted.
- FIG. 19 is an explanatory diagram illustrating an example in which quantization is performed using a quantization parameter to which the transition value QP_offset is applied to a block to be encoded with intra.
- the thick line frame in FIG. It is a 32 ⁇ 32 macroblock different from H.264, and a block in which a number in the macroblock is described is encoded intra.
- the intra block that is shaded applies the transition value QP_offset, and in this example, the transition value is applied to the intra 4 ⁇ 4 prediction block.
- the quantization parameter QP corresponding to the macro block is used for intra blocks that are not shaded.
- the transition value QP_offset is transmitted to the image decoding apparatus as a set with the table ID “0” corresponding to the intra prediction type and the block number in units of pictures or slices.
- the method for converting the quantization parameter QP corresponding to the macroblock into the quantization parameter corresponding to the sub-block using the transition value QP_offset is the same as the method shown in the fifth embodiment.
- the image decoding apparatus applies the transition value QP_offset to the intra block in which the transition value QP_offset is transmitted as a set with the table ID from the image encoding apparatus, and sets the quantization parameter corresponding to the sub-block.
- the quantization parameter QP corresponding to the macroblock is used for the intra block for which the transition value QP_offset is not transmitted.
- the entropy decoding unit 103 of the image decoding device When the bit stream transmitted from the image encoding device is stored, the entropy decoding unit 103 of the image decoding device performs entropy decoding on the bit stream stored in the reception buffer 51.
- the entropy decoding unit 103 outputs, to the inverse quantization unit 55, the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG.
- the intra prediction type output from the intra prediction unit 11 is output to the inverse quantization parameter generation unit 104, and the determination result of the intra / inter determination unit 91 is output to the switch 59.
- the determination result output from the entropy decoding unit 103 is an intra block, and the intra prediction type of the intra block and the divided block number on which the inverse quantization process is performed indicate an intra prediction type.
- the block number, the quantization parameter corresponding to the macroblock is changed to the quantization parameter corresponding to the subblock (intra prediction type and block number) according to the transition value QP_offset output from the entropy decoding unit 103.
- Corresponding quantization parameter and outputs the converted quantization parameter to the inverse quantization unit 55.
- the inverse quantization parameter generation unit 104 uses the intra prediction type and block number for which the transition value QP_offset is not transmitted from the image encoding device even when the determination result output from the entropy decoding unit 103 indicates that it is an intra block.
- the quantization parameter QP corresponding to the macroblock is output to the inverse quantization unit 55 as the quantization parameter corresponding to the subblock.
- the quantization parameter QP corresponding to the macroblock is output to the inverse quantization unit 55 as the quantization parameter corresponding to the subblock.
- the quantization parameter corresponding to the intra block is obtained by adding the quantization parameter corresponding to the macro block and the transition value.
- the quantization parameter is obtained via the conversion table.
- the quantization parameter corresponding to the intra block may be obtained.
- both the image encoding device and the image decoding device need to hold the conversion table.
- the methods shown in the second and third embodiments can be applied.
- the quantization is performed on the inter block with the quantization parameter corresponding to the macro block, the method described in the first to fourth embodiments can be applied.
- FIG. FIG. 21 is a block diagram showing an image coding apparatus according to Embodiment 7 of the present invention.
- the table ID table storage unit 97 includes an orthogonal transform mode for an intra block (orthogonal transform mode in a block that performs intra coding in a macroblock) and an orthogonal transform block (a block that performs orthogonal transform defined for each orthogonal transform mode). ) Is a recording medium storing a table ID table indicating a table ID corresponding to.
- the quantization control unit 98 When the intra / inter determination unit 91 determines that the sub-block in the macroblock is to be encoded with the intra block, the quantization control unit 98 performs the quantization parameter conversion as in the quantization control unit 92 of FIG.
- the quantization parameter QP corresponding to the macroblock is converted into the quantization parameter QP_intra corresponding to the sub-block in accordance with the transition value QP_offset of, and the converted quantization parameter QP_intra is output to the quantization unit 18 To implement.
- the quantization control unit 98 sets the quantization parameter corresponding to the sub block to the quantization parameter corresponding to the orthogonal transform mode of the intra block and the block number to be orthogonal transformed. Convert.
- the quantization parameter QP corresponding to the macroblock is set as in the quantization control unit 92 of FIG. A process of outputting the quantization parameter QP_inter that corresponds to the sub-block to the quantization unit 18 is performed.
- the quantization control unit 98 constitutes a quantization parameter conversion unit.
- the entropy encoding unit 99 includes a transform coefficient quantized by the quantization unit 18, a set of a table ID and a transition value QP_offset indicating the transform table output from the quantization control unit 98, and a quantization parameter corresponding to the macroblock.
- the entropy encoding unit 99 constitutes entropy encoding means.
- FIG. 24 is a block diagram showing an image decoding apparatus according to Embodiment 7 of the present invention.
- the entropy decoding unit 105 entropy-decodes the bit stream output from the reception buffer 51, and dequantizes the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG. To the conversion unit 55. Also, the table ID indicating the conversion table output from the quantization control unit 98 and the transition value QP_offset, and the quantization parameter QP corresponding to the macroblock (or the quantization parameter QP corresponding to the macroblock are adjacent to the left).
- a process of outputting to the parameter generation unit 106 and outputting the determination result of the intra / inter determination unit 91 to the switch 59 is performed. Also, if the determination result of the intra / inter determination unit 91 indicates that the sub-block in the macroblock is an intra block, the entropy decoding unit 105 sets the intra prediction mode that is the prediction image generation information to the intra prediction image.
- the motion vector that is the prediction image generation information is generated as the inter prediction image. Processing to be output to the unit 58 is performed.
- the entropy decoding unit 105 constitutes entropy decoding means.
- the inverse quantization parameter generation unit 106 When the determination result output from the entropy decoding unit 105 indicates that the determination result is an intra block, the inverse quantization parameter generation unit 106 outputs the same from the entropy decoding unit 105 as in the case of the inverse quantization parameter generation unit 102 in FIG. Processing for converting the quantization parameter QP corresponding to the macroblock into the quantization parameter QP_intra corresponding to the sub-block according to the transition value QP_offset and outputting the converted quantization parameter QP_intra to the inverse quantization unit 55 carry out. However, unlike the inverse quantization parameter generation unit 102 in FIG.
- the inverse quantization parameter generation unit 106 has a quantization parameter corresponding to an intra block orthogonal transform mode and an orthogonal transform block number as a quantization parameter corresponding to a sub-block. Convert to On the other hand, when the determination result output from the entropy decoding unit 105 indicates that the block is an interblock, the quantization parameter QP corresponding to the macroblock is set in the subblock as in the case of the inverse quantization parameter generation unit 102 in FIG. A process of outputting the corresponding quantization parameter QP_inter to the inverse quantization unit 55 is performed. Note that the inverse quantization parameter generation unit 106 constitutes a quantization parameter conversion unit.
- FIG. 22 is an explanatory diagram showing an orthogonal transform mode of an intra block.
- H.264 is used as an orthogonal transform mode of an intra block.
- 4 ⁇ 4 block conversion and 8 ⁇ 8 block conversion are defined.
- a 16 ⁇ 16 macroblock is divided into 16 4 ⁇ 4 blocks, and orthogonal transform is performed for each 4 ⁇ 4 block.
- the 8 ⁇ 8 block transform the 8 ⁇ 8 block is divided into four 8 ⁇ 8 blocks, and orthogonal transform is performed for each 8 ⁇ 8 block.
- H. In 16 ⁇ 16 block transformation not defined by H.264, orthogonal transformation is performed with one 16 ⁇ 16 block.
- Each divided orthogonal transform block is assigned a block number to indicate its position.
- H. H.264 stipulates that 4 ⁇ 4 block conversion is performed in the intra 4 ⁇ 4 prediction type and 8 ⁇ 8 block conversion is performed in the intra 8 ⁇ 8 prediction type, but in the seventh embodiment, intra prediction is performed. Regardless of type, H. It is assumed that the orthogonal transform mode can be arbitrarily selected including those not defined by H.264.
- FIG. 23 is an explanatory diagram showing an orthogonal transform mode of an intra block and a table ID corresponding to the orthogonal transform block.
- the corresponding table ID and transition value QP_offset are set and transmitted to the image decoding apparatus in units of pictures or slices. For example, when the table ID is “0”, quantization is performed on all orthogonal transform blocks subjected to orthogonal transform in the 4 ⁇ 4 block transform mode, using the quantization parameter changed with the transition value QP_offset. . When the table ID is “3”, quantization is performed using the quantization parameter changed by the transition value QP_offset with respect to the orthogonal transformation block of block number 0 for which orthogonal transformation is performed in the 4 ⁇ 4 block transformation mode. .
- the intra prediction type shown in FIG. 18 and FIG. 19 shown in the sixth embodiment is replaced with the orthogonal transform mode, and the divided block number is replaced with the orthogonal transform block number. Since the operation is the same as the operation of the image coding apparatus in the sixth embodiment, detailed description is omitted here.
- the entropy decoding unit 105 of the image decoding device When the bit stream transmitted from the image encoding device is stored, the entropy decoding unit 105 of the image decoding device performs entropy decoding on the bit stream stored in the reception buffer 51. The entropy decoding unit 105 outputs, to the inverse quantization unit 55, the transform coefficient quantized by the quantization unit 18 of the image encoding device in FIG.
- the intra prediction type and the orthogonal transform mode output from the intra prediction unit 11 are output to the inverse quantization parameter generation unit 106, and the determination result of the intra / inter determination unit 91 is output to the switch 59.
- the inverse quantization parameter generation unit 106 determines the quantum corresponding to the macroblock according to the transition value QP_offset output from the entropy decoding unit 105.
- the quantization parameter is converted to a quantization parameter (quantization parameter corresponding to the orthogonal transform mode and orthogonal transform block number of the intra block) corresponding to the sub-block, and the converted quantization parameter is output to the inverse quantization unit 55. .
- the quantization parameter QP corresponding to the macroblock is output to the inverse quantization unit 55 as the quantization parameter corresponding to the subblock.
- the inverse quantization parameter generation unit 106 does not transmit a transition value from the image encoding device, and the quantum value corresponding to the macro block is determined.
- the quantization parameter is output to the inverse quantization unit 55 as a quantization parameter corresponding to the subblock.
- the quantization parameter corresponding to the orthogonal transform mode or the orthogonal transform block is obtained by adding the quantization parameter corresponding to the macroblock and the transition value.
- a quantization parameter corresponding to an orthogonal transform mode or an orthogonal transform block may be obtained via a transform table.
- both the image encoding device and the image decoding device need to hold the conversion table.
- the methods shown in the second and third embodiments can be applied to obtain the orthogonal transformation mode or the quantization parameter corresponding to the orthogonal transformation block via the transformation table.
- the contents described in the seventh embodiment are orthogonal transform blocks having a size of 32 ⁇ 32, 64 ⁇ 64, 128 ⁇ 128 or the like, or rectangular orthogonal shapes such as 16 ⁇ 8, 4 ⁇ 16, and 32 ⁇ 16. The same applies to the conversion block.
- the quantization parameter QP corresponding to the macroblock is subjected to the orthogonal transformation mode and orthogonal transformation of the intra block according to the quantization parameter transformation transition value QP_offset specified by the table ID.
- a predetermined common quantum is determined for each of the intra block orthogonal transform mode and the block number to be subjected to orthogonal transform.
- the quantization parameter QP corresponding to the macroblock is converted without transmitting the table ID and the transition value QP_offset for quantization parameter conversion. You can also.
- the quantization is performed on the inter block with the quantization parameter corresponding to the macro block, the method described in the first to fourth embodiments can be applied.
- the present invention is suitable for use in an image encoding device and an image encoding method for encoding, an image decoding device and an image decoding method for decoding an image encoded by the image encoding device.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
La présente invention concerne une section de commande de quantification (33) qui se réfère à une table de transformées qui est associée à un sous-bloc utilisée pour le traitement de prédiction avec compensation de mouvement lors de la création d'une image prédite et qui est une parmi une pluralité de tables de transformées stockées dans une section de stockage de tables de transformées (32), et transforme un paramètre de quantification correspondant à un macro-bloc en un paramètre de quantification correspondant au sous-bloc. Au moyen du paramètre de quantification correspondant au sous-bloc, une section de quantification (18) quantifie un coefficient orthogonal d'une sortie d'image différentielle provenant d'une section de transformation orthogonale (17).
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009-271496 | 2009-11-30 | ||
JP2009271496 | 2009-11-30 | ||
JP2010131988 | 2010-06-09 | ||
JP2010-131988 | 2010-06-09 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2011064926A1 true WO2011064926A1 (fr) | 2011-06-03 |
Family
ID=44066041
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/005547 WO2011064926A1 (fr) | 2009-11-30 | 2010-09-10 | Dispositif de codage d'image, dispositif de décodage d'image, procédé de codage d'image, procédé de décodage d'image |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2011064926A1 (fr) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012117744A1 (fr) * | 2011-03-03 | 2012-09-07 | Panasonic Corporation | Procédé de codage d'une image dans une image codée, procédé de décodage d'une image codée et appareils associés |
WO2013001717A1 (fr) * | 2011-06-30 | 2013-01-03 | 三菱電機株式会社 | Appareil de codage d'images, appareil de décodage d'images, procédé de codage d'images et procédé de décodage d'images |
JP2013531942A (ja) * | 2010-06-10 | 2013-08-08 | トムソン ライセンシング | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
JP2014520475A (ja) * | 2011-06-21 | 2014-08-21 | インテレクチュアル ディスカバリー カンパニー リミテッド | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
US9503754B2 (en) | 2011-12-07 | 2016-11-22 | Hitachi Kokusai Electric Inc. | Image encoding device and image encoding method |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004140473A (ja) * | 2002-10-15 | 2004-05-13 | Sony Corp | 画像情報符号化装置、復号化装置並びに画像情報符号化方法、復号化方法 |
JP2006262004A (ja) * | 2005-03-16 | 2006-09-28 | Toshiba Corp | 動画像符号化/復号化の方法及び装置 |
WO2008126135A1 (fr) * | 2007-03-20 | 2008-10-23 | Fujitsu Limited | Procédé et dispositif de codage d'image variant dans le temps, et dispositif de décodage d'image variant dans le temps |
-
2010
- 2010-09-10 WO PCT/JP2010/005547 patent/WO2011064926A1/fr active Application Filing
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004140473A (ja) * | 2002-10-15 | 2004-05-13 | Sony Corp | 画像情報符号化装置、復号化装置並びに画像情報符号化方法、復号化方法 |
JP2006262004A (ja) * | 2005-03-16 | 2006-09-28 | Toshiba Corp | 動画像符号化/復号化の方法及び装置 |
WO2008126135A1 (fr) * | 2007-03-20 | 2008-10-23 | Fujitsu Limited | Procédé et dispositif de codage d'image variant dans le temps, et dispositif de décodage d'image variant dans le temps |
Cited By (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11381818B2 (en) | 2010-06-10 | 2022-07-05 | Interdigital Vc Holdings, Inc. | Methods and apparatus for determining quantization parameter predictors from a plurality of neighboring quantization parameters |
JP2013531942A (ja) * | 2010-06-10 | 2013-08-08 | トムソン ライセンシング | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
US9749631B2 (en) | 2010-06-10 | 2017-08-29 | Thomson Licensing | Methods and apparatus for determining quantization parameter predictors from a plurality of neighboring quantization parameters |
JP2020058036A (ja) * | 2010-06-10 | 2020-04-09 | インターデジタル ヴイシー ホールディングス, インコーポレイテッド | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
JP7254681B2 (ja) | 2010-06-10 | 2023-04-10 | インターデジタル ヴイシー ホールディングス, インコーポレイテッド | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
JP7228012B2 (ja) | 2010-06-10 | 2023-02-22 | インターデジタル ヴイシー ホールディングス, インコーポレイテッド | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
US9235774B2 (en) | 2010-06-10 | 2016-01-12 | Thomson Licensing | Methods and apparatus for determining quantization parameter predictors from a plurality of neighboring quantization parameters |
JP2016136760A (ja) * | 2010-06-10 | 2016-07-28 | トムソン ライセンシングThomson Licensing | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
US10334247B2 (en) | 2010-06-10 | 2019-06-25 | Interdigital Vc Holdings, Inc. | Methods and apparatus for determining quantization parameter predictors from a plurality of neighboring quantization parameters |
US10742981B2 (en) | 2010-06-10 | 2020-08-11 | Interdigital Vc Holdings, Inc. | Methods and apparatus for determining quantization parameter predictors from a plurality of neighboring quantization parameters |
US10547840B2 (en) | 2010-06-10 | 2020-01-28 | Interdigital Vc Holdings, Inc. | Methods and apparatus for determining quantization parameter predictors from a plurality of neighboring quantization parameters |
US11722669B2 (en) | 2010-06-10 | 2023-08-08 | Interdigital Vc Holdings, Inc. | Methods and apparatus for determining quantization parameter predictors from a plurality of neighboring quantization parameters |
JP2018026824A (ja) * | 2010-06-10 | 2018-02-15 | トムソン ライセンシングThomson Licensing | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
JP2022003790A (ja) * | 2010-06-10 | 2022-01-11 | インターデジタル ヴイシー ホールディングス, インコーポレイテッド | 複数の隣接する量子化パラメータから量子化パラメータ予測子を決定する方法及び装置 |
WO2012117744A1 (fr) * | 2011-03-03 | 2012-09-07 | Panasonic Corporation | Procédé de codage d'une image dans une image codée, procédé de décodage d'une image codée et appareils associés |
US10979720B2 (en) | 2011-03-03 | 2021-04-13 | Sun Patent Trust | Method of encoding an image into a coded image, method of decoding a coded image, and apparatuses thereof |
US9438906B2 (en) | 2011-03-03 | 2016-09-06 | Sun Patent Trust | Method of encoding an image into a coded image, method of decoding a coded image, and apparatuses thereof |
US10070138B2 (en) | 2011-03-03 | 2018-09-04 | Sun Patent Trust | Method of encoding an image into a coded image, method of decoding a coded image, and apparatuses thereof |
US11523122B2 (en) | 2011-03-03 | 2022-12-06 | Sun Patent Trust | Method of encoding an image into a coded image, method of decoding a coded image, and apparatuses thereof |
US9787993B2 (en) | 2011-03-03 | 2017-10-10 | Sun Patent Trust | Method of encoding an image into a coded image, method of decoding a coded image, and apparatuses thereof |
US10666951B2 (en) | 2011-03-03 | 2020-05-26 | Sun Patent Trust | Method of encoding an image into a coded image, method of decoding a coded image, and apparatuses thereof |
JP2014512705A (ja) * | 2011-03-03 | 2014-05-22 | パナソニック株式会社 | 画像符号化方法、画像復号方法、画像符号化装置、及び、画像復号装置 |
JP7087169B2 (ja) | 2011-06-21 | 2022-06-20 | ドルビー ラボラトリーズ ライセンシング コーポレイション | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
US9066098B2 (en) | 2011-06-21 | 2015-06-23 | Intellectual Discovery Co., Ltd. | Method and apparatus for adaptively encoding and decoding a quantization parameter based on a quadtree structure |
JP2020065290A (ja) * | 2011-06-21 | 2020-04-23 | インテレクチュアル ディスカバリー カンパニー リミテッド | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
USRE47465E1 (en) | 2011-06-21 | 2019-06-25 | Intellectual Discovery Co., Ltd. | Method and apparatus for adaptively encoding and decoding a quantization parameter based on a quadtree structure |
JP2018196147A (ja) * | 2011-06-21 | 2018-12-06 | インテレクチュアル ディスカバリー カンパニー リミテッド | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
USRE46678E1 (en) | 2011-06-21 | 2018-01-16 | Intellectual Discovery Co., Ltd. | Method and apparatus for adaptively encoding and decoding a quantization parameter based on a quadtree structure |
JP2017201807A (ja) * | 2011-06-21 | 2017-11-09 | インテレクチュアル ディスカバリー カンパニー リミテッド | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
JP2022032027A (ja) * | 2011-06-21 | 2022-02-24 | ドルビー ラボラトリーズ ライセンシング コーポレイション | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
CN107257488A (zh) * | 2011-06-21 | 2017-10-17 | 英迪股份有限公司 | 基于四叉树编码和解码自适应量化参数的方法及装置 |
JP7507944B2 (ja) | 2011-06-21 | 2024-06-28 | ドルビー ラボラトリーズ ライセンシング コーポレイション | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
JP2022120012A (ja) * | 2011-06-21 | 2022-08-17 | ドルビー ラボラトリーズ ライセンシング コーポレイション | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
USRE49330E1 (en) | 2011-06-21 | 2022-12-06 | Dolby Laboratories Licensing Corporation | Method and apparatus for adaptively encoding and decoding a quantization parameter based on a quadtree structure |
JP2016165138A (ja) * | 2011-06-21 | 2016-09-08 | インテレクチュアル ディスカバリー カンパニー リミテッド | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
CN107257488B (zh) * | 2011-06-21 | 2020-04-17 | 英迪股份有限公司 | 基于四叉树编码和解码自适应量化参数的方法及装置 |
JP2014520475A (ja) * | 2011-06-21 | 2014-08-21 | インテレクチュアル ディスカバリー カンパニー リミテッド | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
JP7344343B2 (ja) | 2011-06-21 | 2023-09-13 | ドルビー ラボラトリーズ ライセンシング コーポレイション | クアッドツリー構造に基づく適応的量子化パラメータ符号化及び復号化方法及び装置 |
WO2013001717A1 (fr) * | 2011-06-30 | 2013-01-03 | 三菱電機株式会社 | Appareil de codage d'images, appareil de décodage d'images, procédé de codage d'images et procédé de décodage d'images |
US9503754B2 (en) | 2011-12-07 | 2016-11-22 | Hitachi Kokusai Electric Inc. | Image encoding device and image encoding method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6863669B2 (ja) | 画像符号化装置、画像符号化方法、画像復号装置および画像復号方法 | |
KR101037816B1 (ko) | 인터레이스된 비디오의 코딩 및 디코딩을 위한 방법 및장치 | |
KR101349599B1 (ko) | 동화상 복호 장치 | |
JP6082073B2 (ja) | 画像復号装置、画像復号方法、画像符号化装置、画像符号化方法及びビットストリーム | |
WO2011064926A1 (fr) | Dispositif de codage d'image, dispositif de décodage d'image, procédé de codage d'image, procédé de décodage d'image | |
JP2008004983A (ja) | 画像理装置および方法、プログラム、並びに記録媒体 | |
KR101038794B1 (ko) | 인터레이스형 비디오의 코딩 및 디코딩 | |
KR101923460B1 (ko) | 비디오 신호의 디코딩 방법 및 장치 | |
JP2015080002A (ja) | 動画像符号化装置、動画像復号装置、動画像符号化方法及び動画像復号方法 | |
KR20140079519A (ko) | 평균 양자화 파라메터를 이용한 양자화 파라메터 부호화 방법 | |
KR20140129420A (ko) | 잔차 변환을 이용한 인트라 예측 방법 및 장치 | |
KR20140129419A (ko) | 잔차 변환을 이용한 인트라 예측 방법 및 장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10832782 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 10832782 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: JP |