JP6620867B2 - Image decoding apparatus, image decoding method, image decoding program, receiving apparatus, receiving method, and receiving program - Google Patents

Description

  The present invention relates to an image decoding technique, and more particularly to an intra-screen decoding technique.

As a typical moving image compression coding system, MPEG-4 AVC / H. There are H.264 standards. MPEG-4 AVC / H. In H.264, encoding is performed in units of macro blocks obtained by dividing a picture into a plurality of rectangular blocks. The size of the macroblock is defined as 16 × 16 pixels in the luminance signal regardless of the image size. The macro block includes a color difference signal, but the size of the color difference signal included in the macro block differs depending on the color difference format of the image to be encoded. When the color difference format is 4: 2: 0, the color difference signal is 8 × 8
When the pixel and color difference format is 4: 2: 2, the color difference signal is 8 × 16 pixels, and when the color difference format is 4: 4: 4, the color difference signal is 16 × 16 pixels.

The color difference format represents the ratio of the number of sampled pixels of three signals of one luminance information and two color difference information as X: Y: Z. MPEG-4 AVC / H. The color difference format of an image to be encoded and decoded in H.264 is 4: 2: 0, 4: 2: 2, 4: 4: 4, and monochrome.

FIG. 3 is a diagram for explaining each color difference format of an image. X indicates the position of the pixel of the luminance signal on the screen plane of the image, and ◯ indicates the position of the pixel of the color difference signal.
In 4: 2: 0 shown in FIG. 3A, the color difference signal is 2 in both the horizontal and vertical directions with respect to the luminance signal.
A color difference format sampled at a density of one part. That is, 4: 2: 0 has the same aspect ratio of the pixels of the luminance signal and the color difference signal. In 4: 2: 0, the color difference signal may be sampled at the position shown in FIG.
4: 2: 2 shown in FIG. 3B is a color difference format in which the color difference signal is sampled with a density of 1/2 in the horizontal direction and the same density in the vertical direction with respect to the luminance signal. That is, 4: 2: 2 has different pixel aspect ratios for the luminance signal and the color difference signal.
4: 4: 4 shown in FIG. 3C is a color difference format in which both the luminance signal and the color difference signal are sampled at the same density. That is, 4: 4: 4 has the same pixel aspect ratio of the luminance signal and the color difference signal.
Monochrome shown in FIG. 3D is a color difference format having only a luminance signal without a color difference signal.

Note that the luminance signal and the color difference signal are encoded and decoded as a set in order to share encoding information such as motion compensation, but in 4: 4: 4, one luminance signal and two color difference signals are independently used. 3
There is also a mechanism for encoding and decoding as one monochrome.

AVC / H. In the H.264 system, a method of predicting from an already encoded / decoded block in an encoding / decoding target picture is used. This method is called intra prediction. In addition, motion compensation that predicts motion from a reference picture using a picture that has already been encoded / decoded as a reference picture is used. A technique for predicting motion by this motion compensation is called inter prediction.

First, AVC / H. A unit for switching the intra prediction mode in the intra prediction in the H.264 intra coding will be described. 4A to 4C are diagrams for explaining a unit for switching the intra prediction mode. AVC / H. In the H.264 intra coding, “4 × 4 intra prediction”, “16 ×
Three types of “16 intra prediction” and “8 × 8 intra prediction” are prepared.

In “4 × 4 intra prediction”, a luminance signal of a macro block (luminance signal 16 × 16 pixel block, color difference signal 8 × 8 pixel block) is divided into 16 × 4 × 4 pixel blocks, and divided 4 × 4 pixel units. Then, a mode is selected from nine types of 4 × 4 intra prediction modes, and intra prediction is sequentially performed (FIG. 4A).
In “16 × 16 pixel intra prediction”, a mode is selected from four types of 16 × 16 intra prediction modes in units of 16 × 16 pixel blocks of the luminance signal, and intra prediction is performed (FIG. 4B).
In “8 × 8 pixel intra prediction”, the luminance signal of the macro block is divided into four 8 × 8 pixel blocks, and a mode is selected from nine types of 8 × 8 intra prediction modes in units of divided 8 × 8 pixels. Then, intra prediction is sequentially performed (FIG. 4C).

In addition, when the color difference format is 4: 2: 0 or 4: 2: 2, intra prediction of color difference signals is performed by selecting a mode from four types of intra prediction modes for color difference signals in units of macroblocks. Is done.

Next, AVC / H. A unit for inter prediction in H.264 inter coding will be described. FIGS. 5A to 5H are diagrams for explaining a macroblock partition and a sub-macroblock partition. To simplify the explanation here,
Only the pixel block of the luminance signal is drawn. In the MPEG series, the macroblock is defined by a square area. Generally, AVC / H. In the MPEG series including the H.264 system, 1
A block defined by 6 × 16 pixels (horizontal 16 pixels, vertical 16 pixels) is called a macroblock. Furthermore, AVC / H. In the H.264 system, a block defined by 8 × 8 pixels is called a sub macroblock. The macroblock partition refers to each small block obtained by further dividing the macroblock for motion compensation prediction. The sub-macroblock partition is a small block obtained by further dividing the sub-macroblock for motion compensation prediction.

FIG. 5A is a diagram showing that a macroblock is composed of one macroblock partition composed of a luminance signal of 16 × 16 pixels and two corresponding color difference signals. Here, this configuration is referred to as a 16 × 16 mode macroblock type.
In FIG. 5B, the macroblock is composed of two macroblock partitions composed of a luminance signal of 16 × 8 pixels (16 horizontal pixels and 8 vertical pixels) and two corresponding color difference signals. FIG. The two macroblock partitions are arranged vertically. Here, this configuration is called a 16 × 8 mode macroblock type.
In FIG. 5C, the macroblock is composed of two macroblock partitions each composed of a luminance signal of 8 × 16 pixels (horizontal 8 pixels, vertical 16 pixels) and two corresponding color difference signals. FIG. The two macroblock partitions are arranged side by side. Here, this configuration is referred to as an 8 × 16 mode macroblock type.
FIG. 5D is a diagram showing that a macroblock is composed of four macroblock partitions each composed of a luminance signal of 8 × 8 pixels and two corresponding color difference signals. These four macroblock partitions are arranged vertically and horizontally. This configuration is called a macroblock type of 8 × 8 mode.
FIG. 5E is a diagram showing that a sub macroblock is composed of one submacroblock partition composed of a luminance signal of 8 × 8 pixels and two corresponding color difference signals. Here, this configuration is referred to as an 8 × 8 mode sub-macroblock type.
In FIG. 5F, the sub-macroblock is composed of two sub-macroblock partitions composed of a luminance signal of 8 × 4 pixels (horizontal 8 pixels, vertical 4 pixels) and two corresponding color difference signals. FIG. These two sub-macroblock partitions are arranged vertically. This configuration is referred to as an 8 × 4 mode sub-macroblock type.
In FIG. 5G, the sub macroblock is composed of two macroblock partitions each composed of a luminance signal of 4 × 8 pixels (horizontal 4 pixels, vertical 8 pixels) and two corresponding color difference signals. FIG. The two macroblock partitions are arranged side by side. Here, this configuration is called a 4 × 8 mode sub-macroblock type.
FIG. 5 (h) is a diagram showing that a sub macroblock is composed of four submacroblock partitions each composed of a luminance signal of 4 × 4 pixels and two corresponding color difference signals. These four sub-macroblock partitions are arranged two by two vertically and horizontally. Here, this configuration is called a 4 × 4 mode sub-macroblock type.

AVC / H. In the H.264 encoding method, a mechanism that can be selected and used from the above motion compensation block sizes is adopted. First, as the motion compensation block size for each macroblock, one of 16 × 16, 16 × 8, 8 × 16, and 8 × 8 mode macroblock types can be selected. When the macro block type of 8 × 8 mode is selected, the motion compensation block size in units of sub macro blocks is 8 × 8.
, 8 × 4, 4 × 8, and 4 × 4 mode sub-macroblock types can be selected.

ISO / IEC 14496-10 Information technology-Coding of audio-visual objects-Part 10: Advanced Video Coding

When encoding information about the intra prediction mode of the image signal, information about the intra prediction mode of the luminance signal and information about the intra prediction mode of the color difference signal are encoded and arranged in the encoded stream. If the intra prediction mode is not encoded according to the color difference format, the processing efficiency may deteriorate.

The present invention has been made in view of such a situation, and an object thereof is to provide an image decoding technique capable of efficiently decoding an image signal by intra prediction of a luminance signal and a color difference signal corresponding to the color difference format. is there.

An image decoding apparatus that decodes information on an intra prediction mode in units of prediction blocks and decodes an image signal including a luminance signal and a color difference signal in units of transform blocks using intra prediction, and includes an intra of a prediction block of a luminance signal. An intra luminance prediction mode decoding unit that decodes a syntax element related to the intra prediction mode of the luminance signal and derives the intra prediction mode of the luminance signal from the encoded stream in which the information about the intra luminance prediction mode indicating the prediction method is encoded; In addition, a syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream obtained by encoding the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal, and the intra luminance prediction mode is also referred to To derive the first intra color difference prediction mode The luminance signal of the conversion block of the luminance signal is predicted from the luminance signal around the conversion block of the luminance signal in accordance with the intra luminance difference prediction mode decoding unit and the intra luminance prediction mode specified for each prediction block of the luminance signal. Color difference for predicting the color difference signal of the conversion block of the color difference signal from the color difference signal around the conversion block of the color difference signal according to the intra color difference prediction mode specified for each prediction block of the color difference signal and the luminance signal intra prediction unit A signal intra prediction unit, wherein the intra color difference prediction mode decoding unit is configured to use the first intra color difference prediction mode used when the aspect ratios of the pixels of the luminance signal and the color difference signal are different. By converting the mode number, the intra prediction mode of the second color difference signal used when the aspect ratios are different. A second intra color difference prediction mode is derived based on the conversion table set as a mode, and when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the second intra color difference prediction mode is derived. The mode number of the color difference prediction mode is also a mode number indicating vertical prediction. If the mode number of the first intra color difference prediction mode is not a mode number indicating vertical prediction, the mode number indicating vertical prediction is avoided and the second intra color difference is avoided. When the mode number of the prediction mode is set and the aspect ratio is the same, the color difference signal intra prediction unit converts the color difference signal from the color difference signal around the color difference signal conversion block according to the first intra color difference prediction mode. When the color difference signal of the block is predicted and the aspect ratio is different, the color difference is determined according to the second intra color difference prediction mode. There is provided an image decoding apparatus that predicts a color difference signal of a color difference signal conversion block from a color difference signal around a signal conversion block.
An image decoding method for decoding information on an intra prediction mode in units of prediction blocks, and decoding an image signal including a luminance signal and a color difference signal in units of transform blocks using intra prediction, wherein the intra of a prediction block of a luminance signal An intra luminance prediction mode decoding step of decoding a syntax element related to the intra prediction mode of the luminance signal and deriving an intra prediction mode of the luminance signal from the encoded stream in which the information related to the intra luminance prediction mode indicating the prediction method is encoded; In addition, a syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream obtained by encoding the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal, and the intra luminance prediction mode is also referred to And the first intra color difference prediction mode In accordance with the intra color difference prediction mode decoding step to be output and the intra luminance prediction mode specified for each prediction block of the luminance signal, the luminance signal of the luminance signal conversion block is converted from the luminance signal around the luminance signal conversion block. In accordance with the luminance signal intra prediction step to be predicted and the intra color difference prediction mode specified for each prediction block of the color difference signal, the color difference signal of the color difference signal conversion block is predicted from the color difference signals around the color difference signal conversion block. The intra-color-difference prediction mode decoding step includes the first intra-color-difference used when the aspect ratio of the pixels of the luminance signal and the color-difference signal is different when the aspect ratio is the same. Convert the prediction mode number and use it when the aspect ratio is different A second intra color difference prediction mode is derived based on the conversion table set as the intra prediction mode of the second color difference signal, and the conversion table indicates a mode number in which the mode number of the first intra color difference prediction mode indicates vertical prediction. , The mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction. If the mode number of the first intra color difference prediction mode is not a mode number indicating vertical prediction, a mode number indicating vertical prediction is set. The mode number of the second intra color difference prediction mode is set to avoid the color difference signal intra prediction step, and when the aspect ratio is the same, the color difference around the color difference signal conversion block depends on the first intra color difference prediction mode. When the color difference signal of the color difference signal conversion block is predicted from the signal and the aspect ratios are different, According to an intra color difference prediction mode, an image decoding method is provided that predicts a color difference signal of a color difference signal conversion block from color difference signals around the color difference signal conversion block.
An image decoding program that decodes information related to an intra prediction mode in units of prediction blocks, and decodes an image signal including a luminance signal and a color difference signal in units of transform blocks using intra prediction. An intra luminance prediction mode decoding step of decoding a syntax element related to the intra prediction mode of the luminance signal and deriving an intra prediction mode of the luminance signal from the encoded stream in which the information related to the intra luminance prediction mode indicating the prediction method is encoded; In addition, a syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream obtained by encoding the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal, and the intra luminance prediction mode is also referred to The first intra color difference prediction module Intra-chrominance prediction mode decoding step for deriving a luminance signal, and luminance of the luminance signal conversion block from luminance signals around the luminance signal conversion block according to the intra luminance prediction mode specified for each prediction block of the luminance signal In accordance with the luminance signal intra prediction step for predicting the signal and the intra color difference prediction mode specified for each prediction block of the color difference signal, the color difference signal of the conversion block of the color difference signal from the color difference signal around the conversion block of the color difference signal A color difference signal intra prediction step for predicting the color difference signal, and the intra color difference prediction mode decoding step is used when the aspect ratio of the pixels of the luminance signal and the color difference signal is different when the aspect ratio is the same. The aspect number is converted by converting the mode number of the first intra color difference prediction mode. The second intra chrominance prediction mode is derived based on the conversion table set as the second chrominance signal intra prediction mode to be used when the two are different, and the conversion table indicates the mode number of the first intra chrominance prediction mode. Is the mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also the mode number indicating vertical prediction, and the mode number of the first intra color difference prediction mode is not the mode number indicating vertical prediction. When the mode number of the second intra color difference prediction mode is set avoiding the mode number indicating vertical prediction, and the aspect ratio is the same, the color difference signal is determined according to the first intra color difference prediction mode. The color difference signal of the color difference signal conversion block is predicted from the color difference signal around the conversion block of Provided is an image decoding program for predicting a color difference signal of a color difference signal conversion block from color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode when the ratio is different. .
Receives an encoded stream in which a moving image is encoded, decodes information related to the intra prediction mode in units of prediction blocks included in the received encoded stream, and includes a luminance signal and a color difference signal in units of transform blocks A reception device that decodes an image signal using intra prediction, and relates to an intra prediction mode of a luminance signal from an encoded stream in which information on an intra luminance prediction mode indicating an intra prediction method of a prediction block of the luminance signal is encoded An intra luminance prediction mode decoding unit that decodes syntax elements and derives an intra prediction mode of a luminance signal, and an encoded stream in which information on the intra color difference prediction mode indicating an intra prediction method of a prediction block of a color difference signal is encoded , Syntax elements related to the intra color difference prediction mode of color difference signals The intra luminance difference prediction mode decoding unit for deriving the first intra color difference prediction mode with reference to the intra luminance prediction mode, and the luminance corresponding to the intra luminance prediction mode specified for each prediction block of the luminance signal. A luminance signal intra prediction unit that predicts a luminance signal of the luminance signal conversion block from luminance signals around the signal conversion block, and a color difference signal according to the intra color difference prediction mode specified for each prediction block of the color difference signal A color difference signal intra prediction unit that predicts a color difference signal of the color difference signal conversion block from a color difference signal around the conversion block of the color conversion signal, and the intra color difference prediction mode decoding unit includes an aspect of a pixel of the luminance signal and the color difference signal. When the ratio is different, the mode number of the first intra color difference prediction mode used when the aspect ratio is the same A second intra color difference prediction mode is derived based on the conversion table set as the intra prediction mode of the second color difference signal to be used when the aspect ratio is different, and the conversion table When the mode number of the intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the mode number of the first intra color difference prediction mode is vertical prediction. If the mode number is not the mode number indicating the vertical intra prediction, the mode number of the second intra chrominance prediction mode is set to avoid the mode number indicating the vertical prediction, and the chrominance signal intra prediction unit has the same aspect ratio, the first intra chrominance prediction According to the mode, the color difference signal of the color difference signal conversion block from the color difference signal around the color difference signal conversion block And the color difference signal of the color difference signal conversion block is predicted from the color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode. Providing equipment.
Receives an encoded stream in which a moving image is encoded, decodes information related to the intra prediction mode in units of prediction blocks included in the received encoded stream, and includes a luminance signal and a color difference signal in units of transform blocks A reception method for decoding an image signal using intra prediction, which relates to an intra prediction mode of a luminance signal from an encoded stream in which information about the intra luminance prediction mode indicating an intra prediction method of a prediction block of the luminance signal is encoded An intra luminance prediction mode decoding step for decoding a syntax element and deriving an intra prediction mode of a luminance signal, and an encoded stream in which information on an intra color difference prediction mode indicating an intra prediction method of a prediction block of a color difference signal is encoded , Syntax for color difference signal intra color difference prediction mode Intra chrominance prediction mode decoding step for deriving a first intra chrominance prediction mode with reference to the intra luminance prediction mode and decoding the element, and according to the intra luminance prediction mode specified for each prediction block of the luminance signal The luminance signal intra prediction step for predicting the luminance signal of the luminance signal conversion block from the luminance signal around the luminance signal conversion block, and the intra color difference prediction mode specified for each prediction block of the color difference signal, A color difference signal intra prediction step for predicting a color difference signal of the color difference signal conversion block from color difference signals around the color difference signal conversion block, and the intra color difference prediction mode decoding step includes: calculating the luminance signal and the color difference signal; When the aspect ratios of the pixels are different, the first input used when the aspect ratio is the same. The second intra color difference prediction mode is derived based on the conversion table set as the intra prediction mode of the second color difference signal used when the aspect ratio is different by converting the mode number of the color difference prediction mode. In the conversion table, when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the first intra color difference If the mode number of the prediction mode is not a mode number indicating vertical prediction, the mode number indicating the vertical prediction is avoided to set the mode number of the second intra color difference prediction mode, and the color difference signal intra prediction step has the same aspect ratio. The color difference signals around the color difference signal conversion block according to the first intra color difference prediction mode. When the color difference signal of the color difference signal conversion block is predicted and the aspect ratio is different, the color difference signal of the color difference signal conversion block is changed from the color difference signal around the color difference signal conversion block according to the second intra color difference prediction mode. A receiving method is provided that predicts.
Receives an encoded stream in which a moving image is encoded, decodes information related to the intra prediction mode in units of prediction blocks included in the received encoded stream, and includes a luminance signal and a color difference signal in units of transform blocks A reception program for decoding an image signal using intra prediction, which relates to an intra prediction mode of a luminance signal from an encoded stream in which information about an intra luminance prediction mode indicating an intra prediction method of a prediction block of the luminance signal is encoded An intra luminance prediction mode decoding step for decoding a syntax element and deriving an intra prediction mode of a luminance signal, and an encoded stream in which information on an intra color difference prediction mode indicating an intra prediction method of a prediction block of a color difference signal is encoded , Syntax related to intra color difference prediction mode for color difference signals Intra color difference prediction mode decoding step for deriving the first intra color difference prediction mode with reference to the intra luminance prediction mode, and the intra luminance prediction mode specified for each prediction block of the luminance signal The luminance signal intra prediction step for predicting the luminance signal of the luminance signal conversion block from the luminance signal around the luminance signal conversion block, and the intra color difference prediction mode specified for each prediction block of the color difference signal The color difference signal intra prediction step for predicting the color difference signal of the color difference signal conversion block from the color difference signals around the color difference signal conversion block is executed by the computer, and the intra color difference prediction mode decoding step includes the luminance signal and the color difference signal. When the aspect ratio of the pixels of the color difference signal is different, the aspect ratio is the same. The second intra color difference based on the conversion table set as the second color difference signal intra prediction mode used when the aspect ratio is different by converting the mode number of the first intra color difference prediction mode used for A prediction mode is derived, and when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction. If the mode number of the first intra color difference prediction mode is not a mode number indicating vertical prediction, a mode number indicating the vertical prediction is avoided and a mode number of the second intra color difference prediction mode is set, and the color difference signal intra prediction step When the aspect ratio is the same, the color difference signal conversion block is converted according to the first intra color difference prediction mode. When the color difference signal of the color difference signal conversion block is predicted from the color difference signal around the color difference and the aspect ratio is different, the color difference signal around the color difference signal conversion block is determined according to the second intra color difference prediction mode. Provided is a reception program for predicting a color difference signal of a color difference signal conversion block.

It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, etc. are also effective as an aspect of the present invention.

According to the present invention, an image signal can be efficiently decoded by intra prediction of a luminance signal and a color difference signal corresponding to a color difference format.

It is a block diagram which shows the structure of the image coding apparatus of embodiment. It is a block diagram which shows the structure of the image decoding apparatus of embodiment. It is a figure explaining the color difference format of an image. AVC / H. It is a figure explaining the unit which switches the intra prediction mode of H.264 system. AVC / H. It is a figure explaining the unit which performs inter prediction of H.264 system. It is a figure explaining the tree block prescribed | regulated by a present Example, and an encoding block. It is a figure explaining the division mode prescribed | regulated by a present Example. It is a figure explaining the value and prediction direction of the intra prediction mode prescribed | regulated by a present Example. It is a figure of an example for demonstrating the position of the block prescribed | regulated by a present Example. It is a figure explaining an example of the definition of a syntax at the time of encoding color difference format information with the sequence parameter set used as the header which encodes the information regarding the encoding of the whole sequence prescribed | regulated by a present Example. It is a figure explaining the division | segmentation method of the color difference signal of the encoding block in the NxN division | segmentation in the case of the intra prediction prescribed | regulated in a present Example. It is a block diagram which shows the structure of the 2nd encoding stream production | generation part of the image coding apparatus of embodiment. It is a block diagram which shows the structure of the 2nd encoding stream decoding part of the image decoding apparatus of embodiment. It is a table for deriving the value of the intra color difference prediction mode from the value of the syntax element used on the decoding side defined in this embodiment and the value of the intra luminance prediction mode of the prediction block of the luminance signal at the same position as the prediction block of the color difference signal. . This is an example of a conversion table for converting from the intra luminance prediction mode or the first intra color difference prediction mode to the second intra color difference prediction mode when the color difference format specified in the present embodiment is 4: 2: 2. This is a conversion table for converting from the intra luminance prediction mode or the first intra color difference prediction mode to the second intra color difference prediction mode when the color difference format specified in the present embodiment is 4: 2: 2. This is another example of a conversion table for converting from the intra luminance prediction mode or the first intra color difference prediction mode to the second intra color difference prediction mode with the color difference format specified in the present embodiment being 4: 2: 2. It is a figure explaining the value and prediction direction of the intra prediction mode of the conversion table of FIG. 15 prescribed | regulated by a present Example. It is a figure explaining the value and prediction direction of the intra prediction mode of the conversion table of FIG. 16 prescribed | regulated by a present Example. It is a figure explaining the value and prediction direction of the intra prediction mode of the conversion table of FIG. 17 prescribed | regulated by a present Example. It is a figure explaining the correspondence of the prediction direction of the luminance signal in case a color difference format is 4: 2: 2, and the intra prediction of a color difference signal. It is a figure explaining the correspondence of the prediction direction of the luminance signal in case a color difference format is 4: 2: 0, and the intra prediction of a color difference signal. The figure explaining the derivation | leading-out process procedure at the time of converting from the intra brightness | luminance prediction mode or 1st intra color difference prediction mode to 2nd intra color difference prediction mode corresponding to the conversion table of FIG.15 and FIG.16 prescribed | regulated by a present Example. It is. It is a figure explaining the derivation | leading-out process procedure at the time of converting from 1st intra color difference prediction mode to 2nd intra color difference prediction mode corresponding to the conversion table of FIG. 17 prescribed | regulated by a present Example. The value of the syntax element related to the intra color difference prediction mode from the value of the intra color difference prediction mode used on the encoding side defined in this embodiment and the value of the intra luminance prediction mode of the prediction block of the luminance signal at the same position as the prediction block of the color difference signal Is a table for deriving It is a figure explaining the process sequence of the decoding in the decoding side intra prediction mode, and intra prediction. It is an example of the table which derives | leads-out the angle of the intra prediction for color difference formats 4: 2: 2 from 1st intra color difference prediction mode. It is another example of the table which derives | leads-out the angle of the intra prediction for color difference formats 4: 2: 2 from 1st intra color difference prediction mode. It is a figure explaining the derivation | leading-out process procedure which derives | leads-out the angle of the intra prediction for color difference formats 4: 2: 2 from 1st intra color difference prediction mode corresponding to the table of FIG. 28 prescribed | regulated by a present Example. This is a conversion table for converting from the intra luminance prediction mode or the first intra color difference prediction mode to the second intra color difference prediction mode when the color difference format specified in the present embodiment is 4: 2: 2. It is a figure explaining the value and prediction direction of the intra prediction mode of the conversion table of FIG. 30 prescribed | regulated by a present Example. It is a figure explaining the derivation | leading-out process procedure at the time of converting from 1st intra color difference prediction mode to 2nd intra color difference prediction mode corresponding to the conversion table of FIG. 30 prescribed | regulated by a present Example. This is a conversion table for converting from the intra luminance prediction mode or the first intra color difference prediction mode to the second intra color difference prediction mode when the color difference format specified in the present embodiment is 4: 2: 2. It is a figure explaining the value and prediction direction of the intra prediction mode of the conversion table of FIG. 33 prescribed | regulated by a present Example. It is a figure explaining the derivation | leading-out process procedure at the time of converting from 1st intra color difference prediction mode to 2nd intra color difference prediction mode corresponding to the conversion table of FIG. 33 prescribed | regulated by a present Example.

In the present embodiment, with regard to encoding and decoding of moving images, in particular, a picture can be of any size,
Intra-prediction, in which prediction is performed from pixel values of surrounding blocks that have already been encoded and decoded in encoding and decoded (hereinafter referred to as “decoded”), and already decoded in block units divided into rectangular shapes The amount of code is reduced from the already-used picture using inter prediction by motion compensation.

  First, techniques used in this embodiment and technical terms are defined.

(Color difference format)
In the description of the embodiment, the color difference format of the image to be encoded and decoded is monochrome, 4: 2: 0, 4: 2: 2, 4: 4: 4, and the luminance signal and the color difference signal are set as a set. It shall be encoded and decoded. However, regarding the description regarding the color difference signal, the description in the case of monochrome is omitted. When the color difference format is 4: 4: 4, RGB signals can be encoded and decoded. In that case, the G (green) signal is regarded as a luminance signal, the B (blue) signal,
The R (red) signal is regarded as a color difference signal, and is encoded and decoded. In the present embodiment, the method of independently encoding and decoding the luminance signal and the color difference signal at 4: 4: 4 is assumed to be monochrome.

(About tree blocks and coding blocks)
In the embodiment, as shown in FIG. 6, the inside of the screen is equally divided into square units of any same size. This unit is defined as a tree block, and is used as a basic unit of address management for specifying an encoding / decoding target block (an encoding target block in encoding and a decoding target block in decoding) in an image. Except for monochrome, the tree block is composed of one luminance signal and two color difference signals. The size of the tree block can be freely set to a power of 2 in accordance with the picture size and the texture in the screen. In order to optimize the encoding process according to the texture in the screen, the tree block hierarchically divides the luminance signal and chrominance signal in the tree block as necessary into four parts (two parts vertically and horizontally), The block can be made smaller in block size. Each block is defined as a coding block, and is a basic unit of processing when performing coding and decoding. Except for monochrome, the coding block is also composed of one luminance signal and two color difference signals. The maximum size of the coding block is the same as the size of the tree block. An encoded block having the minimum size of the encoded block is called a minimum encoded block, and can be freely set to a power of 2.

In FIG. 6, the encoding block A is a single encoding block without dividing the tree block. The encoding block B is an encoding block formed by dividing a tree block into four. The coding block C is a coding block obtained by further dividing the block obtained by dividing the tree block into four. Encoding block D is a tree block of 4
It is an encoded block that is obtained by further dividing the block obtained by dividing into four hierarchically twice.
It is a coding block of the minimum size.

In the description of the embodiment, the color difference format is 4: 2: 0, the size of the tree block is set to 64 × 64 pixels for the luminance signal, and 32 × 32 pixels for the color difference signal, and the minimum coding block size is set. The luminance signal is set to 8 × 8 pixels, and the color difference signal is set to 4 × 4 pixels.
In FIG. 6, the size of the coding block A is 64 × 64 pixels for luminance signals and 32 × 3 for color difference signals.
The size of the encoding block B is 32 × 32 pixels for luminance signals and 16 for color difference signals.
The size of the coding block C is 16 × 16 pixels for the luminance signal and 8 × 8 pixels for the color difference signal, and the size of the coding block D is 8 × 8 pixels for the luminance signal and 4 × for the color difference signal.
4 pixels. When the color difference format is 4: 4: 4, the size of the luminance signal and the color difference signal of each coding block is equal. When the color difference format is 4: 2: 2, the size of the coding block A is 32 × 64 pixels for the color difference signal, the size of the coding block B is 16 × 32 pixels for the color difference signal, and the size of the coding block C is The color difference signal is 8 × 16 pixels, and the size of the coding block D, which is the smallest coding block, is 4 × 8 pixels.

(About prediction mode)
For each coding block, switching is performed between intra prediction in which prediction is performed from surrounding image signals that have been encoded / decoded and inter prediction in which prediction is performed from image signals of images that have been encoded / decoded.
A mode for identifying the intra prediction and the inter prediction is defined as a prediction mode (PredMode). The prediction mode (PredMode) is either intra prediction (MODE_INTRA) or inter prediction (MODE_I
NTER) as a value and can be selected and encoded.

(About split mode and prediction block)
When intra prediction and inter prediction are performed by dividing the screen into blocks, prediction is performed by dividing an encoded block as necessary in order to reduce the unit for switching the method of intra prediction and inter prediction. A mode for identifying the division method of the luminance signal and the color difference signal of the coding block is defined as a division mode (PartMode). Furthermore, this divided block is defined as a prediction block. As shown in FIG. 7, four types of partition modes (PartMode) are defined according to the method of dividing the luminance signal of the coding block. The division mode (PartMode) of the coding block luminance signal (FIG. 7A) regarded as one prediction block without being divided is 2N ×.
2N division (PART_2Nx2N), the luminance signal of the coding block is divided into two in the horizontal direction, and the division mode (PartMode) of the two prediction blocks (FIG. 7B) is set to 2N × N division (PART_2Nx
N) The luminance signal of the coding block is divided in the vertical direction, and the division mode (PartMode) of the coding block having two prediction blocks (FIG. 7C) is N × 2N division (PART_Nx2N)
Then, the division mode (PartMode) of the luminance signal of the encoded block that is divided into four prediction blocks by horizontal and vertical equal division (FIG. 7D) is defined as N × N division (PART_NxN). Except for N × N division (PART_NxN) of intra prediction (MODE_INTRA), the color difference signal is also divided in the same manner as the vertical and horizontal division ratios of the luminance signal for each division mode (PartMode). The vertical / horizontal division ratio of the color difference signal of the N × N division (PART_NxN) coding block of intra prediction (MODE_INTRA) differs depending on the type of the color difference format, which will be described later.

In order to identify each prediction block within the coding block, a number starting from 0 is assigned to the prediction block existing inside the coding block in the coding order. This number is defined as a split index PartIdx. A number described in each prediction block of the encoded block in FIG. 7 represents a partition index PartIdx of the prediction block. FIG.
In the 2N × N division (PART_2NxN) shown in FIG. N shown in FIG.
In × 2N division (PART_Nx2N), the division index PartIdx of the left prediction block is set to 0, and the division index PartIdx of the right prediction block is set to 1. N × N division (P
ART_NxN) sets the partition index PartIdx of the upper left prediction block to 0, the partition index PartIdx of the upper right prediction block to 1, and the partition index Par of the lower left prediction block
tIdx is set to 2, and the division index PartIdx of the lower right prediction block is set to 3.

When the prediction mode (PredMode) is intra prediction (MODE_INTRA), the divided mode (Part
Mode) defines 2N × 2N partitioning (PART_2Nx2N), only coding block D which is the smallest coding block, and partition mode (PartMode) is 2N × 2N partitioning (PART_2Nx2N) and N × N partitioning (
PART_NxN) is defined.

When the prediction mode (PredMode) is inter prediction (MODE_INTER), the partition mode (PartMode) is 2N × 2N partition (PART_2Nx2N) except for the coding block D which is the smallest coding block.
) 2N × N partition (PART_2NxN) and N × 2N partition (PART_Nx2N) are defined, and only the coding block D, which is the smallest coding block, has a partition mode (PartMode) of 2N × 2N partition (PA).
RT_2Nx2N), 2N x N split (PART_2NxN), and N x 2N split (PART_Nx2N) plus N x
N division (PART_NxN) is defined. In addition to the smallest coding block, N × N division (PART_N
The reason for not defining xN) is that, except for the smallest coding block, the coding block can be divided into four to represent a small coding block.

(Intra prediction and intra prediction mode)
In the intra prediction, the pixel value of the conversion block to be processed is predicted from the pixel values of the decoded block, which will be described later, in the same screen. In the encoding apparatus and decoding apparatus of the present embodiment, 35 prediction modes are selected for each prediction block, and intra prediction is performed for each transform block. Although the size of the prediction block and the transform block may be different, the intra prediction mode of the prediction block including the transform block is used for intra prediction of the transform block. FIG. 8 is an explanatory diagram of intra prediction mode values and prediction directions defined in this embodiment. The value of the intra prediction mode is defined by mode numbers from 0 to 34. Intra prediction mode (intraPredMode) is predicted by interpolating pixel values from surrounding decoded blocks (intra prediction mode intraPredMode = 0), and by deriving an average value from surrounding decoded blocks Predicted average value prediction (intra prediction mode intraPredMod
In addition to e = 1), 33 angle predictions (intra prediction mode intraPredMode = 2... 34) for predicting at various angles from surrounding decoded blocks are defined.

(Conversion block)
As in the prior art, in this embodiment, the amount of code is reduced by using orthogonal transform such as DCT (Discrete Cosine Transform), DST (Discrete Sine Transform), etc. that transforms a discrete signal into the frequency domain and its inverse transform. . Conversion or inverse conversion is performed in units of transform blocks obtained by hierarchically dividing an encoded block into four. In the embodiment, 32 × 32 pixels, 16 × 16 pixels, 8 × 8 pixels, 4 ×
Define 4 conversion sizes of 4 pixels, 32 × 32 conversion, 16 × 16 conversion, 8 × 8 conversion,
It is assumed that 4 × 4 conversion and respective inverse conversion are performed.

(Position of tree block, coding block, prediction block, transform block)
The position of each block including the tree block, the encoding block, the prediction block, and the transform block described in the present embodiment is the origin (0, 0) of the pixel position of the upper left luminance signal on the luminance signal screen. And the pixel position of the upper left luminance signal included in each block area is represented by two-dimensional coordinates (x, y). The direction of the coordinate axis is a right direction in the horizontal direction and a downward direction in the vertical direction, respectively, and the unit is one pixel unit of the luminance signal. Of course, the luminance difference and the color difference signal have the same image size (number of pixels) and the color difference format is 4: 4: 4.
Even in the case of 2: 0, 4: 2: 2, the position of each block of the color difference signal is represented by the coordinates of the pixel of the luminance signal included in the block area, and the unit is one pixel of the luminance signal. In this way, not only can the position of each block of the color difference signal be specified, but also the relationship between the positions of the luminance signal block and the color difference signal block can be clarified only by comparing the coordinate values. FIG. 9 is an example for explaining the position of the block defined in the present embodiment when the color difference format is 4: 2: 0. 9 indicates the position of the pixel of the luminance signal on the screen plane of the image, and ○ indicates the position of the pixel of the color difference signal. The dotted square in FIG. 9 is not only a block E of luminance signal of 8 × 8 pixels, but also a block F of color difference signals of 4 × 4 pixels. ▲ is the position of the pixel of the luminance signal at the top left of the block E of the luminance signal of 8 × 8 pixels indicated by the dotted line. Therefore, ▲ is the position of the luminance signal block E of 8 × 8 pixels indicated by the dotted line, and the coordinates of the luminance signal of the pixel indicated by ▲ are the coordinates of the block E of the luminance signal of 8 × 8 pixels indicated by the dotted line. Become. Similarly, ▲ is also the pixel position of the upper left luminance signal included in the area of the block F of the color difference signal of 4 × 4 pixels indicated by the dotted line. Therefore, ▲ also becomes the position of the block F of the color difference signal of 4 × 4 pixels indicated by the dotted line, and the coordinates of the luminance signal of the pixel indicated by ▲ are 4 × 4 indicated by the dotted line.
It becomes the coordinates of the block F of the color difference signal of the pixel. In the embodiment, when the coordinates of the defined luminance signal block and the x component and y component of the coordinate of the color difference signal are the same regardless of the type of the color difference format, the shape and size of the block. Only define these blocks in the same position.

FIG. 1 is a block diagram illustrating a configuration of an image encoding device according to an embodiment. The image coding apparatus according to the embodiment includes a color difference format setting unit 101, an image memory 102, and an intra prediction unit 1.
03, inter prediction unit 104, encoding method determination unit 105, residual signal generation unit 106, orthogonal transform / quantization unit 107, inverse quantization / inverse orthogonal transform unit 108, decoded image signal superimposing unit 109, decoded image memory 111 , A first encoded stream generation unit 112, a second encoded stream generation unit 113, a third encoded stream generation unit 114, and an encoded stream multiplexing unit 115.

The color difference format setting unit 101 sets the color difference format of the image signal to be encoded. The color difference format may be determined by determining the color difference format from the encoded image signal supplied to the color difference format setting unit 101, or may be set from the outside. Only the luminance signal is supplied to the first encoded stream generation unit 112 as the information of the color difference format set to 4: 2: 0, 4: 2: 2, or 4: 4: 4, and the second code The encoded stream generation unit 113 supplies the encoded stream based on the color difference format. Although not shown, the image memory 102, the intra prediction unit 103, and the inter prediction unit 104 in FIG.
, Encoding method determination unit 105, residual signal generation unit 106, orthogonal transform / quantization unit 107, inverse quantization / inverse orthogonal transform unit 108, decoded image signal superimposition unit 109, third encoded stream generation unit 1
14, the encoding process is performed based on the set color difference format, and the encoding information storage memory 110 and the decoded image memory 111 are managed based on the set color difference format.

The image memory 102 temporarily stores the encoding target image signal supplied in time order. The image signals to be encoded stored in the image memory 102 are rearranged in the encoding order, divided into a plurality of combinations according to the setting, and divided into units of the respective prediction blocks. And supplied to the intra prediction unit 103 and the inter prediction unit 104.

The intra prediction unit 103 performs each division mode (Pa
a plurality of intra luminance prediction modes and intra color difference prediction modes for each of the luminance signal and color difference signal of the prediction block to be encoded from the decoded image signal stored in the decoded image memory 111 in units of prediction blocks corresponding to rtMode) Set the intra brightness prediction mode,
And each intra prediction according to the intra color difference prediction mode is performed for each transform block,
An intra prediction signal is obtained. The intra color difference prediction mode is a value predicted from the intra luminance prediction mode, or 0 (plane prediction), 1 (average prediction), 10 (horizontal prediction), and 26 (vertical prediction), which are representative intra prediction modes. ), 34 (oblique prediction) can be selected for each prediction block. However, in this embodiment, the color difference format is 4
In the case of: 2: 2 intra prediction, a second intra color difference prediction mode described later is used. The intra prediction of color difference signals and the intra prediction mode will be described later in detail.

A prediction residual signal is obtained by subtracting the intra prediction signal in units of prediction blocks for each pixel from the signal to be encoded supplied in units of prediction blocks. An evaluation value for evaluating the code amount and the distortion amount is derived using the prediction residual signal, and the most code amount and distortion are selected from a plurality of intra luminance prediction modes and intra color difference prediction modes for each prediction block. An encoding mode determination unit that selects an optimal mode from the viewpoint of quantity and uses intra prediction information corresponding to the selected intra prediction mode, an intra prediction signal, and an evaluation value of the intra prediction as candidates for intra prediction of the prediction block. It supplies to 105.

The inter prediction unit 104 performs each division mode (Pa
rtMode), that is, in units of prediction blocks, from the decoded image signals stored in the decoded image memory 111, a plurality of inter prediction modes (L0 prediction, L1 prediction, bi-prediction), and reference images, respectively. Inter prediction is performed to obtain an inter prediction signal. At that time, a motion vector search is performed, and inter prediction is performed according to the searched motion vector. In the case of bi-prediction, inter-prediction of bi-prediction is performed by averaging or weighting and adding two inter-prediction signals for each pixel. A prediction residual signal is obtained by subtracting the inter prediction signal in units of prediction blocks for each pixel from the signal to be encoded supplied in units of prediction blocks. Deriving evaluation values for evaluating the code amount and distortion amount using the prediction residual signal, and the most suitable mode in terms of code amount and distortion amount from among a plurality of inter prediction modes for each prediction block And the inter prediction information corresponding to the selected inter prediction mode, the inter prediction signal, and the evaluation value of the inter prediction are supplied to the encoding method determination unit 105 as inter prediction candidates for the prediction block.

The encoding method determination unit 105 selects an optimum code based on the intra prediction evaluation value corresponding to the intra prediction information selected for each prediction block in the plurality of encoding block units and the inter prediction evaluation value corresponding to the inter prediction information. Block splitting method, prediction mode (
PredMode) and division mode (PartMode) are determined, and encoded information including intra prediction information or inter prediction information according to the determination is supplied to the second encoded stream generation unit 113, and the encoded information storage memory 110 And the prediction signal subjected to intra prediction or inter prediction according to the determination is supplied to the residual signal generating unit 106 and the decoded image signal superimposing unit 109.

The residual signal generation unit 106 generates a residual signal by subtracting the prediction signal subjected to intra prediction or inter prediction from the image signal to be encoded for each pixel, and supplies the residual signal to the orthogonal transform / quantization unit 107.

The orthogonal transform / quantization unit 107 performs orthogonal transform and quantization for transforming the supplied residual signal into a frequency domain such as DCT or DST according to the quantization parameter, and performing the orthogonal transform / quantization residual. A signal is generated and supplied to the third encoded stream generation unit 114 and the inverse quantization / inverse orthogonal transform unit 108.

The first encoded stream generation unit 112 derives values of syntax elements related to encoding information in units of sequences, pictures, and slices in accordance with semantic rules that define the meaning of the syntax elements and the derivation method. Entropy coding is performed on the value of the syntax element in accordance with syntax rules, such as variable-length coding and arithmetic coding, to generate a first coded stream, and the coded first coded stream is coded. This is supplied to the stream multiplexing unit 115. The value of the syntax element regarding the color difference format is also derived by the first encoded stream generation unit 112. A syntax element relating to the color difference format is derived from the color difference format information supplied from the color difference format setting unit 101. FIG.
0 is an example of a syntax definition when encoding color difference format information with a sequence parameter set serving as a header for encoding information relating to encoding of the entire sequence defined in the present embodiment. The syntax element chroma_format_idc indicates the type of color difference format. The meaning of the syntax element chroma_format_idc is 0 for monochrome and 1 for 4: 2.
0 and 2 represent 4: 2: 2, and 3 represents 4: 4: 4. Also, the syntax element separate_colour_
The meaning of plane_flag indicates whether the luminance signal and chrominance signal are encoded separately.
When the value of _colour_plane_flag is 0, it represents that two color difference signals are associated with the luminance signal and encoded. When the value of the syntax element chroma_format_idc is 1, the luminance signal and 2
It represents that two color difference signals are encoded separately. Only when the value of the syntax element chroma_format_idc is 3, that is, when the color difference format is 4: 4: 4, the value of chroma_format_idc can be set to 0 or 1, and in other color difference formats, the syntax element is always used.
Encoding is performed assuming that the value of separate_colour_plane_flag is 0.

The second encoded stream generation unit 113 is determined by the encoding method determination unit 105 for each prediction block, in addition to the encoding information for each encoding block, in accordance with the semantic rules that define the meaning of the syntax element and the derivation method. A value of a syntax element related to the encoded information is derived. Specifically, in addition to coding information in units of coding blocks such as a coding block division method, prediction mode (PredMode), and division mode (PartMode), values of syntax elements relating to coding information in units of prediction blocks Is derived. When the prediction mode (PredMode) is intra prediction, a value of a syntax element regarding the intra prediction mode including the intra luminance prediction mode and the intra color difference prediction mode is derived, and when the prediction mode (PredMode) is inter prediction, the inter prediction mode A value of a syntax element related to inter prediction information such as information specifying a reference image and a motion vector is derived. The derived syntax element values are entropy-encoded by variable-length encoding, arithmetic encoding, etc. according to syntax rules to generate a second encoded stream, and the encoded second encoding The stream is supplied to the encoded stream multiplexing unit 115. Note that details of processing contents related to the derivation of syntax elements related to the intra luminance prediction mode and the intra color difference prediction mode performed by the second encoded stream generation unit 113 will be described later.

The third coded stream generation unit 114 performs entropy coding by variable length coding, arithmetic coding, and the like on the orthogonally transformed and quantized residual signal according to a prescribed syntax rule, and performs the third coded stream. And the third encoded stream is supplied to the encoded stream multiplexing unit 115.

The encoded stream multiplexing unit 115 generates a bit stream by multiplexing the first encoded stream, the second encoded stream, and the third encoded stream according to a prescribed syntax rule. Output a bitstream.

The inverse quantization / inverse orthogonal transform unit 108 performs inverse quantization and inverse orthogonal transform on the orthogonal transform / quantized residual signal supplied from the orthogonal transform / quantization unit 107 to derive a residual signal for decoding. This is supplied to the image signal superimposing unit 109. The decoded image signal superimposing unit 109 includes a prediction signal that has been intra-predicted or inter-predicted according to the determination by the encoding method determining unit 105, and a residual that has been inversely quantized and inversely orthogonal transformed by the inverse quantization / inverse orthogonal transform unit 108. The decoded image is generated by superimposing the signal and stored in the decoded image memory 111. Note that the decoded image may be stored in the decoded image memory 111 after filtering processing that reduces block distortion or the like due to encoding.

FIG. 2 is a block diagram showing a configuration of an image decoding apparatus according to an embodiment corresponding to the image encoding apparatus of FIG. The image decoding apparatus according to the embodiment includes an encoded stream separation unit 201, a first encoded stream decoding unit 202, a second encoded stream decoding unit 203, a third encoded stream decoding unit 204, and a color difference format management unit. 205, an intra prediction unit 206, an inter prediction unit 207, an inverse quantization / inverse orthogonal transform unit 208, a decoded image signal superimposing unit 209, an encoded information storage memory 210, a decoded image memory 211, and switches 212 and 213.

The bit stream supplied to the coded stream separation unit 201 is separated according to a rule of a prescribed syntax, and is a first indicating coding information in units of sequences, pictures, and slices.
Is supplied to the first encoded stream decoding unit 202, and the second encoded stream including the encoded information in units of encoded blocks is the second encoded stream decoding unit 203.
The third encoded stream including the orthogonal transform and quantized residual signal is supplied to the third encoded stream decoding unit 204.

The first encoded stream decoding unit 202 supplies the supplied first first according to the syntax rule.
The encoded stream is entropy-decoded to obtain respective values of syntax elements related to encoding information in units of sequences, pictures, and slices. The meaning of the syntax element, the decoded sequence, picture,
Also, encoding information in units of sequences, pictures, and slices is derived from values of syntax elements relating to encoding information in units of slices. The first encoded stream decoding unit 202 is an encoded stream decoding unit corresponding to the first encoded stream generation unit 112 on the encoding side, and the sequence encoded by the first encoded stream generation unit 112, It has the function to return to each encoding information from the 1st encoding stream containing the encoding information of a picture and a slice unit. The color difference format information encoded by the first encoded stream generation unit 112 is a syntax element regarding the color difference format information obtained by entropy decoding the second encoded stream by the first encoded stream decoding unit 202. Derived from the value. According to the syntax rules and semantic rules shown in FIG. 10, the type of the color difference format is specified from the value of the syntax element chroma_format_idc, and the syntax element chrom
The value of a_format_idc is 0 for monochrome, 1 for 4: 2: 0, 2 for 4: 2: 2, and 3 for 4: 4: 4. Further, when the value of the syntax element chroma_format_idc is 3, that is, the color difference format is 4: 4: 4, the syntax element separate_colour_plane_flag is decoded to determine whether the luminance signal and the color difference signal are encoded separately. The derived color difference format information is supplied to the color difference format management unit 205.

The color difference format management unit 205 manages the supplied color difference format information. The supplied color difference format information is supplied to the second encoded stream decoding unit 203, and the encoding block and prediction block encoding information derivation processing based on the color difference format information is performed. Although not explicitly shown in the figure, the third encoded stream decoding unit 204, the intra prediction unit 206, the inter prediction unit 207, the inverse quantization / inverse orthogonal transform unit 208, and the decoded image signal superimposing unit 209 in FIG. Decoding processing based on the color difference format information is performed, and the encoding information storage memory 210 and the decoded image memory 211 are managed based on the color difference format information.

The second encoded stream decoding unit 203 receives the supplied first in accordance with the syntax rule.
The encoded stream is entropy-decoded to obtain respective values of syntax elements related to the encoded information of the encoded block and the prediction block. The meaning of the syntax element,
In accordance with the semantic rules that define the derivation method, encoding information for each encoding block and each prediction block is derived from the supplied encoding block unit and syntax element values related to the prediction information for each prediction block. Second encoded stream decoding unit 203
Is an encoded stream decoding unit corresponding to the second encoded stream generation unit 113 on the encoding side, and the encoding block encoded by the second encoded stream generation unit 113 and encoding in units of prediction blocks It has the function to return to each encoding information from the 2nd encoding stream containing information. Specifically, from each syntax element obtained by decoding the second encoded stream according to a prescribed syntax rule, in addition to the encoding block division method, prediction mode (PredMode), and division mode (PartMode) When the prediction mode (PredMode) is intra prediction, an intra prediction mode including an intra luminance prediction mode and an intra color difference prediction mode is obtained. On the other hand, when the prediction mode (PredMode) is inter prediction, inter prediction mode, information for specifying a reference image, and inter prediction information such as a motion vector are obtained. When the prediction mode (PredMode) is intra prediction, the intra prediction mode 206 including the intra luminance prediction mode and the intra color difference prediction mode is supplied to the intra prediction unit 206 via the switch 212. When the prediction mode (PredMode) is inter prediction, Through the switch 212, inter prediction mode, information for identifying a reference image, and inter prediction information such as a motion vector are supplied to the inter prediction unit 207. Details regarding the entropy decoding process performed by the second encoded stream decoding unit 203, and the intra luminance prediction mode and the intra color difference prediction mode derivation process from the syntax elements related to the intra luminance prediction mode and the intra color difference prediction mode. This process will be described later.

The third encoded stream decoding unit 204 decodes the supplied third encoded stream to derive an orthogonally transformed / quantized residual signal and reverses the orthogonally transformed / quantized residual signal. This is supplied to the quantization / inverse orthogonal transform unit 208.

The intra prediction unit 206 generates a predicted image signal by intra prediction from the decoded peripheral blocks stored in the decoded image memory 211 according to the supplied intra luminance prediction mode and intra color difference prediction mode, and switches the switch 213. Then, the predicted image signal is supplied to the decoded image signal superimposing unit 209. However, in this embodiment, the color difference format is 4
In the case of: 2: 2 intra prediction, a second intra color difference prediction mode described later is used. The intra prediction of color difference signals and the intra prediction mode will be described later in detail.

The inter prediction unit 207 uses motion compensation from the decoded reference picture stored in the decoded image memory 211 using the inter prediction mode supplied, information specifying the reference picture, and inter prediction information such as a motion vector. A predicted image signal is generated by inter prediction, and the predicted image signal is supplied to the decoded image signal superimposing unit 209 via the switch 213. In the case of bi-prediction, the two motion-compensated prediction image signals of L0 prediction and L1 prediction are adaptively multiplied and weighted to generate a final prediction image signal.

The inverse quantization / inverse orthogonal transform unit 208 performs inverse orthogonal transform and inverse quantization on the orthogonal transform / quantized residual signal decoded by the third encoded stream decoding unit 204 to perform inverse orthogonal transform.・
An inverse quantized residual signal is obtained.

The decoded image signal superimposing unit 209 includes a prediction image signal predicted by the intra prediction unit 206 or the inter prediction unit 207, and a residual signal that has been inversely orthogonal transformed / inversely quantized by the inverse quantization / inverse orthogonal transform unit 208. Is decoded to decode the decoded image signal, and the decoded image memory 211 is decoded.
To store. When stored in the decoded image memory 211, the decoded image may be stored in the decoded image memory 211 after filtering processing for reducing block distortion or the like due to encoding is performed on the decoded image. The decoded image signals stored in the decoded image memory 211 are output in the output order.

Next, it is used for intra prediction and intra prediction performed by the intra prediction unit 103 of the image encoding device in FIG. 1 and the intra prediction unit 206 of the image decoding device in FIG. 2, and the second code in FIG. An intra prediction mode encoded by the encoded stream generation unit 113 and decoded by the second encoded stream decoding unit 203 of FIG. 2 will be described.

In the intra prediction, the pixel value of the conversion block to be processed is predicted from the pixel values of the surrounding decoded conversion blocks in the same screen. In the encoding apparatus and decoding apparatus of the present embodiment, 35 intra prediction modes are selected and intra prediction is performed. FIG. 8 is an explanatory diagram of intra prediction mode values and prediction directions defined in this embodiment. The direction indicated by the arrow indicates the prediction direction of each intra prediction, that is, the direction referred to in the intra prediction. In each intra prediction mode, each pixel (see FIG. 8) is referenced with reference to the decoded boundary pixels in the prediction direction of the intra prediction (direction indicated by the arrow in FIG. 8) included in the transform block adjacent to the transform block that is the target of intra prediction. Intra prediction of the pixel at the start point of the arrow 8) is performed. The numbers on the left and upper sides indicate the value of the intra prediction mode. The numbers on the right side and the lower side indicate the angles of intra prediction corresponding to the left and upper intra prediction modes, respectively. Intra prediction mode (intraPredMode) is a plane prediction (intra prediction mode) that predicts by interpolating pixel values from pixels of surrounding decoded transform blocks.
intraPredMode = 0), in addition to the average value prediction (intra prediction mode intraPredMode = 1) that is predicted by deriving the average value from the pixels of the surrounding decoded transform block, various from the pixels of the surrounding decoded transform block 33 angle predictions (intra prediction mode intraPredMode = 2... 34) that are predicted at a certain angle are defined. Note that this angle prediction includes vertical prediction (intra prediction mode intraPredMode = 26) that predicts in the vertical direction from the pixel of the transformed block above.
), And horizontal prediction (intra prediction mode intraPredMode = 10) for predicting in the horizontal direction from the pixels of the left decoded transform block. In this embodiment, the angle of intra prediction is represented by the length in the vertical direction with respect to the unit length 32 in the horizontal direction or the length in the horizontal direction with respect to the unit length 32 in the vertical direction. The angle of intra prediction corresponding to the intra prediction mode of horizontal prediction for predicting in the horizontal direction is set to 0, and the vertical length with respect to the unit length 32 in the horizontal direction is represented by a positive value in the downward direction and a negative value in the upward direction. The angle of intra prediction is used. Alternatively, the angle of intra prediction corresponding to the intra prediction mode of vertical prediction that predicts in the vertical direction is set to 0, and the horizontal length with respect to the unit length 32 in the vertical direction is positive in the right direction and negative in the left direction. Expressed as the angle of intra prediction. For example, an intra prediction angle of 32 represents a power method of 45 °, and −32 represents a power method of −45 °.

The intra prediction mode is prepared for each of the luminance signal and the color difference signal, and the intra prediction mode for the luminance signal is defined as the intra luminance prediction mode, and the intra prediction mode for the color difference signal is defined as the intra color difference prediction mode. In the encoding and decoding of the intra luminance prediction mode, when it is determined that the encoding side can predict from the intra luminance prediction mode of the surrounding block using the correlation with the intra luminance prediction mode of the surrounding block. When it is determined that it is better to set a different value for the intra luminance prediction mode than to predict from the intra luminance prediction mode of the neighboring blocks by transmitting information for identifying the block to be referred to, the intra luminance prediction mode is further increased. A mechanism for encoding or decoding the value of is used. By predicting the intra luminance prediction mode of the block to be encoded / decoded from the intra luminance prediction modes of the neighboring blocks, the amount of code to be transmitted can be reduced. On the other hand, in the coding and decoding of the intra chrominance prediction mode, the intra luminance prediction mode is used on the encoding side by utilizing the correlation with the intra luminance prediction mode of the prediction block of the luminance signal at the same position as the prediction block of the chrominance signal. From the value of the intra luminance prediction mode, the value of the intra color difference prediction mode is predicted from the value,
When it is determined that it is better to set a unique value for the intra color difference prediction mode than for prediction from the intra luminance prediction mode, a mechanism for encoding or decoding the value of the intra color difference prediction mode is used. By predicting the intra color difference prediction mode from the intra luminance prediction mode, the amount of code to be transmitted can be reduced.

Next, points relating to the intra prediction mode, which is a feature of the embodiment, regarding the encoding processing of the encoding block and the encoding information in units of prediction blocks performed by the second encoded stream generation unit 113 in FIG. The explanation is centered. FIG. 12 is a block diagram showing the configuration of the second encoded stream generation unit 113 in FIG.

As shown in FIG. 12, the second encoded stream generating unit 113 in FIG. 1 includes a syntax element deriving unit 121 for encoding information in units of coding blocks, a syntax element deriving unit 122 for intra luminance prediction mode, an intra It includes a syntax element deriving unit 123 for the color difference prediction mode, a syntax element deriving unit 124 for inter prediction information, an intra prediction mode encoding control unit 125, and an entropy encoding unit 126. In each unit constituting the second encoded stream generation unit 113, the color difference format setting unit 101
Are performed according to the color difference format information supplied from, and also according to the coding information such as the prediction mode and the partition mode (PartMode) for each coding block.

The syntax element deriving unit 121 related to the coding information in units of coding blocks derives values of syntax elements related to the coding information in units of coding blocks, and the derived values of syntax elements are sent to the entropy coding unit 126. Supply. Intra prediction of coded block (
MODE_INTRA) or prediction mode (PredMode) to determine inter prediction (MODE_INTER),
And the value of the syntax element regarding the division mode (PartMode) which discriminates the shape of the prediction block is derived by the syntax element deriving unit 121 regarding the coding information of the coding block unit.

The syntax element deriving unit 122 regarding the intra luminance prediction mode, when the prediction mode (PredMode) of the coding block is intra prediction (MODE_INTRA), sets the value of the syntax element regarding the intra luminance prediction mode of the prediction block of the luminance signal, respectively. Then, the value of each derived syntax element is supplied to the entropy encoding unit 126. The syntax element relating to the intra luminance prediction mode is a flag indicating whether or not prediction can be performed from the intra luminance prediction mode of the surrounding blocks. Syntax element prev_intra_luma_pred_flag [x0] [y0
], A syntax element mpm_idx [x0] that is an index that points to the prediction block of the prediction source
[y0] and a syntax element rem_in indicating an intra luminance prediction mode in units of prediction blocks
tra_luma_pred_mode [x0] [y0]. Note that x0, and y0 are coordinates indicating the position of the prediction block. In deriving the value of the syntax element for the intra luminance prediction mode,
This is a flag indicating that the value is used when prediction is possible from the intra-brightness prediction mode of the surrounding block using the correlation with the intra-brightness prediction mode of the surrounding block stored in the encoded information storage memory 110. Syntax element prev_intra_luma_pred_flag [x0
] [y0] is set to 1 (true), and a value specifying the reference destination is set in the syntax element mpm_idx [x0] [y0], which is an index indicating the prediction block of the prediction source. , Prev_intra_luma_pred_flag [x0] [y0] is set to 0 (false), and a value specifying the intra luminance prediction mode is set to the syntax element rem_intra_luma_pred_mode [x0] [y0] indicating the intra luminance prediction mode to be encoded.

In addition, when the number of intra-brightness prediction modes of the prediction block in an encoding block differs according to a division block, and a division mode (PartMode) is 2Nx2N division, the intra-intensity of one set of prediction blocks for every encoding block The value of the syntax element regarding the prediction mode is derived, and when the division mode is N × N division, the value of the syntax element regarding the intra luminance prediction mode of four sets of prediction blocks is derived for each coding block.

The syntax element deriving unit 123 related to the intra color difference prediction mode, when the prediction mode (PredMode) of the encoded block is intra prediction (MODE_INTRA), the syntax element related to the intra color difference prediction mode of the prediction block of the color difference signal intra_chroma_pred_mode [x0] [
The value of y0] is derived, and the value of the derived syntax element intra_chroma_pred_mode [x0] [y0] is supplied to the entropy encoding unit 126. In the determination of the intra color difference prediction mode in the intra prediction unit 103 and the derivation of the syntax element value related to the intra color difference prediction mode in the syntax element deriving unit 123 related to the intra color difference prediction mode, the same position as the prediction block of the color difference signal is used. Using the correlation between the prediction block of the luminance signal and the intra luminance prediction mode, the prediction value from the intra luminance prediction mode of the prediction block of the luminance signal in the same position as the prediction block of the chrominance signal is the most suitable. If it is determined that it is better to predict the value of the intra color difference prediction mode from the value of the intra luminance prediction mode and set a unique value rather than the predicted value from the intra luminance prediction mode, the mode is switched to the intra color difference prediction mode. Typical intra prediction modes 0 (planar prediction), 1 (average prediction) 10 (horizontal prediction), 26 (vertical prediction), by using a mechanism for setting a value of either 34 (diagonal prediction) to reduce the amount of codes.

Here, a method of deriving the value of the intra color difference prediction mode from the value of the intra luminance prediction mode and the syntax element related to the intra color difference prediction mode in the later-described intra color difference prediction mode deriving unit 225 on the decoding side will be described. In this embodiment, in order to distinguish from the intra color difference prediction mode for the color difference format 4: 2: 2 described later, FIG.
The intra color difference prediction mode for 4: 2: 0 or 4: 4: 4 derived from the above table is defined as the first intra color difference prediction mode. FIG. 14 shows the first intra-chroma prediction mode value based on the value of the syntax element intra_chroma_pred_mode [x0] [y0] and the intra-brightness prediction mode of the prediction block at the same position as the prediction block of the chrominance signal. It is a table for deriving the value of the color difference prediction mode, and using this table, on the decoding side,
A value of the first intra color difference prediction mode is derived.
When the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 0, the value of the first intra chrominance prediction mode if the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the chrominance signal is not 0 Takes a value of 0 (planar prediction), and if the value of the intra luminance prediction mode is 0, the value of the first intra color difference prediction mode takes a value of 34 (oblique prediction).

When the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 1, if the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal is not 1, the value of the first intra color difference prediction mode Takes a value of 26 (vertical prediction), and if the value of the intra luminance prediction mode is 1, the value of the first intra color difference prediction mode takes a value of 34 (oblique prediction).

When the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 2, if the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal is not 2, the value of the first intra color difference prediction mode Takes a value of 10 (horizontal prediction), and if the value of the intra luminance prediction mode is 2, the value of the first intra color difference prediction mode takes a value of 34 (oblique prediction).

When the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 3, if the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal is not 3, the value of the first intra color difference prediction mode is 1. If the value of (average value prediction) is taken and the value of the intra luminance prediction mode is 3, the value of the first intra color difference prediction mode takes a value of 34 (oblique prediction).

When the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 4, the value of the first intra color difference prediction mode takes the same value as the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal.

When the color difference format is 4: 2: 0 or 4: 4: 4, the first intra color difference prediction mode derived from FIG. 14 is used as the color difference signal intra for the color difference format 4: 2: 0 or 4: 4: 4. Used as a prediction mode. In the intra prediction unit 103 of the image encoding device in FIG. 1 and the intra prediction unit 206 of the image decoding device in FIG. 2, when the color difference format is 4: 2: 0 or 4: 4: 4, the first intra color difference. Intra prediction of color difference signals is performed using a prediction mode.

When the color difference format is 4: 2: 2, the value of the intra color difference prediction mode for the color difference format 4: 2: 2 is derived from the first intra color difference prediction mode derived from FIG. 14 using the conversion table. In the encoding and decoding of the present embodiment, FIGS.
Color difference format 4: 2 derived from the conversion table of FIG. 17, FIG. 30, or FIG.
: The intra color difference prediction mode for 2 is defined as the second intra color difference prediction mode. The intra prediction unit 103 of the image encoding device in FIG. 1 and the intra prediction unit 206 of the image decoding device in FIG.
Then, when the color difference format is 4: 2: 2, intra prediction of the color difference signal is performed using the second intra color difference prediction mode. 15, FIG. 16, FIG. 17, FIG. 30 and FIG. 33 show that the color difference format is further 4: 2 from the intra luminance prediction mode defined in this embodiment or the first intra color difference prediction mode derived from the table of FIG. : A conversion table for deriving a value of a second intra color difference prediction mode for color difference format 4: 2: 2 used for intra prediction of a color difference signal of 2: 2. 18 is a diagram for explaining the intra prediction mode values and prediction directions derived from the conversion table of FIG. 15 defined in this embodiment, and FIG. 19 is derived from the conversion table of FIG. 16 defined in this embodiment. FIG. 20 is a diagram for explaining the values of the intra prediction mode and the prediction direction derived from the conversion table of FIG. 17 defined in this embodiment. 31 is a diagram for explaining the values and prediction directions of the intra prediction mode derived from the conversion table of FIG. 30 defined in this embodiment, and FIG. 34 is derived from the conversion table of FIG. 33 defined in this embodiment. It is a figure explaining the value and prediction direction of intra prediction mode.

In the present embodiment, the second intra color difference prediction for the color difference format 4: 2: 2 from the intra luminance prediction mode or the first intra color difference prediction mode according to FIG. 15, FIG. 16, FIG. 17, FIG. The process for deriving the mode is performed by the intra prediction unit 103 of the encoding device on the encoding side, and by the second encoded stream decoding unit 203 or the intra prediction unit 206 of the decoding device on the decoding side.

In the encoding and decoding of the present embodiment, when the color difference format is 4: 2: 2, 4
: 2: 0 or 4: 4: 4, instead of using the first intra color difference prediction mode derived from the table of FIG. 14 as it is, FIG. 15, FIG. 16, FIG. 17, FIG. 30, or FIG. 33
The reason for deriving the second intra color difference prediction mode for the color difference format 4: 2: 2 using this conversion table will be described. When the color difference format is 4: 2: 2, as shown in FIG. 3 (b), the color difference signal is sampled at a half density in the horizontal direction and the same density in the vertical direction with respect to the luminance signal. is there. Therefore, the intra luminance prediction mode or the first
When the color difference signal intra prediction is performed in the prediction direction scaled by a factor of two in the horizontal direction or the prediction direction in the vicinity thereof with respect to each prediction direction of the intra color difference prediction mode of
This is equivalent to or close to equivalent to the intra prediction of the luminance signal of the prediction block at the same position as the prediction block of the color difference signal.

This will be described in more detail with reference to FIG. In FIG. 21, the color difference format is 4: 2.
: Is a figure explaining the correspondence of the prediction direction of the intra prediction of the luminance signal in the case of 2, and a color difference signal. In FIG. 21, x indicates the position of the pixel of the luminance signal, and ◯ indicates the position of the pixel of the color difference signal. In 4: 2: 2, the color difference signal is sampled (sampled) in the horizontal direction by 1/2 with respect to the luminance signal, and the aspect ratios of the pixels of the luminance signal and the color difference signal are different. FIG. 21 (a) shows 4
: Shows the sampled pixel position of the 2: 2 luminance signal and color difference signal. The code P1 is a pixel that is intra-predicted, and the code P2 is a pixel that is referred to during intra-prediction (actually, since it is filtered, the adjacent pixel is also referenced). An arrow from the pixel P1 to the pixel P2 indicated by reference numeral 2701 indicates the intra prediction direction of the pixel P1 of the luminance signal, and the pixel P1 of the color difference signal
Indicates the intra prediction direction.

FIG. 21B shows an arrangement of pixels of the color difference signal sampled by 1/2 in the horizontal direction. Here, in the case of intra prediction of the color difference signal, if the half scaling is not performed in the horizontal direction, the intra prediction direction of the pixel P1 of the color difference signal becomes the direction of the arrow indicated by reference numeral 2702, and the color difference signal In this pixel arrangement, the pixel P3 is erroneously referred to. However, the correct reference destination is the pixel P2. Accordingly, the intra prediction direction of the luminance signal is scaled by a factor of 1/2 in the horizontal direction to obtain the intra prediction direction of the chrominance signal, thereby deriving the correct intra prediction direction in the arrangement of the chrominance signals as indicated by reference numeral 2703. Then, the pixel adjacent to the upper side, which is the correct reference destination in the intra prediction direction (actually, since it is filtered, the adjacent pixel is also referred to) is acquired.

In FIGS. 21A and 21B, the case of referring to the pixel adjacent to the upper side of the prediction block has been described, but the same applies to the case of referring to the pixel adjacent to the left side. In the case of the pixel adjacent to the left side, the intra prediction direction of the luminance signal is scaled twice in the vertical direction (this is equivalent in terms of obtaining the direction of intra prediction and scaling to ½ times in the horizontal direction). ) To derive the correct intra prediction direction in the chrominance signal array, and obtain the pixels that are adjacent to the left, which is the correct reference destination in the intra prediction direction (including pixels that are partially adjacent to the upper side) To do.

Therefore, in the conversion tables of FIGS. 15 and 16, as shown by the dotted arrows in FIGS. 18 and 19, respectively, the intra luminance prediction modes arranged in the horizontal direction (on the horizontal axis) or FIG.
The values of the first intra color difference prediction mode derived from the table are 18, 19, 20, 2
1, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34
In this case, the value of the intra prediction mode in the prediction direction close to the prediction direction derived by scaling the angle of the prediction direction by a factor of 1/2 in the horizontal direction around the vertical prediction (intra prediction mode 26) is the second value. As the value of the intra color difference prediction mode, the values of the second intra color difference prediction mode are respectively set to 21, 22, 23, 23, 24, 24, 25, 25, 26, 27,
27, 28, 28, 29, 29, 30, 31 Scaling the prediction direction of intra prediction by a factor of two in the horizontal direction is equivalent to scaling by a factor of two in the vertical direction. Therefore, with respect to each prediction direction of the intra luminance prediction mode or the first intra color difference prediction mode, the prediction direction scaled twice in the vertical direction around the horizontal prediction (intra prediction mode 10), or a prediction in the vicinity thereof When intra prediction of the color difference signal is performed in the direction, it becomes equivalent to or close to equivalent to the intra prediction of the luminance signal of the prediction block at the same position as the prediction block of the color difference signal. Therefore, in the conversion tables of FIGS. 15 and 16, as shown in FIGS. 18 and 19, respectively, intra prediction modes (intra luminance prediction mode or first intra color difference prediction mode) arranged in the vertical direction (on the vertical axis). The value is 2, 3, 4
For 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, the angle of the prediction direction is doubled in the vertical direction centering on horizontal prediction (intra prediction mode 10) Is selected as the value of the second intra color difference prediction mode and the value of the second intra color difference prediction mode is set to 2, 2, 2 respectively. 2, 3, 5, 7, 8, 10, 12, 13, 15, 17, 18, 18, 18
, 18 and 2, 2, 2, 2, 3, 5, 7, 8, 10, 12, 13, 15, 17, 18,
18, 19, and 20.

Moreover, it is also possible to convert from the intra prediction mode (intra luminance prediction mode or first intra color difference prediction mode) to the second intra color difference prediction mode using the conversion table of FIG. In the conversion table of FIG. 17, as indicated by the dotted arrows in FIG. 20, the intra luminance prediction mode in which the reference destinations are arranged in the horizontal direction (on the horizontal axis) or the first intra color difference prediction mode derived from the table of FIG. Is 18, 19, 20, 21, 22, 23, 24, 2
In the case of 5, 26, 27, 28, 29, 30, 31, 32, 33, 34, the intra luminance prediction mode or the first intra color difference prediction mode is set to 2 in the horizontal direction centering on the vertical prediction (intra prediction mode 26). The value derived by scaling to 1 / fold is set as the value of the second intra color difference prediction mode, and the values of the second intra color difference prediction mode are set to 22, 22, 2 respectively.
3, 23, 24, 24, 25, 25, 26, 27, 27, 28, 28, 29, 29, 30
, 30. Scaling the prediction direction of intra prediction by a factor of two in the horizontal direction is equivalent to scaling by a factor of two in the vertical direction. Therefore, with respect to each prediction direction of the intra luminance prediction mode or the first intra color difference prediction mode, the prediction direction scaled twice in the vertical direction around the horizontal prediction (intra prediction mode 10), or a prediction in the vicinity thereof When intra prediction of the color difference signal is performed in the direction, it becomes equivalent to or close to equivalent to the intra prediction of the luminance signal of the prediction block at the same position as the prediction block of the color difference signal.
Therefore, in the conversion table of FIG. 17, the values of the intra luminance prediction mode or the first intra color difference prediction mode in which the reference destinations are arranged in the vertical direction (on the vertical axis) are 2, 3 as shown by the dotted arrows in FIG. 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
17, the intra luminance prediction mode or the first intra color difference prediction mode is set to horizontal prediction (
A value derived by scaling twice in the vertical direction centering on the intra prediction mode 10) and limiting it to 2 or more and 18 or less is set as the value of the intra color difference prediction mode, and the value of the second intra color difference prediction mode is set to 2, 2, 2, 2, 2, 4, 6, 8, 10, 12, 14, 16, 18, 1
8, 18, and 18.

Moreover, it is also possible to convert from the intra prediction mode (intra luminance prediction mode or the first intra color difference prediction mode) to the second intra color difference prediction mode using the conversion table of FIG. In the conversion table of FIG. 30, the values of the intra luminance prediction mode or the first intra color difference prediction mode derived from the table of FIG. 14 are 16, 17, 18, 19, 20 as indicated by the dotted arrows in FIG. , 21, 22, 23, 24, 25, 26, 27, 28,
In the case of 29, 30, 31, 32, 33, and 34, the intra luminance prediction mode or the first intra color difference prediction mode is halved in the horizontal direction around the vertical prediction (intra prediction mode 26).
The value derived by scaling to double is taken as the value of the second intra color difference prediction mode,
The values of the second intra color difference prediction mode are respectively 21, 21, 22, 22, 23, 23,
24, 24, 25, 25, 26, 27, 27, 28, 28, 29, 29, 30, 30. In addition, the value of the intra luminance prediction mode or the first intra color difference prediction mode is 2, 3,
In the case of 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, the intra luminance prediction mode or the first intra color difference prediction mode is centered on horizontal prediction (intra prediction mode 10). The value derived by scaling twice in the vertical direction and limiting to 2 or more is the second
And the second intra color difference prediction mode value is 2, 2, 2,
2, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20.

Also, conversion from the intra prediction mode (intra luminance prediction mode or first intra color difference prediction mode) to the second intra color difference prediction mode can be performed using the conversion table of FIG. In the conversion table of FIG. 33, as indicated by the dotted arrows in FIG. 34, the values of the intra luminance prediction mode or the first intra color difference prediction mode derived from the table of FIG. , 26, 27, 28, 29, 30, 31 the intra luminance prediction mode or the first intra color difference prediction mode is scaled by a factor of two in the horizontal direction centering on the vertical prediction (intra prediction mode 26). The value derived in this way is set as the value of the second intra color difference prediction mode, and the value of the second intra color difference prediction mode is set to 23.
24, 24, 25, 25, 26, 27, 27, 28, 28, 29. In addition, the value of the intra luminance prediction mode or the first intra color difference prediction mode is 7, 8, 9, 10, 11,
In the case of 12, 13, a value derived by scaling the intra luminance prediction mode or the first intra color difference prediction mode twice in the vertical direction centering on the horizontal prediction (intra prediction mode 10) is used as the second intra color difference prediction. The mode value is set to 4, 6, 8, 10, 12, 14, and 16 for the second intra color difference prediction mode. Further, when the value of the intra luminance prediction mode or the first intra color difference prediction mode is 2, 3, 4, 5, 6, 3 is subtracted from the intra luminance prediction mode or the first intra color difference prediction mode to be 2 or more. The value derived by limiting is set as the value of the second intra color difference prediction mode, and the value of the second intra color difference prediction mode is set as 2, 2, 2, 2, 3. Further, when the value of the intra luminance prediction mode or the first intra color difference prediction mode is 14, 15, 16, 17, 18, 19, 20, 3 is added to the intra luminance prediction mode or the first intra color difference prediction mode. The value derived by this is used as the value of the second intra color difference prediction mode, and the value of the second intra color difference prediction mode is set to 17, 1
8, 19, 20, 21, and 22. Furthermore, when the value of the intra luminance prediction mode or the first intra color difference prediction mode is 32, 33, 34, the intra luminance prediction mode or the first
The value derived by subtracting 3 from the intra color difference prediction mode is set as the value of the second intra color difference prediction mode, and the values of the second intra color difference prediction mode are set as 29, 30, and 31, respectively.

When the color difference format is 4: 2: 2, the first intra color difference prediction mode corresponding to the conversion table in FIGS. 15 and 16 when the first intra color difference prediction mode is converted to the second intra color difference prediction mode is changed from the first intra color difference prediction mode to the second intra color difference prediction mode. A derivation process procedure for conversion to the intra color difference prediction mode 2 will be described with reference to the flowchart of FIG.

For each value from 0 to 34 of the first intra prediction mode IntraPredMode1, the second intra prediction mode IntraPredMode2 is derived by the procedure of the flowchart of FIG.

First, when the angle prediction is not performed, that is, when the first intra prediction mode IntraPredMode1 is 1 or less (NO in step S3001 in FIG. 23), the first intra prediction mode IntraPredMod.
The value of e1 is used as it is as the second intra color difference prediction mode IntraPredMode2 (step S3002 in FIG. 23), and this derivation process ends. The first intra prediction mode IntraPredMode1 is 1
The following are plane predictions that are predicted by interpolating pixel values from surrounding decoded blocks (intra prediction mode intraPredMode1 = 0), and average value predictions that are predicted by deriving average values from surrounding decoded blocks ( Intra prediction mode intraPredMode1 = 1).

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is angle prediction, that is, greater than 1 (YES in step S3001 in FIG. 23), the first intra color difference prediction mode from step S3003 to the second intra color difference prediction mode. Convert to.
When the intra color difference prediction mode IntraPredMode1 is smaller than 18 (step S3 in FIG. 23)
YES in 003), the first intra prediction angle IntraPredAngle1 corresponding to the first intra color difference prediction mode IntraPredMode1 is doubled to obtain the intra prediction angle IntraPredAngle2 '(step S3004 in FIG. 23). Further, the value of the intra luminance prediction mode or the first intra color difference prediction mode IntraPredMode1 corresponding to the first intra prediction angle IntraPredAngle1 close to the intra prediction angle IntraPredAngle2 ′ is set as the second intra prediction mode IntraPredMode1.
dMode2 is set (step S3005 in FIG. 23), and the derivation process is terminated. However, the first
When the intra prediction mode is 2, 3, 4 or 5, the angle of intra prediction IntraPredAngle2 '
Is set to −32 or less, and the angle of intra prediction at that time is set to −32, and the second intra color difference prediction mode is set to 2. When the first intra prediction mode is 15, 16, and 17, the value of the intra prediction angle IntraPredAngle2 ′ is 32 or more, and the intra prediction angle at that time is 32, and the second intra color difference prediction mode is 18 And As shown in FIG. 19, when the angle of intra prediction corresponding to the first intra prediction mode corresponding to 16 is doubled in the vertical direction, the intra prediction mode takes a value close to the angle of intra prediction corresponding to 19. When the intra prediction angle corresponding to 17 in the first intra prediction mode is doubled in the vertical direction, the intra prediction mode takes a value close to the angle of intra prediction corresponding to 20. Therefore, as shown in FIG. 19, when the first intra prediction mode is 16, the second intra prediction mode is set to 19,
When the first intra prediction mode is 17, the second intra prediction mode can be set to 20.

On the other hand, when the intra color difference prediction mode IntraPredMode1 is not smaller than 18, that is, 18 or more (NO in step S3003 in FIG. 23), the first intra color difference prediction mode IntraP.
The first intra prediction angle IntraPredAngle1 corresponding to redMode1 is halved to obtain the intra prediction angle IntraPredAngle2 ′ (steps S3006 to S3007 in FIG. 23). In this embodiment, according to the sign of the first intra prediction angle IntraPredAngle1 corresponding to the first intra color difference prediction mode IntraPredMode1, the value is -1 for negative and 1 for positive or when the variable a is 0. A value is set in the variable SignIntraPredAngle (step S3006 in FIG. 23),
The result of performing a 1-bit right shift operation equivalent to ½ times the absolute value of the first intra color difference prediction mode IntraPredMode1 is multiplied by the variable SignIntraPredAngle to obtain the angle IntraPre for intra prediction.
It is set to dAngle2 ′ (step S3007 in FIG. 23). Note that the result of performing 1-bit right shift operation equivalent to 1/2 after adding 1 to the absolute value of the first intra color difference prediction mode IntraPredMode1 is multiplied by the variable SignIntraPredAngle, and set to the intra prediction angle IntraPredAngle2 ′. May be. Further, the intra prediction mode (upper part of FIG. 8) corresponding to the intra prediction angle (lower part of FIG. 8) prepared in the intra luminance prediction mode close to the intra prediction angle IntraPredAngle2 ′ and the first intra color difference prediction mode. Value in the second intra prediction mode In
traPredMode2 is set (step S3008 in FIG. 23), and the derivation process is terminated. When the value of the intra prediction angle IntraPredAngle2 ′ is rounded to the intra prediction angle prepared in the intra luminance prediction mode and the first intra color difference prediction mode, the intra prediction angle Intr is used.
It may be rounded to the nearest value to aPredAngle2 ', rounded up, rounded up or rounded down. Also, the same positive / negative sign as the intra prediction angle IntraPredAngle2 ′ may be set to a value obtained by rounding up, rounding up or down the absolute value of the intra prediction angle IntraPredAngle2 ′.

If the angle of intra prediction in which the first intra color difference prediction mode is 25 is halved, −
1 can be rounded (converted) to either -2 corresponding to the intra prediction mode value of 25 or 0 corresponding to the intra prediction mode value of 26. Since 26 shown can always be encoded, it is set to 25 when the first intra color difference prediction mode converts 25 into the second intra color difference prediction mode. If the angle of intra prediction of the first intra color difference prediction mode is ½, it becomes 1, and the value of 0 corresponding to 26 for the intra prediction mode and 2 corresponding to 27 for the intra prediction mode. Can be rounded (converted), but 26, which indicates vertical prediction, can always be encoded, so
When the first intra color difference prediction mode converts 27 into the second intra color difference prediction mode, 27 is set. That is, when converting from the first intra color difference prediction mode to the second intra color difference prediction mode using the conversion tables shown in FIGS. 15, 16, 17, 30, and 33, the first intra color difference is changed. If the prediction mode is not 26, which is vertical prediction, the second intra color difference prediction mode is derived from the first intra color difference prediction mode by converting the prediction mode to a value that avoids 26, which is vertical prediction. That is, it can be derived from the syntax elements (0, 1, 2, 3 in FIGS. 14 and 25) of the intra color difference prediction mode selected when the value of the intra luminance prediction mode and the value of the intra color difference prediction mode do not match. Value (0, 1, 10, 26, 34)
Convert to avoid. By setting in this way, the range of selection of the intra color difference prediction mode is widened, and the encoding efficiency can be improved.

In steps S3005 and S3008, the angle of intra prediction IntraPredA
By setting the value of the intra luminance prediction mode or the first intra color difference prediction mode IntraPredMode1 corresponding to the first intra prediction angle IntraPredAngle1 close to ngle2 ′ to the second intra prediction mode IntraPredMode2, the color difference format 4: 2: When the intra prediction calculation of the color difference signal in 2 is implemented by hardware, the intra prediction calculation using the second intra color difference prediction mode is performed using the intra luminance prediction mode or the first intra color difference prediction mode IntraPre.
Since it can be realized only by an intra prediction angle corresponding to dMode1, it can be performed without adding hardware based on a new intra prediction angle.

In this angle prediction, vertical prediction (intra prediction mode intraPredMode1 = 26) predicting in the vertical direction from the above decoded block, and horizontal prediction (intra prediction mode intraPredMode1 == predicting in the horizontal direction from the left decoded block) 10) is also included. However, vertical prediction,
The horizontal prediction does not change even if the conversion process from the first intra color difference prediction mode to the second intra color difference prediction mode after step S3003 is performed. Therefore, step S3
In the condition determination of 001, the process may proceed to step S3002 also in the case of vertical prediction and horizontal prediction.

A derivation process procedure when converting from the first intra color difference prediction mode corresponding to the conversion table of FIG. 17 to the second intra color difference prediction mode when the color difference format is 4: 2: 2 will be described with reference to the flowchart of FIG. To do.

When angle prediction is not performed, that is, when the first intra prediction mode IntraPredMode1 is 1 or less (NO in step S3101 in FIG. 24), the value of the first intra prediction mode IntraPredMode1 is directly used as the second intra color difference prediction mode IntraPredMode2 ( Step S3 in FIG.
102) The derivation process is terminated.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is angle prediction, that is, when it is larger than 1 (YES in step S3101 in FIG. 24), the first intra color difference prediction mode from step S3103 to the second intra color difference prediction mode. Convert to.
When the first intra color difference prediction mode IntraPredMode1 is smaller than 18 (YES in step S3103 in FIG. 24), the first intra color difference prediction mode derived from the table in FIG. 14 is centered on horizontal prediction (intra prediction mode 10). The value derived by scaling twice in the vertical direction is set as the value of the second intra color difference prediction mode (step S in FIG. 32).
3304 to S3307). A value obtained by subtracting 10 indicating horizontal prediction from the first intra color difference prediction mode IntraPredMode1 is set to the variable a (step S3104 in FIG. 24). Subsequently, a value obtained by doubling the variable a is set in the variable b (step S3105 in FIG. 24).
. Subsequently, a value obtained by adding 10 indicating horizontal prediction to b is set as a variable c (step S3106 in FIG. 24). Subsequently, a value obtained by limiting the value of the variable c to 2 or more and 18 or less is set to the second intra prediction mode IntraPredMode2 (step S3107 in FIG. 24), and this derivation process is ended. Specifically, when the variable c is 2 or more and less than 18, the intra prediction mode In
When the variable c is set to the value of traPredMode2 as it is, and the variable c is less than 2, the intra prediction mode IntraPredMode2 is set to 2, and when the variable c exceeds 18, the intra prediction mode IntraP
Set redMode2 to 18. That is, when the value derived by scaling the angle prediction mode number in the first intra color difference prediction mode is outside the range of the angle prediction mode number defined in the intra prediction mode, the derived value is Set a value within that range. Accordingly, when the intra prediction calculation of the color difference signal in the color difference format 4: 2: 2 is implemented by hardware, the intra prediction calculation using the second intra color difference prediction mode is performed without adding hardware. Can do.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is not smaller than 18, that is, 18 or more (NO in step S3103 in FIG. 24), the first intra color difference prediction mode derived from the table in FIG. 14 is vertically predicted. A value derived by scaling by a factor of two in the horizontal direction centering on (intra prediction mode 26) is set as the value of the second intra color difference prediction mode (steps S3108 to S3112 in FIG. 24). A value obtained by subtracting 26 indicating vertical prediction from the first intra color difference prediction mode IntraPredMode1 is set to the variable a (step S3108 in FIG. 24). Subsequently, depending on the sign of the variable a, -1 for negative,
When positive or variable a is 0, a value is set in variable SignIntraPredMode having a value of 1 (FIG. 24).
Step S3109). Subsequently, a value obtained by multiplying the absolute value of the variable a by 1-bit right shift operation equivalent to 1/2 times the variable SignIntraPredMode is set to the variable b (step S3110 in FIG. 24). Note that a value obtained by multiplying the variable SignIntraPredMode by the result of performing a 1-bit right shift operation equivalent to 1/2 after adding 1 to the absolute value of the variable a may be set in the variable b. Subsequently, a value obtained by adding 26 indicating vertical prediction to b is set as a variable c.
(Step S3111 in FIG. 24). Subsequently, the value of the variable c is set to the second intra prediction mode IntraPredMode2 (step S3112 in FIG. 24), and this derivation process ends. When the value of the variable c corresponding to 25 in the first intra color difference prediction mode is 26, the first intra color difference prediction mode is set to avoid 26 indicating vertical prediction that can always be encoded. When 25 is converted to the second intra color difference prediction mode, 25 is set. First
When the value of the variable c corresponding to the intra color difference prediction mode of 27 is 26, the first intra color difference prediction mode sets the second to 27 while avoiding 26 indicating vertical prediction that can always be encoded. 27 when converting to the intra color difference prediction mode. That is, it can be derived from the syntax elements (0, 1, 2, 3 in FIGS. 14 and 25) of the intra color difference prediction mode selected when the value of the intra luminance prediction mode does not match the value of the intra color difference prediction mode. Round (convert) to avoid values (0, 1, 10, 26, 34).
By setting in this way, the range of selection of the intra color difference prediction mode is widened, and the encoding efficiency can be improved. In this derivation processing procedure, a value derivable from the syntax element (1 in FIGS. 14 and 25) of the intra color difference prediction mode selected when the value of the intra luminance prediction mode does not match the value of the intra color difference prediction mode. In order to perform conversion so as to avoid H.26, 1 is added to the absolute value of the variable a before performing a 1-bit right shift operation on the absolute value of the variable a in step S3110.

A derivation process procedure when converting from the first intra color difference prediction mode corresponding to the conversion table of FIG. 30 to the second intra color difference prediction mode when the color difference format is 4: 2: 2 will be described using the flowchart of FIG. To do.

When angle prediction is not performed, that is, when the first intra prediction mode IntraPredMode1 is 1 or less (NO in step S3301 in FIG. 32), the value of the first intra prediction mode IntraPredMode1 is directly used as the second intra color difference prediction mode IntraPredMode2 ( Step S3 in FIG.
302) This derivation process is terminated.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is angle prediction, that is, when it is larger than 1 (YES in step S3301 in FIG. 32), the first intra color difference prediction mode to the second intra color difference prediction mode after step S3303. Convert to.
When the first intra color difference prediction mode IntraPredMode1 is smaller than 16, that is, 15 or less (YES in step S3303 in FIG. 32), the first derived from the table in FIG.
Intra color difference prediction mode of 2 in the vertical direction centering on horizontal prediction (intra prediction mode 10)
A value derived by scaling to twice and limiting to 2 or more is set as the value of the second intra color difference prediction mode (steps S3304 to S3307 in FIG. 32). A value obtained by subtracting 10 indicating horizontal prediction from the first intra color difference prediction mode IntraPredMode1 is set to the variable a (step S3304 in FIG. 32). Subsequently, a value obtained by doubling the variable a is set in the variable b (step S3305 in FIG. 32). Subsequently, a value obtained by adding 10 indicating horizontal prediction to b is set as a variable c (step S3306 in FIG. 32). Subsequently, the value of the variable c is set to 2
The value obtained by limiting to the above is set to the second intra prediction mode IntraPredMode2 (FIG. 32).
In step S3307), the derivation process is terminated. Specifically, when the variable c is 2 or less,
The value of the intra prediction mode IntraPredMode2 is set to 2. That is, when the value derived by scaling the angle prediction mode number in the first intra color difference prediction mode is outside the range of the angle prediction mode number defined in the intra prediction mode, the derived value is Set a value within that range. Thereby, when the intra prediction calculation of the color difference signal in the color difference format 4: 2: 2 is implemented by hardware, the intra prediction calculation using the second intra color difference prediction mode is performed.
This can be done without adding hardware.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is not smaller than 16, that is, 16 or more (NO in step S3303 in FIG. 32), the first intra color difference prediction mode derived from the table in FIG. 14 is vertically predicted. A value derived by scaling by a factor of 1/2 in the horizontal direction centering on (intra prediction mode 26) is set as the value of the second intra color difference prediction mode (steps S3308 to S3312 in FIG. 32). A value obtained by subtracting 26 indicating vertical prediction from the first intra color difference prediction mode IntraPredMode1 is set to the variable a (step S3308 in FIG. 32). Subsequently, depending on the sign of the variable a, -1 for negative,
If positive or variable a is 0, a value is set in variable SignIntraPredMode having a value of 1 (FIG. 32).
Step S3309). Subsequently, the variable b is set to a value obtained by multiplying the absolute value of the variable a by a variable SignIntraPredMode, which is obtained by performing a 1-bit right shift operation equivalent to a half of the absolute value of the variable a (
Step S3310 in FIG. 32). Note that a value obtained by multiplying the variable SignIntraPredMode by the result of performing a 1-bit right shift operation equivalent to one-half of the absolute value of the variable a after adding 1 may be set as the variable b. Subsequently, a value obtained by adding 26 indicating vertical prediction to b is set as a variable c (step S3311 in FIG. 32). Subsequently, the value of the variable c is set to the second intra prediction mode IntraPredMode2 (step S3312 in FIG. 32), and this derivation process is terminated. When the value of the variable c corresponding to 25 in the first intra color difference prediction mode is 26, the first intra color difference prediction mode is set to avoid 26 indicating vertical prediction that can always be encoded. When 25 is converted to the second intra color difference prediction mode, 25 is set.
In the case where the value of the variable c corresponding to 27 in the first intra color difference prediction mode is 26, the first intra color difference prediction mode is set to 27 while avoiding 26 indicating vertical prediction that can always be encoded. It is set to 27 when converting to the second intra color difference prediction mode. That is, FIG.
5, when converting from the first intra color difference prediction mode to the second intra color difference prediction mode using the conversion tables shown in FIG. 16, FIG. 17, FIG. 30, and FIG. If it is not 26 which is the vertical prediction, the second intra color difference prediction mode is derived from the first intra color difference prediction mode by converting the value to 26 which avoids the vertical prediction 26. That is, the syntax element of the intra color difference prediction mode selected when the value of the intra luminance prediction mode and the value of the intra color difference prediction mode do not match (0 in FIGS. 14 and 25).
Round to avoid values (0, 1, 10, 26, 34) derivable from (1, 2, 3) (
Convert). In this derivation processing procedure, a value derivable from the syntax element (1 in FIGS. 14 and 25) of the intra color difference prediction mode selected when the value of the intra luminance prediction mode and the value of the intra color difference prediction mode do not match. To convert to avoid 26,
In step S3310, 1 is added to the absolute value of the variable a before performing a 1-bit right shift operation on the absolute value of the variable a.

In step S3303 of the derivation process procedure, the intra color difference prediction mode IntraP
When redMode1 is smaller than 16, that is, 15 or less, the first intra color difference prediction mode is derived by scaling twice in the vertical direction around the horizontal prediction (intra prediction mode 10) and limiting it to 2 or more. When the value is set to the value of the second intra color difference prediction mode (steps S3304 to S3307 in FIG. 32), and the intra color difference prediction mode IntraPredMode1 is not smaller than 16, that is, 16 or more, the first intra color difference prediction mode is the vertical prediction. The value derived by scaling by a factor of 2 in the horizontal direction centering on (intra prediction mode 26) is used as the value of the second intra color difference prediction mode (steps S3308 to S3 in FIG. 32).
312) When the intra color difference prediction mode IntraPredMode1 is smaller than 15, that is, 14 or less, the first intra color difference prediction mode is derived by scaling twice in the vertical direction around the horizontal prediction (intra prediction mode 10). The obtained value is set as the value of the second intra color difference prediction mode (steps S3304 to S3307 in FIG. 32), and the intra color difference prediction mode Intr.
When aPredMode1 is not smaller than 15, that is, 15 or more, a value derived by scaling the first intra color difference prediction mode by a factor of 1/2 in the horizontal direction around the vertical prediction (intra prediction mode 26) It may be the value of the second intra color difference prediction mode (FIG. 32).
Steps S3308 to S3312), the conversion results are the same. This is because when the intra color difference prediction mode IntraPredMode1 is 15, a value derived by scaling the first intra color difference prediction mode twice in the vertical direction around the horizontal prediction (intra prediction mode 10) and the first intra color difference This is because the values derived by scaling the prediction mode by a factor of 1/2 in the horizontal direction around the vertical prediction (intra prediction mode 26) are equal.

Next, when the color difference format is 4: 2: 2, the first corresponding to the conversion table of FIG.
A derivation process procedure when converting from the intra color difference prediction mode to the second intra color difference prediction mode will be described with reference to the flowchart of FIG.

When angle prediction is not performed, that is, when the first intra prediction mode IntraPredMode1 is 1 or less (NO in step S3401 in FIG. 35), the value of the first intra prediction mode IntraPredMode1 is directly used as the second intra color difference prediction mode IntraPredMode2 ( Step S3 in FIG.
402) This derivation process is terminated.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is angular prediction, that is, greater than 1 (YES in step S3401 in FIG. 35), the first intra color difference prediction mode from step S3403 to the second intra color difference prediction mode. Convert to.
When the first intra color difference prediction mode IntraPredMode1 is smaller than 7, that is, 6 or less (YES in step S3403 in FIG. 35), the first intra color difference prediction mode IntraPredMod.
A value obtained by subtracting 3 indicating horizontal prediction from e1 is set as a variable c (step S in FIG. 35).
3407). Subsequently, a value obtained by limiting the value of the variable c to 2 or more is set to the second intra prediction mode IntraPredMode2 (step S3408 in FIG. 35), and this derivation process is terminated.
Specifically, when the variable c is 2 or more, the variable c is set as it is in the intra prediction mode IntraPredMode2, and when the variable c is less than 2, 2 is set as the intra prediction mode IntraPredMode2. That is, when the value derived by scaling the angle prediction mode number in the first intra color difference prediction mode is outside the range of the angle prediction mode number defined in the intra prediction mode, the derived value is Set a value within that range. Accordingly, when the intra prediction calculation of the color difference signal in the color difference format 4: 2: 2 is implemented by hardware, the intra prediction calculation using the second intra color difference prediction mode is performed without adding hardware. Can do.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is not smaller than 7, and the first intra color difference prediction mode IntraPredMode1 is smaller than 14, that is, 7 or more and 13 or less (
35 (NO in step S3403 in FIG. 35 and YES in step S3404), the first intra color difference prediction mode derived from the table in FIG. 14 is set to horizontal prediction (intra prediction mode 10).
The value derived by scaling twice in the vertical direction around the center is set as the value of the second intra color difference prediction mode (steps S3409 to S3412 in FIG. 35). A value obtained by subtracting 10 indicating horizontal prediction from the first intra color difference prediction mode IntraPredMode1 is set to the variable a (step S3409 in FIG. 35). Subsequently, the value obtained by doubling the variable a is represented by the variable b.
(Step S3410 in FIG. 35). Subsequently, a value obtained by adding 10 indicating horizontal prediction to b is set as a variable c (step S3411 in FIG. 35). Subsequently, the value of the variable c is set to the second intra prediction mode IntraPredMode2 (step S3412 in FIG. 35),
The derivation process ends.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is not smaller than 14 and smaller than 21, that is, 14 or more and 20 or less (NO in step S3404 in FIG. 35 and YES in step S3405), the first intra color difference prediction mode. A value obtained by adding 3 to IntraPredMode1 is set to a variable c (step S3413 in FIG. 35). Subsequently, the value of the variable c is set to the second intra prediction mode IntraPredMode2 (step S3414 in FIG. 35), and this derivation process ends.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is not smaller than 21 and smaller than 32, that is, 21 or more and 31 or less (NO in step S3405 in FIG. 35 and YES in step S3406), it is derived from the table in FIG. The value derived by scaling the first intra color difference prediction mode by a factor of 1/2 in the horizontal direction around the vertical prediction (intra prediction mode 26) is set as the value of the second intra color difference prediction mode (FIG. 35 steps S3415 to S3419). A value obtained by subtracting 26 indicating vertical prediction from the first intra color difference prediction mode IntraPredMode1 is set to the variable a (step S3415 in FIG. 35).
). Subsequently, in accordance with the sign of the variable a, a value is set in the variable SignIntraPredMode having a value of -1 if negative, or 1 if the variable a is 0 (step S3416 in FIG. 35). Subsequently, the variable SignIn is obtained by performing a 1-bit right shift operation equivalent to 1/2 the absolute value of the variable a.
A value obtained by multiplying traPredMode is set in the variable b (step S3417 in FIG. 35).
. Note that a value obtained by multiplying the variable SignIntraPredMode by the result of performing a 1-bit right shift operation equivalent to one-half of the absolute value of the variable a after adding 1 may be set as the variable b. Subsequently, a value obtained by adding 26 indicating vertical prediction to b is set as a variable c (step S3418 in FIG. 35). Subsequently, the value of the variable c is set to the second intra prediction mode IntraPredMode2 (step S3419 in FIG. 35), and this derivation process ends. When the value of the variable c corresponding to 25 in the first intra color difference prediction mode is 26, the first intra color difference prediction mode is avoided by avoiding 26 indicating vertical prediction that can always be encoded. 25 is second
25 when converting to the intra color difference prediction mode. In the case where the value of the variable c corresponding to 27 in the first intra color difference prediction mode is 26, the first intra color difference prediction mode is set to 27 while avoiding 26 indicating vertical prediction that can always be encoded. It is set to 27 when converting to the second intra color difference prediction mode. That is, it can be derived from the syntax elements (0, 1, 2, 3 in FIGS. 14 and 25) of the intra color difference prediction mode selected when the value of the intra luminance prediction mode and the value of the intra color difference prediction mode do not match. Value (0, 1, 10,
26, 34) is rounded off (converted). In this derivation processing procedure, a value derivable from the syntax element (1 in FIGS. 14 and 25) of the intra color difference prediction mode selected when the value of the intra luminance prediction mode and the value of the intra color difference prediction mode do not match. In order to perform conversion so as to avoid H.26, 1 is added to the absolute value of the variable a before performing a 1-bit right shift operation on the absolute value of the variable a in step S3417.

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is not smaller than 32, that is, 32 or more (NO in step S3416 in FIG. 35), the first intra color difference prediction mode.
A value obtained by subtracting 3 from IntraPredMode1 is set in a variable c (step S3 in FIG. 35).
420). Subsequently, the value of the variable c is set to the second intra prediction mode IntraPredMode2 (step S3421 in FIG. 35), and this derivation process ends.

In step S3403 of this derivation procedure, the intra color difference prediction mode IntraP
When redMode1 is 6 or less, the value obtained by subtracting 3 from the first intra color difference prediction mode is limited to 2 or more to obtain the second intra color difference prediction mode.
In the same manner as when the intra color difference prediction mode IntraPredMode1 is 7 or less and 13 or less, the condition determination of 3403 is omitted, and when the intra color difference prediction mode IntraPredMode1 is 6 or less,
A value derived by scaling the first intra color difference prediction mode twice in the vertical direction with the horizontal prediction (intra prediction mode 10) as the center can also be used as the value of the second intra color difference prediction mode (FIG. 35). Steps S3409 to S3412). However, step S3
In 412, similarly to S 3408, the variable c derived in step S 3411 is limited to 2 or more and the second intra color difference prediction mode is set.

Further, in step S3406 of the derivation processing procedure, the intra color difference prediction mode Intr
When aPredMode1 is 32 or more, the value obtained by subtracting 3 from the first intra color difference prediction mode is set as the second intra color difference prediction mode. However, for the sake of simplicity, the condition determination in step S3406 is omitted. Similarly to the case where the intra color difference prediction mode IntraPredMode1 is 21 or more and 31 or less, the first intra color difference prediction mode is horizontal with the vertical prediction (intra prediction mode 26) as the center even when the intra color difference prediction mode IntraPredMode1 is 32 or more. A value derived by scaling in the direction by a factor of two can be used as the value of the second intra color difference prediction mode (steps S3415 to S3419 in FIG. 35).

On the other hand, when the color difference format is 4: 2: 0 or 4: 4: 4, the sampling ratios of the luminance signal intra prediction direction and the horizontal direction and the vertical direction of the color difference signal are the same. It is not necessary to convert the derived first intra color difference prediction mode into the second intra color difference prediction mode. This will be described with reference to FIG. FIG. 22 is a diagram for explaining a correspondence relationship between the prediction direction of the luminance signal and the intra prediction of the color difference signal when the color difference format is 4: 2: 0. FIG. 22A shows the arrangement of the luminance signal and the color difference signal when the color difference format is 4: 2: 0, and the color difference signal is sampled at 1/2 both horizontally and vertically with respect to the luminance signal ( The aspect ratio of the pixels of the luminance signal and the color difference signal is the same. An arrow indicated by reference numeral 2704 from the pixel P4 to the pixel P5 indicates the intra prediction direction of the pixel P4 of the luminance signal. An arrow indicated by reference numeral 2705 from the pixel P1 to the pixel P2 indicates the intra prediction direction of the pixel P1 of the color difference signal. The arrow from pixel P4 to pixel P5 indicated by reference numeral 2704 and the arrow from pixel P1 to pixel P2 indicated by reference numeral 2705 are directed in the same direction, and the intra prediction direction is the same. In this case, also in the color difference signal array shown in FIG. 22B, the intra prediction direction of the luminance signal is the same as the intra prediction direction of the color difference signal as indicated by reference numeral 2706, and the reference destination of the pixel P1 of the color difference signal The pixel P2 can be correctly referred to.

When the intra prediction unit 103 also predicts the value of the intra color difference prediction mode in consideration of the above points, the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal according to the color difference format. To predict the value of the intra color difference prediction mode. That is, the color difference format in which the luminance signal and the color difference signal have the same pixel aspect ratio is 4: 2: 0.
Alternatively, when the value of the intra color difference prediction mode is predicted at 4: 4: 4, the color difference format 4: 2: 0 or 4 is used without changing the value of the intra color difference prediction mode obtained from the table of FIG.
: Intra color difference prediction mode value for 4: 4, and intra prediction of the color difference signal is performed according to the intra color difference prediction mode. When the color difference format is 4: 2: 2 and the value of the intra color difference prediction mode is predicted, the intra table obtained from the table of FIG. 14 by the conversion table shown in FIG. 15, FIG. 16, FIG. 17, FIG. The value of the intra color difference prediction mode for the color difference format 4: 2: 2 is derived from the value of the color difference prediction mode, and intra prediction of the color difference signal is performed according to the intra color difference prediction mode.

FIG. 25 shows the value of the syntax element intra_chroma_pred_mode [x0] [y0] regarding the intra color difference prediction mode from the value of the intra color difference prediction mode and the value of the intra luminance prediction mode of the prediction block of the luminance signal at the same position as the prediction block of the color difference signal. The table shown in FIG. 25 used on the encoding side corresponds to the table shown in FIG. 14 used on the decoding side. Using the table shown in FIG. 25, on the encoding side, the syntax element intra_chroma_pred_mo
The value of de [x0] [y0] is derived.

When the value of the first or second intra chrominance prediction mode is 0, the syntax element intra_chroma_pred_mode [x0] [y0] unless the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the chrominance signal is 0. ] Takes a value of 0, and if the value of the intra luminance prediction mode is 0, the value of the syntax element intra_chroma_pred_mode [x0] [y0] takes a value of 4.

If the value of the first or second intra chrominance prediction mode is 26 and the intra luminance prediction mode value of the prediction block at the same position as the prediction block of the chrominance signal is not 26, the syntax element intra_chroma_pred_mode [x0] [y0 ] Takes a value of 1, and if the value of the intra luminance prediction mode is 26, the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 4
Takes the value of

If the value of the first or second intra color difference prediction mode is 10, and if the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal is not 10, the syntax element intra_chroma_pred_mode [x0] [y0 ] Takes a value of 2, and if the value of the intra luminance prediction mode is 10, the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 4
Takes the value of

If the value of the first or second intra color difference prediction mode is 1, and if the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal is not 10, the syntax element intra_chroma_pred_mode [x0] [y0 ] Takes a value of 3, and if the value of the intra luminance prediction mode is 10, the value of the syntax element intra_chroma_pred_mode [x0] [y0] takes a value of 4.

When the value of the first intra color difference prediction mode is 34, if the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal is not 0, the syntax element intra_
If the value of chroma_pred_mode [x0] [y0] is 0 and the value of intra luminance prediction mode is 1, the value of syntax element intra_chroma_pred_mode [x0] [y0] is 1 and intra luminance prediction If the mode value is 2, the syntax element intra_chroma_pred_mode [x0
] [y0] takes a value of 2, and if the value of intra luminance prediction mode is 3, the value of the syntax element intra_chroma_pred_mode [x0] [y0] takes a value of 3, and the value of intra luminance prediction mode Is 34, the value of the syntax element intra_chroma_pred_mode [x0] [y0] is 4.

When the value of the first intra color difference prediction mode is the same as the value of the intra luminance prediction mode of the prediction block at the same position as the prediction block of the color difference signal, the syntax element intra_chroma_pred_mode
The value of [x0] [y0] takes a value of 4. However, when the color difference format is 4: 2: 2 and the value of the intra color difference prediction mode is predicted, the intra prediction unit 103 uses FIGS.
30 or FIG. 33, the second intra color difference format 4: 2: 2 is changed from the first intra color difference prediction mode for the color difference format 4: 2: 0 or 4: 4: 4.
Intra color difference prediction mode is derived, and the second intra color difference prediction mode is used for intra prediction of color difference signals for the color difference format 4: 2: 2.

When specifying the prediction block of the luminance signal at the same position as the prediction block of the color difference signal, it may be specified by referring to the division index PartIdx that specifies each prediction block, You may specify by referring the coordinate which shows a position.

Note that the number of intra color difference prediction modes of the prediction block in the coding block differs depending on the combination of the division mode and the color difference format supplied from the color difference format setting unit 101. When the division mode is 2N × 2N division, the value of the syntax element related to the intra color difference prediction mode of one prediction block is derived for each coding block regardless of the type of the color difference format.

When the division mode is N × N division and the color difference format is 4: 2: 0, the value of the syntax element related to the intra color difference prediction mode of one prediction block is derived for each coding block. When the division mode is N × N division and the color difference format is 4: 2: 2, the value of the syntax element related to the intra color difference prediction mode of two prediction blocks is derived for each coding block. When the division mode is N × N division and the color difference format is 4: 4: 4, the value of the syntax element related to the intra color difference prediction mode of four prediction blocks is derived for each coding block. FIG. 11 is a diagram for explaining a method of dividing the color difference signal of the encoded block into the prediction block in N × N division at the time of intra prediction. 11A shows a luminance signal in N × N division, FIG. 11B shows a color difference signal in N × N division when the color difference format is 4: 2: 0,
FIG. 11C shows color difference signals in N × N division when the color difference format is 4: 2: 2, and FIG. 11D shows N × N when the color difference format is 4: 4: 4. The color difference signal in the division is shown. When the chrominance format is 4: 2: 0, 4: 4: 4, the luminance signal encoding block and the chrominance signal encoding block are similar, and the aspect ratios of both blocks are the same. When the color difference format is 4: 2: 2, the encoding block of the luminance signal and the encoding block of the color difference signal are not similar, and the aspect ratios of the two encoding blocks are different. The color difference format is 4: 2: 0.
As in the case of the above, even when the color difference format is 4: 2: 2 or 4: 4: 4, one prediction block is obtained without dividing the encoded block in the color difference signal whose division mode is N × N division. You can also Similar to the case where the color difference format is 4: 0: 0, even when the color difference format is 4: 2: 2 or 4: 4: 4, the coding block is used in the color difference signal whose division mode is N × N division. It is also possible to make one prediction block without dividing.

The syntax element deriving unit 124 for the inter prediction information derives and derives the value of the syntax element for the inter prediction information for each prediction block when the prediction mode (PredMode) of the encoded block is inter prediction (MODE_INTER). The value of each syntax element is supplied to the entropy encoding unit 126. The inter prediction information in units of prediction blocks includes information such as an inter prediction mode (L0 prediction, L1 prediction, bi-prediction), an index for specifying a plurality of reference images, and a motion vector.

The entropy coding unit 126 derives syntax element values related to the encoding information in units of coding blocks supplied from the syntax element deriving unit 121 in coding block units and syntax elements related to the intra luminance prediction mode. A value of a syntax element related to the intra luminance prediction mode of the prediction block of the luminance signal supplied from the unit 122;
Prediction block unit supplied from the syntax element deriving unit 124 regarding the intra color difference prediction mode of the prediction block of the color difference signal supplied from the syntax element deriving unit 123 regarding the intra color difference prediction mode, and the syntax element deriving unit 124 regarding the inter prediction information Entropy-encode the value of the syntax element related to the inter prediction information of the following according to a predetermined syntax rule. At that time, the intra prediction mode encoding control unit 125 controls the order of the entropy encoding of the intra luminance prediction mode and the intra color difference prediction mode according to the division mode and the color difference format, and the entropy encoding unit 126 performs the intra prediction mode. Entropy encoding processing of the intra luminance prediction mode and the intra color difference prediction mode is performed in the order instructed by the encoding control unit 125.

Next, with respect to the decoding process of the encoded information in units of the encoded block and the prediction block performed by the second encoded stream decoding unit 203 in FIG. 2, the points related to the intra prediction mode, which is a feature of the embodiment, are mainly described. Explained. FIG. 13 is a block diagram showing the configuration of the second encoded stream decoding unit 203 in FIG.

As illustrated in FIG. 13, the second encoded stream decoding unit 203 in FIG. 2 includes an intra prediction mode decoding control unit 221, an entropy decoding unit 222, an encoding information deriving unit 223 for each encoding block, and an intra luminance prediction mode. Deriving unit 224, Intra color difference prediction mode deriving unit 22
5 and an inter prediction information deriving unit 226. In each unit constituting the second encoded stream decoding unit 203, processing according to the color difference format information supplied from the color difference format management unit 205 is performed, and encoding such as a prediction mode and a division mode in units of encoded blocks is performed. Processing according to the conversion information is performed.

The entropy decoding unit 222 performs entropy decoding on the second encoded stream including the encoded block supplied from the encoded stream separation unit 201 and the encoded information in units of prediction blocks according to a predetermined syntax rule, and performs encoding. Syntax element values for coding information in units of blocks, values of syntax elements for intra luminance prediction modes of prediction blocks of luminance signals, values of syntax elements for intra color difference prediction modes of prediction blocks of color difference signals, and prediction blocks A value of a syntax element related to inter prediction information of a unit is obtained. At this time, the intra prediction mode decoding control unit 221 controls the order of entropy decoding in the intra luminance prediction mode and the intra color difference prediction mode according to the division mode and the color difference format, and the entropy decoding unit 222 controls the intra prediction mode decoding control unit. The entropy decoding process of the intra luminance prediction mode and the intra color difference prediction mode is performed in the order instructed in 221. The intra prediction mode decoding control unit 221 is a control unit corresponding to the intra prediction mode encoding control unit 125 on the encoding side, and is set by the intra prediction mode encoding control unit 125 according to the division mode and the color difference format. The same decoding order of the intra prediction mode as that of the encoding order is set, and the decoding order of the intra prediction mode of the entropy decoding unit 222 is controlled. The entropy decoding unit 222 includes an entropy encoding unit 126 on the encoding side.
The entropy decoding process is performed according to the same rule as the syntax rule used in the entropy encoding unit 126.

The value of the syntax element relating to the coding information in units of coding blocks obtained by decoding is supplied to the coding information deriving unit 223 in units of coding blocks, and the syntax element relating to the intra luminance prediction mode of the prediction block of the luminance signal. The value is the intra luminance prediction mode deriving unit 224.
The value of the syntax element relating to the intra color difference prediction mode of the prediction block of the color difference signal is supplied to the intra color difference prediction mode deriving unit 225, and the value of the syntax element relating to the inter prediction information in units of prediction blocks is derived from the inter prediction information. Supplied to the unit 226.

The encoding information deriving unit 223 for each coding block derives coding information for each coding block from the value of the syntax element related to the supplied coding information for each coding block,
This is supplied to the intra prediction unit 206 or the inter prediction unit 207 via the switch 212.

The coding information deriving unit 223 for each coding block is a coding information deriving unit corresponding to the syntax element deriving unit 121 for coding information for each coding block on the coding side, and is common to the coding side and the decoding side. Encoding information is derived according to the rules of PredMode (PredMode) to determine intra prediction (MODE_INTRA) or inter prediction (MODE_INTER) of the coded block
) And a value related to the partition mode (PartMode) for determining the shape of the prediction block is derived by the coding information deriving unit 223 for each coding block.

The intra luminance prediction mode deriving unit 224 is a coding block deriving unit 22 for each coding block.
The prediction mode (PredMode) of the coded block derived in step 3 is intra prediction (MODE_INTRA)
In this case, the intra luminance prediction mode of the prediction block of the luminance signal is derived from the value of the syntax element related to the intra luminance prediction mode of the prediction block of the luminance signal to be supplied, and is supplied to the intra color difference prediction mode deriving unit 225. This is supplied to the intra prediction unit 206 via the switch 212. The intra luminance prediction mode deriving unit 224 is a deriving unit corresponding to the syntax element deriving unit 122 related to the intra luminance prediction mode on the encoding side, and is derived according to a common rule on the encoding side and the decoding side. The syntax element related to the intra luminance prediction mode is a syntax element prev_intra_luma_pred_flag [x0] [y0], which is a flag indicating whether or not prediction can be performed from the intra luminance prediction mode of surrounding blocks, and a syntax that is an index indicating the prediction block of the prediction source Element mpm_idx [x0] [y0] and syntax element rem_intra_luma_pred_mode [x0] indicating the intra-brightness prediction mode in units of prediction blocks
[y0]. In the derivation of the intra luminance prediction mode, the encoded information storage memory 210 is used.
The syntax element prev_intra_luma_pred_flag [x0 is a flag indicating that the value is used when it can be predicted from the intra luminance prediction mode of the surrounding block using the correlation with the intra luminance prediction mode of the surrounding block stored in ] [y0] is 1 (true), and the syntax element mpm_idx [x is an index indicating the prediction block of the prediction source
[0] Let the intra luminance prediction mode of the surrounding prediction block indicated by [y0] be the intra luminance prediction mode of the prediction mode. Syntax element prev_intra_luma_pred_flag [
When x0] [y0] is 0 (false), the syntax element rem_intr indicating the decoded intra luminance prediction mode is used instead of predicting the intra luminance prediction mode from the surrounding prediction blocks.
The intra luminance prediction mode is derived from the value of a_luma_pred_mode [x0] [y0].

In addition, when the number of intra luminance prediction modes of the prediction block in the coding block differs according to the division mode, and the division mode is 2N × 2N division, the intra luminance prediction mode of one set of prediction blocks for each coding block. A value is derived, and when the division mode is N × N division, intra luminance prediction mode values of four sets of prediction blocks are derived for each coding block.

The intra color difference prediction mode deriving unit 225 is a coding information deriving unit 22 for each coding block.
The prediction mode (PredMode) of the coded block derived in step 3 is intra prediction (MODE_INTRA)
In this case, the value of the syntax element intra_chroma_pred_mode [x0] [y0] and the intra luminance prediction mode deriving unit 2 regarding the intra color difference prediction mode of the prediction block of the supplied color difference signal
The value of the first intra color difference prediction mode is derived from the value of the intra luminance prediction mode supplied from 24 according to the table of FIG. Color difference format is 4: 2: 0 or 4: 4: 4
In this case, the first intra color difference prediction mode is supplied to the intra prediction unit 206 via the switch 212 as the color prediction signal intra prediction mode. The color difference format is 4: 2:
In the case of 2, the second intra color difference prediction mode is derived from the first intra color difference prediction mode by the conversion table of FIG. 15, FIG. 16, FIG. 17, FIG. The mode is supplied to the intra prediction unit 206 via the switch 212 as the color prediction signal intra prediction mode. The intra color difference prediction mode deriving unit 225 is an encoding information deriving unit corresponding to the syntax element deriving unit 123 related to the intra color difference prediction mode on the encoding side, and is derived according to a common rule on the encoding side and the decoding side. On the encoding side, the intra color difference prediction mode encoding uses the correlation between the prediction block of the luminance signal at the same position as the prediction block of the color difference signal and the intra luminance prediction mode of the prediction block of the luminance signal on the encoding side. When it is determined that the predicted value from the intra luminance prediction mode of the prediction block of the luminance signal in the same position as the prediction block of the color difference signal is the most suitable, the value of the intra color difference prediction mode is calculated from the value of the intra luminance prediction mode. When it is determined that it is better to set a unique value for the intra color difference prediction mode than for prediction from the intra luminance prediction mode, the intra color difference prediction mode is represented by 0 (planar prediction). ), 1 (average value prediction), 10
By using a mechanism for setting any one of (horizontal prediction), 26 (vertical prediction), and 34 (diagonal prediction), the code amount is reduced.

The inter prediction information deriving unit 226 derives and derives inter prediction information from values of syntax elements related to inter prediction information in units of prediction blocks when the prediction mode (PredMode) of the encoded block is inter prediction (MODE_INTER). The value of the inter prediction information is supplied to the inter prediction unit 207 via the switch 212. The inter prediction information deriving unit 226 is an inter prediction information deriving unit corresponding to the syntax element deriving unit 124 regarding the inter prediction information on the encoding side, and is derived according to a common rule on the encoding side and the decoding side. The derived inter prediction information for each prediction block includes information such as an inter prediction mode (L0 prediction, L1 prediction, bi-prediction), an index for specifying a plurality of reference images, and a motion vector.

Next, processing procedures for decoding and intra prediction in intra prediction mode on the decoding side will be described. FIG. 26 shows a second encoded stream decoding unit 203 and an intra prediction unit 206 on the decoding side.
It is a figure explaining the processing procedure of decoding of intra prediction mode implemented in FIG. First, the intra luminance prediction mode derivation unit 224 of the second encoded stream decoding unit 203 decodes the intra luminance prediction mode (step S4001 in FIG. 26). Subsequently, the intra color difference prediction mode deriving unit 225 of the second encoded stream decoding unit 203 decodes the first intra color difference prediction mode according to the table of FIG. 14 (step S4002 of FIG. 26).
. Subsequently, when the color difference format is not 4: 2: 2 (N in step S4003 in FIG. 26).
O), the process proceeds to step S4004, and if the color difference format is 4: 2: 2 (YES in step S4003 in FIG. 26), the intra color difference prediction mode deriving unit 225 of the second encoded stream decoding unit 203 performs FIG. 16, FIG. 17, FIG. 30, or FIG. 33, the second intra color difference prediction mode is derived from the first intra color difference prediction mode (FIG. 2).
6 step S4004). Subsequently, the intra prediction unit 206 performs intra prediction of the luminance signal and the color difference signal (step S4004 in FIG. 26). Note that step S40 in FIG.
The process of deriving the second intra color difference prediction mode from the first intra color difference prediction mode of 04 is performed by the intra prediction unit 206 instead of the intra color difference prediction mode deriving unit 225 of the second encoded stream decoding unit 203. Also good.

When the intra prediction mode for plane prediction is 0 and the intra prediction mode for average value prediction is 1, the color difference format 4: 2: 2 is the same as the color difference format 4: 2: 0 and the color difference format 4: 4: 4. Also, since the intra prediction is performed with the intra prediction mode of plane prediction set to 0 and the intra prediction mode of average value prediction set to 1, respectively, FIG. 15, FIG. 16, FIG.
In the conversion table of FIG. 7, FIG. 30, or FIG. 33, the value is the same even if the first intra color difference prediction mode is converted to the second intra color difference prediction mode. Therefore, in the intra prediction modes 0 and 1 that are not angle prediction, the second intra color difference prediction mode value is calculated from the value of the first intra color difference prediction mode using the conversion table of FIG. 15, FIG. 16, FIG. 17, FIG. Intra prediction may be performed after the value of the color difference prediction mode is derived, or FIGS.
The intra prediction may be performed as it is according to the first intra color difference prediction mode without deriving the second intra color difference prediction mode using the conversion table of FIG.

In the image encoding device and the image decoding device of the present embodiment, the color difference format is 4
In the case of 2: 2, the value of the second intra color difference prediction mode is changed from the value of the first intra color difference prediction mode using the conversion table of FIG. 15, FIG. 16, FIG. 17, FIG. Although described as being derived, the value of the second intra color difference prediction mode may be derived from the value of the first intra color difference prediction mode by a calculation formula instead of the conversion table.

In the image coding apparatus and the image decoding apparatus according to the present embodiment, when the color difference format in which the aspect ratios of the pixels of the luminance signal and the color difference signal are different is 4: 2: 2, FIG. 15 and FIG.
17, 30, or 33, the second intra color difference prediction mode value is derived from the first intra color difference prediction mode value using the conversion table in FIG. Instead of converting to the second intra color difference prediction mode in the unit 103 and the intra prediction unit 206 of the decoding device, the intra prediction modes other than the color difference signal of the color difference format 4: 2: 2 from the intra prediction mode shown in FIG. In addition to prediction angle (intra prediction angle for luminance signal and intra prediction angle for color difference signal 4: 2: 0, 4: 4: 4 color difference signal), color difference of color difference format 4: 2: 2 A table is prepared which is associated with the angle of intra prediction for signals. When the color difference format is 4: 2: 2, this table is used for the first intra color. Chroma format 4 from the prediction mode: 2: 2 to derive the angle of intra prediction for color difference signals, it is also possible to perform intra prediction of the chrominance signal using the angle. 27 and 28 show the angle of intra prediction other than the color difference signal of the color difference format 4: 2: 2 from the intra prediction mode (the angle of the intra prediction for the luminance signal and the color difference format 4: 2: 0, 4: 4: 4 is a table used for deriving the intra prediction angle of the color difference signal for the color difference format 4: 2: 2. FIG. 27 shows the second intra color difference prediction mode value to the second value using the conversion table of FIG.
This is a table in which the angle of intra prediction for color difference signals in the color difference format 4: 2: 2 is set so as to obtain the same result as that obtained by deriving the value of the intra color difference prediction mode. When the color difference format is 4: 2: 2, the angle of intra prediction for color difference signals is derived according to the table of FIG. 27 and the intra prediction is performed, so that the first intra color difference prediction mode can be obtained using the conversion table of FIG. The result is the same as when the value of the second intra color difference prediction mode is derived from the value to perform the intra prediction of the color difference signal.

FIG. 28 is a table in which the result of doubling the intra prediction angle in the vertical direction and halving in the horizontal direction is set. A procedure for deriving the table in FIG. 28 when converting the angle of the first intra color difference prediction to the angle of the second intra color difference prediction when the color difference format is 4: 2: 2 will be described with reference to the flowchart of FIG.

For each value from 0 to 34 of the first intra prediction mode IntraPredMode1, the second intra prediction angle IntraPredMode2 used for the intra prediction of the color difference signal of 4: 2: 2 is derived by the procedure of the flowchart of FIG. To do.

First, when the angle prediction is not performed, that is, when the first intra prediction mode IntraPredMode1 is 1 or less (NO in step S3201 in FIG. 29), the derivation process ends. The first intra prediction mode IntraPredMode1 is 1 or less because plane prediction is performed by interpolating pixel values from surrounding decoded blocks (intra prediction mode intraPredMode1 = 0), and the average value is derived from surrounding decoded blocks Mean value prediction (intra prediction mode)
intraPredMode1 = 1).

On the other hand, when the first intra color difference prediction mode IntraPredMode1 is angle prediction, that is, greater than 1 (YES in step S3201 of FIG. 29), the angle of the second intra prediction from the angle of the first intra prediction after step S3202 Convert to.

When the intra color difference prediction mode IntraPredMode1 is smaller than 18 (step S3 in FIG. 29)
202 YES), the first intra prediction angle IntraPredAngle1 corresponding to the first intra color difference prediction mode IntraPredMode1 is doubled, and the second intra prediction angle IntraPredAngle2
(Step S3203 in FIG. 29). In addition, the angle of the second intra prediction IntraPredA
ngle2 is limited to −32 or more and 32 or less (step S3204 in FIG. 29), and this derivation process is terminated. Specifically, when the second intra prediction angle IntraPredAngle2 is smaller than −32, the second intra prediction angle IntraPredAngle2 is set to −32, and the second intra prediction angle IntraPredAngle2 is larger than 32. If the angle Intra of the second intra prediction
Set PredAngle2 to 32. When the intra prediction mode IntraPredMode2 is 2 or more and less than 18, the intra prediction mode IntraPredMode2 remains as it is.

On the other hand, when the intra color difference prediction mode IntraPredMode1 is not smaller than 18, that is, 18 or more (NO in step S3202 of FIG. 29), the first intra color difference prediction mode IntraP.
The first intra prediction angle IntraPredAngle1 corresponding to redMode1 is multiplied by one half and the second
The intra prediction angle IntraPredAngle2 is set (step S3205 in FIG. 29), and this derivation process is terminated. In the present embodiment, the result of performing a 1-bit right shift operation equivalent to a half of the first intra prediction angle IntraPredAngle1 is used as the second intra prediction angle IntraPredAngle.
Set to 2.

In the above description, the second intra prediction angle is derived from the first intra prediction angle using the table of FIG. 28 when the color difference format is 4: 2: 2. In the intra prediction unit 103 and the intra prediction unit 206 of the decoding device,
Instead of the table of FIG. 28, the angle of the second intra prediction may be derived from the value of the first intra color difference prediction mode by the derivation method according to the processing procedure of FIG.

The moving image encoded stream output from the image encoding apparatus according to the embodiment described above has a specific data format so that it can be decoded according to the encoding method used in the embodiment. Thus, an image decoding apparatus corresponding to the image encoding apparatus can decode the encoded stream of this specific data format.

When a wired or wireless network is used to exchange an encoded stream between an image encoding device and an image decoding device, the encoded stream is converted into a data format suitable for the transmission form of the communication path and transmitted. May be. In that case, an image transmission apparatus that converts the encoded stream output from the image encoding apparatus into encoded data in a data format suitable for the transmission form of the communication path and transmits the encoded data to the network, and receives the encoded data from the network There is provided an image receiving apparatus that restores the encoded stream and supplies the encoded stream to the image decoding apparatus.

An image transmission device includes a memory that buffers an encoded stream output from the image encoding device, a packet processing unit that packetizes the encoded stream, and a transmission unit that transmits packetized encoded data via a network. including. The image reception device receives a packetized encoded data via a network, a memory for buffering the received encoded data, packetizes the encoded data to generate an encoded stream, And a packet processing unit provided to the image decoding device.

The above processing relating to encoding and decoding can be realized as a transmission, storage, and reception device using hardware, and is stored in a ROM (Read Only Memory), a flash memory, or the like. It can also be realized by firmware or software such as a computer. The firmware program and software program can be recorded on a computer-readable recording medium, provided from a server through a wired or wireless network, or provided as a data broadcast of terrestrial or satellite digital broadcasting Is also possible.

The present invention has been described based on the embodiments. The embodiments are exemplifications, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are within the scope of the present invention. .

101 color difference format setting unit, 102 image memory, 103 intra prediction unit, 104 inter prediction unit, 105 coding method determination unit, 106 residual signal generation unit, 107 orthogonal transform / quantization unit, 108 inverse quantization / inverse orthogonal transform , 109 decoded image signal superimposing unit, 110 encoded information storage memory, 111 decoded image memory, 11
2 1st encoding stream production | generation part, 113 2nd encoding stream production | generation part, 11
4 3rd encoded stream production | generation part, 115 Encoding stream multiplexing part, 121
A syntax element deriving unit for coding information in units of coding blocks, 122 a syntax element deriving unit for intra luminance prediction mode, a syntax element deriving unit for 123 intra color difference prediction mode, and 124 a syntax element deriving unit for inter prediction information, 125 intra prediction mode encoding control unit, 126 entropy encoding unit, 201 encoded stream demultiplexing unit, 202 first encoded stream decoding unit, 2
03 second encoded stream decoding unit, 204 third encoded stream decoding unit, 2
05 color difference format management unit, 206 intra prediction unit, 207 inter prediction unit, 208 inverse quantization / inverse orthogonal transform unit, 209 decoded image signal superimposing unit, 210 encoded information storage memory, 211 decoded image memory, 212 switch, 213 switch 221 Intra prediction mode decoding control unit 222 Entropy decoding unit 22
3. Coding information deriving unit 223, 224 intra luminance prediction mode deriving unit, 225 intra color difference prediction mode deriving unit, 226 inter prediction information deriving unit in units of coding blocks.

Claims (6)

An image decoding apparatus that decodes information related to an intra prediction mode in units of prediction blocks and decodes an image signal including a luminance signal and a color difference signal in units of transform blocks using intra prediction,
The syntax element related to the intra prediction mode of the luminance signal is decoded from the encoded stream in which the information related to the intra luminance prediction mode indicating the intra prediction method of the prediction block of the luminance signal is encoded, and the intra prediction mode of the luminance signal is derived. An intra luminance prediction mode decoding unit;
The syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream in which the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal is encoded, and the intra luminance prediction mode is also referred to. An intra color difference prediction mode decoding unit for deriving a first intra color difference prediction mode;
A luminance signal intra prediction unit that predicts the luminance signal of the conversion block of the luminance signal from the luminance signal around the conversion block of the luminance signal according to the intra luminance prediction mode specified for each prediction block of the luminance signal;
A color difference signal intra prediction unit that predicts the color difference signal of the conversion block of the color difference signal from the color difference signals around the conversion block of the color difference signal according to the intra color difference prediction mode specified for each prediction block of the color difference signal. ,
The intra chrominance prediction mode decoding unit converts the mode number of the first intra chrominance prediction mode used when the aspect ratio is the same when the luminance signal and the chrominance signal have different pixel aspect ratios, and Deriving the second intra color difference prediction mode based on the conversion table set as the second color difference signal intra prediction mode used when the aspect ratio is different,
In the conversion table, when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the first intra color difference If the mode number of the prediction mode is not a mode number indicating vertical prediction, the mode number indicating the vertical prediction is avoided and the mode number of the second intra color difference prediction mode is set,
When the aspect ratio is the same, the color difference signal intra prediction unit predicts the color difference signal of the color difference signal conversion block from the color difference signal around the color difference signal conversion block according to the first intra color difference prediction mode. An image decoding apparatus that predicts a color difference signal of a color difference signal conversion block from color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode when the ratio is different. An image decoding method for decoding information on an intra prediction mode in units of prediction blocks and decoding an image signal including a luminance signal and a color difference signal in units of transform blocks using intra prediction,
The syntax element related to the intra prediction mode of the luminance signal is decoded from the encoded stream in which the information related to the intra luminance prediction mode indicating the intra prediction method of the prediction block of the luminance signal is encoded, and the intra prediction mode of the luminance signal is derived. An intra luminance prediction mode decoding step;
The syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream in which the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal is encoded, and the intra luminance prediction mode is also referred to. An intra color difference prediction mode decoding step for deriving a first intra color difference prediction mode;
A luminance signal intra prediction step for predicting a luminance signal of the luminance signal conversion block from luminance signals around the luminance signal conversion block according to an intra luminance prediction mode specified for each prediction block of the luminance signal;
A color difference signal intra prediction step for predicting the color difference signal of the conversion block of the color difference signal from the color difference signals around the conversion block of the color difference signal according to the intra color difference prediction mode specified for each prediction block of the color difference signal. And
The intra chrominance prediction mode decoding step converts the mode number of the first intra chrominance prediction mode used when the aspect ratio is the same when the luminance signal and the chrominance signal have different pixel aspect ratios, and Deriving the second intra color difference prediction mode based on the conversion table set as the second color difference signal intra prediction mode used when the aspect ratio is different,
In the conversion table, when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the first intra color difference If the mode number of the prediction mode is not a mode number indicating vertical prediction, the mode number indicating the vertical prediction is avoided and the mode number of the second intra color difference prediction mode is set,
The color difference signal intra prediction step predicts the color difference signal of the color difference signal conversion block from the color difference signal around the color difference signal conversion block according to the first intra color difference prediction mode when the aspect ratio is the same, and the aspect ratio An image decoding method comprising: predicting a color difference signal of a color difference signal conversion block from color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode when the ratio is different. An image decoding program that decodes information about an intra prediction mode in units of prediction blocks and decodes an image signal including a luminance signal and a color difference signal in units of transform blocks using intra prediction,
The syntax element related to the intra prediction mode of the luminance signal is decoded from the encoded stream in which the information related to the intra luminance prediction mode indicating the intra prediction method of the prediction block of the luminance signal is encoded, and the intra prediction mode of the luminance signal is derived. An intra luminance prediction mode decoding step;
The syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream in which the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal is encoded, and the intra luminance prediction mode is also referred to. An intra color difference prediction mode decoding step for deriving a first intra color difference prediction mode;
A luminance signal intra prediction step for predicting a luminance signal of the luminance signal conversion block from luminance signals around the luminance signal conversion block according to an intra luminance prediction mode specified for each prediction block of the luminance signal;
A color difference signal intra prediction step for predicting a color difference signal of the color difference signal conversion block from a color difference signal around the color difference signal conversion block according to an intra color difference prediction mode specified for each prediction block of the color difference signal. To run
The intra chrominance prediction mode decoding step converts the mode number of the first intra chrominance prediction mode used when the aspect ratio is the same when the luminance signal and the chrominance signal have different pixel aspect ratios, and Deriving the second intra color difference prediction mode based on the conversion table set as the second color difference signal intra prediction mode used when the aspect ratio is different,
In the conversion table, when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the first intra color difference If the mode number of the prediction mode is not a mode number indicating vertical prediction, the mode number indicating the vertical prediction is avoided and the mode number of the second intra color difference prediction mode is set,
The color difference signal intra prediction step predicts the color difference signal of the color difference signal conversion block from the color difference signal around the color difference signal conversion block according to the first intra color difference prediction mode when the aspect ratio is the same, and the aspect ratio An image decoding program for predicting a color difference signal of a color difference signal conversion block from color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode when the ratio is different. Receives an encoded stream in which a moving image is encoded, decodes information related to the intra prediction mode in units of prediction blocks included in the received encoded stream, and includes a luminance signal and a color difference signal in units of transform blocks A receiving device that decodes an image signal using intra prediction,
The syntax element related to the intra prediction mode of the luminance signal is decoded from the encoded stream in which the information related to the intra luminance prediction mode indicating the intra prediction method of the prediction block of the luminance signal is encoded, and the intra prediction mode of the luminance signal is derived. An intra luminance prediction mode decoding unit;
The syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream in which the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal is encoded, and the intra luminance prediction mode is also referred to. An intra color difference prediction mode decoding unit for deriving a first intra color difference prediction mode;
A luminance signal intra prediction unit that predicts the luminance signal of the conversion block of the luminance signal from the luminance signal around the conversion block of the luminance signal according to the intra luminance prediction mode specified for each prediction block of the luminance signal;
A color difference signal intra prediction unit that predicts the color difference signal of the conversion block of the color difference signal from the color difference signals around the conversion block of the color difference signal according to the intra color difference prediction mode specified for each prediction block of the color difference signal. ,
The intra chrominance prediction mode decoding unit converts the mode number of the first intra chrominance prediction mode used when the aspect ratio is the same when the luminance signal and the chrominance signal have different pixel aspect ratios, and Deriving the second intra color difference prediction mode based on the conversion table set as the second color difference signal intra prediction mode used when the aspect ratio is different,
In the conversion table, when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the first intra color difference If the mode number of the prediction mode is not a mode number indicating vertical prediction, the mode number indicating the vertical prediction is avoided and the mode number of the second intra color difference prediction mode is set,
When the aspect ratio is the same, the color difference signal intra prediction unit predicts the color difference signal of the color difference signal conversion block from the color difference signal around the color difference signal conversion block according to the first intra color difference prediction mode. When the ratio is different, the color difference signal of the color difference signal conversion block is predicted from the color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode. Receives an encoded stream in which a moving image is encoded, decodes information related to the intra prediction mode in units of prediction blocks included in the received encoded stream, and includes a luminance signal and a color difference signal in units of transform blocks A reception method for decoding an image signal using intra prediction,
The syntax element related to the intra prediction mode of the luminance signal is decoded from the encoded stream in which the information related to the intra luminance prediction mode indicating the intra prediction method of the prediction block of the luminance signal is encoded, and the intra prediction mode of the luminance signal is derived. An intra luminance prediction mode decoding step;
The syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream in which the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal is encoded, and the intra luminance prediction mode is also referred to. An intra color difference prediction mode decoding step for deriving a first intra color difference prediction mode;
A luminance signal intra prediction step for predicting a luminance signal of the luminance signal conversion block from luminance signals around the luminance signal conversion block according to an intra luminance prediction mode specified for each prediction block of the luminance signal;
A color difference signal intra prediction step for predicting the color difference signal of the conversion block of the color difference signal from the color difference signals around the conversion block of the color difference signal according to the intra color difference prediction mode specified for each prediction block of the color difference signal. And
The intra chrominance prediction mode decoding step converts the mode number of the first intra chrominance prediction mode used when the aspect ratio is the same when the luminance signal and the chrominance signal have different pixel aspect ratios, and Deriving the second intra color difference prediction mode based on the conversion table set as the second color difference signal intra prediction mode used when the aspect ratio is different,
In the conversion table, when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the first intra color difference If the mode number of the prediction mode is not a mode number indicating vertical prediction, the mode number indicating the vertical prediction is avoided and the mode number of the second intra color difference prediction mode is set,
The color difference signal intra prediction step predicts the color difference signal of the color difference signal conversion block from the color difference signal around the color difference signal conversion block according to the first intra color difference prediction mode when the aspect ratio is the same, and the aspect ratio When the ratio is different, the color difference signal of the color difference signal conversion block is predicted from the color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode. Receives an encoded stream in which a moving image is encoded, decodes information related to the intra prediction mode in units of prediction blocks included in the received encoded stream, and includes a luminance signal and a color difference signal in units of transform blocks A reception program for decoding an image signal using intra prediction,
The syntax element related to the intra prediction mode of the luminance signal is decoded from the encoded stream in which the information related to the intra luminance prediction mode indicating the intra prediction method of the prediction block of the luminance signal is encoded, and the intra prediction mode of the luminance signal is derived. An intra luminance prediction mode decoding step;
The syntax element related to the intra color difference prediction mode of the color difference signal is decoded from the encoded stream in which the information related to the intra color difference prediction mode indicating the intra prediction method of the prediction block of the color difference signal is encoded, and the intra luminance prediction mode is also referred to. An intra color difference prediction mode decoding step for deriving a first intra color difference prediction mode;
A luminance signal intra prediction step for predicting a luminance signal of the luminance signal conversion block from luminance signals around the luminance signal conversion block according to an intra luminance prediction mode specified for each prediction block of the luminance signal;
A color difference signal intra prediction step for predicting a color difference signal of the color difference signal conversion block from a color difference signal around the color difference signal conversion block according to an intra color difference prediction mode specified for each prediction block of the color difference signal. To run
The intra chrominance prediction mode decoding step converts the mode number of the first intra chrominance prediction mode used when the aspect ratio is the same when the luminance signal and the chrominance signal have different pixel aspect ratios, and Deriving the second intra color difference prediction mode based on the conversion table set as the second color difference signal intra prediction mode used when the aspect ratio is different,
In the conversion table, when the mode number of the first intra color difference prediction mode is a mode number indicating vertical prediction, the mode number of the second intra color difference prediction mode is also a mode number indicating vertical prediction, and the first intra color difference If the mode number of the prediction mode is not a mode number indicating vertical prediction, the mode number indicating the vertical prediction is avoided and the mode number of the second intra color difference prediction mode is set,
The color difference signal intra prediction step predicts the color difference signal of the color difference signal conversion block from the color difference signals around the color difference signal conversion block according to the first intra color difference prediction mode when the aspect ratio is the same, and the aspect ratio A reception program that predicts a color difference signal of a color difference signal conversion block from color difference signals around the color difference signal conversion block according to the second intra color difference prediction mode when the ratio is different.

Images