JP2021090221A - Encoder, decoder and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To efficiently reduce entropy and improve coding performance in intra prediction. A coding device 1 according to the present invention has an intra prediction unit 14a that generates a prediction image using an intra prediction mode, and a residual signal generation that generates a residual signal by a difference between the predicted image and an original image. Intra prediction with unit 14b, an inversion unit 14c1 that inverts the residual signal to at least one of the horizontal and vertical directions when the position of the reference pixel used to generate the predicted image includes at least one of the right side and the lower side. The orthogonal transformation process to be applied is selected from the predetermined orthogonal transformation processing groups according to the mode and the position of the reference pixel used to generate the predicted image, and the inverted residual signal is selected. It is provided with an orthogonal transform unit 14c2 that performs the orthogonal transform process. [Selection diagram] Fig. 2

Description

The present invention relates to a coding device, a decoding device and a program.

In the moving image (video) coding method represented by H.265 / HEVC (High Efficiency Video Coding), there are two types of inter-prediction using temporal correlation between frames and intra-prediction using spatial correlation within frames. It is configured to output a stream obtained by performing orthogonal conversion processing, loop filtering processing, and entropy coding processing after performing prediction while switching between types of prediction to generate a residual signal.

In intra-prediction in HEVC, a total of 35 types of intra-prediction modes such as Planar prediction, DC prediction, and direction prediction are prepared, and intra-prediction is performed using adjacent decoded reference pixels according to the intra-prediction mode determined by the encoder. It is configured to do. Hereinafter, unless otherwise specified, the description "reference pixel" shall indicate a decoded reference pixel.

Here, in the intra prediction in HEVC, in the CU in which there is no adjacent reference pixel such as the coded target block (hereinafter referred to as “CU: Coding Unit”) located at the upper left in the frame, the specified value (10). If it is a moving image of a bit, it is configured to create a reference pixel to be used when generating a predicted image by a process of filling "512").

Further, in the conventional HEVC, since the coding process is performed in the raster scan order from the upper left, the reference pixel may not be decoded. In such a case, the predicted image is generated by using the value obtained by extrapolating the nearest decoded reference pixel to the 0th order.

In particular, in the conventional intra-prediction in HEVC, the reference pixels located on the lower left side and the upper right side of the CU are often not decoded due to the coding process in the raster scan order. In such a case, the reference pixels that have not been decoded are not decoded. There is a problem that the prediction accuracy is lowered and the coding efficiency is lowered when the direction is predicted from the direction in which the is present.

In order to solve this problem, in intra-prediction, the raster scan order (for example, Z type) is used as the coding processing order for a plurality of conversion blocks (hereinafter, referred to as “TU: Patent Unit”) existing in the CU. In addition, there is known a technique for improving prediction accuracy by giving a degree of freedom in the coding order of U-type, X-type, etc. (see Non-Patent Document 1).

Further, the intra prediction used in HEVC is a prediction using spatially adjacent upper or left reference pixels, and the prediction pixel at a position close to the reference pixel has high accuracy, and the prediction at a position far from the reference pixel is performed. Pixel accuracy tends to be low (see FIG. 10).

In addition, in the figure of this specification, the arrow indicating the direction (prediction direction) of the intra prediction mode is assumed to go from the pixel to be the target of the intra prediction to the reference pixel as described in the HEVC standard (the same applies hereinafter). ..

In conventional HEVC, by utilizing such a property, discrete sine transform (DST: Discrete Cosine Transform) or discrete cosine transform (DCT: Discrete Cosine Transform) or the like is performed in the horizontal and vertical directions from the left and upper directions where the reference pixel is located. The orthogonal transform process of is applied to reduce the entropy of the residual signal.

In particular, as shown in FIG. 11, the shape of the impulse response of the DST is an asymmetrical shape in which one of the end points is closed and the other end point is widened. Therefore, as shown in FIG. By applying DST according to the signal strength of the residual signal, the entropy can be effectively reduced.

By the way, Non-Patent Document 2 describes a technique for increasing the types of bases of the orthogonal transformation processing that can be selected, in addition to the orthogonal transformation processing (DCT-II, DST-VII) adopted in the conventional HEVC. ..

According to the technique described in Non-Patent Document 2, the coding efficiency can be improved by selecting the optimum orthogonal transformation process that concentrates the energy of the residual signal more (entropy can be reduced). ..

On the other hand, by increasing the types of bases of the orthogonal transformation processing, there is a problem that the amount of information required for transmission and storage of flag information indicating which orthogonal transformation processing was applied increases.

In order to prevent such a problem, the technique described in Non-Patent Document 2 is configured to select the orthogonal transformation process for the residual signal obtained by the intra-prediction according to the intra-prediction mode.

The reason is that there is a statistical bias in the tendency of the energy distribution of the residual signal depending on the direction of intra-prediction, and by limiting the options to orthogonal transformation processing, which is statistically highly effective in reducing entropy. It is possible to reduce the amount of information required for transmitting and accumulating flag information indicating the basis of the applied orthogonal transform processing.

Mochizuki et al., "Applied intra-prediction method based on average value coordinates", IPSJ Research Report, vol, 2012-AVM-77, No.12 X.Zhao, J.Chen, M.Karkzewicz, "Mode-dependent non-separable secarable transition", ITU-T SG16 / Q6 Doc. COM16-C1044, October 2015

However, in the technique described in Non-Patent Document 2, the base group (orthogonal conversion processing) of the orthogonal transformation processing that can be selected according to the intra prediction mode without considering the position of the reference pixel used in the intra prediction mode. It is configured to determine the group).

Here, the characteristics of the residual signal obtained by the intra prediction using the reference pixels on the right side and the lower side are different from the characteristics of the residual signal obtained by the intra prediction using the reference signals on the upper side and the left side.

Therefore, in the technique described in Non-Patent Document 2, when intra-prediction is performed using the reference pixels on the right side or the lower side, if the orthogonal transformation processing group that can be selected only in the intra-prediction mode is switched, There is a problem that the orthogonal transformation process to be applied is selected from the options for which the effect of reducing entropy is not statistically high, and the entropy may be increased and the coding performance may be lowered.

Therefore, the present invention has been made to solve the above-mentioned problems, and provides a coding device, a decoding device, and a program capable of efficiently reducing entropy and improving coding performance in intra-prediction. The purpose is to provide.

The first feature of the present invention is a coding device configured to divide the original image of each frame constituting the moving image into coding target blocks and encode the original image, using the intra-prediction mode. An intra prediction unit configured to generate a prediction image, and a residual signal configured to generate a residual signal based on the difference between the prediction image generated by the intra prediction unit and the original image. When at least one of the right side and the lower side is included in the position of the generation unit and the reference pixel used for generating the predicted image, the residual signal generated by the residual signal generation unit is at least horizontal and vertical. An orthogonal matrix applied from a predetermined orthogonal transformation processing group according to an inversion unit configured to invert to one side, the intra prediction mode, and the position of a reference pixel used to generate the predicted image. The gist is that the conversion process is selected, and the orthogonal transformation unit configured to perform the selected orthogonal transformation process on the residual signal inverted by the inversion unit is provided.

The second feature of the present invention is a decoding device configured to divide the original image of each frame constituting the moving image into coding target blocks and decode it, and the prediction image using the intra prediction mode. An intra-prediction unit configured to generate the above, an inverse quantization unit configured to perform an inverse quantization process on the quantized conversion coefficient, the intra-prediction mode, and the prediction image. The inverse orthogonal transform processing to be applied is selected from the predetermined inverse orthogonal transform processing group according to the position of the reference pixel used for the generation of, and the signal output from the inverse quantization unit is subjected to. A signal output from the inverse orthogonal transform unit when the inverse orthogonal transform unit configured to perform the selected inverse orthogonal transform process and at least one of the right side and the lower side are included in the position of the reference pixel. It is a gist to include an inversion portion configured to invert in at least one of the horizontal direction and the vertical direction.

The third feature of the present invention is a coding device configured to divide the original image of each frame constituting the moving image into coding target blocks and encode the original image, using the intra-prediction mode. An intra prediction unit configured to generate a prediction image, and a residual signal configured to generate a residual signal based on the difference between the prediction image generated by the intra prediction unit and the original image. It is configured to select the orthogonal transformation process to be applied from the predetermined orthogonal transform processing group according to the generation unit, the intra prediction mode, and the position of the reference pixel used for generating the predicted image. The orthogonal transform unit includes at least one of the right side and the lower side at the position of the reference pixel, and the orthogonal transform unit is used for the residual signal generated by the residual signal generation unit. On the other hand, it is a gist that it is configured to perform the selected orthogonal transformation process after inverting at least one of the bases in the horizontal direction and the vertical direction.

The fourth feature of the present invention is a decoding device configured to divide the original image of each frame constituting the moving image into coding target blocks and decode it, and the prediction image is predicted by using the intra prediction mode. An intra-prediction unit configured to generate the above, an inverse quantization unit configured to perform an inverse quantization process on the quantized conversion coefficient, the intra-prediction mode, and the prediction image. It is provided with an inverse orthogonal transform unit configured to select an inverse orthogonal transform process to be applied from a predetermined inverse orthogonal transform process group according to the position of the reference pixel used for generating the above. The inverse orthogonal transform unit includes at least one of the right side and the lower side at the position of the reference pixel, and at least one of the horizontal direction and the vertical direction with respect to the signal output from the inverse quantization unit. It is a gist that it is configured to perform the selected inverse orthogonal transformation process after inverting the basis of the above.

A fifth feature of the present invention is a program for making a computer function as a coding device according to the first and third features described above.

A fifth feature of the present invention is a program for making a computer function as a decoding device according to the second and fourth features described above.

According to the present invention, it is possible to provide a coding device, a decoding device and a program capable of efficiently reducing entropy and improving coding performance in intra-prediction.

FIG. 1 is a diagram showing an example of a functional block of the coding device 1 according to the first embodiment. FIG. 2 is a diagram showing an example of a functional block of the orthogonal transformation / quantization unit 14c of the coding apparatus 1 according to the first embodiment. FIG. 3 is a diagram showing an example of the direction of the intra prediction mode used in the first embodiment. FIG. 4 is a diagram showing an example of a method for generating a predicted image according to the first embodiment. FIG. 5 is a diagram showing an example of a method for generating a predicted image according to the first embodiment. FIG. 6 is a flowchart showing an example of the operation of the coding device 1 according to the first embodiment. FIG. 7 is a diagram showing an example of a functional block of the decoding device 3 according to the first embodiment. FIG. 8 is a diagram showing an example of a functional block of the inverse quantization / inverse transformation unit 33b of the decoding apparatus 3 according to the first embodiment. FIG. 9 is a flowchart showing an example of the operation of the decoding device 3 according to the first embodiment. FIG. 10 is a diagram for explaining the prior art. FIG. 11 is a diagram for explaining the prior art. FIG. 12 is a diagram for explaining the prior art.

(First Embodiment)
Hereinafter, the coding device 1 and the decoding device 3 according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 9.

Here, the coding device 1 and the decoding device 3 according to the present embodiment are configured to correspond to the intra prediction in the moving image coding method such as HEVC. The coding device 1 and the decoding device 3 according to the present embodiment are configured to be compatible with any moving image coding method as long as it is a moving image coding method that performs intra-prediction.

The coding device 1 according to the present embodiment is configured to divide the original image of each frame constituting the moving image into CUs and encode the original image. Further, the coding device 1 according to the present embodiment may be configured so that the CU can be divided into a plurality of TUs. Hereinafter, in the present embodiment, a case where the CU is divided into a plurality of TUs will be described as an example, but the present invention does not divide the CU into a plurality of TUs, and the position of the reference pixel of the CU is lower. It can also be applied to cases that include the side and right side.

In the present embodiment, the specified value (“512” in the case of a 10-bit moving image) is used for the CU to be encoded in which the adjacent decoded reference pixel does not exist, such as the CU located at the upper left in the frame. Since it is configured to create reference pixels to be used when generating a predicted image by the process of filling in, it is possible that all the pixels adjacent to the left side of the CU to be encoded can be used as reference pixels.

As shown in FIG. 1, the coding apparatus 1 according to the present embodiment includes an intra prediction mode determination unit 11, a TU division determination unit 12, a coding order control unit 13, and a sequential local decoding image generation unit 14. It includes a memory 15 and an entropy coding unit 16.

The intra prediction mode determination unit 11 is configured to determine the optimum intra prediction mode to be applied to the CU.

The TU division determination unit 12 is configured to determine whether or not to divide the CU into a plurality of TUs. In the present embodiment, as a method of dividing the CU into a plurality of TUs, a case of four divisions is described as an example, but the number of divisions and the division shape when the CU is divided into a plurality of TUs are described. , Not limited to such cases.

The coding order control unit 13 is configured to determine the coding order of the TUs in the CU based on the intra prediction mode (for example, the direction of the intra prediction mode).

For example, in the coding order control unit 13, when the TU division determination unit 12 determines that the CU is divided into a plurality of TUs, the direction of the intra prediction mode determined by the intra prediction mode determination unit 11 is from the lower left. When the direction is toward the upper right (that is, when the direction is predicted from the lower left to the upper right), the coding order of the TUs in the CU is not the conventional raster scan order but the lower left TU in the CU → The coding order is TU at the lower right in the CU → TU at the upper left in the CU → TU at the upper right in the CU, or TU at the lower left in the CU → TU at the upper left in the CU → TU at the lower right in the CU → Of the coding order of TU on the upper right in the CU, a predetermined coding order may be adopted.

The sequential locally decoded image generation unit 14 is configured to generate a locally decoded image (decoded image for each TU) based on the coding order determined by the coding order control unit 13 and the method of dividing the CU into TUs. ing.

Specifically, the sequential local decoding image generation unit 14 follows the coding order determined by the coding order control unit 13 when the TU division determination unit 12 determines that the CU is divided into a plurality of TUs. , Sequentially configured to generate locally decoded images.

As shown in FIG. 1, the sequential local decoding image generation unit 14 includes an intra prediction unit 14a, a residual signal generation unit 14b, an orthogonal transformation / quantization unit 14c, and an inverse quantization unit / inverse orthogonal conversion unit 14d. , A locally decoded image generation unit 14e.

The intra prediction unit 14a is configured to generate a prediction image using the intra prediction mode determined by the intra prediction mode determination unit 11. That is, the intra prediction unit 14a is configured to determine the position of the reference pixel used when generating the prediction image according to the intra prediction mode, and generate the prediction image using the reference pixel.

Further, the intra prediction unit 14a may be configured to generate a prediction image in the coding order determined by the coding order control unit 13.

The residual signal generation unit 14b is configured to generate a residual signal based on the difference between the predicted image generated by the intra prediction unit 14a and the original image.

The orthogonal transformation / quantization unit 14c is configured to perform orthogonal conversion processing and quantization processing on the residual signal generated by the residual signal generation unit 14b to generate a quantized conversion coefficient. ..

As shown in FIG. 2, the orthogonal transformation / quantization unit 14c includes an inversion unit 14c1, an orthogonal transformation unit 14c2, and a quantization unit 14c3.

The inversion unit 14c1 includes a case where at least one of the right side and the lower side is included in the position of the reference pixel used for generating the predicted image (when the predicted image is generated using the reference pixel adjacent to at least one of the right side and the lower side). In addition, the residual signal generated by the residual signal generation unit 14b is configured to be inverted in at least one of the horizontal direction and the vertical direction.

For example, the inversion unit 14c1 is configured to invert the residual signal in the vertical direction when the position of the reference pixel includes the lower side (when the predicted image is generated by using the reference pixel adjacent to the lower side). You may be.

Alternatively, the inversion unit 14c1 is configured to invert the residual signal in the horizontal direction when the position of the reference pixel includes the right side (when the predicted image is generated using the reference pixel adjacent to the right side). You may.

The orthogonal transform unit 14c2 is configured to perform orthogonal transform processing on the residual signal inverted by the inverting unit 14c1.

Specifically, the orthogonal transformation unit 14c2 is applied from a predetermined orthogonal transformation processing group (orthogonal transformation base group) according to the intra prediction mode and the position of the reference pixel used for generating the predicted image. The orthogonal transformation process to be performed is selected, and the selected orthogonal transform processing is applied to the residual signal inverted by the inversion unit 14c1.

FIG. 3 shows an example of the intra prediction mode used in this embodiment. As shown in FIG. 3, in the present embodiment, the intra prediction modes 2 to 9 are classified into category A, the intra prediction modes 10 to 26 are classified into category B, and the intra prediction modes 27 to 34 are classified into category C. It shall be classified into.

In the present embodiment, an example using the intra prediction mode in HEVC shown in FIG. 3 will be described, but the present invention is also applicable to an example in which another intra prediction mode is used.

Here, the residual signal obtained by the difference between the predicted image and the original image is converted into an orthogonal transformation coefficient by using an orthogonal transformation process. By concentrating the energy of the residual signal by the orthogonal transformation process, it is possible to improve the coding efficiency in the entropy coding process in the subsequent stage.

In HEVC, DCT and DST are prepared as applicable orthogonal transformation processing, and the orthogonal transformation processing is performed while switching according to the block size and the prediction mode.

Here, the orthogonal transformation process is not limited to DST, DCT, etc., but may be a conversion process (including an integerized one for speeding up) applied to a residual signal for the purpose of concentrating energy. For example, any conversion process may be used.

By increasing the types of orthogonal transformation processes that can be selected, it is more likely that the orthogonal transformation process that concentrates more energy can be selected for residual signals with various energy distributions, but on the other hand, which orthogonal matrix is used. The amount of information required for transmitting and accumulating flag information indicating whether to apply the conversion process increases.

The energy distribution of the residual signal is statistically correlated with the distance from the reference pixel used for the intra prediction. Therefore, the energy distribution of the residual signal is different between the intra prediction mode using only the reference pixels on the left side and the intra prediction mode using only the reference pixels on the left side and the upper side.

Therefore, the technique described in Non-Patent Document 2 utilizes the correlation between the bias of the negergy distribution of the residual signal and the direction of the intra prediction mode, and is an orthogonal transformation that can be selected according to the direction of the intra prediction mode. It is configured to switch processing groups.

In FIGS. 4 (a) and 4 (b), as an example of the energy distribution of the residual signal, the intra prediction mode 2 (intra prediction mode using only the reference pixel located on the left side) and the intra prediction mode 18 (left side) in HEVC are shown. And the difference in the energy distribution of the residual signal in the intra prediction mode) using the reference pixel located on the upper side is shown.

As described above, for the residual signals having different energy distributions, the orthogonal transformation processing having a statistically high entropy reduction effect is different.

Therefore, in the technique described in Non-Patent Document 2, as described above, an orthogonal transformation processing group that can be selected according to the direction of the intra prediction mode is prepared, and the optimum orthogonal transformation processing is selected from the orthogonal transformation processing groups. It is configured.

According to such a technique, by switching the applicable orthogonal transformation processing group according to the direction of the intra prediction mode, which orthogonal transformation processing is applied while efficiently concentrating the statistical energy distribution of the residual signal. It is possible to reduce the amount of information of the flag indicating whether or not.

However, as shown in FIG. 5, when the direction prediction of the intra prediction mode 2 is performed using the reference pixels located on the left side and the lower side, the direction prediction of the intra prediction mode 2 is performed using only the reference pixels located on the left side. The energy distribution of the residual signal is also different due to the difference in the position of the reference pixel as compared with the case of performing.

The energy distribution of the residual signal by the direction prediction in the intra prediction mode 2 using the reference pixels located on the left side and the lower side (see FIG. 5) uses the reference pixels located on the left side and the upper side shown in FIG. 4 (b). The energy distribution is the same as that obtained by inverting the residual signal obtained by the direction prediction of the intra prediction mode 18 in the vertical direction.

That is, when the direction prediction in the intra prediction mode 2 is performed, it is obtained when the left side and the lower side are included as the positions of the reference pixels and the orthogonal transformation process is applied after the residual signal is inverted in the vertical direction. The energy distribution of the orthogonal transform coefficient to be obtained is that when the direction prediction of the intra prediction mode 18 is performed, the position of the reference pixel includes the left side and the upper side, and the residual signal is not inverted in the horizontal direction and the vertical direction. The energy distribution of the orthogonal transformation coefficient obtained when the orthogonal transformation processing is applied is the same (see FIGS. 4 (b) and 5).

Since the energy distribution of the orthogonal transformation coefficient obtained by the orthogonal transformation processing for the residual signal by the direction prediction in the intra prediction mode 2 differs depending on the position of the reference pixel used for the intra prediction, the orthogonality applicable only based on the intra prediction mode. Determining the conversion processing group may increase the entropy and reduce the coding performance.

Therefore, when the orthogonal transform unit 14c2 inverts the residual signal in at least one of the horizontal direction and the vertical direction depending on the position of the reference pixel in the intra prediction, the orthogonal transform unit 14c2 selects according to the direction of the applied intra prediction mode and the position of the reference pixel. Determine possible orthogonal transformation processing groups.

That is, when the intra prediction mode belongs to category B, the orthogonal transformation unit 14c2 is configured to select the orthogonal transformation process to be applied from the orthogonal transformation group defined in advance according to the direction of the intra prediction mode. It may have been done.

For example, when the intra prediction mode is 18, the orthogonal transformation unit 14c2 is configured to select an orthogonal transformation process to be applied from a predetermined orthogonal transformation group according to the direction of the intra prediction mode 18. You may.

Alternatively, the orthogonal transform unit 14c2 is determined in advance according to the direction of the intra prediction mode when the intra prediction mode belongs to category A and the lower side is not included as the position of the reference pixel. It may be configured to select the orthogonal transformation process to be applied from the transformation group.

For example, when the intra-prediction mode is 2 and the position of the reference pixel does not include the lower side, the orthogonal transform unit 14c2 has a group of orthogonal transforms defined in advance according to the direction of the intra-prediction mode 2. It may be configured to select the orthogonal transformation process to be applied from among.

Alternatively, the orthogonal transform unit 14c2 is determined in advance according to the direction of the intra prediction mode when the intra prediction mode belongs to category C and the right side is not included as the position of the reference pixel. It may be configured to select the orthogonal transformation process to be applied from the transformation group.

For example, when the intra-prediction mode is 34 and the right side is not included as the position of the reference pixel, the orthogonal transform unit 14c2 has a group of orthogonal transforms defined in advance according to the direction of the intra-prediction mode 34. It may be configured to select the orthogonal transformation process to be applied from among.

Further, when the position of the reference pixel includes the lower side, the orthogonal transform unit 14c2 applies the orthogonal transform from the orthogonal transform group defined in advance according to the direction in which the direction of the intra prediction mode is inverted in the vertical direction. It may be configured to select a process.

Here, "reversing the direction of the intra prediction mode to the vertical direction" means that in the example of FIG. 3, the direction of the intra prediction modes 2 to 9 and the direction of the intra prediction modes 18 to 11 are converted, respectively. That is, it means that the direction of each intra prediction mode is converted to the direction of the intra prediction mode having a line-symmetrical positional relationship with reference to the direction of the intra prediction mode 10.

That is, when the intra-prediction mode belongs to category A and the lower side is included as the position of the reference pixel, the orthogonal transform unit 14c2 responds to the direction in which the direction of the intra-prediction mode is reversed in the vertical direction. It may be configured to select the orthogonal transformation process to be applied from the orthogonal transform group defined in advance.

For example, when the orthogonal transform unit 14c2 has an intra prediction mode of 2 and the lower side is included as the position of the reference pixel, the orthogonal transform unit 14c2 reverses the direction of the intra prediction mode 2 in the vertical direction (intra prediction mode). It may be configured to select the orthogonal transformation process to be applied from the orthogonal transform group defined in advance according to the direction (18 directions).

Alternatively, when the position of the reference pixel includes the right side, the orthogonal transform unit 14c2 applies the orthogonal transform from the orthogonal transform group defined in advance according to the direction in which the direction of the intra prediction mode is reversed in the horizontal direction. It may be configured to select a process.

Here, "reversing the direction of the intra prediction mode in the horizontal direction" means that in the example of FIG. 3, the direction of the intra prediction mode 18 to 25 and the direction of the intra prediction mode 34 to 27 are converted, respectively. That is, it means that the direction of each intra prediction mode is converted to the direction of the intra prediction mode having a line-symmetrical positional relationship with reference to the direction of the intra prediction mode 26.

That is, when the intra-prediction mode belongs to category C and the right side is included as the position of the reference pixel, the orthogonal transform unit 14c2 responds to the direction in which the direction of the intra-prediction mode is reversed in the horizontal direction. It may be configured to select the orthogonal transformation process to be applied from the orthogonal transform group defined in advance.

For example, when the orthogonal transform unit 14c2 has the intra prediction mode of 34 and the right side is included as the position of the reference pixel, the orthogonal transform unit 14c2 reverses the direction of the intra prediction mode 34 in the horizontal direction (intra prediction mode). It may be configured to select the orthogonal transformation process to be applied from the orthogonal transform group defined in advance according to the direction (18 directions).

The quantization unit 14c3 is configured to perform a quantization process on the signal output from the orthogonal transform unit 14c2 to generate a quantized conversion coefficient.

The inverse quantization unit / inverse orthogonal transform unit 14d again performs inverse quantization processing and inverse orthogonal transformation processing on the quantized conversion coefficient generated by the orthogonal transformation / quantization unit 14c to generate a residual signal. It is configured to generate.

The locally decoded image generation unit 14e generates a locally decoded image by adding the prediction image generated by the intra prediction unit 14a to the residual signal generated by the inverse quantization unit and the inverse orthogonal transform unit 14d. It is configured.

The memory 15 is configured to hold the locally decoded image generated by the sequential locally decoded image generation unit 14 so as to be available as a reference image.

The entropy coding unit 16 is configured to perform entropy coding processing on flag information including an intra prediction mode determined by the intra prediction mode determination unit 11 and a quantized conversion coefficient, and output a stream. There is.

FIG. 6 shows a flowchart for explaining an example of the operation of the coding device 1 according to the present embodiment.

As shown in FIG. 6, in step S101, the coding apparatus 1 determines the position of the reference pixel used when generating the predicted image according to the determined intra prediction mode, and uses the reference pixel to generate the predicted image. It is generated, and a residual signal is generated by the difference between the predicted image and the original image.

In step S102, when the position of the reference pixel used for generating the predicted image includes at least one of the right side and the lower side, the coding device 1 horizontally produces the residual signal generated by the residual signal generation unit 14b. And flip in at least one of the vertical directions.

In step S103, the coding apparatus 1 selects an orthogonal transformation process to be applied from a predetermined orthogonal transform processing group according to the intra prediction mode and the position of the reference pixel used for generating the predicted image. The inverted residual signal is subjected to the selected orthogonal transformation process.

In step S104, the coding apparatus 1 performs a quantization process on the signal subjected to the orthogonal transformation process to generate a quantized conversion coefficient.

In step S105, the coding device 1 performs entropy coding processing on the flag information including the intra prediction mode and the quantized conversion coefficient, and outputs the stream.

Further, the decoding device 3 according to the present embodiment is configured to divide the original image of each frame constituting the moving image into CUs and decode it. Further, the decoding device 3 according to the present embodiment is configured so that the CU can be divided into a plurality of TUs, similarly to the coding device 1 according to the present embodiment.

As shown in FIG. 7, the decoding device 3 according to the present embodiment includes an entropy decoding unit 31, a decoding order control unit 32, a sequential decoding image generation unit 33, and a memory 34.

The entropy decoding unit 31 is configured to perform entropy decoding processing on the stream output from the coding device 1 to decode the conversion coefficient, flag information, and the like from the stream output from the coding device 1. ing. Here, the conversion coefficient is a quantized conversion coefficient obtained as a signal encoded by dividing the original image in frame units into CUs by the coding device 1.

The decoding order control unit 32 is configured to determine the decoding order of the TUs in the CU based on the intra prediction mode.

Specifically, the decoding order control unit 32 has a flag indicating whether or not the TU division output by the entropy decoding unit 31 has been performed (whether or not the CU is divided into a plurality of TUs) and an intra prediction mode. It is configured to determine the decoding order of the TUs in the CU according to the direction.

For example, in the decoding order control unit 32, similarly to the coding order control unit 13, when the CU is divided into a plurality of TUs and the direction of the intra prediction mode is from the lower left to the upper right. Decoding order of lower left TU in CU → lower right TU in CU → upper left TU in CU → upper right TU in CU, or lower left TU in CU → upper left TU in CU → in CU Of the decoding order of TU at the lower right of TU → TU at the upper right in the CU, the decoding process may be performed in a predetermined decoding order.

The sequential decoding image generation unit 33 is configured to generate a decoded image (decoded image for each TU) based on the decoding order determined by the decoding order control unit 32 and the method of dividing the CU into TUs.

Specifically, when the CU is divided into a plurality of TUs, the sequential decoding image generation unit 33 is quantized and output by the entropy decoding unit 31 according to the decoding order determined by the decoding order control unit 32. It is configured to generate a decoded image by sequentially performing inverse quantization processing, inverse orthogonal conversion processing, and intra-prediction with respect to the conversion coefficient.

As shown in FIG. 7, the sequential decoding image generation unit 33 includes an intra prediction unit 33a, an inverse quantization / inverse conversion unit 33b, and a decoding image generation unit 33c.

The intra prediction unit 33a may be configured to generate a prediction image using the intra prediction mode output by the entropy decoding unit 31 according to the decoding order determined by the decoding order control unit 32.

The inverse quantization / inverse transformation unit 33b performs the inverse quantization processing and the inverse transformation processing (for example, the inverse orthogonal transformation processing) on the quantized conversion coefficient output by the entropy decoding unit 31, and the residual. It is configured to generate a signal.

As shown in FIG. 8, the inverse quantization / inverse conversion unit 33b includes an inverse quantization unit 33b1, an inverse orthogonal transformation unit 33b2, and an inverse orthogonal transformation unit 33b3.

The inverse quantization unit 33b1 is configured to perform an inverse quantization process on the quantized conversion coefficient output by the entropy decoding unit 31.

The inverse orthogonal transform unit 33b2 is configured to perform an inverse orthogonal transform process on the signal (conversion coefficient) output from the inverse quantization unit 33b1.

Specifically, the inverse orthogonal transform unit 33b2, like the orthogonal transform unit 14c2, is included in the inverse orthogonal transform group defined in advance according to the intra prediction mode and the position of the reference pixel used for generating the predicted image. The inverse orthogonal transform process to be applied is selected from, and the selected inverse orthogonal transform process is applied to the signal output from the inverse quantization unit 33b1.

That is, when the intra-orthogonal conversion mode belongs to category B, the anti-orthogonal conversion unit 33b2 selects an anti-orthogonal conversion process to be applied from a predetermined anti-orthogonal conversion group according to the direction of the intra-prediction mode. It may be configured as follows.

For example, when the intra-prediction mode is 18, the anti-orthogonal conversion unit 33b2 selects an anti-orthogonal conversion process to be applied from a predetermined anti-orthogonal conversion group according to the direction of the intra-prediction mode 18. It may be configured.

Alternatively, the inverse orthogonal transform unit 33b2 is predetermined according to the direction of the intra prediction mode when the intra prediction mode belongs to category A and the lower side is not included as the position of the reference pixel. It may be configured to select the inverse orthogonal transform process to be applied from the inverse orthogonal transform group.

For example, the inverse orthogonal transform unit 33b2 is determined in advance according to the direction of the intra prediction mode 2 when the intra prediction mode is 2 and the lower side is not included as the position of the reference pixel. It may be configured to select the inverse orthogonal transformation process to be applied from the transformation group.

Alternatively, the inverse orthogonal transform unit 33b2 is predetermined according to the direction of the intra prediction mode when the intra prediction mode belongs to category C and the right side is not included as the position of the reference pixel. It may be configured to select the inverse orthogonal transformation process to be applied from the inverse orthogonal transformation group.

For example, the inverse orthogonal transform unit 33b2 is determined in advance according to the direction of the intra prediction mode 34 when the intra prediction mode is 34 and the right side is not included as the position of the reference pixel. It may be configured to select the inverse orthogonal transformation process to be applied from the transformation group.

Further, when the position of the reference pixel includes the lower side, the inverse orthogonal transform unit 33b2 is applied from the inverse orthogonal transform group defined in advance according to the direction in which the direction of the intra prediction mode is reversed in the vertical direction. It may be configured to select the inverse orthogonal transformation process.

That is, when the intra-orthogonal conversion unit 33b2 belongs to the category A and the lower side is included as the position of the reference pixel, the inverse orthogonal transform unit 33b2 reverses the direction of the intra-orthogonal prediction mode in the vertical direction. It may be configured to select the inverse orthogonal transform process to be applied from the inverse orthogonal transform group defined in advance accordingly.

For example, the inverse orthogonal transform unit 33b2 reverses the direction of the intra prediction mode 2 in the vertical direction (intra prediction) when the intra prediction mode is 2 and the lower side is included as the position of the reference pixel. It may be configured to select the inverse orthogonal transform process to be applied from the inverse orthogonal transform group defined in advance according to the direction of the mode 18).

Alternatively, when the position of the reference pixel includes the right side, the inverse orthogonal transform unit 33b2 applies from the inverse orthogonal transform group defined in advance according to the direction in which the direction of the intra prediction mode is reversed in the horizontal direction. It may be configured to select the inverse orthogonal transformation process.

That is, when the intra-orthogonal conversion unit 33b2 belongs to the category C and the right side is included as the position of the reference pixel, the inverse orthogonal transform unit 33b2 reverses the direction of the intra-orthogonal mode in the horizontal direction. It may be configured to select the inverse orthogonal transform process to be applied from the inverse orthogonal transform group defined in advance accordingly.

For example, when the inverse orthogonal transform unit 33b2 is in the intra prediction mode 34 and the right side is included as the position of the reference pixel, the inverse orthogonal transform unit 33b2 reverses the direction of the intra prediction mode 34 in the horizontal direction (intra prediction). It may be configured to select the inverse orthogonal transform process to be applied from the inverse orthogonal transform group defined in advance according to the direction of the mode 18).

The inversion unit 33b3 is configured to invert the signal output from the inverse orthogonal transform unit 33b2 in at least one of the horizontal direction and the vertical direction when the position of the reference pixel includes at least one of the right side and the lower side. There is.

Specifically, the inversion unit 33b3 may be configured to invert the signal output from the inverse orthogonal transform unit 33b2 in the vertical direction when the position of the reference pixel includes the lower side.

Alternatively, the inversion unit 33b3 may be configured to invert the signal output from the inverse orthogonal transform unit 33b2 in the horizontal direction when the position of the reference pixel includes the right side.

The decoded image generation unit 33c is configured to generate a decoded image by adding the predicted image generated by the intra prediction unit 33a and the residual signal generated by the inverse quantization / inverse conversion unit 33b.

The memory 34 is configured to hold the decoded image generated by the sequential decoding image generation unit 33 so that it can be used as a reference image for intra-prediction and inter-prediction.

FIG. 9 shows a flowchart for explaining an example of the operation of the decoding device 3 according to the present embodiment.

As shown in FIG. 9, in step S201, the decoding device 3 uses the intra prediction mode to generate a prediction image.

In step S202, the decoding device 3 performs an inverse quantization process on the quantized conversion coefficient.

In step S203, the decoding device 3 selects an inverse orthogonal transform process to be applied from a predetermined inverse orthogonal transform group according to the intra prediction mode and the position of the reference pixel used for generating the predicted image. The selected inverse orthogonal transformation process is applied to the signal that has been subjected to the inverse quantization process.

In step S204, when the position of the reference pixel includes at least one of the right side and the lower side, the decoding device 3 inverts the signal subjected to the inverse orthogonal transformation process in at least one of the horizontal direction and the vertical direction.

According to the coding device 1 and the decoding device 3 according to the present embodiment, the residual signal obtained by the intra prediction is different depending on not only the direction of the intra prediction mode but also the position of the reference pixel. Can be switched and used, entropy can be reduced, and coding efficiency is improved.

(Second Embodiment)
Hereinafter, the coding device 1 and the decoding device 3 according to the second embodiment of the present invention will be described focusing on the differences from the coding device 1 and the decoding device 3 according to the first embodiment described above.

The coding device 1 according to the present embodiment does not include the inversion unit 14c1, and the decoding device 3 according to the present embodiment does not include the inversion unit 33b3.

In the coding apparatus 1 according to the present embodiment, the orthogonal transform unit 14c2 is applied from a predetermined orthogonal transform processing group according to the intra prediction mode and the position of the reference pixel used for generating the predicted image. It is configured to select the orthogonal transformation process.

Here, when the position of the reference pixel includes at least one of the right side and the lower side, the orthogonal transform unit 14c2 is in the horizontal direction and the vertical direction with respect to the residual signal generated by the residual signal generation unit 14b. It is configured to invert at least one of the bases and then perform the selected orthogonal transformation process.

Specifically, when the position of the reference pixel includes the lower side, the orthogonal transform unit 14c2 is selected from the orthogonal transform processing group defined in advance according to the direction in which the direction of the intra prediction mode is reversed in the vertical direction. It may be configured to select the orthogonal transform process to be applied, invert the base in the vertical direction with respect to the residual signal, and then perform the selected orthogonal transform process.

Alternatively, when the position of the reference pixel includes the right side, the orthogonal transform unit 14c2 applies the orthogonal matrix from the orthogonal transform processing group defined in advance according to the direction in which the direction of the intra prediction mode is reversed in the horizontal direction. The conversion process may be selected, the base in the horizontal direction may be inverted with respect to the residual signal, and then the selected orthogonal transformation process may be performed.

In the decoding device 3 according to the present embodiment, the inverse orthogonal transform unit 33b2 is applied from a predetermined inverse orthogonal transform processing group according to the intra prediction mode and the position of the reference pixel used for generating the predicted image. It is configured to select the inverse orthogonal transformation process to be performed.

Here, when the position of the reference pixel includes at least one of the right side and the lower side, the inverse orthogonal transform unit 33b2 has at least one of the horizontal direction and the vertical direction with respect to the signal output from the inverse quantization unit 33b1. It is configured to perform the selected orthogonal transformation process after inverting the basis of.

Specifically, when the position of the reference pixel includes the lower side, the inverse orthogonal transform unit 33b2 of the inverse orthogonal transform processing group defined in advance according to the direction in which the direction of the intra prediction mode is vertically inverted. It is configured to select the inverse orthogonal transform process to be applied from the inside, invert the base in the vertical direction with respect to the signal output from the inverse quantization unit 33b1, and then perform the selected inverse orthogonal transform process. May be good.

Alternatively, when the position of the reference pixel includes the right side, the inverse orthogonal transform unit 33b2 is applied from the inverse orthogonal transform processing group defined in advance according to the direction in which the direction of the intra prediction mode is reversed in the horizontal direction. The inverse orthogonal transformation process to be performed may be selected, the base in the horizontal direction may be inverted with respect to the signal output from the inverse quantization unit 33b1, and then the selected inverse orthogonal transformation process may be performed.

(Other embodiments)
As mentioned above, the invention has been described by the embodiments described above, but the statements and drawings that form part of the disclosure in such embodiments should not be understood as limiting the invention. Such disclosure will reveal to those skilled in the art various alternative embodiments, examples and operational techniques.

Further, although not particularly mentioned in the above-described embodiment, a program for causing a computer to execute each process performed by the above-mentioned coding device 1 and decoding device 3 may be provided. The program may also be recorded on a computer-readable medium. Computer-readable media can be used to install such programs on computers. Here, the computer-readable medium on which such a program is recorded may be a non-transient recording medium. The non-transient recording medium is not particularly limited, but may be, for example, a recording medium such as a CD-ROM or a DVD-ROM.

Alternatively, even if a chip composed of a memory for storing a program for realizing at least a part of the functions in the encoding device 1 and the decoding device 3 described above and a processor for executing the program stored in the memory is provided. Good.

1 ... Coding device 11 ... Intra prediction mode determination unit 12 ... TU division determination unit 13 ... Coding order control unit 14 ... Sequential local decoding image generation unit 14a ... Intra prediction unit 14b ... Residual signal generation unit 14c ... Orthogonal conversion Quantization unit 14c1 ... Inversion unit 14c2 ... Orthogonal conversion unit 14c3 ... Quantization unit 14d ... Inverse quantization unit / inverse orthogonal conversion unit 14e ... Local decoding image generation unit 15 ... Memory 16 ... Entropy coding unit 3 ... Decoding device 31 ... Entropy decoding unit 32 ... Decoding order control unit 33 ... Sequential local decoding image generation unit 33a ... Intra prediction unit 33b ... Inverse quantization / inverse conversion unit 33b1 ... Inverse quantization unit 33b2 ... Inverse orthogonal conversion unit 33b3 ... Inversion unit 33c ... Decoding Image generator 34 ... Memory

Claims (4)

A coding device that divides the original image of each frame that constitutes a moving image into blocks and encodes them.
An intra-prediction unit that generates a prediction image corresponding to a coded target block using an intra-prediction mode that indicates the type of intra-prediction processing.
A residual signal generation unit that generates a residual signal based on the difference between the predicted image generated by the intra prediction unit and the target block, and a residual signal generation unit.
Depending on whether or not at least one pixel included in the pixel line adjacent to the left side of the target block and the pixel line adjacent to the upper side of the target block is used for generating the prediction image, and the intra prediction mode, in advance. A coding device including a conversion unit that selects a conversion process to be applied from a specified conversion process group. It is a decoding device that decodes the original image of the frame unit that constitutes the moving image in block units obtained by dividing it.
An entropy decoding unit that decodes the intra prediction mode indicating the type of intra prediction processing,
Using the intra prediction mode, an intra prediction unit that generates a prediction image corresponding to the block to be decoded, and an intra prediction unit.
An inverse quantization unit that performs inverse quantization processing on the quantized conversion coefficient,
Depending on whether or not at least one pixel included in the pixel line adjacent to the left side of the target block and the pixel line adjacent to the upper side of the target block is used for generating the predicted image, and the intra prediction mode, in advance. A decoding device including a reverse conversion unit that selects an reverse conversion process to be applied from a defined reverse conversion process group. A program for causing a computer to function as the coding device according to claim 1. A program for causing a computer to function as the decoding device according to claim 2.

Images