JP2008283481A - Image processor, and method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce an operation amount required to determine a predictive mode of an in-frame predictive coding. <P>SOLUTION: When encoding a frame of a moving image in a block unit, predictive image generating parts 201 to 209 generate a plurality of predictive images respectively corresponding to a plurality of predictive modes in the case of performing in-frame predictive coding of a block of an encoding object. Pixel selecting parts 211 to 219 acquire the value of a pixel of a position corresponding to each predictive mode from the block of the encoding object and a plurality of predictive images. SAD (sum of absolute difference) calculating parts 221 to 229 calculate an evaluation value showing a difference between pixel values. A predictive mode determining part 210 sets a predictive mode of the block of the encoding object on the basis of evaluation values respectively corresponding to the plurality of predictive modes. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to video encoding.

  MPEG-2 (ISO / IEC 13818) is widely used as a moving image encoding method in the fields of storage, communication, and broadcasting. In recent years, H.264 / MPEG-4 AVC (ISO / IEC 14496-10) has been standardized as a new MPEG encoding method and is expected to be widely used (hereinafter referred to as H.264).

  The H.264 encoding device prepares various prediction modes as an intra prediction method when intra-frame predictive encoding of a moving image frame, and selects an optimal prediction mode from a plurality of prediction modes. Thus, higher encoding efficiency than before can be obtained. Below, the kind of prediction mode and the production | generation method of a prediction image are demonstrated.

  The predicted image is generated using a locally decoded image from already encoded data in the screen. Since encoding is performed in units of blocks from the upper left to the lower right of the screen, the pixels that can be used for generating the predicted image of the target block are decoded images of blocks such as the left side and the upper side of the target block.

  FIG. 1 is a diagram showing adjacent blocks used for generating a predicted image, in which the shaded portion is a block that is a generation target of the predicted image, and blocks A, B, C, and D are locally decoded images that can be referred to .

  FIG. 2 is a diagram showing nine types of prediction modes for each prediction direction in encoding of a H.264 4 × 4 pixel block. For each prediction mode, it is defined which reference pixel is used to generate a prediction image.

  FIG. 3 is a diagram for explaining the relationship between each prediction mode and the predicted pixel value. Pixels a to p indicate the positions of the pixels generated as the predicted image, and pixels A to M are used to generate the predicted image. Reference pixels are shown.

The prediction mode 0 is vertical prediction, and each pixel of the prediction image is generated as follows.
a, e, i, m: A
b, f, j, n: B
c, g, k, o: C
d, h, l, p ： D… (1)

The prediction mode 1 is horizontal prediction, and each pixel of the predicted image is generated as follows.
a, b, c, d: I
e, f, g, h: J
i, j, k, l: K
m, n, o, p: L… (2)

Although the prediction mode 2 is not shown in FIG. 2, each pixel of the predicted image is generated as follows in the prediction of the DC component. “>>” represents a bit shift, and “>> x” means right shift by x bits, in other words, 1/2 ^x .
a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p: (A + B + C + D + I + J + K + L + 4 ) ≫ 3… (3)

Prediction mode 3 is diagonal lower left (diagonal_down_left) prediction, and each pixel of the predicted image is generated as follows.
a ： (A + 2B + C + 2) ≫ 2
b, e: (B + 2C + D + 2) ≫ 2
c, f, i: (C + 2D + E + 2) ≫ 2
d, g, j, m: (D + 2E + F + 2) ≫ 2
h, k, n: (E + 2F + G + 2) ≫ 2
l, o: (F + 2G + H + 2) ≫ 2
p ： (G + 3H + 2) ≫ 2… (4)

Prediction mode 4 is diagonally lower right (diagonal_down_right) prediction, and each pixel of the predicted image is generated as follows.
m: (J + 2K + L + 2) ≫ 2
i, n: (I + 2J + K + 2) ≫ 2
e, j, o: (M + 2I + J + 2) ≫ 2
a, f, k, p: (A + 2M + I + 2) ≫ 2
b, g, l: (M + 2A + B + 2) ≫ 2
c, h: (A + 2B + C + 2) ≫ 2
d ： (B + 2C + D + 2) ≫ 2… (5)

The prediction mode 5 is diagonally lower right (diagonal_vertical_right) prediction, and each pixel of the predicted image is generated as follows.
a, j: (M + A + 1) ≫ 1
b, k: (A + B + 1) ≫ 1
c, l: (B + C + 1) ≫ 1
d ： (C + D + 1) ≫ 1
e, n: (I + 2M + A + 2) ≫ 2
f, o: (M + 2A + B + 2) ≫ 2
g, p: (A + 2B + C + 2) ≫ 2
h: (B + 2C + D + 2) ≫ 2
i ： (M + 2I + J + 2) ≫ 2
m ： (I + 2J + K + 2) ≫ 2… (6)

The prediction mode 6 is horizontal slightly down (horizontal_down) prediction, and each pixel of the predicted image is generated as follows.
a, g ： (M + I + 1) ≫ 1
b, h: (I + 2M + A + 2) ≫ 2
c: (M + 2A + B + 2) ≫ 2
d ： (A + 2B + C + 2) ≫ 2
e, k: (I + J + 1) ≫ 1
f, l: (M + 2I + J + 2) ≫ 2
i, o: (J + K + 1) ≫ 1
j, p: (I + 2J + K + 2) ≫ 2
m: (K + L + 1) ≫ 1
n ： (J + 2K + L + 2) ≫ 2… (7)

The prediction mode 7 is diagonally lower left (diagonal_vertical_left) prediction, and each pixel of the predicted image is generated as follows.
a ： (A + B + 1) ≫ 1
b, i: (B + C + 1) ≫ 1
c, j: (C + D + 1) ≫ 1
d, k: (D + E + 1) ≫ 1
l ： (E + F + 1) ≫ 1
e: (A + 2B + C + 2) ≫ 2
f, m: (B + 2C + D + 2) ≫ 2
g, n: (C + 2D + E + 2) ≫ 2
h, o: (D + 2E + F + 2) ≫ 2
p: (E + 2F + G + 2) ≫ 2… (8)

The prediction mode 8 is horizontal slightly up (horizontal_up) prediction, and each pixel of the predicted image is generated as follows.
a ： (I + J + 1) ≫ 1
b ： (I + 2J + K + 2) ≫ 2
c, e: (J + K + 1) ≫ 1
d, f: (J + 2K + L + 2) ≫ 2
g, i ： (K + L + 1) ≫ 1
h, j: (K + 3L + 2) ≫ 2
k, l, m, n, o, p: L… (9)

  Thus, there are nine types of prediction modes for 4 × 4 pixel blocks. In order to generate prediction images for all nine types of prediction modes, obtain evaluation values, and determine an optimal prediction mode from them, there is a problem that the amount of calculation is large and the processing load is large.

  As a method of reducing the processing load, Patent Document 1 discloses the following method. That is, nine types of modes are classified into two types, those having a correlation in the horizontal direction and those having a correlation in the vertical direction. Then, it is detected from the comparison of the difference sum in the horizontal direction and the difference sum in the vertical direction to which the generation target block of the predicted image belongs. However, also in this method, regardless of whether horizontal or vertical is selected, prediction images are generated for six types of prediction modes, and the optimal prediction mode is determined. That is, the amount of calculation cannot be reduced sufficiently.

JP2004-304724

  An object of the present invention is to reduce the amount of calculation required for determining a prediction mode of intraframe prediction encoding.

  The present invention has the following configuration as one means for achieving the above object.

  The image processing for encoding the frame of the moving image according to the present invention in units of blocks generates a plurality of prediction images corresponding to a plurality of prediction modes when the block to be encoded is subjected to intraframe prediction encoding, Obtain a pixel value at a position corresponding to each prediction mode from the encoding target block and the plurality of prediction images, calculate an evaluation value indicating a difference between the pixel values, and correspond to each of the plurality of prediction modes The prediction mode of the block to be encoded is set based on the evaluation value to be encoded.

  Further, for a plurality of prediction images corresponding to each of a plurality of prediction modes when the block to be encoded is intra-frame predictively encoded, a pixel at a position corresponding to each prediction mode is generated, and the block to be encoded Based on evaluation values corresponding to each of the plurality of prediction modes, obtaining pixel values at positions corresponding to the respective prediction modes of the plurality of prediction images, calculating evaluation values indicating differences between the pixel values. A prediction mode of the block to be encoded is set, and a prediction image of the set prediction mode is generated.

  In addition, when the prediction mode information of a plurality of encoded blocks adjacent to the block to be encoded is acquired, and the block to be encoded is subjected to intraframe prediction encoding according to the prediction mode indicated by the prediction mode information. Generating one predicted image, calculating a first evaluation value indicating a difference between a corresponding pixel value of the block to be encoded and the first predicted image, and based on the first evaluation value, When the prediction mode indicated by the prediction mode information is selected, and the prediction target having the prediction direction adjacent to the prediction direction of the selected prediction mode is used for intra-frame prediction encoding of the block to be encoded A prediction image is generated, a second evaluation value indicating a difference between corresponding pixel values of the encoding target block and the second prediction image is calculated, and based on the first and second evaluation values. Z , And sets the prediction mode of the block of the encoding target.

  An image processing method for encoding a frame of a moving image in units of blocks, wherein a value of a predetermined pixel of a block to be encoded is acquired, and the encoded block is framed based on a combination of the values of the predetermined pixel. It is characterized by setting a prediction mode in the case of intra prediction encoding.

  An image processing method for encoding a frame of a moving image in units of blocks, wherein a value of a predetermined pixel of a block to be encoded is acquired, and the encoded block is framed based on a combination of the values of the predetermined pixel. Selecting a plurality of prediction modes when performing intra prediction encoding, generating a plurality of prediction images corresponding to each of the plurality of prediction modes, and corresponding pixel values of the block to be encoded and the plurality of prediction images An evaluation value indicating a difference between them is calculated, and a prediction mode of the block to be encoded is set based on an evaluation value corresponding to each of the plurality of prediction modes.

  According to the present invention, it is possible to reduce the amount of calculation required for determining the prediction mode of intraframe prediction encoding.

  Hereinafter, image processing according to an embodiment of the present invention will be described in detail with reference to the drawings. In the following, a 4 × 4 pixel block will be described, but the same processing can be applied to a 16 × 16 pixel block and an 8 × 8 pixel block.

[Device configuration]
FIG. 4 is a block diagram illustrating a configuration example of the encoding apparatus according to the embodiment. The encoding device encodes a frame of a moving image divided into encoded blocks in H.264 format on a block basis.

  The subtractor 1001 calculates a difference between an image of a block to be encoded (hereinafter referred to as the current block) of a frame to be encoded (hereinafter referred to as the current frame) and a predicted image, and outputs a difference image. An orthogonal transform (DCT) unit 1002 performs orthogonal transform on the difference image. The quantization unit 1003 quantizes the orthogonal transform coefficient. The variable length coding unit 1004 generates a code from the quantized orthogonal transform coefficient using Huffman coding or arithmetic coding.

  For generation of a predicted image, an image obtained by locally decoding already encoded data (hereinafter referred to as a locally decoded image) is used. The inverse quantization unit 1006 inversely quantizes the quantized orthogonal transform coefficient. The inverse DCT unit 1007 performs inverse DCT on the orthogonal transform coefficient obtained by inverse quantization to generate a locally decoded image. The adder 1017 adds the image output from the inverse DCT unit 1007 and the predicted image in the case of inter-frame predictive coding. The block distortion removing unit 1011 suppresses visual degradation that easily occurs when the quantization step called block distortion is large. The above decoding process is also called local decoding. A frame memory (FM) 1013 temporarily stores locally decoded images.

  The intra prediction unit 1010 receives an image of the current block and a locally decoded image located in the vicinity of the current block from the FM 1013 for intra prediction of intraframe prediction encoding, and generates a prediction image. The motion compensation unit 1012 receives an image of the current block and a local decoded image of a frame in the vicinity of the current frame from the FM 1013 for inter-frame prediction encoding, and the relative motion amount (hereinafter referred to as motion) of the object between the blocks. Vector) and a predicted image is generated.

  When performing encoding, the variable length encoding unit 1004 also encodes additional information such as mode determination in intra prediction and motion vectors in interframe prediction. The buffer unit 1014 monitors the amount of generated code, outputs the state to the rate control unit 1015, and outputs a code at a predetermined transmission rate. The rate control unit 1015 sets a quantization step for performing coarse quantization in the quantization unit 1003 when the generated code amount> target value, and performs a quantization step for performing fine quantization when the generated code amount <target value. The generated code amount is controlled by setting in the quantization unit 1003.

  The mode determination unit 1005 determines whether the current frame is subjected to intraframe prediction encoding or interframe prediction encoding, and controls the switches 1008 and 1009 according to the determination result. In the case of an intra picture (I picture) to be subjected to intraframe prediction encoding, a prediction image of the intra prediction unit 1010 is input to the subtractor 1001 via the switch 1009. The switch 1008 is open. On the other hand, in the case of a prediction picture (P picture) or a bidirectional prediction picture (B picture) to be subjected to interframe prediction encoding, a prediction image of the motion compensation unit 1012 is input to the subtractor 1001 via the switch 1009. Also, the predicted image of the motion compensation unit 1012 is input to the adder 1017 via the switch 1008.

  As described above, the H.264 method encodes the difference image between the current block image and the predicted image block image in both intra-frame coding and inter-frame prediction coding.

  FIG. 11 is a block diagram illustrating an example in which the encoding apparatus is realized by the computer apparatus 2000.

  The CPU 2002 executes an operating system (OS) and various programs stored in the ROM 2003 and the hard disk drive (HDD) 2008 using the RAM 2004 as a work memory. Then, various components to be described later are controlled via the system bus 2001, and the program for realizing the function as the encoding device of the embodiment is executed, thereby functioning as the encoding device shown in FIG.

  A network interface (I / F) 2005 is an interface with the network 2010. The input device 2006 is a video input device such as a mouse, a keyboard, or a video camera. The output device 2007 is a recording device that records video on a monitor or various recording media.

  The computer device 2000 encodes video data input from the input device 2006 or video data stored in the HDD 2008 and outputs the encoded data to the output device 2007 or transmits it to the server or client via the network 2010.

[Intra prediction section]
FIG. 5 is a block diagram illustrating a configuration example of the intra prediction unit 1010.

  Prediction image generation units 201 to 209 generate prediction images of prediction modes 0 to 8 from local decoded images, respectively. That is, nine predicted images (hereinafter, predicted images 0 to 8) corresponding to the nine types of prediction modes are generated.

  The pixel selectors 211 to 219 respectively select a pixel (input pixel) of the current block and a corresponding pixel (predicted pixel) of the predicted images 0 to 8. Each of the SAD calculation units 221 to 229 calculates the sum of absolute differences (SAD) between the input pixel and the selected pixel, and uses the sum or average value of the SADs between corresponding pixels as an evaluation value.

  The evaluation value may be any value as long as it indicates an error between the current block image and the predicted image. For example, the evaluation value may be the sum of squares of the difference between the input pixel and the predicted pixel. In order to further increase the accuracy, the difference values may be compared with transform coefficients obtained by orthogonal transform, or the generated code amounts when the transform coefficients are quantized may be compared with predicted values.

  FIG. 6 is a diagram illustrating pixel positions selected by the pixel selection units 211 to 219. Arrows indicate the direction of prediction.

  The pixel selection unit 211 for the prediction mode 0 selects the pixels shown in FIG. 6A (pixels m, n, o, and p shown in FIG. 3). The pixel selection unit 212 for the prediction mode 1 selects the pixels shown in FIG. 6B (pixels d, h, l, and p shown in FIG. 3). The pixel selection unit 213 for the prediction mode 2 selects the pixels shown in FIG. 6C (pixels a, d, m, and p shown in FIG. 3). The pixel selection unit 214 for the prediction mode 3 selects the pixels shown in FIG. 6D (pixels i, m, n, and o shown in FIG. 3). The pixel selection unit 215 for the prediction mode 4 selects the pixels shown in FIG. 6E (pixels h, l, n, and o shown in FIG. 3). The pixel selection unit 216 for the prediction mode 5 selects the pixels shown in FIG. 6 (f) (pixels h, n, o, and p shown in FIG. 3). The pixel selection unit 217 for the prediction mode 6 selects the pixels shown in FIG. 6G (pixels h, l, n, and p shown in FIG. 3). The pixel selection unit 218 for the prediction mode 7 selects the pixels shown in FIG. 6 (h) (pixels e, m, n, and o shown in FIG. 3). The pixel selection unit 219 for the prediction mode 8 selects the pixels shown in FIG. 6 (i) (pixels b, c, d, and h shown in FIG. 3).

  That is, since the pixel selection units 211 to 219 each select four pixels and calculate the evaluation value, the calculation amount of each of the SAD calculation units 221 to 229 is smaller than when all the pixels are selected and the evaluation value is calculated. Reduced to 1/4.

  Note that the number of pixels selected by the pixel selectors 211 to 219 is not limited to four as shown in FIG. Evaluation accuracy is proportional to the number of pixels to be selected. In addition, although the position of the selected pixel is not limited, it is possible to select a pixel farther from the pixel used to generate the predicted image (the pixel indicated by a circle in FIG. 6) with respect to the prediction direction of the prediction mode. However, it is considered that the evaluation accuracy becomes high. Therefore, FIG. 6 shows an example in which the pixel at the farthest position is selected.

  Moreover, although the number of pixels to be selected in all the prediction modes is four, it may be changed for each prediction mode. However, if the number of pixels to be selected differs depending on the prediction mode, the evaluation value of SAD is divided by the number of selected pixels and an average value per pixel is obtained, or SAD is multiplied by a weighting factor according to the number of selected pixels. Take action to match the weights.

  The prediction mode determination unit 210 receives nine evaluation values from the SAD calculation units 221 to 229, determines a prediction mode with the smallest evaluation value, and outputs a determination result. The selector 220 selectively outputs one of the prediction images of the prediction image generation units 201 to 209 according to the determination result of the prediction mode determination unit 210.

  FIG. 7 is a flowchart for explaining the operation of the intra prediction unit 1010.

  The intra prediction unit 1010 inputs a locally decoded image (S301), and inputs an image of the current block (S302). Then, the counter i is initialized to 0 (S303).

  Next, the intra prediction unit 1010 generates a predicted image by the predicted image generation unit corresponding to the prediction mode i (S304). Then, a pixel for evaluation value calculation in the prediction mode i is selected by the pixel selection unit corresponding to the prediction mode i (S305). Then, the evaluation amount in the prediction mode i is calculated by the SAD calculation unit corresponding to the prediction mode i (S306).

  Next, the intra prediction unit 1010 determines whether i <8 (S307). If i <8, i is incremented (S308), and the process returns to step S304. Further, when i = 8, since the evaluation values in all prediction modes are obtained, the prediction mode determination unit 210 selects the prediction mode with the smallest evaluation value (S309), and the selector 220 selects the prediction mode selected. Predictive images are selectively output.

  As described above, in this embodiment, first, a plurality of prediction images corresponding to a plurality of prediction modes in the case where intra-frame prediction encoding is performed on a block to be encoded are generated. And the value of the pixel of the position according to each prediction mode is acquired from the block to be encoded and a plurality of prediction images, and the evaluation value indicating the difference between the pixel values is calculated. Then, the calculation amount for determining the prediction mode can be reduced by setting the prediction mode of the block to be encoded based on the evaluation value corresponding to each of the plurality of prediction modes.

  The image processing according to the second embodiment of the present invention will be described below. Note that the same reference numerals in the second embodiment denote the same parts as in the first embodiment, and a detailed description thereof will be omitted.

  FIG. 8 is a block diagram illustrating a configuration example of the intra prediction unit 1010 according to the second embodiment.

  The pixel selection units 401 to 409 respectively select a pixel (input pixel) of the current block and a corresponding pixel of the local decoded images 0 to 8. Prediction image generation units 411 to 419 generate prediction images of only pixel positions selected by pixel selection units 401 to 409 from the locally decoded image.

The predicted image generation unit 411 corresponding to the prediction mode 0 generates a predicted image according to the following equation.
m: A
n: B
o: C
p: D… (10)

The predicted image generation unit 412 corresponding to the prediction mode 1 generates a predicted image by the following equation.
d: I
h: J
l: K
p: L (11)

The predicted image generation unit 413 corresponding to the prediction mode 2 generates a predicted image according to the following equation.
a, d, m, p: (A + B + C + D + I + J + K + L + 4) ≫ 3… (12)

The predicted image generation unit 414 corresponding to the prediction mode 3 generates a predicted image according to the following equation.
i ： (C + 2D + E + 2) ≫ 2
m: (D + 2E + F + 2) ≫ 2
n: (E + 2F + G + 2) ≫ 2
o ： (F + 2G + H + 2) ≫ 2… (13)

The predicted image generation unit 415 corresponding to the prediction mode 4 generates a predicted image according to the following equation.
o: (M + 2I + J + 2) ≫ 2
n: (I + 2J + K + 2) ≫ 2
l ： (M + 2A + B + 2) ≫ 2
h ： (A + 2B + C + 2) ≫ 2… (14)

The predicted image generation unit 416 corresponding to the prediction mode 5 generates a predicted image according to the following equation.
n: (I + 2M + A + 2) >> 2
o: (M + 2A + B + 2) ≫ 2
p: (A + 2B + C + 2) ≫ 2
h ： (B + 2C + D + 2) ≫ 2… (15)

The predicted image generation unit 417 corresponding to the prediction mode 6 generates a predicted image according to the following equation.
h: (I + 2M + A + 2) ≫ 2
l ： (M + 2I + J + 2) ≫ 1
p: (I + 2J + K + 2) ≫ 2
n ： (J + 2K + L + 2) ≫ 2… (16)

The predicted image generation unit 418 corresponding to the prediction mode 7 generates a predicted image according to the following equation.
e: (A + 2B + C + 2) ≫ 2
m: (B + 2C + D + 2) ≫ 2
n: (C + 2D + E + 2) >> 2
o ： (D + 2E + F + 2) ≫ 2… (17)

The predicted image generation unit 414 corresponding to the prediction mode 8 generates a predicted image according to the following equation.
b ： (I + 2J + K + 2) ≫ 2
c: (J + K + 1) ≫ 1
d: (J + 2K + L + 2) ≫ 2
h ： (K + 3L + 2) ≫ 2… (18)

  The selector 220 selectively outputs any one of the predicted images of the predicted image generation units 411 to 419 according to the determination result of the prediction mode determination unit 210 as in the first embodiment. However, the selected predicted image does not have all the pixel values of the block.

  The additional predicted image generation unit 430 generates a predicted image other than the pixel position selected by the pixel selection unit 401-409 from the locally decoded image according to the determination result of the prediction mode determination unit 210. The predicted image integration unit 431 combines the image output from the selector 220 and the image output from the additional predicted image generation unit 430, and outputs a complete predicted image.

  For example, when the prediction mode 0 is selected, the prediction image generated by the prediction image generation unit 411 has only four pixel values of pixels m, n, o, and p. Accordingly, the additional predicted image generation unit 430 generates the pixel values of the remaining pixels.

  FIG. 9 is a flowchart for explaining the operation of the intra prediction unit 1010 according to the second embodiment. However, the same steps as those shown in FIG. 7 are denoted by the same reference numerals as those in FIG.

  The intra prediction unit 1010 initializes the counter i (S303), and then selects a pixel for evaluation value calculation in the prediction mode i by the pixel selection unit corresponding to the prediction mode i (S504). Then, a predicted image at the pixel position selected by the pixel selection unit is generated by the predicted image generation unit corresponding to the prediction mode i (S505). Then, the evaluation amount in the prediction mode i is calculated by the SAD calculation unit corresponding to the prediction mode i (S506).

  When the prediction mode determination unit 210 selects a prediction mode with the smallest evaluation value (S309), the intra prediction unit 1010 generates an insufficient prediction image in the selected prediction mode using the additional prediction image generation unit 430 (S510). ). Then, the predicted image integrated by the predicted image integration unit 431 is output (S511).

  FIG. 10 is a block diagram showing another configuration example of the intra prediction unit 1010.

  In the intra prediction unit 1010 illustrated in FIG. 10, when the final predicted image is output, the predicted image generation unit 433 generates a predicted image corresponding to the selection result of the prediction mode. According to this configuration, the predicted image generation units 411 to 419 do not need to hold the predicted image, and the selector 220 and the predicted image integration unit 431 are not necessary.

  In the configuration shown in FIG. 10, the operation of the intra prediction unit 1010 is to generate a prediction image corresponding to the selected prediction mode by the prediction image generation unit 433 (S510), and output the generated prediction image (S511). It will be.

  As described above, in the present embodiment, for the plurality of prediction images corresponding to the plurality of prediction modes when the block to be encoded is subjected to intra-frame prediction encoding, the pixel at the position corresponding to each prediction mode is set to the first. Generated by generating means. And the value of the pixel of the position according to each said prediction mode of the block of an encoding target and several prediction images is acquired, and the evaluation value which shows the difference between pixel values is calculated. Then, based on the evaluation value corresponding to each of the plurality of prediction modes, the prediction mode of the block to be encoded is set, and the prediction image of the set prediction mode is generated by the second generation unit, so that the prediction mode is determined. The amount of calculation for determination can be reduced.

  Hereinafter, image processing according to the third embodiment of the present invention will be described. Note that the same reference numerals in the third embodiment denote the same parts as in the first and second embodiments, and a detailed description thereof will be omitted.

  FIG. 12 is a block diagram illustrating a configuration example of the intra prediction unit 1010 according to the third embodiment.

  Prediction image generation units 1201 and 1202 generate prediction images from locally decoded images. The mode setting unit 1203 sets the prediction mode of the prediction image generated by the prediction image generation units 1201 and 1202.

  The prediction mode of the processing target block is encoded together with the processing target image data. In this embodiment, however, the prediction mode is temporarily stored until the processing of the adjacent block is completed in order to use it for prediction of the adjacent block to be processed thereafter. Keep it.

  The mode setting unit 1203 sets the prediction mode of the upper block (block B shown in FIG. 1) of the current block in the prediction image generation unit 1201, and sets the prediction mode of the left block (block A shown in FIG. 1) to the prediction image generation unit Set to 1202. This utilizes a strong correlation between the prediction mode of the current block and the prediction mode of a block adjacent to the current block (hereinafter referred to as an adjacent block). Of course, the prediction mode of adjacent blocks C and D shown in FIG. 1 can also be used.

  The SAD calculation unit 1204 (1205) calculates an evaluation value from the image of the current block and the prediction image generated by the prediction image generation unit 1201 (1202). The prediction mode determination unit 1206 compares the evaluation values calculated by the SAD calculation units 1204 and 1205, selects a prediction mode with a smaller evaluation value, and outputs a signal indicating the temporary prediction mode (hereinafter referred to as a temporary prediction signal). To do.

  For example, the prediction mode determination unit 1206 is '0' when the prediction mode of the prediction image generation unit 1201 is the temporary prediction mode, and is '1' when the prediction mode of the prediction image generation unit 1202 is the temporary prediction mode. A temporary prediction signal is output. The selectors 1207 and 1208 respectively select the output of the predicted image generation unit 1201 and the SAD calculation unit 1204 when the temporary prediction signal is “0”, and the predicted image generation unit 1202 and SAD when the temporary prediction signal is “1”. The output of the calculation unit 1205 is selected.

  For example, if the upper block of the current block is in prediction mode 1 and the left block is in prediction mode 5, the prediction image generation unit 1201 generates a prediction image in prediction mode 1, and the prediction image generation unit 1202 generates a prediction image in prediction mode 5. Generate. Therefore, the prediction mode determination unit 1206 determines the evaluation values of the prediction modes 1 and 5, and sets the prediction mode having a small generated code amount as the temporary prediction mode.

  The mode setting unit 1212 receives the temporary prediction signal and sets a prediction mode adjacent to the temporary prediction mode in the prediction image generation unit 1210 and the prediction image generation unit 1211. As shown in FIG. 2, the prediction mode adjacent to the temporary prediction mode is a prediction mode having a prediction direction adjacent to the prediction direction of the temporary prediction mode.

  The prediction mode determination unit 1215 receives the evaluation value calculated by the SAD calculation units 1213 and 1214 and the evaluation value calculated by the SAD calculation unit 1204 or 1205 via the selector 1208. Then, the evaluation values are compared, and a prediction mode signal indicating the prediction mode with the smallest evaluation value is output.

For example, the prediction mode determination unit 1215 outputs the next prediction mode signal.
When selecting the prediction mode of the prediction image generation unit 1210: '0'
When selecting the prediction mode of the prediction image generation unit 1211: '1'
When selecting the prediction mode of the prediction image generation unit 1201 or 1202: '2'

  The selector 1217 selectively outputs a prediction image based on the prediction mode signal.

  For example, if the temporary prediction mode is 1, the mode setting unit 1212 sets the prediction mode 6 in the prediction image generation unit 1210 and the prediction mode 8 in the prediction image generation unit 1211. Therefore, the prediction mode determination unit 1215 determines the evaluation values of the prediction modes 1, 6, and 8, and selects a prediction mode with a small generated code amount. For example, when the prediction mode 8 is selected, the selector 1217 selectively outputs the prediction image of the prediction image generation unit 1211.

  13A and 13B are flowcharts for explaining the operation of the intra prediction unit 1010 according to the third embodiment.

  The intra prediction unit 1010 inputs a locally decoded image (S1301), and inputs an image of the current block (S1302).

  Next, the intra prediction unit 1010 acquires the prediction mode information of the upper block by the mode setting unit 1203 (S1303). Then, the prediction image generation unit 1201 generates a prediction image in the prediction mode of the upper block (S1304), and the SAD calculation unit 1204 calculates the evaluation value in the prediction mode of the upper block (S1305).

  Next, the intra prediction unit 1010 inputs the prediction mode of the left block by the mode setting unit 1203 (S1306). Then, the prediction image generation unit 1202 generates a prediction image of the prediction mode of the left block (S1307), and the SAD calculation unit 1205 calculates the evaluation value in the prediction mode of the left block (S1308).

  Next, the intra prediction unit 1010 uses the prediction mode determination unit 1206 to select a prediction mode with a small evaluation value as a temporary prediction mode (S1309). Then, the mode setting unit 1212 sets a prediction mode adjacent to the temporary prediction mode (hereinafter, adjacent prediction mode) (S1311).

  FIG. 14 is a diagram showing a table showing the relationship between the temporary prediction mode and the adjacent prediction mode, and the mode setting unit 1212 selects the adjacent prediction mode according to this table. For example, the adjacent prediction mode is a prediction mode in which the inclination of the prediction direction is the closest in the positive direction and the prediction mode in which the inclination of the prediction direction is the closest in the negative direction with respect to the prediction direction of the selected prediction mode. Although the maximum number of adjacent prediction modes is two in FIG. 14, the prediction mode 2 (DC prediction mode) may be added to provide a maximum of three. Further, prediction modes 0 and 1 having relatively high occurrence frequencies may be set as the adjacent prediction modes of the prediction mode 2.

  Next, the intra prediction unit 1010 determines whether or not there is an adjacent prediction mode (S1312). For example, when the temporary prediction mode is 2, there is no adjacent prediction mode in the table shown in FIG. Also, when the prediction modes input in steps S1303 and S1306 are 8 and 1, and the temporary prediction mode is 8, the prediction mode 1 is not necessary, so it is determined that there is no adjacent prediction mode. If there is no adjacent prediction mode, the intra prediction unit 1010 causes the prediction mode determination unit 1215 to determine the temporary prediction mode as the final prediction mode (S1313), and the process proceeds to step 1318.

  On the other hand, when there is an adjacent prediction mode, the intra prediction unit 1010 generates a prediction image of the adjacent prediction mode by the predicted image generation unit 1210 (S1314), and calculates it as an evaluation value by the SAD calculation unit 1213 (S1315). Then, when there are two adjacent prediction modes (S1316), the second evaluation value is calculated by the predicted image generation unit 1211 and the SAD calculation unit 1214 (S1314, S1315).

  Next, the intra prediction unit 1010 uses the prediction mode determination unit 1215 to determine the prediction mode having the smallest evaluation value among all the evaluation values as the prediction mode of the current block (S1317). Then, the predicted image of the determined prediction mode is selectively output (S1318).

  As described above, in this embodiment, prediction mode information of a plurality of encoded blocks adjacent to a block to be encoded is acquired. Then, the first generation image is generated by the first generation unit when the block to be encoded is subjected to intraframe prediction encoding according to the prediction mode indicated by the prediction mode information. And the 1st evaluation value which shows the difference between the pixel value corresponding to the block for coding and the 1st prediction picture is calculated by the 1st calculation means, and prediction mode information is based on the 1st evaluation value Select to select the prediction mode indicated by. Then, the second generation image is generated by the second generation unit when the intra-frame prediction encoding is performed on the block to be encoded in the prediction mode having the prediction direction adjacent to the prediction direction of the selected prediction mode. Then, a second evaluation value indicating a difference between corresponding pixel values of the encoding target block and the second predicted image is calculated by the second calculation unit. And the process which produces | generates the prediction image of all the prediction modes and calculates an evaluation value can be omitted by setting the prediction mode of the block of an encoding target based on the 1st and 2nd evaluation value. Therefore, the amount of calculation for determining the prediction mode can be reduced.

  Hereinafter, image processing according to the fourth embodiment of the present invention will be described. Note that the same reference numerals in the fourth embodiment denote the same parts as in the first to third embodiments, and a detailed description thereof will be omitted.

  FIG. 15 is a block diagram illustrating a configuration example of the intra prediction unit 1010 according to the fourth embodiment.

  The difference from the third embodiment is that after the temporary prediction mode is selected, the determination on the adjacent prediction mode is controlled by threshold processing.

  The threshold determination unit 1220 compares the evaluation value Et in the temporary prediction mode with a predetermined threshold th. When the evaluation value is less than the threshold (Et <th), the selectors 1218 and 1219 are controlled so as to output a prediction image in the temporary prediction mode. That is, in the case of Et <th, the temporary prediction mode is changed to the final prediction mode without performing the determination regarding the adjacent prediction mode. If the evaluation value is equal to or greater than the threshold (Et ≧ th), the selector 1218 supplies the prediction image in the temporary prediction mode to the selector 1217, and the selector 1219 switches to output the prediction image selected by the selector 1217. Therefore, as in the third embodiment, a prediction image is output based on the evaluation values of the temporary prediction mode and the adjacent prediction mode.

  The predetermined threshold th is preferably determined in consideration of the amount of noise included in the input image. When the pixel value level in the block is smaller than the noise level, the influence of noise becomes a dominant factor in determining the prediction mode. In this case, even if the prediction mode with the minimum evaluation value is selected, the improvement in coding efficiency is slight.

  FIG. 16 is a flowchart for explaining the operation of the intra prediction unit 1010 according to the fourth embodiment. Note that the first half of the processing is the same as FIG. 13A. The difference from the operation of the third embodiment shown in FIGS. 13A and 13B is that, after selecting the temporary prediction mode (S1309), the evaluation value Et of the temporary prediction mode is compared with the threshold th (S1310), and according to the comparison result. The point is that the process branches to step S1311 or S1313.

  As described above, when the prediction mode of the current block is temporarily set using the strong correlation between the prediction mode of the current block and the prediction mode of the adjacent block, if the evaluation value is sufficiently small, the adjacent prediction mode is further evaluated. First, the process of generating the predicted image and calculating the evaluation value is omitted. Therefore, the amount of calculation for determining the prediction mode can be reduced.

  Hereinafter, image processing according to the fifth embodiment of the present invention will be described. Note that the same reference numerals in the fifth embodiment denote the same parts as in the first to fourth embodiments, and a detailed description thereof will be omitted.

  FIG. 17 is a block diagram illustrating a configuration example of the intra prediction unit 1010 according to the fifth embodiment.

  The pixel selection unit 2201 selects a predetermined pixel from the image of the current block and inputs the pixel value. Here, an example in which four pixels a, d, m, and p shown in FIG. 3 are selected will be described. The prediction mode setting unit 2202 uniquely sets the prediction mode from the value of the pixel selected by the pixel selection unit 2201. The predicted image generation unit 2203 generates and outputs a predicted image corresponding to the prediction mode set by the prediction mode setting unit 202 from the locally decoded image.

  FIG. 18 is a diagram showing a table showing the relationship between combinations of four pixel values and the prediction mode. The prediction mode setting unit 2202 sets the prediction mode according to this table.

  For example, when pixels a, d, m, and p have the same value, DC prediction is considered optimal, and the table is described so as to set prediction mode 2. If the values of the pixels a and m are similar and the values of the pixels d and p are similar, the vertical correlation is considered high, and the table is described so that the prediction mode 0 is set. Further, when the values of the pixels a and d are similar and the values of the pixels m and p are similar, the horizontal correlation is considered to be high, and the table is described so that the prediction mode 1 is set.

  In this way, if the prediction mode to be set is described in the table for the combination of the four values of the pixels a, d, m, and p, the prediction image for each prediction mode is not generated and the evaluation value is not calculated. In addition, the prediction mode can be determined.

  FIG. 19 is a flowchart for explaining the operation of the intra prediction unit 1010 according to the fifth embodiment.

  The intra prediction unit 1010 inputs a locally decoded image (S2301), and inputs an image of the current block (S2302). Then, the pixel value of the predetermined pixel is input by the pixel selection unit 2201 (S2303), and the prediction mode corresponding to the combination of the pixel values of the predetermined pixel is set by the prediction mode setting unit 2202 using the table shown in FIG. (S2304). Then, the predicted image generation unit 2203 generates and outputs a predicted image corresponding to the prediction mode (S2305).

  There are no restrictions on the position or number of pixels selected by the pixel selection unit 2201. For example, it is possible to select 12 pixels of a, b, c, d, e, h, i, l, m, n, o, and p.

  In this way, by obtaining the value of the predetermined pixel of the block to be encoded and setting the prediction mode in the case of intra-frame predictive encoding of the encoded block based on the combination of the values of the predetermined pixel, the prediction mode is set. The amount of calculation for determination can be reduced.

  The image processing according to the sixth embodiment of the present invention will be described below. Note that the same reference numerals in the sixth embodiment denote the same parts as in the first to fifth embodiments, and a detailed description thereof will be omitted.

  The difference from the fifth embodiment is that the evaluation values of three prediction modes, that is, a prediction mode selected from a combination of values of predetermined pixels of the current block (hereinafter, selected prediction mode) and a prediction mode adjacent to the selected prediction mode are calculated. To do. Then, the prediction mode is determined more accurately from the comparison of the evaluation values.

  FIG. 20 is a block diagram illustrating a configuration example of the intra prediction unit 1010 according to the fifth embodiment.

  The prediction mode setting unit 2202 selects a prediction mode from the combination of four pixel values selected by the pixel selection unit 2201. Then, the selected prediction mode and the adjacent prediction mode of the selected prediction mode are set in the predicted image generation units 2204, 2205, and 2206, respectively. The selection prediction mode does not necessarily need to be selected from all nine types of prediction modes. Here, the selection prediction mode candidates are described as four types of prediction modes 0, 1, 3, and 4.

  The prediction mode setting unit 2202 calculates absolute differences | ad |, | am |, | ap |, | dm |, | dp |, and | mp | of the mutual differences at the pixels a, d, m, and p at the four corners of the block. To obtain an evaluation value. Then, the prediction mode is selected depending on which evaluation value is the smallest.

  FIG. 21 is a diagram showing a table showing the relationship between the minimum evaluation value and the prediction mode. The prediction mode setting unit 2202 selects a prediction mode according to this table.

  FIG. 22 is a diagram schematically showing the relative sizes of the four pixel values. In the example of FIG. 22 (a), the difference absolute value between the pixels a and m is the smallest, and it is considered that the correlation in the vertical direction is strong, so the prediction mode 0 is selected. In the example of FIG. 22 (b), the difference absolute value between the pixels a and d is the smallest, and it is considered that the correlation in the horizontal direction is strong, so the provisional prediction mode 1 is selected. In the example of FIG. 22 (c), the difference absolute value between the pixels d and m is the smallest, and it is considered that the correlation in the oblique direction from the upper right to the lower left is strong, and the prediction mode 3 is selected. In the example of FIG. 22 (d), the difference absolute value between the pixels a and p is the smallest, and it is considered that the correlation in the oblique direction from the upper left to the lower right is strong, and the prediction mode 4 is selected.

  FIG. 23 is a diagram showing a table showing the relationship between the selected prediction mode and the adjacent prediction mode, and the prediction mode setting unit 2202 sets the adjacent prediction mode according to this table. Note that FIG. 23 shows an example in which the maximum number of adjacent prediction modes is two, but there is no limit to the number of adjacent prediction modes, such as adding DC prediction to a maximum of three types.

  Each of the predicted image generation units 2204 to 2206 generates a predicted image in the prediction mode set from the locally decoded image. Each of the SAD calculating units 2207 to 2209 calculates an absolute difference between the current block image and the predicted image to obtain an evaluation value. The prediction mode determination unit 2210 determines the minimum evaluation value from the evaluation values calculated by the SAD calculation units 2207 to 2209, and determines the prediction mode corresponding to the minimum evaluation value as the final prediction mode. The selector 2210 selectively outputs the prediction image of the prediction mode determined by the prediction mode determination unit 2211.

  FIG. 24 is a flowchart for explaining the operation of the intra prediction unit 1010 according to the sixth embodiment.

  When the pixel value of a predetermined pixel is input from the pixel selection unit 2201 (S2303), the intra prediction unit 1010 selects a prediction mode from the prediction mode setting unit 2202 (S2604). Then, a predicted image corresponding to the selected prediction mode is generated by the predicted image generation unit (S2605).

  Next, the intra prediction unit 1010 sets a prediction mode adjacent to the selected prediction mode by the prediction mode setting unit 2202 (S2606), and generates a prediction image corresponding to the adjacent prediction mode by the prediction image generation unit (S2607). ). Then, when the generation of the prediction image corresponding to the adjacent prediction mode is finished (S2608), the SAD calculation unit calculates the evaluation value of each prediction mode (S2609).

  When the calculation of the evaluation value is completed (S2610), the intra prediction unit 1010 determines the prediction mode having the minimum evaluation value by the prediction mode determination unit 2211 (S2611), and the prediction image of the prediction mode determined by the selector 2210 Are selectively output (S2612).

  Thus, the prediction mode is determined by calculating the evaluation values of the three prediction modes, that is, the prediction mode selected from the combination of the values of the predetermined pixels of the current block and the prediction mode adjacent to the selected prediction mode. Accordingly, the calculation amount for determining the prediction mode can be reduced, and the prediction mode can be determined with higher accuracy.

[Other embodiments]
Note that the present invention can be applied to a system including a plurality of devices (for example, a computer, an interface device, a reader, a printer, etc.), but an apparatus (for example, a copier, a facsimile machine, a control device) including a single device. Etc.).

  Another object of the present invention is to supply a storage medium storing a computer program for realizing the functions of the above embodiments to a system or apparatus, and the computer (CPU or MPU) of the system or apparatus executes the computer program. But it is achieved. In this case, the software read from the storage medium itself realizes the functions of the above embodiments, and the computer program and the computer-readable storage medium storing the computer program constitute the present invention. .

  Further, the above functions are not only realized by the execution of the computer program. That is, according to the instruction of the computer program, the operating system (OS) running on the computer and / or the first, second, third,... This includes cases where functions are realized.

  The computer program may be written in a memory of a device such as a function expansion card or unit connected to the computer. That is, the case where the CPU or the like of the first, second, third,... Device performs part or all of the actual processing according to the instruction of the computer program, thereby realizing the above functions.

  When the present invention is applied to the storage medium, the storage medium stores a computer program corresponding to or related to the flowchart described above.

The figure which shows the adjacent block used in order to produce | generate a prediction image, The figure which shows nine kinds of prediction modes for every direction of prediction in encoding of 4 × 4 pixel block of H.264, The figure explaining the relationship between each prediction mode and a prediction pixel value, A block diagram showing a configuration example of an encoding device of an embodiment, A block diagram showing a configuration example of an intra prediction unit, The figure which shows the position of the pixel which a pixel selection part selects, A flowchart for explaining the operation of the intra prediction unit; Block diagram showing a configuration example of the intra prediction unit of the second embodiment, Flowchart explaining the operation of the intra prediction unit of the second embodiment, A block diagram showing another configuration example of the intra prediction unit, FIG. 2 is a block diagram illustrating an example in which the encoding device is realized by a computer device; Block diagram showing a configuration example of the intra prediction unit of the third embodiment, A flowchart for explaining the operation of the intra prediction unit of the third embodiment, A flowchart for explaining the operation of the intra prediction unit of the third embodiment, The figure which shows the table which shows the relationship between temporary prediction mode and adjacent prediction mode, Block diagram showing a configuration example of the intra prediction unit of Example 4, Flowchart explaining the operation of the intra prediction unit of the fourth embodiment, Block diagram showing a configuration example of the intra prediction unit of Example 5, The figure which shows the table which shows the relationship between the combination of the value of four pixels, and prediction mode, Flowchart explaining the operation of the intra prediction unit of Example 5, Block diagram showing a configuration example of the intra prediction unit of Example 5, The figure which shows the table which shows the relationship between the minimum evaluation value and prediction mode, A diagram schematically showing the relative size of the four pixel values, The figure which shows the table which shows the relationship between selection prediction mode and adjacent prediction mode, 12 is a flowchart for explaining the operation of an intra prediction unit according to the sixth embodiment.

Claims (18)

An image processing apparatus that encodes a frame of a moving image in units of blocks,
Generating means for generating a plurality of prediction images corresponding to a plurality of prediction modes in the case of intra-frame predictive encoding of a block to be encoded;
Calculating means for obtaining a value of a pixel at a position corresponding to each prediction mode from the block to be encoded and the plurality of prediction images, and calculating an evaluation value indicating a difference between the pixel values;
An image processing apparatus comprising: a setting unit configured to set a prediction mode of the block to be encoded based on an evaluation value corresponding to each of the plurality of prediction modes. An image processing apparatus that encodes a frame of a moving image in units of blocks,
First generation means for generating a pixel at a position corresponding to each prediction mode for a plurality of prediction images corresponding to each of a plurality of prediction modes in the case of intra-frame prediction encoding of a block to be encoded;
Calculating means for obtaining a value of a pixel at a position corresponding to each prediction mode of the encoding target block and the plurality of prediction images, and calculating an evaluation value indicating a difference between the pixel values;
Setting means for setting a prediction mode of the block to be encoded based on an evaluation value corresponding to each of the plurality of prediction modes;
An image processing apparatus comprising: a second generation unit configured to generate a prediction image in the set prediction mode.   The second generation unit generates a pixel other than the position corresponding to the set prediction mode, and combines the pixel with a position corresponding to the set prediction mode generated by the first generation unit. 3. The image processing apparatus according to claim 2, wherein the predicted image is generated.   The pixel at a position corresponding to the prediction mode is a pixel that is farthest from a pixel used to generate the prediction image with respect to a prediction direction of the prediction mode. An image processing apparatus according to any one of the above. An image processing apparatus that encodes a frame of a moving image in units of blocks,
Obtaining means for obtaining prediction mode information of a plurality of encoded blocks adjacent to a block to be encoded;
First generation means for generating a first prediction image when the block to be encoded is subjected to intraframe prediction encoding according to the prediction mode indicated by the prediction mode information;
First calculation means for calculating a first evaluation value indicating a difference between the encoding target block and the corresponding pixel value of the first predicted image;
Selection means for selecting a prediction mode indicated by the prediction mode information based on the first evaluation value;
Second generation means for generating a second prediction image when the block to be encoded is subjected to intraframe prediction encoding by a prediction mode having a prediction direction adjacent to the prediction direction of the selected prediction mode;
Second calculation means for calculating a second evaluation value indicating a difference between the corresponding pixel value of the block to be encoded and the second predicted image;
An image processing apparatus comprising: a setting unit configured to set a prediction mode of the encoding target block based on the first and second evaluation values.   When the first evaluation value corresponding to the prediction mode selected by the selection unit is less than a predetermined threshold, the setting unit sets the prediction mode selected by the selection unit to the prediction mode of the block to be encoded. 6. The image processing device according to claim 5, wherein the image processing device is set.   The setting unit, when there is no prediction mode adjacent to the selected prediction mode, sets the prediction mode selected by the selection unit as the prediction mode of the block to be encoded. An image processing apparatus according to claim 6.   8. The second generation unit according to claim 5, wherein when the selected prediction mode is a DC prediction mode, a prediction mode in a vertical direction and a horizontal direction is set to the adjacent prediction mode. An image processing apparatus according to any one of the above. An image processing apparatus that encodes a frame of a moving image in units of blocks,
Obtaining means for obtaining a value of a predetermined pixel of a block to be encoded;
An image processing apparatus comprising: a setting unit configured to set a prediction mode when the encoded block is subjected to intraframe prediction encoding based on a combination of values of the predetermined pixels. An image processing apparatus that encodes a frame of a moving image in units of blocks,
Obtaining means for obtaining a value of a predetermined pixel of a block to be encoded;
Selection means for selecting a plurality of prediction modes when the encoded block is subjected to intraframe prediction encoding based on a combination of values of the predetermined pixels;
Generating means for generating a plurality of prediction images corresponding to each of the plurality of prediction modes;
Calculation means for calculating an evaluation value indicating a difference between corresponding pixel values of the block to be encoded and the plurality of predicted images;
An image processing apparatus comprising: a setting unit configured to set a prediction mode of the block to be encoded based on an evaluation value corresponding to each of the plurality of prediction modes.   The predetermined pixels are pixels at the four corners of the block, and the selection unit is adjacent to the prediction mode having a prediction direction in which the difference matches the direction with the smallest difference among the combinations of the pixel values at the four corners. 11. The image processing apparatus according to claim 10, wherein a prediction mode having a prediction direction is selected. An image processing method for encoding a frame of a moving image in units of blocks,
Generating a plurality of prediction images corresponding to a plurality of prediction modes in the case of intra-frame predictive encoding of a block to be encoded,
Obtaining a value of a pixel at a position corresponding to each prediction mode from the block to be encoded and the plurality of prediction images, and calculating an evaluation value indicating a difference between the pixel values;
An image processing method, comprising: setting a prediction mode of the encoding target block based on an evaluation value corresponding to each of the plurality of prediction modes. An image processing method for encoding a frame of a moving image in units of blocks,
For a plurality of prediction images corresponding to each of a plurality of prediction modes in the case of intra-frame predictive encoding of a block to be encoded, a pixel at a position corresponding to each prediction mode is generated,
Obtaining a value of a pixel at a position corresponding to each prediction mode of the block to be encoded and the plurality of prediction images, and calculating an evaluation value indicating a difference between the pixel values;
Based on the evaluation value corresponding to each of the plurality of prediction modes, the prediction mode of the block to be encoded is set,
An image processing method characterized by generating a prediction image of the set prediction mode. An image processing method for encoding a frame of a moving image in units of blocks,
Obtain prediction mode information of multiple encoded blocks adjacent to the block to be encoded,
According to a prediction mode indicated by the prediction mode information, a first prediction image in the case where the block to be encoded is subjected to intraframe prediction encoding is generated,
Calculating a first evaluation value indicating a difference between a corresponding pixel value of the block to be encoded and the first predicted image;
Based on the first evaluation value, select a prediction mode indicated by the prediction mode information,
Generating a second prediction image in a case where the block to be encoded is subjected to intraframe prediction encoding by a prediction mode having a prediction direction adjacent to the prediction direction of the selected prediction mode;
Calculating a second evaluation value indicating a difference between a corresponding pixel value of the block to be encoded and the second predicted image;
An image processing method comprising: setting a prediction mode of the encoding target block based on the first and second evaluation values. An image processing method for encoding a frame of a moving image in units of blocks,
Get the value of the specified pixel of the block to be encoded,
An image processing method, comprising: setting a prediction mode for intra-frame predictive encoding of the encoded block based on a combination of the predetermined pixel values. An image processing method for encoding a frame of a moving image in units of blocks,
Get the value of the specified pixel of the block to be encoded,
Based on a combination of the predetermined pixel values, select a plurality of prediction modes when the encoded block is subjected to intraframe predictive encoding,
Generating a plurality of prediction images corresponding to each of the plurality of prediction modes;
Calculating an evaluation value indicating a difference between corresponding block values of the encoding target block and the plurality of predicted images;
An image processing method, comprising: setting a prediction mode of the encoding target block based on an evaluation value corresponding to each of the plurality of prediction modes.   12. A computer program for controlling a computer device to function as each unit of the image processing device according to any one of claims 1 to 11.   A computer-readable storage medium on which the computer program according to claim 17 is recorded.

Images