JP2006345123A - Moving picture decoding device and moving picture encoding device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform efficient decoding processing while reducing the size of a memory that a microblock replacement part has and lightening the load of data transfer to the memory by reducing the amount of data stored in the memory as to a moving picture decoding device for a moving picture encoding system such that the order of divided microblocks of a source image in a stream is not limited to the order of raster scanning like H.264/AVC. <P>SOLUTION: The microblock replacement part 42 is provided between a variable length decoding processing part 10 and a main decoding processing part 11. The microblock replacement part 42 replaces the mocroblocks so that the microblocks are in the order of raster scanning by changing the order of wiring of the microblocks to the microblock data memory 43 and the order of reading. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  In the present invention, as in H.264 / MPEG-4 part 10: AVC (hereinafter referred to as H.264), the order of macroblocks obtained by dividing an original image in a stream is the raster scan order (upper left in the screen). The present invention relates to a moving picture decoding apparatus and a moving picture coding apparatus for a moving picture coding system that are not limited to the order of the first to the lower right.

  For example, in H.264, a technique called FMO / ASO is adopted as one technique for suppressing image degradation due to an error on a transmission path. When FMO / ASO is not used, the macroblocks obtained by dividing the original image are encoded in the raster scan order, arranged in the stream in this order, and transmitted. On the other hand, when FMO / ASO is used, macroblocks can be encoded in an order different from the raster scan order, and arranged and transmitted in a stream in an order different from the raster scan order. Is done.

  FIG. 5 is a diagram showing the positional relationship between the macroblocks in the original image and the macroblocks in the stream. FIG. 5A shows an original image to be encoded, FIG. 5B shows a stream output for the original image shown in FIG. 5A by a moving image encoding apparatus that does not employ FMO / ASO, and FIG. Shows an example of a stream output from the moving picture encoding apparatus adopting FMO / ASO for the original picture shown in FIG. 5A, and M0 to M19 are macroblocks.

  6 is a circuit diagram showing a general configuration of a moving picture decoding apparatus for H.264. In FIG. 6, 10 is a variable-length decoding processing unit that analyzes an input stream that is a data sequence encoded by the moving image encoding device and divides it into data for each macroblock, 11 is a main decoding processing unit, Is an inverse quantization / inverse orthogonal transform unit that performs inverse quantization / inverse orthogonal transform, 13 is an intra-frame prediction unit that performs intra-frame prediction, and 14 is an inter-frame prediction unit that performs inter-frame prediction.

  15 is a selector for selecting the output of the intra-frame prediction unit 13 or the output of the inter-frame prediction unit 14, and 16 is the output of the intra-frame prediction unit 13 or the output of the intra-frame prediction unit 12. 14 is an adder that outputs the decoded image by adding 14 outputs, 17 is a deblocking filter processing unit that receives the decoded image output from the adder 16 and performs deblocking filter processing, and 18 is a deblocking filter processing unit 17. It is a frame memory for storing a decoded image subjected to deblocking filter output.

  The deblocking filter process is a process aimed at removing noise between blocks caused by dividing an original image into blocks and encoding, and must be executed in the order of raster scanning. However, the macroblocks output from the variable length decoding processing unit 10 may be in an order different from the order in the input stream, that is, the raster scan order. In this case, after the variable length decoding processing by the variable length decoding processing unit 10 and before the deblocking filter processing by the deblocking filter processing unit 17, it is necessary to replace the macroblocks in raster scan order.

  7 is a circuit diagram showing an example of an H.264 video decoding device including a macroblock replacement unit. The moving picture decoding apparatus shown in FIG. 7 is provided with a macroblock replacement unit 19 between the adder 16 and the deblocking filter processing unit 17 of the main decoding processing unit 11, and the others are the moving picture decoding shown in FIG. 6. It is comprised similarly to an apparatus.

  The macroblock replacement unit 19 includes a macroblock data memory 20 for storing macroblock data, and a memory control unit 21 for controlling writing / reading of macroblock data to / from the macroblock data memory 20, By changing the writing order and reading order of the macro block data to the macro block data memory 20, the macro blocks are switched so that the order of the output macro blocks becomes the raster scan order.

  8 is a circuit diagram showing a general configuration of a video encoding apparatus for H.264. In FIG. 8, 22 is a main encoding processing unit, 23 is a difference calculation unit that calculates the difference between the original image and the predicted image, and 24 is input with the output of the difference calculation unit 23 to perform quantization and orthogonal transformation. A quantization / orthogonal transform unit 25 is a prediction method determination unit 25 that determines a prediction method, and 26 is a motion vector detection unit that detects a motion vector.

  27 is an intra-frame prediction unit that performs intra-frame prediction, 28 is a motion compensation processing unit that performs motion compensation processing, 29 is a selector that selects an output of the intra-frame prediction unit 27 or an output of the motion compensation processing unit 28, and 30 is a quantization An inverse quantization / inverse orthogonal transform unit that receives the output of the orthogonal transform unit 24 and performs inverse quantization / inverse orthogonal transform, 31 is an output of the inverse quantization / inverse orthogonal transform unit 30 and an output of the intra-frame prediction unit 27 Or it is an adder which adds the output of the motion compensation process part 28, and outputs a decoded image.

  Reference numeral 32 denotes a deblocking filter processing unit that inputs the decoded image output from the adder 31 and performs deblocking filter processing. Reference numeral 33 denotes a frame memory that stores the deblocking filtered image output from the deblocking filter processing unit 32. , 34 receives the output of the quantization / orthogonal transform unit 24, the output of the prediction method determination unit 25, and the output of the motion vector detection unit 26, performs variable length encoding processing, and outputs a stream. It is.

  Here, the main encoding processing of the macroblocks by the main encoding processing unit 22 is performed in the order of the macroblocks decoded by the moving image decoding apparatus, and therefore the output of the adder 31 may not be in the raster scan order. Therefore, in the moving image encoding apparatus, it is necessary to replace the macroblocks so that the order of the macroblocks becomes the raster-can order before the deblocking filter processing by the deblocking filter processing unit 32.

  9 is a circuit diagram showing an example of an H.264 video encoding apparatus including a macroblock replacement unit. The moving picture coding apparatus shown in FIG. 9 is provided with a macroblock replacement unit 35 between the adder 31 and the deblocking filter processing unit 32 of the main decoding processing unit 22, and the other moving pictures shown in FIG. The configuration is the same as that of the encoding device.

The macroblock replacement unit 35 includes a macroblock data memory 36 for storing macroblock data, and a memory control unit 37 for controlling writing / reading of macroblock data to / from the macroblock data memory 36. By changing the writing order and reading order of the macro block data in the macro block data memory 36, the macro blocks are switched so that the order of the output macro blocks becomes the raster scan order.
JP 2004-165746 A

  In the conventional moving picture decoding apparatus shown in FIG. 7, since the macroblock replacement unit 19 is provided between the adder 16 and the deblocking filter processing unit 17 of the main decoding processing unit 11, the macroblock data memory 20 The image data stored in the memory has the same size as the original image, requires a large amount of memory, and has a problem that the amount of data transferred to the macroblock data memory 20 is a heavy burden.

  In the inter-frame prediction in the inter-frame prediction unit 14, there is a very high possibility of referring to the image immediately before the encoding target image, but it is not a macroblock for which the deblocking filter processing by the deblocking filter processing unit 17 is finished And cannot be referred to in the inter-frame prediction process for the next image. FIG. 10 is a diagram for explaining a problem resulting from this point.

  In FIG. 10, (A) is a reference relationship of macroblocks, (B) is a stream, (C) is the timing of main decoding processing and deblocking filter processing, 38 is an original image, 39 is an original image 38 Next, the original image encoded and transmitted, Ma, Mb, and Mc are macroblocks, 40 is a stream of the original image 38, and 41 is a stream of the original image 39.

  In this example, the macroblock Ma positioned at the upper left of the original image 38 is positioned behind the macroblock Mb positioned at the lower right of the original image 38 in the stream 40, and the macroblock Mb is It is assumed that the macroblock Mc is referenced from the upper left macroblock Mc of the original image 39.

  In this case, the deblocking filter process of the original image 38 cannot be started until the macroblock Ma finishes the main decoding process, as shown in FIG. The macroblock Mb cannot be started until the deblocking filter processing is completed. That is, the conventional video decoding apparatus shown in FIG. 7 has a problem that there may be a time when the main decoding process is stopped, and an efficient decoding process cannot be performed.

  Also in the conventional moving picture coding apparatus shown in FIG. 9, since the macroblock replacement unit 35 is provided between the adder 31 and the deblocking filter processing unit 32 of the main coding processing unit 22, The image data stored in the block data memory 36 has the same size as the original image, requires a large amount of memory, and has a problem that the amount of data transfer with the macroblock data memory 36 becomes a large burden, and the main code. There is a case in which there is a time when the encoding process stops, and there is a problem that an efficient encoding process cannot be performed.

  In view of this point, the present invention can reduce the amount of data stored in the memory included in the macroblock replacement unit, reduce the size of the memory, and reduce the burden of data transfer to the memory. Reduces the amount of data stored in a memory included in a moving image decoding apparatus and macroblock that can perform efficient decoding processing, and reduces the size of the memory and the burden of data transfer to the memory An object of the present invention is to provide a moving picture coding apparatus that can perform efficient coding processing.

  The moving picture decoding apparatus according to the present invention is a moving picture decoding apparatus for a moving picture coding system in which the order in a stream of macroblocks obtained by dividing an original image is not limited to the raster scan order, and the variable length decoding processing unit A macroblock replacement unit that replaces the order of the macroblocks is provided in the subsequent stage.

  The moving picture coding apparatus according to the present invention is a moving picture coding apparatus for a moving picture coding method in which the order in a stream of macroblocks obtained by dividing an original image is not limited to a raster scan order, and is a variable length coding A macroblock replacement unit that replaces the order of the macroblocks is provided in front of the processing unit.

  According to the moving picture decoding apparatus of the present invention, since the macroblock replacement unit is provided at the subsequent stage of the variable length decoding processing unit, the amount of data stored in the memory included in the macroblock replacement unit is reduced, and the size of the memory is reduced. As a result, it is possible to reduce the burden of data transfer to the memory, eliminate the time for the main decoding process to stop, and perform an efficient decoding process.

  According to the moving picture coding apparatus of the present invention, since the macroblock replacement unit is provided in the preceding stage of the variable length coding processing unit, the amount of data stored in the memory included in the macroblock replacement unit is reduced, and It is possible to reduce the size and the burden of data transfer to the memory, and it is possible to perform an efficient encoding process by eliminating the time for the main encoding process to stop.

(One Embodiment of Moving Picture Decoding Device of the Present Invention)
FIG. 1 is a circuit diagram showing a main part of an embodiment of the moving picture decoding apparatus of the present invention. The moving picture decoding apparatus according to the present invention is a moving picture decoding apparatus for H.264, in which the macroblock replacement unit 42 is arranged after the variable length decoding processing unit 10, that is, the variable length decoding processing unit 10 and the main decoding processing unit. The other components are the same as those in the moving picture decoding apparatus shown in FIG.

  The macroblock replacement unit 42 includes a macroblock data memory 43 for storing macroblock data, and a memory control unit 44 that controls writing / reading of macroblock data to / from the macroblock data memory 43. By changing the writing order and reading order of the macroblock data to the macroblock data memory 43, the macroblocks are switched so that the order of the output macroblocks becomes the raster scan order.

  In one embodiment of the moving picture decoding apparatus of the present invention, the variable length decoding processing unit 10 analyzes an input stream, which is a data sequence encoded by the moving picture encoding apparatus, and divides it into data for each macroblock. The macroblock replacement unit 42 writes the data for each macroblock output from the variable length decoding processing unit 10 to the macroblock data memory 43, and reads out the macroblock data in the raster / scan order to output the macroblocks to be output. The macroblocks are replaced so that the order is the raster scan order.

  The main decoding processing unit 11 performs main decoding processing of the macro blocks in the raster / scan order output from the macro block replacement unit 42, and the deblocking filter processing unit 17 is arranged in the raster / scan order output from the adder 16. A macroblock is input to perform a deblocking filter process on the decoded image.

  FIG. 2 is a timing chart showing an embodiment of the moving picture decoding apparatus of the present invention and the operation timing of the conventional moving picture decoding apparatus shown in FIG. 2A shows the timing of variable length decoding processing, main decoding processing, and deblocking filter processing in an embodiment of the moving image decoding apparatus of the present invention, and FIG. 2B shows the conventional moving image shown in FIG. The timings of the variable length decoding process, main decoding process, and deblocking filter process in the decoding apparatus are shown, and the case where the input stream is given in the order of the original image 1, the original image 2, and the original image 3 is taken as an example.

  That is, in the embodiment of the moving picture decoding apparatus of the present invention, the macroblock replacement unit 42 is provided between the variable length decoding processing unit 10 and the main decoding processing unit 11, so that the variable length decoding processing unit While the variable length decoding process of the stream of the original image 1 is being executed by the macro block 10, the macroblock replacement unit 42 has a macroblock in an order different from the raster scan order of the original image 1 that is output in order by the variable length decoding process unit 10. Are stored in the macroblock data memory 43.

  When the variable-length decoding processing unit 10 completes the variable-length decoding process for the stream of the original image 1, the variable-length decoding processing unit 10 starts the variable-length decoding process for the stream of the original image 2 and replaces the macroblock. The unit 42 reads out the macroblock data of the original image 1 from the macroblock data memory 43 so that the order of the macroblocks of the original image 1 is the raster scan order, and outputs the original image output from the variable length decoding processing unit 10. The macro blocks in the order different from the raster scan order of 2 are stored in the macro block data memory 43.

  The main decoding processing unit 11 inputs the macroblocks in the raster / scan order of the original image 1 output from the macroblock replacement unit 42 and performs the main decoding process, and the mask blocks in the raster / scanning order of the decoded original image 1 Is output. The deblocking filter processing unit 17 sequentially inputs macroblocks in the raster / scan order of the original image 1 output from the main decoding processing unit 11 to perform the deblocking filter processing.

  When the variable length decoding processing unit 10 completes the variable length decoding processing of the stream of the original image 2, the variable length decoding processing unit 10 starts the variable length decoding processing of the stream of the original image 3 and replaces the macro block. The unit 42 reads out the macroblock data of the original image 2 from the macroblock data memory 43 so that the order of the macroblocks of the original image 2 is the raster scan order, and outputs the original image output from the variable length decoding processing unit 10. The macro blocks in the order different from the raster scan order of 3 are stored in the macro block data memory 43.

  The main decoding processing unit 11 receives the macroblocks in the raster / scan order of the original image 2 output from the macroblock replacement unit 42, performs main decoding processing, and mask blocks in the raster / scan order of the decoded original image 2 Is output. The deblocking filter processing unit 17 inputs the macro blocks in the raster / scan order of the original image 2 output from the main decoding processing unit 11 in order and performs the deblocking filter processing. Thereafter, the same operation is repeated.

  On the other hand, in the conventional video decoding device shown in FIG. 7, the variable length decoding processing unit 10 performs variable length decoding processing on the stream of the original image 1, and the main decoding processing unit 11 includes the variable length decoding processing unit 10. The macroblock replacement unit 19 performs main decoding while the main decoding processing unit 11 is executing the main decoding processing of the original image 1. The macro block data of the original image 1 output from the processing unit 11 is stored in the macro block data memory 20.

  Then, when the main decoding processing unit 11 completes the main decoding process of the original image 1, the macroblock replacement unit 19 reads the macroblock data of the original image 1 from the macroblock data memory 20 in the raster / scan order. This is transferred to the deblocking filter processing unit 17, and the deblocking filter processing unit 17 starts the deblocking filter processing of the decoded image of the original image 1. When decoding of the original image 2 becomes possible, variable length decoding processing and main decoding processing of the stream of the original image 2 are started.

  As described above, in the embodiment of the moving picture decoding apparatus of the present invention, the macroblock replacement unit 42 is provided between the variable length decoding processing unit 10 and the main decoding processing unit 11. Deblocking filter processing can be immediately performed on the macroblock output by the decoding processing unit 11, and the decoding processing of the next original image can be started immediately after the deblocking filtering processing that is the final processing of one original image is completed. it can. Therefore, it is possible to eliminate the time for the main decoding process to stop and perform an efficient decoding process.

  Further, the macroblock replacement unit 42 is provided between the variable length decoding processing unit 10 and the main decoding processing unit 11, but data stored in the macroblock data memory 43 in the macroblock replacement unit 42. Is an orthogonal transform of a macroblock coding method, information for generating a predicted image (motion vector during inter-frame prediction, prediction mode for intra-frame prediction), and the residual between the predicted image and the current image. On the other hand, the data output from the main decoding processing unit 11 is decoded image data before the deblocking filter process.

  Therefore, as in the embodiment of the video decoding device of the present invention, when the macroblock replacement unit 42 is provided in the subsequent stage of the variable length decoding processing unit 10, and as shown in FIG. Compared with the case where the macroblock replacement unit 19 is provided in the subsequent stage, the amount of data stored in the macroblock data memory 43 in the macroblock replacement unit 42 is equal to the macroblock data memory 20 in the macroblock replacement unit 19. Smaller than the amount of data stored in Thus, according to one embodiment of the moving picture decoding apparatus of the present invention, the amount of data stored in the macroblock data memory can be reduced, the size of the macroblock data memory can be reduced, the macroblock data memory, It is possible to reduce the burden of data transfer between.

(One Embodiment of Video Encoding Device of the Present Invention)
FIG. 3 is a circuit diagram showing the main part of an embodiment of the moving picture coding apparatus of the present invention. One embodiment of the moving picture coding apparatus of the present invention is a moving picture coding apparatus for H.264, in which the macroblock replacement unit 45 is arranged before the variable length coding processing unit 34, that is, the main coding process. 8 is provided between the quantization / orthogonal transformation unit 24, the prediction method determination unit 25, the motion vector detection unit 26, and the variable length coding processing unit 34 of the unit 22, and the rest is the same as the moving picture coding apparatus shown in FIG. It is constituted similarly.

  The macroblock replacement unit 45 includes a macroblock data memory 46 for storing macroblock data, and a memory control unit 47 for controlling writing / reading of macroblock data to / from the macroblock data memory 46. By changing the order in which the macroblock data is written to and read from the macroblock data memory 46, the macroblocks are replaced so that the order of the macroblocks to be output becomes the decoding order in the video decoding device.

  In one embodiment of the moving picture encoding apparatus of the present invention, encoding of macroblocks is performed in raster scan order, but the difference calculation unit 23 calculates the difference between the original image and the predicted image, and performs quantization / The orthogonal transform unit 24 performs quantization / orthogonal transform of the difference signal, the prediction method determination unit 25 determines a prediction method, and the motion vector detection unit 26 detects a motion vector.

  The macroblock replacement unit 45 writes the output of the quantization / orthogonal transform unit 24, the output of the prediction method determination unit 25, and the output of the motion vector detection unit 26 as macroblock data in the macroblock data memory 46, and the macroblock By changing the data writing order and the reading order, the macroblocks are switched so that the order of the macroblocks to be output becomes the decoding order in the moving picture decoding apparatus. The variable length coding processing unit 34 inputs macroblock data in the order output by the macroblock replacement unit 45, performs variable length coding, and outputs a stream.

  The inverse quantization / inverse orthogonal transform unit 30 receives the output of the quantization / orthogonal transform unit 24 to perform inverse quantization / inverse orthogonal transform, the intra-frame prediction unit 27 performs intra-frame prediction, and the motion compensation processing unit 28 performs a motion compensation process. Then, the adder 31 performs addition of the output of the inverse quantization / inverse orthogonal transform unit 30 and the output of the intra-frame prediction unit 27 or the output of the motion compensation processing unit 28 to generate a decoded image.

  And the deblocking filter process part 32 performs a deblocking filter process about the decoded image which the adder 31 outputs, and the decoded image by which the deblocking process output by the deblocking filter process part 32 is stored in the frame memory 33, It is used in the motion vector detection unit 26 and the motion compensation processing unit 28.

  FIG. 4 is a timing chart showing an embodiment of the moving picture coding apparatus of the present invention and the operation timing of the conventional moving picture coding apparatus shown in FIG. FIG. 4A shows the timing of main encoding processing, deblocking filter processing, and variable-length encoding processing in one embodiment of the moving image encoding apparatus of the present invention, and FIG. 4B shows the prior art shown in FIG. The timings of the main encoding process, the deblocking filter process, and the variable length encoding process in the moving image encoding apparatus are shown, and the case where the original image 1, the original image 2, and the original image 3 are given in this order is taken as an example. .

  That is, in one embodiment of the moving image encoding apparatus of the present invention, when the main encoding processing unit 22 starts the main encoding process of the original image 1, the macroblock replacement unit 45 causes the quantum for the original image 1 to be quantized. The output of the orthogonalization / orthogonal transformation unit 24, the output of the prediction method determination unit 25, and the output of the motion vector detection unit 26 are stored in the macroblock data memory 46 for each macroblock, and the deblocking filter processing unit 32 A macroblock in the raster / scan order of the original image 1 output from the adder 31 of the processing unit 22 is input to perform a deblocking filter process on the decoded image of the original image 1.

  When the main encoding processing unit 22 completes the main encoding process for the original image 1, the main encoding processing unit 22 starts the main encoding process for the original image 2, and the macroblock replacement unit 45 The output of the quantization / orthogonal transform unit 24, the output of the prediction method determination unit 25, and the output of the motion vector detection unit 26 for the image 2 are stored in the macroblock data memory 46 for each macroblock, and the deblocking filter processing unit 32. Performs the deblocking filter process on the decoded image of the original image 2 by inputting the macroblocks in the raster / scan order of the original image 2 output from the adder 31 of the main encoding processing unit 22. The same operation is repeated for the original image 3 and later.

  On the other hand, in the conventional video encoding device shown in FIG. 9, encoding is performed in the decoding order executed by the video decoding device, but the main encoding processing unit 22 performs main encoding on the original image 1. When the process is started, the variable-length encoding processing unit 34 receives the output of the quantization / orthogonal transform unit 24, the output of the prediction method determination unit 25, and the output of the motion vector detection unit 26 for the original image 1 as a variable length. Encode and output a stream.

  The macroblock replacement unit 35 stores the macroblock data of the original image 1 output from the adder 31 in the macroblock data memory 36, and when the main encoding process of the original image 1 by the main encoding processing unit 22 is completed, The macroblocks of the original image 1 are read from the macroblock data memory 36 so that the macroblock order is the raster scan order.

  The deblocking filter processing unit 32 inputs the macroblock of the original image 1 in the raster / scan order output from the macroblock replacement unit 35 and performs the deblocking filtering process on the decoded image of the original image 1. When the original image 2 can be encoded, the main encoding process and the variable length encoding process of the original image 2 are started.

  As described above, in one embodiment of the moving picture coding apparatus of the present invention, the macroblock replacement unit 45 includes the quantization / orthogonal transform unit 24, the prediction method determination unit 25, the motion vector detection unit 26, and a variable length. Since it is provided between the encoding processing unit 34 and the macroblock output from the adder 31 of the main encoding processing unit 22, the deblocking filter processing can be performed immediately, and the final processing of one original image can be performed. Immediately after a certain deblocking filter process is completed, the encoding process of the next original image can be started. Therefore, it is possible to eliminate the time for the main encoding process to stop and perform an efficient encoding process.

  In one embodiment of the moving picture coding apparatus of the present invention, the macroblock replacement unit 45 includes a quantization / orthogonal transform unit 24, a prediction method determination unit 25, a motion vector detection unit 26, and a variable length coding process. However, the data stored in the macroblock data memory 46 in the macroblock replacement unit 45 includes information for generating a macroblock and information for generating a predicted image (interframe prediction). Motion vectors in time, prediction mode of intra-frame prediction), and the residual between the prediction image and the current image are orthogonally transformed. On the other hand, the data output from the adder 31 is decoded image data before the deblocking filter process.

  Therefore, when the macroblock replacement unit 45 is provided in the preceding stage of the variable length encoding processing unit 34 as in the embodiment of the moving image encoding device of the present invention, as shown in FIG. Compared with the case where the macro block replacement unit 35 is provided in the subsequent stage, the amount of data stored in the macro block data memory 46 in the macro block replacement unit 45 is equal to the macro block data memory 36 in the macro block replacement unit 35. Smaller than the amount of data stored in As described above, according to the embodiment of the moving picture coding apparatus of the present invention, the amount of data stored in the macroblock data memory can be reduced, the size of the macroblock data memory can be reduced, and the macroblock data memory can be reduced. Can reduce the burden of data transfer between the two.

  In H.264, it is also possible to use macroblock adaptive frame / field coding in which an original image is divided into macroblock pairs each having 16 horizontal pixels and 32 vertical pixels, and each is treated as two macroblocks. . In this case, the two macroblocks of the macroblock pair are continuous both in the intra-stream data order and in the processing order of the variable length decoding process, the main decoding process, and the deblocking filter process. Therefore, the present invention can also be applied to macroblock adaptive frame / field coding by using a macroblock pair as a unit for writing to and reading from the macroblock data memory.

It is a circuit diagram which shows the principal part of one Embodiment of the moving image decoding apparatus of this invention. 8 is a timing chart showing an embodiment of the video decoding device of the present invention and the operation timing of the conventional video decoding device shown in FIG. It is a circuit diagram which shows the principal part of one Embodiment of the moving image encoder of this invention. FIG. 10 is a timing chart showing an embodiment of the moving picture coding apparatus of the present invention and the operation timing of the conventional moving picture coding apparatus shown in FIG. 9. It is a figure which shows the positional relationship of the macroblock in an original image, and the macroblock in a stream. It is a circuit diagram which shows the general structure of the moving image decoding apparatus for H.264. It is a circuit diagram which shows an example of the moving image decoding apparatus for H.264 provided with a macroblock replacement part. It is a circuit diagram which shows the general structure of the moving image encoder for H.264. It is a circuit diagram which shows an example of the moving image encoder for H.264 provided with a macroblock replacement part. It is a figure for demonstrating the problem which the moving image decoding apparatus shown in FIG. 7 has.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Variable length decoding process part 11 ... Main decoding process part 12 ... Inverse quantization and inverse orthogonal transformation part 13 ... Intra-frame prediction part 14 ... Inter-frame prediction part 15 ... Selector 16 ... Adder 17 ... Deblocking filter process part 18 ... Frame memory 19 ... Macro block replacement unit 20 ... Macro block data memory 21 ... Memory control unit 22 ... Main encoding processing unit 23 ... Difference calculation unit 24 ... Quantization / orthogonal transformation unit 25 ... Prediction method determination unit 26 ... Motion Vector detection unit 27 ... intra-frame prediction unit 28 ... motion compensation processing unit 29 ... selector 30 ... inverse quantization / inverse orthogonal transform unit 31 ... adder 32 ... deblocking filter processing unit 33 ... frame memory 34 ... variable length encoding process 35: Macroblock replacement unit 36 ... Macroblock data memory 37 ... Memory control unit 38, 39 ... Original image 40, 1 ... stream 42 ... macroblock input section 43 ... macroblock data memory 44 ... memory controller 45 ... macroblock input section 46 ... macroblock data memory 47 ... memory controller

Claims (2)

A moving picture decoding apparatus for a moving picture coding system in which the order in a stream of macroblocks obtained by dividing an original picture is not limited to a raster scan order,
A moving picture decoding apparatus comprising: a macroblock replacement section that replaces the order of the macroblocks in a subsequent stage of the variable length decoding processing section. A moving picture coding apparatus for a moving picture coding method in which the order in a stream of macroblocks obtained by dividing an original picture is not limited to a raster scan order,
A moving picture coding apparatus comprising: a macroblock replacing unit that replaces the order of the macroblocks before the variable length coding processing unit.

Images