WO2016143093A1

WO2016143093A1 - Moving image encoding device and intra-prediction encoding method used by such device, and moving image decoding device

Info

Publication number: WO2016143093A1
Application number: PCT/JP2015/057155
Authority: WO
Inventors: 谷田部　祐介; 小味　弘典; 浩朗伊藤; 稲田　圭介
Original assignee: 株式会社日立製作所
Priority date: 2015-03-11
Filing date: 2015-03-11
Publication date: 2016-09-15

Abstract

The purpose of the present invention is to provide a device that encodes large-size moving images such as 4k and 2k at a low cost and with low-delay. In order to achieve the foregoing, provided is a moving image encoding device which includes the following: a dividing unit for dividing input moving images; a plurality of encoding pre-processing units that create, from the moving images divided by the dividing unit, encoding information in a macro-block processing order using an intra-prediction method or an inter-prediction method; a memory unit for storing the encoding information created by the encoding pre-processing units; and an encoding unit that generates a compressed stream from the encoding information read out from the memory unit in the macro-block order. The plurality of encoding pre-processing units are configured so that each unit creates encoding information without reciprocally referencing the encoding information held by each of the encoding pre-processing units. Due to this configuration, even in a parallel operation which uses a plurality of encoding devices, low-delay encoding can be realized.

Description

Moving picture coding apparatus, intra prediction coding method used therefor, and moving picture decoding apparatus

The present invention relates to a moving image encoding device and a moving image decoding device capable of encoding a moving image of a large size such as 4k2k with low cost and low delay.

In the H.264 standard, which is an international standard for moving image coding, an image is divided into rectangular areas called macroblocks (MB) and processed in raster order from the upper left of the image. In general, encoding is performed with reference to the encoding information. In such encoding, when a large-size image is encoded in real time, as a background art in the technical field of dividing an image and processing in parallel using a plurality of encoding devices, Japanese Patent Laying-Open No. 2013-165514 ( There exists patent document 1). In Patent Document 1, in order to reduce the amount of data transfer between encoding devices for maintaining the reference relationship of MB encoding when encoding is performed by operating two encoding devices in parallel, the image is processed in the vertical direction. A method is disclosed in which encoding is performed while being synchronized with each encoding device.

In 2013, the latest video coding standard, H.265, was standardized. This standard discloses a technique that can select a plurality of MB sizes as a new encoding unit, and a technique that can encode an image in units called vertical tiles.

JP 2013-165514 A

In Patent Document 1, an image is divided into a left image and a right image, and the encoding device processes each image in parallel. After encoding of the end MB of the left image for each MB line, the encoding device Since the MB information is transferred to the encoding device for the right image and the MB encoding of the right image is started after the transfer is completed, the encoding of the image with low delay is not taken into consideration.

Therefore, in view of the above problems, the present invention has an object of enabling encoding with low delay even when an image is divided.

In order to solve the above problems, for example, the configuration described in the claims is adopted. The present invention includes a plurality of means for solving the above-described problems. To give an example, the present invention is a video encoding device, which is a splitting unit that splits an input video and a splitting unit. A plurality of pre-encoding units that generate encoding information in the order of macroblock processing from a moving image by using either intra prediction or inter prediction; a memory unit that stores encoding information generated by the pre-encoding processing unit; An encoding unit that generates a compressed stream from encoding information read out from the memory unit in macroblock order, and a plurality of pre-encoding units are encoded by each pre-encoding unit The encoding information is created without referring to the information mutually.

According to the present invention, it is possible to realize encoding with low delay even in a parallel operation using a plurality of encoding devices.

It is a block diagram which shows an example of the system of the moving image encoder in Example 1. It is a figure explaining the MB process order of the moving image encoder in Example 1. FIG. It is a figure explaining the vertical division | segmentation of the image of the moving image encoder in Example 1. FIG. FIG. 10 is a diagram for explaining an MB processing order when an image is vertically divided by a moving image encoding device according to Embodiment 1. 3 is an operation timing chart for each frame of the moving image encoding apparatus according to the first embodiment. It is a figure which shows an example of the processing pipeline of the pre-encoding process part of the moving image encoder in Example 1. FIG. It is a figure explaining the intra prediction of the moving image encoder in Example 1. FIG. It is a figure explaining the reference pixel used for Intra prediction of the moving image encoder in Example 1. FIG. FIG. 3 is a diagram illustrating an intra prediction mode of the video encoding device in the first embodiment. It is a figure which shows an example of the processing pipeline at the time of using two encoding pre-processing parts of the moving image encoder in Example 1. FIG. FIG. 10 is a diagram illustrating a relationship between an input rate of an original image and an encoding rate of an encoding device in an encoding process time and an original image size of an image of one frame in Example 2. FIG. 10 is a system configuration diagram of a moving image encoding apparatus according to Embodiment 4. FIG. 10 is a schematic diagram illustrating intra refresh in the sixth embodiment. FIG. 10 is a system configuration diagram of a video decoding device in Embodiment 7.

Hereinafter, examples of the present invention will be described with reference to the drawings, but the present invention is not necessarily limited to these examples. In the drawings for explaining the embodiments, the same symbols are attached to the same members, and the repeated explanation thereof is omitted. Further, although H.265 will be described as an example of an encoding standard to be described, other encoding standards may be used.

FIG. 1 is a configuration diagram illustrating an example of a system of a moving image encoding apparatus according to the present embodiment. As shown in FIG. 1, the moving picture coding apparatus according to the present embodiment divides an input moving picture and stores it in a memory unit, reads the divided moving picture, and performs preprocessing for coding. The first pre-encoding processing unit 0102 for storing the encoding information in the middle of encoding in the memory unit 0104, the second pre-encoding processing unit 0103 having the same configuration, and the encoding from the memory unit An encoding unit 0105 that reads out the encoded information and stores it in the memory, a stream output unit 0106 that reads out and outputs the stream, a deblocking unit 0107 that reads out the decoded image and performs the deblocking filter process, and a control unit 0108 Consists of

The first encoding preprocessing unit 0102 includes an original image reading unit 0102 that reads an original image from a memory, a reference image reading unit 01021 that reads a reference image for performing inter-screen prediction (Inter), and a vector for Inter prediction. Inter mode determination unit 01023 for determining the block size and the like, Intra mode determination unit 01024 for determining the prediction mode of intra prediction (Intra), and determining one of the modes of Intra prediction and Inter prediction. Prediction error generation unit 01025 for generating prediction error and generating decoded image after inverse frequency conversion, Intra prediction error generation and prediction error frequency conversion and quantization, and quantized data Is composed of a frequency transform quantizing unit 01026 that performs inverse quantization and inverse frequency transform, and an encoded information writing unit 01027 that creates encoded information held in the memory and stores the encoded information in the memory. Here, the coding information is intra prediction for each block of MB, information indicating intra prediction, vector at inter prediction, block division information, intra prediction mode at intra prediction, book division information, quantization value, quantization The later image information, the locally decoded image, and the like.

The second pre-encoding processing unit 0103 has the same configuration as that of the first pre-encoding processing unit. In this embodiment, two examples of the pre-encoding processing unit will be described, but the number is not limited.

The control unit 0108 performs overall operation control, rate control, and MB size determination.

Next, the operation of the moving picture coding apparatus in the present embodiment will be described. 2A, 2B, and 2C are diagrams for explaining the processing order in MB units. In FIG. 2A, encoding of a moving image is performed by dividing the screen into rectangular blocks called MB0202 for each continuous screen 0201 that constitutes the moving image, for example, a still image 0201 such as one frame, from the upper left to the right. In general, encoding is performed in the order of the raster scan 0203 with reference to information on neighboring MBs.

In this embodiment, as shown in FIG. 2B, the screen is divided in the vertical direction, each image is divided into a left image 0204 and a right image 0205, and the MB of each image is raster scanned as shown in FIG. 2C. In order, encoding is performed in the order of 0206 and 0207, respectively. However, even when encoding is performed separately for the left and right images in this way, the leftmost MB of the right image requires the information of the left image MB (0208), so that encoding is simply performed by dividing the left image. Can not.

To deal with this problem, there is a method of handling left and right images as independent regions using a stream configuration called slices. However, since there is a lot of additional information that represents slices, using many slices impairs coding efficiency. End up.

There is also a method of dividing into independent areas by a method called tiles, but it is necessary to store the stream position, which is the break position of tile division, at the beginning of the stream in units of frames. It is difficult to use because it outputs a stream before it is determined.

Further, as a method not using the slices and tiles, there is a method of Patent Document 1, but as described above, the amount of delay at the time of encoding increases, so that it cannot cope with encoding with low delay.

On the other hand, in this embodiment, by cutting off the reference relationship between the right image and the left image, the left image and the right image can be processed in parallel, and encoding with a small amount of delay is realized.

Hereinafter, the detailed operation of each block in FIG. 1 will be specifically described. The input moving image is vertically divided by the dividing unit 0101 according to the number of divisions designated by the user and stored in the memory unit 0104. The input image may be input by raster scanning or may be input for each divided image area, but is stored in the memory unit 0104 for each vertically divided image. The number of divisions is determined by the image size and frame rate of the moving image to be encoded and the processing performance of the pre-encoding processing device.

FIG. 3 shows an example of an operation timing chart for each frame of the moving image encoding apparatus. In FIG. 3, the horizontal axis represents time 0301, and one section shows the required processing time 0302 for one image, which is one frame when performing real-time video encoding. The present embodiment assumes real-time encoding with low delay, and the input image is stored in the memory unit by the dividing unit 0101 separately in the left and right images. The process 0304 of the first pre-encoding processing unit and the process 0305 of the second code processing unit start processing as soon as the required MB original image is input, generate encoding information, and generate encoding information. Once stored in memory. Then, the processing 0306 of the encoding unit immediately reads out the data in the order of the encoded MB and performs the stream conversion.

Next, the MB processing operation of the pre-encoding processing unit will be described. FIG. 4 shows an example of a processing pipeline of the pre-encoding processing unit. In FIG. 4, the horizontal axis indicates time 0401, and the section in the horizontal axis indicates time 0402 necessary for processing 1 MB. Each process shows a state in which processing is sequentially performed in a pipeline of 0 MB, 1 MB, and 2 MB in the order of MB processing.

The original image reading process 0403 is a process of reading an original image for each MB from the memory unit 0104 by the original image reading unit 01022.

The reference image reading process 0404 indicates a process of reading a reference image for inter prediction by the reference image reading unit 01021. The reference image reading process 0404 is a process of pre-reading before starting each process and sequentially reading necessary data in the order of processing MB.

Inter prediction mode determination processing 0405 is processing for determining a motion vector and a block division size by performing motion detection processing using an original image and a reference image in the Inter mode determination unit 01023.

The intra mode determination process 0406 is a process in which the intra mode determination unit 01024 determines an intra prediction mode (reference direction) using peripheral pixels as reference pixels.

Intra prediction is a method of performing encoding using only pixels in the screen. As shown in FIG. 5, for each MB0701 to be encoded, a rectangular Intra prediction block 0702 having the same size or smaller than that is used. Divide and make predictions. Intra prediction creates a prediction image using pixels of surrounding blocks as reference pixels with respect to the encoding target block. An example of the reference pixel is shown in FIG. FIG. 6 shows reference pixels necessary for intra prediction of the encoding target block 0601. For the encoding target block, the pixel 0602 belonging to the upper block or MB, the upper left block or MB, and the like. A pixel 0603, a pixel 0604 belonging to the left block or MB, and a pixel 0605 belonging to the upper right block are selected as reference pixels, and one prediction mode is selected from Intra modes that can be predicted from a plurality of directions as shown in FIG. A predicted image is created using reference pixels in that direction. Here, FIG. 7 shows the direction (mode) in which direction the reference image is referred to by the pixel in the intra prediction block. At this time, the reference pixel may use the original image for pixels that have not been decoded, and may use the decoded image or the original image for pixels that have already been decoded.

In such intra prediction, in this embodiment, in the intra prediction mode restriction block 0705 where the right image and the left image dividing boundary 0704 shown in FIG. 5 are in contact, intra prediction is performed using only reference pixels belonging to the divided image. In addition, the intra prediction mode is limited. In other words, the intra prediction mode is limited so that the decoded pixels of blocks belonging to different divided screens are not used as reference pixels. That is, the two pre-encoding processing units respectively create encoding information without mutually referring to the encoding information held by the individual encoding pre-processing units.

The limitation of the Intra prediction mode of the rightmost Intra prediction block (upper right and lower right blocks) in the left image of FIG. 5 will be described. In these intra prediction blocks, the pixel 0605 belonging to the upper right block in FIG. 6 is a right image, and thus information cannot be acquired. Therefore, the intra prediction mode that can be predicted only from other reference pixels is limited.

Next, limitations on the intra prediction mode (upper left and lower left blocks) of the leftmost intra prediction block in the right image will be described. In these intra prediction blocks, the pixel 0603 belonging to the upper left block in FIG. 6 and the pixel 0604 belonging to the left block are left images, so the pixel 0602 belonging to the upper block and the pixel belonging to the upper right block The intra prediction mode that can be predicted using only 0605 is limited.

By limiting to the intra prediction mode in this way, in the prediction image creation processing of intra prediction described later, a prediction image of intra prediction can be created only with reference pixels in the divided image, and encoding between the left and right images is performed. It becomes possible to cut off the reference of information.

Next, the Intra / Inter determination / Inter prediction image creation processing 0407 in FIG. 4 determines whether the Inter error mode or the Intra mode is selected in the prediction error creation unit 01025. This is a process of creating a prediction image of a mode and generating an error image that takes a difference from the original image.

Intra prediction image creation, frequency transform quantization, inverse quantization inverse frequency transform, and decoded image creation processing 0408 are determined by the intra mode determination unit 01024 at the time of intra prediction in the prediction error creation unit 01025 and the frequency transform quantization unit 01026. Generate a prediction image from the Intra prediction mode and surrounding and reference pixels of its own MB, create a prediction residual that takes the difference from the original image, and perform frequency conversion and quantum conversion on the prediction residual in both Intra / Inter modes In addition, prediction error data obtained by inverse quantization and inverse frequency conversion of quantized data is added to a prediction image to generate a decoded image.

The encoded information writing process 0409 is a process in which the encoded information writing unit 01027 writes the encoded information into the memory.

させる By operating these processes in the pipeline, it is possible to output data in a 1MB processing period as throughput.

Next, FIG. 8 shows an example of a processing pipeline in the configuration of FIG. 1 using two pre-encoding processing units. FIG. 8 shows time 0501 on the horizontal axis, and the period required for processing 1 MB therein is shown as time 0502 required for processing 1 MB. In this configuration, since the real-time encoding is performed using the parallel processing of the two pre-coding processing units, the processing time of 1 MB of the pre-coding processing unit is at most twice less than the time 0502 required for the processing of 1 MB. Need to process in time. Also, the encoding unit needs to end the process in the 1 MB period.
The first pre-encoding process and the second pre-encoding process each perform the pipeline operation shown in FIG. For simplicity, the pre-encoding process in FIG. 8 shows only the MB number for which the encoded information writing process in FIG. 4 is performed.

In the first pre-encoding process 0503, as soon as the original image data of MB0 is stored in the memory in the first pre-encoding processing unit 0102 according to the processing order of the left image in the processing order of FIG. 2C, the pre-encoding process is performed. Start and store the encoded information in the memory unit.

Similarly, in the second pre-encoding process 0504, the MB4 original image is stored in the memory unit in the second pre-encoding processing unit 0103 according to the processing order of the right image in the processing order of FIG. Start, create encoding information for each MB, and store in the memory unit. At this time, since the intra prediction mode is limited, the first MB of the right image can be processed before the encoding of the right end MB of the left image is completed.

In the encoding process 0505, the encoding unit 0105 immediately converts the encoding information stored in the memory unit 0104 by the first pre-encoding processing unit 0102 and the second pre-encoding processing unit 0103 in the MB encoding order. In addition, the data is streamed by an encoding method such as CABAC (Context-based Adaptive Binary Arithmetic Coding) or CAVLC (Context-adaptive variable-length coding) in consideration of surrounding MB information.

The stream output process 0506 for each MB line is output by the stream output unit 0106 as soon as the stream is stored in the memory unit 0104 for each MB line.

In the deblocking process 0507, after the decoded images of the left image and the right image are stored in the memory unit for 2 MB lines in the deblocking unit 0107, the decoded image is read again from the memory unit, and subjected to the deblocking filter process. Stored in memory as a reference image for inter prediction after the frame. If the deblocking process is not performed, the process of this block is not necessary. Further, the deblocking process may be configured to perform a process when reading a reference image for performing the Inter prediction.

In the above description, the case where the image is vertically divided has been described. However, the present embodiment is not limited to this, and can be divided into four, six, and eight, for example. That's all. Moreover, horizontal division may be sufficient and the combination of vertical division and horizontal division may be sufficient.

In this embodiment, by limiting the Intra prediction mode in this way, it is possible to achieve processing dependency between multiple pre-coding processing units, and to perform independent parallel processing, and encoding with low delay. Can be realized. In addition, since high-speed processing can be reduced by parallel processing, low power consumption and low cost can be realized.

The MB size can be changed in the H.265 standard. Therefore, it is necessary to determine the MB size and perform encoding. The MB size needs to be appropriately determined according to the target delay amount because the encoding time differs depending on the size.

FIG. 9 is a diagram showing the relationship between the input rate of the original image and the encoding rate of the encoding device in the encoding processing time and the original image size of one image of one frame. As shown in FIG. 9, when the MB size is large, it is necessary to start encoding after inputting a large number of original images. Therefore, the amount of encoding delay varies depending on the input time required to input the original image.

Therefore, the MB size determination processing of the control unit 0108 in FIG. 1 is a standard that can specify the MB size in the moving image encoding, the target delay amount, the moving image size, the frame rate, and the input of the original image The MB size is determined based on the rate, the encoding rate of the encoding device that actually performs encoding, and the input time of the original image. By this size determination, desired low-delay encoding can be realized. Note that this MB size determination unit can also be applied when the pre-encoding processing unit is not used in parallel.

According to the present embodiment, an appropriate MB size can be determined even for an encoding standard in which the MB size can be selected, and encoding with low delay can be realized.

The following describes how to improve image quality in this embodiment. In the first embodiment, since the intra prediction mode is limited, there is a problem that prediction efficiency is reduced only by the block, and image degradation is perceived as a line.

In contrast, in this embodiment, the intra prediction block limited to the intra prediction mode in which prediction can be performed only with the reference image belonging to the divided image in the first embodiment has a smaller quantization value than other blocks. As a result, the image quality in the Intra prediction mode restricted block can be improved, and the perception of the degradation line can be prevented.

Also, when the image is divided vertically, the number of MBs configured for each MB line may be changed, and this value may be changed for each frame. By doing so, the boundary line can be scattered for each frame, and the image quality degradation at the boundary can be made inconspicuous. Further, even if the MB size is changed for each MB line, similarly, it is possible to make the image quality deterioration at the boundary less noticeable.

FIG. 10 shows a system configuration diagram of the moving picture encoding apparatus of the present embodiment. FIG. 10 includes a connection unit 0901 for connecting a plurality of pre-encoding units in addition to the configuration of FIG. That is, in this embodiment, the data can be transferred between the pre-encoding processing units. This is a configuration for enabling the reference image to be sent between the pre-encoding processing units for the reference pixels for which the decoded image generation processing in the peripheral divided image has already been completed in the intra predicted image generation processing. It is.

For example, in the Intra prediction mode restriction block 0705 shown in FIG. 5, an Intra prediction mode restriction block (upper right block and lower right block) that is an Intra prediction block belonging to the right end of the left image is an MB (upper left block and The reference pixel in the lower left block) is used. In the processing pipeline shown in FIG. 8, the MB (eg, MB3) located at the right end of the left image requires information on the MB (eg, 4) belonging to the left end of the right image, but before processing MB3, MB4 has already been processed. Since the above process has been completed, it is possible to perform intra prediction of MB3 using the reference pixels of MB4. Therefore, in this embodiment, it is necessary to limit the intra prediction mode in the first pre-processing unit by transferring the decoded image in the second pre-processing unit to the first pre-processing unit. Disappears.

Also, in the intra prediction block at the left end of the right image, in the intra prediction mode restriction block 0705 that is in contact with the upper MB line, the process of generating the decoded image of the upper MB line has already been completed. Can be used as an image. That is, in the processing pipeline of FIG. 8, for example, at the time of MBn + 4 MB processing, since the MB processing of MB3 has already been completed, the pixel can be used. Therefore, by transferring this pixel from the first pre-encoding processing unit to the second pre-encoding processing unit, the intra prediction mode is set to the upper left block in FIG. 6 in the intra prediction block adjacent to the upper MB. The pixel 0603 belonging to can also be used, and the restriction on the mode of intra prediction can be relaxed.

According to the present embodiment, it is possible to provide a moving image encoding apparatus that can relax the restriction of the intra prediction mode and that has high image quality and low delay.

In this embodiment, the two pre-encoding processing units mutually transfer information, but only one of them may be transferred.

In addition, the actual data transfer may be transfer via a memory unit instead of transfer between pre-encoding processing units.

In this embodiment, a technique for performing coding with low delay using tiles standardized by H.265 will be described.

The tile is a technique that allows an image to be divided into a plurality of parts in the vertical direction as shown in FIG. 2C and that each can be encoded independently. The processing order of MBs at this time is also the processing order shown in FIG. 2C. However, as described above, when streaming, it is necessary to store the break position of the stream of the left image and the right image at the head of the frame, and an encoded stream on the MB line for the purpose of low delay is output. In such a device, it is necessary to output a stream before the break position is determined, which is not feasible.

Therefore, when tiles are used, a slice is formed for each MB line. Then, the slice is divided into a plurality of tiles. Here, the slice is a stream configuration that handles left and right images as independent areas. In stream creation, in order to determine the cut position of the stream during MB line encoding, the information is held and added to the stream held in the memory unit before the stream is output. Alternatively, a dummy value is streamed in advance, and the dummy value held in the memory unit is realized by a method of rewriting to a correct value as soon as the break position is determined.

This makes it possible to realize low-delay encoding even when tiles are used.

In the first to fifth embodiments, description has been given of the point of realizing low-delay encoding when an image is divided and processed in parallel using a plurality of encoding devices. In the present embodiment, a description will be given of another applied embodiment in that the intra prediction mode is limited so that the intra prediction is performed using only the reference pixels belonging to the divided image applied at that time.

FIG. 11 is a schematic diagram for explaining intra-refresh performed in a low-delay encoder by circulating an intra MB in a band shape and circulating between frames. In FIG. 11, the intra refresh is arranged so that the code amount is constant for delay reduction, and the banded intra MB0905 is shifted for each frame to make a round with a predetermined refresh cycle for error tolerance. To do. The point of limiting the Intra prediction mode described in the first to fifth embodiments is applied so that intra prediction that does not refer to the prediction pixel beyond the banded intra MB0905 region is performed. As a result, the delay can be reduced as in the first to fifth embodiments.

In the present embodiment, the configuration of the moving picture decoding apparatus when decoding the stream created by the moving picture encoding apparatus in the first to sixth embodiments will be described. The moving picture decoding apparatus shown in FIG. 12 includes a stream input unit 1201 that inputs a stream, a decoding unit 1202 that decodes the stream and stores the decoding information in the memory unit 1206, and displays a segmented area based on the decoding information. A first post-decoding processing unit 1203 and a second post-decoding processing unit 1204 that generate an image, a display image reading unit 1205 that generates a final decoded image, and a memory unit 1206 that stores decoding information and a display image The control unit 1207 performs overall control.

The post-decoding processing unit includes a decoding information reading unit 12031 that reads decoding information stored in the memory unit 1206 by the decoding unit 1202, an inverse quantization inverse frequency conversion unit 12032 that performs inverse quantization and inverse frequency conversion on the decoded pixels, Intra mode decoding unit 12033 that decodes intra prediction and generates a prediction image, reference image reading unit 12034 that reads a reference image for inter prediction decoding, inter mode decoding unit 12035 that generates a prediction image for inter prediction, inter prediction The display image generation unit 12036 generates a display image by adding the prediction image of intra prediction and the error image generated by the inverse quantization inverse frequency conversion unit.

In the video encoding device described in the first to sixth embodiments, since intra prediction selects a mode that allows independent processing in a divided image, the video code is also used in post-decoding processing of decoding. It is possible to perform image processing in parallel by using the same image division as that of the pre-encoding processing unit of the encoding device. In the above description, the case where the image is vertically divided has been described. However, the present embodiment is not limited to this, and as described above, the moving image encoding apparatus side is divided into four and six. 8 divisions, vertical divisions of 2 or more, horizontal divisions, and combinations of vertical divisions and horizontal divisions may be used. The image decoding apparatus may also correspond to the division.

As described above, by adopting the configuration of the present embodiment, parallel processing is possible even in a video decoding device, and low-delay decoding can be realized.

The present invention is not limited to the above-described embodiments, and includes various modifications. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

In addition, each of the above-described configurations, processing units, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Further, each of the above-described configurations, processing units, and the like may be realized by software obtained by the processor interpreting and executing a program that realizes each function.

0101: Dividing unit, 0102 ... First encoding preprocessing unit, 0103 ... Second encoding preprocessing unit, 0104 ... Memory unit, 0105 ... Encoding unit, 0106 ... Stream output unit, 0107 ... Deblocking unit, 0108 ... Control unit, 0202 ... MB, 0203 ... Raster scan, 0204 ... Left image, 0205 ... Right image, 0705 ... Intra prediction mode restriction block, 0901 ... Connection unit, 0905 ... Intra MB, 1203 ... After first decoding Processing section,
1204 ... Second decryption post-processing section

Claims

A dividing unit for dividing the input moving image;
A plurality of pre-encoding units that generate encoding information in the order of macroblock processing by using either intra prediction or inter prediction from the video divided by the dividing unit;
A memory unit for storing encoding information created by the pre-encoding processing unit;
An encoding unit that generates a compressed stream from the encoding information read from the memory unit in the macroblock order, and
The plurality of pre-encoding processing units create encoding information without referring to the encoding information held by the individual encoding pre-processing units, respectively. .
The moving image encoding device according to claim 1,
The moving image encoding apparatus, wherein the dividing unit divides one screen constituting the moving image in a vertical direction.
The moving image encoding device according to claim 1,
An intra prediction mode determined by the pre-encoding processing unit is an intra prediction mode that can be predicted only by a decoded pixel of a pre-encoding processing unit to which the intra prediction block belongs.
The moving image encoding device according to claim 1,
The pre-encoding processing unit generates a decoded image and stores it in the memory unit,
A moving picture coding apparatus comprising: a deblocking unit that acquires the decoded image from the memory unit, performs a deblocking filter process, and stores the deblocking filter in the memory unit.
The moving image encoding device according to claim 1,
When encoding by selecting the size of the macroblock from a plurality of sizes,
The size of the macroblock is determined based on a target encoding delay amount, the size and frame rate of the moving image to be encoded, the processing time for encoding, and the input time of the input moving image. A video encoding apparatus characterized by the above.
The moving image encoding device according to claim 1,
The division unit divides one screen constituting the moving image in the vertical direction, and changes the number of MBs formed for each macroblock line.
The moving image encoding device according to claim 1,
The Intra prediction mode determined by the pre-encoding processing unit is smaller than the other blocks in the quantized value of the Intra prediction block that is the intra prediction mode that can be predicted only by the decoded pixels of the pre-encoding processing unit to which the intra prediction block belongs. A moving picture coding apparatus characterized by having a value.
The moving image encoding device according to claim 1,
Transfer data between the pre-encoding processing unit,
An Intra prediction mode in which an Intra prediction block belonging to the right end of the divided left image is set to an Intra prediction mode in which a reference image belonging to an upper right block can be referred to.
The moving image encoding device according to claim 1,
Transfer data between the pre-encoding processing unit,
An Intra prediction mode in which an Intra prediction block belonging to the left end of the divided right image and in contact with an upper macroblock line is set to an Intra prediction mode in which a reference image belonging to an upper left block can be referred to.
The moving image encoding device according to claim 1,
A moving picture coding apparatus characterized in that a slice is formed for each macroblock line and coding is performed by dividing the slice into a plurality of tiles.
Dividing the continuous screens that make up the input video, and decoding the surrounding blocks for the encoding target block divided into blocks of the size or less for each encoding target macroblock for each divided screen An intra prediction encoding method that creates a prediction image using a pixel as a reference pixel and performs intra prediction encoding,
An Intra prediction encoding method characterized by having an Intra prediction mode in which a decoded pixel of a block belonging to a different divided screen is not used as a reference pixel as a reference pixel of an encoding target block belonging to each of the divided screens.
A video decoding device for decoding a video stream,
A decoding unit that decodes the input video stream and stores decoding information in macroblock order in the memory unit;
A memory unit for storing the decryption information created by the decryption unit;
A plurality of post-decoding processing units that create display images in the order of macroblock processing by using either intra prediction or inter prediction from the decoding information read from the memory unit;
The plurality of post-decoding processing units create respective display images without mutually referring to the decoding information held by the individual decoding post-processing units. .