JP5442688B2 - Moving picture coding apparatus and method, and moving picture decoding apparatus and method - Google Patents

Description

  The present invention relates to a so-called right-eye image (also referred to as a right-eye image) and a so-called left-eye image (also referred to as a left-eye image) alternately arranged in vertical columns (so-called stereo moving images), and odd rows Moving image encoding apparatus and method for encoding moving images (so-called interlaced moving images) in which images and even-numbered row images are arranged alternately every horizontal row, and moving images for decoding the stereo moving images and interlaced moving images The present invention relates to an image decoding apparatus and method.

  The “left field image” means an image obtained by extracting only the left eye image in a stereo moving image in which the right eye image and the left eye image are alternately arranged in a vertical column. "Means an image obtained by extracting only the right-eye image from the stereo moving image.

  As one of the stereoscopic moving image display devices, a parallax having a configuration in which a slit plate 12 having a large number of holes is arranged on the front surface of a liquid crystal display 11 having a filter 10 having a large number of image arrays as shown in FIG. Lux barrier type stereoscopic image display devices are known. This stereoscopic image display apparatus is configured so that only the left eye image L on the filter can be seen from the viewer's left eye 13 and only the right eye image R on the filter can be seen from the viewer's right eye 14, so that the viewer Can visually recognize a stereoscopic moving image. In addition, it replaces with the slit board 12 of FIG. 1, and the three-dimensional video display apparatus of the structure which has arrange | positioned the lenticular board is also known.

  As another stereoscopic video encoding method, for example, a “stereoscopic video transmission method and apparatus” disclosed in Patent Document 1 below is known. In this technique, a left-eye image is first placed on the left half of the image as shown in FIG. 2 (b) with respect to the stereoscopic image in which the left-eye image and the right-eye image are alternately arranged for each vertical column shown in FIG. 2 (a). The right eye image is collected in the right half and rearranged to create a converted image. Next, processing such as video encoding, transmission of encoded data, reception of encoded data, and video decoding is performed on the created converted image. Thereafter, the pixel arrangement of the decoded converted image is re-arranged with the left-eye image and the right-eye image alternately for each vertical column, and the same image as the stereoscopic image that is the input signal is reproduced.

Japanese Patent Laid-Open No. 11-18111

  In a stereoscopic image, a nearby object has a large parallax between the left-eye image and the right-eye image, but a distant object has little parallax between the left-eye image and the right-eye image. Therefore, data compression efficiency can be improved by utilizing the correlation between the left-eye image and the right-eye image, particularly in a block indicating a distant object.

  However, in the above prior art, in the converted image, the left eye image is arranged in the left half and the right eye image is arranged in the right half. Therefore, when performing video coding, the correlation between the left eye image and the right eye image is used. There is a problem that data compression efficiency cannot be improved.

  In addition, in the converted image, the left eye image is arranged once in the left half and the right eye image is arranged in the right half and encoded. Therefore, when the converted image is displayed on the above-described parallax barrier stereoscopic moving image display device, decoding is performed. By changing the pixel arrangement of the processed image, it is necessary to again arrange the left-eye image and the right-eye image alternately for each vertical column. For this reason, there exists a subject that the efficiency of a process is difficult.

  The present invention has been made to solve the above-described problems, and provides a moving image encoding apparatus and method, and a moving image decoding apparatus and method capable of efficiently performing image processing on a stereoscopic moving image. For the purpose.

  In order to achieve the above object, the moving image encoding apparatus of the present invention includes a stereo moving image in which a right eye image and a left eye image are alternately arranged in a vertical column, and an odd row image and an even row image in each horizontal row. A moving image encoding apparatus that encodes interlaced moving images arranged alternately, a moving image type determining unit that determines whether or not a moving image to be encoded is a stereo moving image, and an encoding target When it is determined that the moving image is a stereo moving image, a moving image rotating unit that rotates the moving image by a predetermined angle in a predetermined direction so that the vertical direction of the moving image changes to a horizontal direction, and a non-stereo moving image A moving image interlace encoding unit that interlace-codes the moving image determined to be a stereo moving image and the moving image that has been rotated by the predetermined angle, and the encoding target moving image is a stereo moving image A stereo image identifier encoding unit that encodes a stereo image identifier indicating whether or not, an encoded bitstream obtained by interlace encoding by the moving image interlace encoding unit, and encoding by the stereo image identifier encoding unit And a multiplexing unit that creates a multiplexed encoded bit stream by multiplexing the codes of the stereo image identifiers obtained in the above.

  The moving image type determination unit may determine whether the moving image to be encoded is a stereo moving image based on the input image signal, or may perform encoding according to a predetermined rule. It may be determined whether or not the target moving image is a stereo moving image.

  In addition, when the moving image to be encoded is determined to be a stereo moving image, the moving image rotating unit described above, for example, moves the moving image to the right so that the vertical direction in the moving image changes to the horizontal direction. May be rotated + 90 °, or the moving image may be rotated −90 ° to the right.

  At this time, it is preferable that the stereo image identifier encoding unit encodes the stereo image identifier including information on rotation performed on the moving image to be encoded by the moving image rotation unit.

In order to achieve the above object, the moving image encoding apparatus of the present invention includes a stereo moving image in which a right eye image and a left eye image are alternately arranged in a vertical column, and an odd row image and an even row image in each horizontal row. A video encoding device that encodes interlaced video images alternately arranged on the basis of an input video signal representing a video to be encoded, and whether the video to be encoded is a stereo video A moving image type determining unit that determines the type of an interlaced moving image, and when the inter-frame prediction mode is selected and the moving image type obtained by the determination is a stereo moving image, the input image is used as a frame image. Compare the coding efficiency of the case of inter-frame prediction and the case of inter-frame prediction by separating the input image into a right-eye image and a left-eye image, and inter-frame prediction using the input image as a frame image If the coding efficiency of the case is higher, if the inter-frame prediction is performed with the input image separated into the right-eye image and the left-eye image, the inter-frame prediction is performed. When “interframe prediction in a field image” is selected as a prediction mode, when the interframe prediction mode is selected and the type of moving image obtained by the determination is an interlaced moving image, the input image is used as a frame image. The coding efficiency of the case where the inter prediction was compared with the case where the inter prediction was compared with the case where the input image was separated into the odd row image and the even row image and the inter frame prediction was compared. If it is higher, the inter-frame prediction with the frame image is used for the case where the input image is separated into the odd-numbered image and the even-numbered row image and the inter-frame prediction is performed. When the coding efficiency is higher, “inter-frame prediction with field image” is selected as the prediction mode, the intra-frame prediction mode is selected, and the type of moving image obtained by the determination is a stereo moving image The intra-frame prediction using the input image as the frame image and the case where the input image is separated into the right-eye image and the left-eye image and the intra-frame prediction is compared. When the encoding efficiency of the case is higher than that of the case where the intra-frame prediction is performed by separating the input image into the right-eye image and the left-eye image, and the intra-frame prediction is performed. Selects “intraframe prediction in a field image” as the prediction mode, the intraframe prediction mode is selected, and the type of moving image obtained by the above determination When the other is an interlaced video, the encoding efficiency is compared between the case where the input image is predicted in the frame as a frame image and the case where the input image is separated into the odd row image and the even row image and predicted in the frame, When the intra-frame prediction is performed with the input image as the frame image, the intra-frame prediction is performed by separating the intra-frame prediction with the frame image into the odd-numbered and even-numbered row images. If the encoding efficiency of the selected case is higher, select “intraframe prediction in the field image” as the prediction mode, and select “interframe prediction in the frame image” or “interframe prediction in the field image” as the prediction mode. If the "is selected, a motion detection unit for detecting a motion vector for the moving picture of the coding target, the type of the moving image, which is the selected Based on the measurement mode and the detected motion vector, a motion compensation unit that performs motion compensation on the moving image, and on the moving image based on the type of the moving image and the selected prediction mode, Obtained as a difference between the predicted image signal obtained by the motion compensation or the spatial prediction and the input image signal based on the spatial prediction unit that performs spatial prediction, the type of the moving image, and the selected prediction mode. An orthogonal transform unit that performs orthogonal transform on the prediction residual signal, and a predetermined length including variable length coding for the image data after the orthogonal transform based on the type of the moving image and the selected prediction mode A variable-length encoding unit that performs image processing, and a predetermined value including inverse orthogonal transform for the image data after the orthogonal transform based on the type of the moving image and the selected prediction mode Characterized in that it comprises an inverse orthogonal transform unit for performing image processing.

  At this time, the motion detection unit determines that the encoding target region is a left field image when the encoding target moving image is a stereo moving image and the encoding target region is predicted as a field image based on the selected prediction mode. It is desirable to detect a motion vector for each field separated right and left as a right field image.

  Further, at this time, the motion compensation unit, when the encoding target moving image is a stereo moving image and predicting the encoding target region as a field image based on the selected prediction mode, the encoding target region is set to the left field image. It is desirable to perform motion compensation for each field separated into right and left as a right field image.

  Also, at this time, the spatial prediction unit determines that the encoding target region is a left field image when the encoding target moving image is a stereo moving image and the encoding target region is predicted as a field image based on the selected prediction mode. It is desirable to perform spatial prediction for each field separated right and left as a right field image.

  Further, at this time, the orthogonal transform unit predicts based on the prediction residual signal when the video to be encoded is a stereo video and predicts the encoding target region as a field image based on the selected prediction mode. It is desirable to perform orthogonal transform for each field in which the residual image is separated into left and right as a left field prediction residual image and a right field prediction residual image.

  Further, at this time, the inverse orthogonal transform unit, when the encoding target moving image is a stereo moving image and predicting the encoding target region as a field image based on the selected prediction mode, the image data after the orthogonal transform It is desirable to perform predetermined image processing including inverse orthogonal transformation for each of the fields separated into left and right as left field image data and right field image data.

  In order to achieve the above object, the moving picture decoding apparatus according to the present invention includes a stereo moving picture in which a right-eye picture and a left-eye picture are alternately arranged in a vertical column, and an odd-numbered picture and an even-numbered picture in a horizontal direction. A moving picture decoding apparatus for decoding interlaced moving pictures arranged alternately for each row, type information indicating whether or not a decoding target moving picture is a stereo moving picture, and prediction mode information regarding a decoding target area And a variable length decoding unit that decodes the orthogonally transformed image data of the decoding target area, and a motion vector of the decoding target area is restored based on the type information and the prediction mode information obtained by the decoding A motion vector restoration unit; a motion compensation unit that performs motion compensation on a decoding target region based on the type information, prediction mode information, and the restored motion vector; and the type information and A spatial prediction unit that performs spatial prediction on the decoding target region based on the measurement mode information, and orthogonally transformed image data of the decoding target region obtained by the decoding based on the type information and the prediction mode information. On the other hand, an inverse orthogonal transform unit that performs predetermined image processing including inverse orthogonal transform, a prediction residual signal obtained by image processing by the inverse orthogonal transform unit, and a predicted image obtained by the motion compensation or the spatial prediction And an image data generation unit configured to generate image data of a decoding target area from the signal.

  At this time, the motion vector restoration unit determines that the decoding target region is a left field image when the decoding target moving image is a stereo moving image and the decoding target region is predicted as a field image based on the prediction mode information. It is desirable to restore a motion vector for each field separated into right and left as a right field image.

  Also, at this time, the motion compensation unit, when the decoding target moving image is a stereo moving image and predicting the decoding target region as a field image based on the prediction mode information, the decoding target region is defined as a left field image. It is desirable to perform motion compensation for each field separated right and left as a right field image.

  Also, at this time, the spatial prediction unit, when the decoding target moving image is a stereo moving image and predicting the decoding target region as a field image based on the prediction mode information, the decoding target region is defined as a left field image. It is desirable to perform spatial prediction for each field separated right and left as the right field image.

  Further, at this time, when the moving image to be decoded is a stereo moving image and the decoding target region is predicted as a field image based on the prediction mode information, the inverse orthogonal transform unit sets the decoding target region as the left field image. It is desirable to perform inverse orthogonal transform for each field separated into right and left as the right field image.

  According to the above moving image encoding device and moving image decoding device, the correlation between the left eye image and the right eye image is used by performing encoding and decoding based on at least the type of moving image and the selected prediction mode. Thus, the efficiency of data compression can be improved.

  In addition, since an output image having the same pixel arrangement as the input stereo moving image signal is obtained, the order of the lines of the image signal after decoding processing is changed when displaying on a parallax barrier type stereoscopic moving image display device. The same image signal as the input image can be obtained without correction.

  Furthermore, a stereo moving image signal in which left-eye images and right-eye images are alternately arranged every vertical column, and an interlaced moving image signal in which odd-numbered row images and even-numbered row images are alternately arranged every horizontal row are identical to each other. Encoding and decoding can be performed by the moving image encoding device and the moving image decoding device, respectively, and the device can be used effectively.

  The invention relating to the moving image encoding device and the moving image decoding device as described above can be regarded as the invention relating to the following moving image encoding method and moving image decoding method, and obtain the same effect. Can do.

  That is, in the moving image encoding method according to the present invention, the stereo moving image in which the right eye image and the left eye image are alternately arranged in every vertical column, and the odd row image and the even row image are alternately arranged in every horizontal row. A moving image encoding method for encoding an interlaced moving image, the moving image type determining step for determining whether or not the moving image to be encoded is a stereo moving image, and the moving image to be encoded is a stereo moving image. A moving image rotation step for rotating the moving image by a predetermined angle in a predetermined direction so that the vertical direction of the moving image changes to a horizontal direction when the image is determined to be an image, and a moving image determined not to be a stereo moving image A video interlace encoding step for interlace encoding the video that has been determined to be an image and a stereo video and rotated by the predetermined angle, and the video to be encoded is a stereo video A stereo image identifier encoding step for encoding a stereo image identifier indicating whether or not, an encoded bitstream obtained by the interlaced encoding, and a code of the stereo image identifier obtained by the encoding are multiplexed And a multiplexing step of creating a multiplexed encoded bitstream.

The moving image encoding method according to the present invention includes a stereo moving image in which right-eye images and left-eye images are alternately arranged in vertical columns, and an interlaced moving image in which odd-numbered images and even-numbered rows images are alternately arranged in horizontal rows. A video encoding method for encoding an image, wherein, based on an input image signal representing a video to be encoded, whether the video to be encoded is a stereo video or an interlace video A moving image type determining step for determining a type, and a case in which an inter-frame prediction mode is selected and the type of moving image obtained by the determination is a stereo moving image, and an input image is used as a frame image and input Compare the coding efficiency of the case where the image is divided into the right-eye image and the left-eye image and the inter-frame prediction is performed, and the inter-frame prediction is performed using the input image as the frame image. If the rate is higher, the inter-frame prediction in the frame image is performed. If the input image is divided into the right-eye image and the left-eye image and the inter-frame prediction is performed, the coding efficiency is higher in the field image. When the inter-frame prediction mode is selected as the prediction mode, and when the inter-frame prediction mode is selected and the type of the moving image obtained by the determination is an interlaced moving image, the input image is used as the frame image for the inter-frame prediction. Compare the encoding efficiency with the case where the input image is divided into odd-numbered and even-numbered images and the inter-frame prediction is performed, and the encoding efficiency is higher when the input image is inter-frame predicted as the frame image Is the encoding efficiency in the case where the inter-frame prediction is performed by separating the input image into odd-numbered and even-numbered images, and “inter-frame prediction with frame images”. In the case where the inter-frame prediction in the field image is selected as the prediction mode, the intra-frame prediction mode is selected, and the moving image type obtained by the determination is a stereo moving image, the input image is framed. Compare the coding efficiency of the case of intra-frame prediction as an image and the case of intra-frame prediction by separating the input image into a right-eye image and a left-eye image, and the coding efficiency of the case of intra-frame prediction using the input image as a frame image If the coding efficiency is higher in the case where the intra-frame prediction is performed when the input image is separated into the right-eye image and the left-eye image and the intra-frame prediction is performed. “Intra-frame prediction” is selected as the prediction mode, the intra-frame prediction mode is selected, and the type of moving image obtained by the above determination is If the input image is a frame image, the encoding efficiency is compared between the case where the input image is predicted as a frame image and the case where the input image is divided into an odd-numbered image and an even-numbered row image and is predicted within the frame. When the coding efficiency of the case where the intra-frame prediction is performed as a frame image is higher, the intra-frame prediction is performed by separating the input image into an odd-numbered image and an even-numbered row image for “intra-frame prediction with a frame image” When the encoding efficiency of the above is higher, “intraframe prediction in a field image” is selected as a prediction mode, and “interframe prediction in a frame image” or “interframe prediction in a field image” is selected as a prediction mode. If selected, the prediction mode in which the code and the motion detection step of detecting a motion vector for encoding target moving image, the type of the moving image, which is the selected And a motion compensation step for performing motion compensation on the moving image based on the detected motion vector, and spatial prediction for the moving image based on the type of the moving image and the selected prediction mode. And a prediction residual obtained as a difference between the predicted image signal obtained by the motion compensation or the spatial prediction and the input image signal based on the type of the moving image and the selected prediction mode. Predetermined image processing including variable length coding for the image data after the orthogonal transformation based on the orthogonal transformation step for performing orthogonal transformation on the difference signal, and the type of the moving image and the selected prediction mode A variable length encoding step for performing the orthogonal transformation on the image data after the orthogonal transformation based on the type of the moving image and the selected prediction mode. And having an inverse orthogonal transform step of performing a predetermined image processing including conversion.

  In addition, the moving picture decoding method according to the present invention includes a stereo moving picture in which the right eye image and the left eye picture are alternately arranged in the vertical column, and an odd line image and the even line image in the horizontal line alternately. A moving picture decoding method for decoding an interlaced moving picture, wherein the decoding target moving picture is a stereo moving picture, type information about the decoding target area, prediction mode information about the decoding target area, and decoding target area A variable length decoding step for decoding orthogonally transformed image data; a motion vector restoration step for restoring a motion vector of a decoding target region based on the type information and prediction mode information obtained by the decoding; Based on the type information, the prediction mode information, and the restored motion vector, a motion compensation step for performing motion compensation on the decoding target region, the type information and the prediction A spatial prediction step for performing spatial prediction on the decoding target area based on the mode information, and orthogonally transformed image data of the decoding target area obtained by the decoding based on the type information and prediction mode information. On the other hand, an inverse orthogonal transform step for performing predetermined image processing including inverse orthogonal transform, a prediction residual signal obtained by the image processing, and a prediction image signal obtained by the motion compensation or the spatial prediction are decoded. And an image data generation step for generating image data of the region to be converted.

  According to the present invention, the efficiency of data compression can be improved by utilizing the correlation between the left eye image and the right eye image.

  In addition, since an output image having the same pixel arrangement as the input stereo moving image signal is obtained, the order of the lines of the image signal after decoding processing is changed when displaying on a parallax barrier type stereoscopic moving image display device. The same image signal as the input image can be obtained without correction.

  Furthermore, a stereo moving image signal in which left-eye images and right-eye images are alternately arranged every vertical column, and an interlaced moving image signal in which odd-numbered row images and even-numbered row images are alternately arranged every horizontal row are identical to each other. Encoding and decoding can be performed by the moving image encoding device and the moving image decoding device, respectively, and the device can be used effectively.

It is a figure explaining the principle of the stereoscopic image display by a parallax barrier system. It is a figure which shows the conventional stereoscopic video coding system. It is a figure which shows the moving image encoder in 1st Embodiment. (A) is a pixel arrangement | positioning of a stereo image, (b) is a figure which shows the pixel arrangement | positioning of an interlaced image. (A) shows the pixel arrangement of the stereo image, (b) shows the pixel arrangement when the stereo image is rotated by + 90 ° to the right, and (c) shows the pixel arrangement when the stereo image is rotated by −90 ° to the right. FIG. It is the figure which showed the example of the multiplex encoding bit stream transmitted to the exterior. It is the figure which showed the example of the multiplex encoding bit stream transmitted to the exterior. It is the figure which showed the example of the multiplex encoding bit stream transmitted to the exterior. It is the figure which showed the example of the multiplex encoding bit stream transmitted to the exterior. It is a flowchart which shows operation | movement of the moving image encoder in 1st Embodiment. It is a figure which shows the moving image decoding apparatus in 1st Embodiment. (A) shows one pixel arrangement of the moving picture signal sent from the switch 1104, (b) shows another pixel arrangement of the moving picture signal sent from the switch 1104, and (c) shows the left (a). It is a figure which shows pixel arrangement | positioning when +90 degrees or (b) is rotated to -90 degrees to the left. It is a flowchart which shows operation | movement of the moving image decoding apparatus in 1st Embodiment. It is a figure which shows the moving image encoder in 2nd Embodiment. (A) is a frame image of a stereo image, (b) is a left field image of the stereo image, and (c) is a diagram showing a right field image of the stereo image. (A) shows a frame image of an interlaced image, (b) shows an upper field image of the interlaced image, and (c) shows a lower field image of the interlaced image. (A) is a figure which shows the orthogonal transformation block in the frame image in the pixel arrangement | positioning of the prediction residual signal of a stereo image, (b) is a figure which shows the orthogonal transformation block in the field image in the pixel arrangement | positioning of the prediction residual signal of a stereo image. is there. (A) is a figure which shows the orthogonal transformation block in the frame image in the pixel arrangement | positioning of the prediction residual signal of an interlaced image, (b) is a figure which shows the orthogonal transformation block in the field image in the pixel arrangement | positioning of the prediction residual signal of an interlaced image. is there. (A) is a pixel arrangement in a frame image in a pixel arrangement of a prediction residual signal after inverse orthogonal transformation for a stereo image, and (b) is a field image in a pixel arrangement of a prediction residual signal after inverse orthogonal transformation for a stereo image. It is a figure which shows pixel arrangement | positioning in. (A) is a pixel arrangement in a frame image in a pixel arrangement of a prediction residual signal after inverse orthogonal transformation for an interlaced image, and (b) is a field image in a pixel arrangement of a prediction residual signal after inverse orthogonal transformation for an interlaced image. It is a figure which shows pixel arrangement | positioning in. It is a figure which shows the moving image decoding apparatus in 2nd Embodiment. It is a figure which shows the structure of the moving image encoding program which concerns on 1st Embodiment. It is a figure which shows the structure of the moving image decoding program which concerns on 1st Embodiment. It is a figure which shows the structure of the moving image encoding program which concerns on 2nd Embodiment. It is a figure which shows the structure of the moving image decoding program which concerns on 2nd Embodiment.

  Hereinafter, a moving picture coding apparatus and method, and a moving picture decoding apparatus and method according to embodiments of the present invention will be described with reference to the drawings. In addition, in each figure, the same code | symbol is attached | subjected to the same element and the overlapping description is abbreviate | omitted.

[First embodiment]
(Configuration of video encoding device)
First, the moving picture coding apparatus according to the present embodiment will be described with reference to FIG. The moving image coding apparatus 30 according to the present embodiment includes, as its functional components, a moving image type determination unit 301, a switch 302, a moving image rotation unit 303, a switch 304, and a moving image interlace coding unit. 305, a stereo image identifier encoding unit 306, and a multiplexing unit 307.

  The moving image type determination unit 301 receives the input moving image signal 308 and determines the type of the received moving image. When the received moving image is a stereo image signal in which left-eye images and right-eye images are alternately arranged for each vertical column as shown in FIG. 4A, the moving image type determination unit 301 determines that the input image is Information that is a stereo image (for example, a stereo image identifier set to “1”) 310 is sent to the switch 302, the switch 304, and the stereo image identifier encoding unit 306. On the other hand, when the received moving image is an interlaced image signal in which odd-numbered row images and even-numbered row images are alternately arranged for each horizontal row as shown in FIG. , Information that the input image is not a stereo image (for example, a stereo image identifier set to “0”) 310 is sent to the switch 302, the switch 304, and the stereo image identifier encoding unit 306. In addition, the moving image type determination unit 301 sends the received moving image signal 309 to the switch 302. Note that FIG. 4 shows an example where the input image is 352 pixels wide and 288 pixels long.

  The determination of the image type in the moving image type determination unit 301 can be performed based on, for example, detecting information related to the image type added to the input image. In addition, the determination of the image type in the moving image type determination unit 301 may be performed based on information on the image type such as a setting file given from the outside before encoding.

  Further, the determination of the image type in the moving image type determination unit 301 may be performed based on the result of analyzing the relationship between the luminance values of the input images as follows. For example, a left field image and a right field image are created by alternately separating input images for each vertical column, and the correlation between the luminance values in the horizontal direction of the separated field images is a frame image before separation. When the correlation is higher than the horizontal luminance value, the input image may be determined as a stereo image. Further, for example, the input image is alternately separated for each horizontal row to create an upper field image and a lower field image, and the correlation between the vertical luminance values of the separated field images is the same as that before the separation. If it is higher than the correlation between the luminance values in the vertical direction of the frame image, the input image may be determined as an interlaced image.

  Note that the image type determination method is not limited to the method exemplified above.

  The switch 302 receives the moving image signal 309 and the stereo image identifier 310 sent from the moving image type determination unit 301. When the stereo image identifier is 1, the switch 302 sends the moving image signal 309 to the moving image rotation unit 303. When the stereo image identifier is 0, the moving image signal 309 is sent to the switch 304.

  The moving image rotating unit 303 receives the moving image signal 309 sent from the switch 302, rotates the moving image represented by the moving image signal 309 to the right by + 90 °, and each horizontal row as in the case of the interlaced moving image. Are converted into a moving image signal 311 representing a moving image in which the right eye image and the left eye image are alternately arranged, and the moving image signal 311 is sent to the switch 304.

  FIG. 5 shows an example in which the stereo moving image is rotated to the right by + 90 ° by the moving image rotating unit 303, and FIG. 5A shows a moving image represented by the moving image signal 309 sent from the switch 302. FIG. 5B shows a moving image obtained by rotating the moving image of FIG. 5A to the right by + 90 °. Note that FIG. 5 shows an example in which the input image is 352 pixels wide and 288 pixels long.

  The switch 304 selects one of the moving image signal 311 transmitted from the moving image rotation unit 303 and the moving image signal 309 transmitted from the switch 302 based on the stereo image identifier 310 transmitted from the moving image type determination unit 301. select. That is, the switch 304 displays the moving image signal 311 sent from the moving image rotation unit 303 when the stereo image identifier 310 is 1, and the moving image signal 309 sent from the switch 302 when the stereo image identifier 310 is 0. , Respectively, and the selected moving image signal is sent to the moving image interlace coding unit 305 as a moving image signal 312.

  The moving image interlace encoding unit 305 receives the moving image signal 312 transmitted from the switch 304 and performs interlace encoding of the moving image to generate an encoded bit stream 313. Then, the moving image interlace encoding unit 305 sends the generated encoded bit stream 313 to the multiplexing unit 307. An example of an interlace encoding method used in the moving image interlace encoding unit 305 is H.264. H.264 / AVC coding (Joint Video Team (JVT) of ISO / IEC MPEG and ITU-VCEG, “Editor's Proposed Draft Text Modifications for Joint Video Specification (ITU-T Rec.H.264 | ISO / IEC 14496-10 AVC ), See Geneva modifications draft 37 ”). However, the above H.P. Not only the H.264 / AVC encoding method but also any encoding method corresponding to the encoding of the interlaced image can be applied.

  The stereo image identifier encoding unit 306 encodes the stereo image identifier 310 sent from the moving image type determination unit 301 and sends the code 314 obtained by the encoding to the multiplexing unit 307.

  The multiplexing unit 307 multiplexes the encoded bit stream 313 sent from the moving image interlace coding unit 305 and the stereo image identifier code 314 sent from the stereo image identifier coding unit 306, and obtains them by multiplexing. The transmitted bit stream is transmitted to the outside as a multiplexed encoded bit stream 315.

  6 to 9 show examples of the multiplexed encoded bit stream 315 transmitted to the outside.

  The multiplexed encoded bit stream 315 includes, after a synchronization signal indicating the head of each sequence, encoding information (sequence header) regarding the entire moving image, encoding information (frame header) regarding each frame of the moving image, and code of the moving image. Encoding information (slice header) related to each slice obtained by combining several macroblocks as a unit of encoding, encoding information (macroblock header) related to each macroblock of a moving image, and encoding information for each macroblock are multiplexed. Configured.

  The stereo image identifier code, which is information related to the type of the input moving image, may be transmitted by being included in the sequence header as shown in FIG. 6, or may be transmitted by being included in the frame header as shown in FIG. . The stereo image identifier code may be transmitted by being included in a slice header as shown in FIG. 8, or may be transmitted by being included in a macroblock header as shown in FIG.

  The moving image rotating unit 303 receives the moving image signal 309 sent from the switch 302 and rotates the moving image represented by the moving image signal 309 shown in FIG. 5A to the right by −90 ° (ie, The image is converted to a moving image signal 311 representing a moving image (see FIG. 5C) in which a left eye image and a right eye image are alternately arranged for each horizontal line in the same manner as an interlaced moving image. The moving image signal 311 may be sent to the switch 304.

  Whether the moving image rotation unit 303 rotates the moving image signal 309 sent from the switch 302 to the right by + 90 ° or −90 ° depends on a predetermined rotation method.

  Information indicating whether the moving image rotation unit 303 rotates the moving image signal 309 to the right by + 90 ° or −90 ° is multiplexed and encoded with a stereo image identifier as information related to moving image encoding. The bit stream 315 may be transmitted. For example, when the stereo image identifier is 1 and the moving image rotation unit 303 converts the moving image signal 309 sent from the switch 302 to the moving image signal 311 by rotating the moving image signal 309 to the right by + 90 °, the code “10” is displayed. When the identifier is 1 and the moving image rotation unit 303 converts the moving image signal 309 sent from the switch 302 to the moving image signal 311 by rotating the moving image signal 309 to the right by −90 °, the code “11” is set, and the stereo image identifier is 0. In this case, the code “0” may be multiplexed by the multiplexing unit 307 together with the stereo image identifier as information relating to the encoding of the moving image and transmitted as a multiplexed encoded bit stream 315.

(Operation of video encoding device)
Next, the operation of the moving picture coding apparatus 30 according to the present invention will be described with reference to FIG.

  First, the moving image type determination unit 301 determines whether or not the moving image is a stereo image as the image type determination of the input moving image (step S1001). If the input moving image is a stereo image, the moving image type determining unit 301 sets the stereo image identifier to “1” (step S1002), and the moving image rotating unit 303 follows a predetermined rotation method. The input moving image is rotated to the right by + 90 ° or −90 ° (step S1004). On the other hand, when the input moving image is not a stereo image, the moving image type determination unit 301 sets the stereo image identifier to “0” (step S1003).

  As described above, the switch 304 uses the moving image signal 311 sent from the moving image rotation unit 303 when the stereo image identifier 310 is 1 and the moving image sent from the switch 302 when the stereo image identifier 310 is 0. Each of the signals 309 is selected, and the selected moving image signal is sent to the moving image interlace coding unit 305 as a moving image signal 312.

  The moving image interlace encoding unit 305 that has received the moving image signal 312 performs interlace encoding of the moving image (step S1005), and generates an encoded bit stream 313. Also, the stereo image identifier encoding unit 306 encodes the stereo image identifier (step S1006), and generates encoded information 314.

  Finally, the multiplexing unit 307 multiplexes the encoded bit stream 313 and the encoded information 314 to create a multiplexed encoded bit stream 315 (step S1007), and ends the process of FIG.

(Configuration of video decoding device)
Next, the moving picture decoding apparatus according to the present invention will be described with reference to FIG. The moving image decoding apparatus 110 according to the present invention includes, as its functional components, a separating unit 1101, a moving image interlace decoding unit 1102, a stereo image identifier decoding unit 1103, a switch 1104, and a moving image inverse unit. A rotating unit 1105 and a switch 1106 are provided.

  The separation unit 1101 separates the input multiplexed encoded bit stream 315 into a moving image encoded bit stream 1107 and a stereo image identifier code 1108, and the encoded bit stream 1107 is converted into a moving image interlace decoding unit 1102. The stereo image identifier code 1108 is sent to the stereo image identifier decoding unit 1103.

  The moving image interlace decoding unit 1102 obtains a moving image signal 1109 by decoding the encoded bit stream of the moving image sent from the separation unit 1101. Then, the moving image interlace decoding unit 1102 sends the moving image signal 1109 obtained by decoding to the switch 1104. An example of the interlace decoding method used in the moving image interlace decoding unit 1102 is H.264. H.264 / AVC decoding method. However, H. Not only the H.264 / AVC decoding method but also any decoding method corresponding to decoding of interlaced images can be applied.

  Stereo image identifier decoding section 1103 decodes stereo image identifier code 1108 sent from demultiplexing section 1101, and sends the decoded stereo image identifier 1110 to switch 1104 and switch 1106.

  The switch 1104 receives the moving image signal 1109 sent from the moving image interlace decoding unit 1102 and the stereo image identifier 1110 sent from the stereo image identifier decoding unit 1103. When the stereo image identifier is 1, The moving image signal 1109 is sent to the moving image reverse rotation unit 1105, and if the stereo image identifier is 0, the moving image signal 1109 is sent to the switch 1106.

  The moving image reverse rotation unit 1105 receives the moving image signal 1109 sent from the switch 1104 and rotates the moving image represented by the moving image signal 1109 shown in FIG. 12 (c) is converted into a moving image signal 1110 in which a right eye image and a left eye image are alternately arranged for each vertical column, and the moving image signal 1110 is sent to the switch 1106. The moving image reverse rotation unit 1105 corresponds to a “processing control unit” recited in the claims. Note that FIG. 12 shows an example in which the input image is 352 pixels wide and 288 pixels long.

  Based on the stereo image identifier 1110 sent from the stereo image identifier decoding unit 1103, the switch 1106 is based on the moving image signal 1111 sent from the moving image reverse rotation unit 1105 and the moving image signal 1109 sent from the switch 1104. Select one. That is, the switch 1106 displays the moving image signal 1111 sent from the moving image reverse rotation unit 1105 when the stereo image identifier 1110 is 1, and the moving image signal 1109 sent from the switch 1104 when the stereo image identifier 1110 is 0. Are selected, and the selected moving image signal is output as a moving image signal 1112 to a display device (not shown) at a predetermined timing to reproduce the input video signal.

  The moving image reverse rotation unit 1105 receives the moving image signal 1109 sent from the switch 1104 and rotates the moving image represented by the moving image signal 1109 shown in FIG. 12B to the left by −90 °. Thus, the moving image signal 1110 may be converted to the moving image signal 1110 in which the left eye image and the right eye image are alternately arranged for each vertical column shown in FIG.

  The moving image reverse rotation unit 1105 receives the moving image signal 1109 sent from the switch 1104, and determines in advance whether to rotate the moving image represented by the moving image signal 1109 to the left by + 90 ° or −90 °. Follow the rotation method.

  In addition, the process of whether the moving image reverse rotation unit 1105 rotates the moving image signal 1109 to the left by + 90 ° or −90 ° is a multiplexed coding bit together with a stereo image identifier as information on moving image coding. You may perform based on the code | symbol contained in the stream 315. FIG. For example, the following processing may be performed. When the code relating to the moving image encoding of the multiplexed encoded bit stream 315 is “10”, the stereo image identifier is set to 1, and the moving image reverse rotation unit 1105 moves the moving image signal 1109 sent from the switch 1104 to the left. Rotate + 90 °. When the code is “11”, the stereo image identifier is set to 1, and the moving image reverse rotation unit 1105 rotates the moving image signal 1109 sent from the switch 1104 to the left by −90 °. When the code is “0”, the stereo image identifier is set to 0.

(Operation of video decoding device)
Next, the operation of the moving picture decoding apparatus 110 according to the present invention will be described with reference to FIG.

  First, the separation unit 1101 receives an input multiplexed encoded bit stream and separates it into a moving image encoded bit stream 1107 and a stereo image identifier code 1108 (step S1301).

  Next, the moving image interlace decoding unit 1102 restores the moving image signal 1109 by decoding the encoded bit stream 1107 of the moving image (step S1302). Next, the stereo image identifier decoding unit 1103 restores the stereo image identifier 1110 by decoding the stereo image identifier code 1108 (step S1303).

  Next, it is determined whether or not the stereo image identifier is 1 (step S1304). If the stereo image identifier is 1, the moving image reverse rotation unit 1105 adds the restored moving image signal 1109 to the left by +90. It is rotated by 90 ° or −90 ° (step S1305). On the other hand, if the stereo image identifier is not 1, the rotation process in step S1305 is skipped and the process proceeds to step S1306 described later.

  Finally, the switch 1106 displays the moving image signal 1111 sent from the moving image reverse rotation unit 1105 when the stereo image identifier is 1, and the moving image signal 1109 sent from the switch 1104 when the stereo image identifier 1110 is 0. Are selected, and the selected moving image signal is output as a moving image signal 1112 to a display device (not shown) at a predetermined timing (step S1306).

  According to the first embodiment described above, the stereo moving image signal in which the left-eye image and the right-eye image are alternately arranged every vertical column is rotated by + 90 ° or −90 ° to obtain the same pixel arrangement as that of the interlaced image. After that, by performing interlace encoding, it is possible to improve the efficiency of data compression by utilizing the correlation between the left-eye image and the right-eye image.

  Further, the moving image rotating unit 303 rotates the stereo image by + 90 ° or −90 ° to perform interlace encoding with the same pixel arrangement as the interlaced image, and the moving image reverse rotating unit 1105 reverses the decoded image by + 90 ° or −90 °. The same image as the input image without changing the order of the lines of the decoded image signal when displaying on a parallax barrier stereoscopic video display device by rotating and restoring to a stereo image A signal can be obtained.

  Furthermore, it is the same for a stereo moving image signal in which left-eye images and right-eye images are alternately arranged for each vertical column, and an interlaced moving image signal in which odd-numbered row images and even-numbered row images are alternately arranged for each horizontal row. Can be encoded by the same moving picture encoding apparatus, and can be decoded by the same moving picture decoding apparatus, so that the apparatus can be used effectively.

  The moving image rotation unit 303 and the moving image reverse rotation unit 1105 rotate the moving image signal 309 and the moving image signal 1109 to the right by + 90 ° or −90 ° and to the left by + 90 ° or −90 °, respectively. It may rotate.

  The moving image rotating unit 303 and the moving image reverse rotating unit 1105 rotate the moving image signal 309 and the moving image signal 1109 to the right by + 90 ° or −90 ° and to the left by + 90 ° or −90 °, respectively. It may rotate.

  The moving image rotation unit 303 and the moving image reverse rotation unit 1105 rotate the moving image signal 309 and the moving image signal 1109 to the right by + 90 ° or −90 ° and to the left by + 90 ° or −90, respectively, in units of macroblocks. ° May rotate.

  In the above, an example of + 90 ° or −90 ° rotation to the right and + 90 ° or −90 ° rotation to the left is shown, but the rotation angle is not limited to these, and the vertical direction in the moving image is the horizontal direction Rotate to change to For example, a rotation pattern of + 270 ° or −270 ° rotation to the right and + 270 ° or −270 ° rotation to the left may be employed.

  In the above description, an example in which a moving image signal is rotated in a predetermined direction by the moving image rotation unit 303 and rotated in a direction opposite to the predetermined direction by the moving image reverse rotation unit 1105 (that is, reverse rotation) is shown. However, the present invention is not limited to this, and the original moving image signal may be restored by rotating the moving image reverse rotation unit 1105 in the same direction as the predetermined direction. For example, the original moving image signal may be restored by rotating the moving image signal to the right by + 90 ° by the moving image rotating unit 303 and rotating the moving image signal by + 270 ° to the right by the moving image reverse rotating unit 1105.

[Second Embodiment]
(Configuration of video encoding device)
First, the moving picture coding apparatus 140 according to the present invention will be described with reference to FIG. The moving picture encoding apparatus 140 described below is an This is an encoding device compliant with the H.264 / AVC encoding system.

  Here, an input video signal as a moving image signal input to the moving image encoding device 140 is a stereo moving image in which right-eye images and left-eye images are alternately arranged in vertical columns, or odd-numbered images and even-numbered rows. It is a moving image signal representing an interlaced moving image in which images are alternately arranged for each horizontal line. In the present embodiment, an image represented by an input moving image signal is divided into macroblocks that are square pixels having a fixed size of 16 pixels × 16 lines, and the following encoding process is performed in units of macroblocks.

  As shown in FIG. 14, the moving image coding apparatus 140 includes, as functional components, a moving image type determination unit 1401, a stereo / interlace motion detection unit 1402, a stereo / interlace motion compensation unit 1403, and a frame memory. 1404, stereo / interlace space prediction unit 1405, switch 1406, subtractor 1407, stereo / interlace orthogonal transform unit 1408, quantization unit 1409, variable length coding unit 1410, and inverse quantization unit 1411 , A stereo / interlace inverse orthogonal transform unit 1412 and an adder 1413. Hereinafter, each component will be described.

  The moving image type determination unit 1401 receives an input video signal 1421 as a moving image signal input from the outside representing a moving image to be encoded, and then displays an image represented by the input video signal 1421 (hereinafter “input image”). ) Are divided into macro blocks, and input image signals 1422 and 1423 are sent to the subtracter 1407 and the stereo / interlace motion detector 1402 in units of macro blocks, respectively. In addition, the moving image type determination unit 1401 determines whether or not the input image is a stereo image. If the input image is a stereo image, the stereo image identifier that is information regarding the type of the image is set to “1”, and the input image is not a stereo image. The stereo image identifier is set to “0”. Then, the moving image type determination unit 1401 includes information related to encoding of the entire moving image (sequence information), information related to encoding of each frame image (frame information), and each slice in which one or more macroblocks are collected. Stereo / interlace motion detection unit 1402 and variable length using information on the stereo image identifier as signal 1440 together with information on encoding in units (slice information) and information on encoding in units of macroblocks (macroblock information) The data is sent to the encoding unit 1410. In addition, the code | symbol of the said stereo image identifier may be included and transmitted in a sequence header like FIG. 6, and may be included and transmitted in a frame header like FIG. The stereo image identifier code may be transmitted by being included in a slice header as shown in FIG. 8, or may be transmitted by being included in a macroblock header as shown in FIG.

  The frame memory 1404 is a part for storing previously encoded frame image signals.

  The stereo / interlace motion detection unit 1402 is based on a signal 1440 that is a combination of information related to the type of image, sequence information, frame information, slice information, and macroblock information sent from the moving image type determination unit 1401. This is the part that performs selection and motion vector detection. H. In the H.264 / AVC encoding method, for each macroblock, as a prediction mode, a plurality of inter-frame prediction modes that perform prediction with reference to a plurality of encoded frame image signals temporally different from the input video signal; There are prepared a plurality of intra-frame prediction modes that perform spatial prediction using neighboring pixel values that have been encoded in the same space. Specifically, when the inter-frame prediction mode is selected as the prediction mode, the motion detection unit 1402 uses a plurality of codes stored in the frame memory 1404 in advance using the reference image signal 1424 and the motion vector 1442 of the adjacent block. An image signal pattern similar to the image signal pattern of the encoding target region is searched for from the encoded image within a predetermined search range. Then, a motion vector that is a spatial displacement amount between the image signal pattern of the encoding target region and the similar image signal pattern is detected.

  More specifically, when the input image is a stereo image (that is, when the stereo image identifier is set to “1”), the stereo / interlace motion detection unit 1402 converts the input image into a frame image (FIG. 15 ( a) (see FIG. 15B) and when the input image is a left field image (see FIG. 15B) and a right field image (see FIG. 15C). ) Reference) and the coding efficiency compared with the case where the inter-frame prediction is performed separately (that is, when the inter-frame prediction is performed on the field image), and the inter-frame prediction having the higher coding efficiency is selected. .

  The stereo / interlace motion detection unit 1402 converts the input image into a frame image (see FIG. 16A) when the input image is an interlaced image (that is, when the stereo image identifier is set to “0”). ) When inter-frame prediction is performed (that is, when inter-frame prediction is performed on a frame image), and the input image is an odd-numbered row image (upper field image: see FIG. 16B) and even-numbered row image (lower field image) : See FIG. 16 (c)), and the encoding efficiency is compared with the case where the inter-frame prediction is performed separately (that is, when the inter-frame prediction is performed on the field image). Select between predictions.

  The stereo / interlace motion detection unit 1402 is a motion vector difference value that is difference information between the detected motion vector and the optimal prediction motion vector (motion vector prediction value) calculated from the motion vector 1442 of the encoded adjacent block. Then, a signal 1425 including the reference frame number indicating the reference frame image signal used for motion vector detection and the selected prediction mode is sent to the variable length coding unit 1410. At the same time, the motion detection unit 1402 sends a signal 1426 including the selected prediction mode, motion vector, and reference frame number to the stereo / interlace motion compensation unit 1403.

  The stereo / interlace motion detection unit 1402 also includes information on “whether the selected prediction mode is inter-frame prediction in a frame image or inter-frame prediction in a field image”, which is a part of prediction mode information, and A signal 1441 representing information indicating whether the input image is a stereo image or an interlaced image is converted into a stereo / interlace motion compensation unit 1403, a stereo / interlace orthogonal transform unit 1408, and a stereo / interlace inverse orthogonal transform unit 1412. Send to.

  The stereo / interlace motion compensation unit 1403 uses the above-described signal 1426 sent from the stereo / interlace motion detection unit 1402 to encode an encoded image signal (reference image signal 1424) indicated by a reference frame number in the frame memory 1404. , A predicted image signal 1427 for each macroblock is generated and sent to the switch 1406.

  More specifically, the stereo / interlace motion compensation unit 1403 uses the signal 1426 sent from the stereo / interlace motion detection unit 1402 based on the signal 1441, and the reference frame number in the frame memory 1404. The predicted image signal 1427 of each macroblock is created with reference to the encoded image signal (reference image signal 1424) shown.

  When the input image is a stereo image (when the stereo image identifier is “1”) and the selected prediction mode is “inter-frame prediction with a frame image”, the stereo / interlace motion compensation unit 1403 selects the encoding target. After performing motion compensation using a macroblock as one frame image, a predicted image signal 1427 is created. In addition, when the input image is a stereo image and the selected prediction mode is “interframe prediction with a field image”, the stereo / interlace motion compensation unit 1403 converts the macroblock to be encoded into a left field image and a right field. After performing motion compensation for each image, a predicted image signal 1427 is generated by alternately arranging the predicted image signal of the left field and the predicted image signal of the right field for each vertical column.

  When the input image is an interlaced image (when the stereo image identifier is “0”) and the selected prediction mode is “inter-frame prediction with a frame image”, the stereo / interlace motion compensation unit 1403 is the encoding target. After performing motion compensation using a macroblock as one frame image, a predicted image signal 1427 is created. When the input image is an interlaced image and the selected prediction mode is “interframe prediction in a field image”, the stereo / interlace motion compensation unit 1403 converts the macroblock to be encoded into an upper field image and a lower field. After performing motion compensation for each image, a predicted image signal 1427 is generated by alternately arranging the predicted image signal of the upper field and the predicted image signal of the lower field for each horizontal row.

  On the other hand, when the “intraframe prediction mode” is selected as the prediction mode, the stereo / interlace motion detection unit 1402 performs spatial prediction using pixel values of neighboring blocks that are already encoded on the same image, and performs prediction mode. Is sent to the variable length coding unit 1410. In this case, the stereo / interlace motion detection unit 1402 does not perform the process of transmitting the motion vector difference value and the reference frame number signal, which are information about temporal motion, to the variable length coding unit 1410. In addition, the stereo / interlace motion detection unit 1402 includes information on “whether the selected prediction mode is intra-frame prediction in a frame image or intra-frame prediction in a field image”, which is a part of prediction mode information, and A signal 1428 representing information indicating whether the input image is a stereo image or an interlaced image is converted into a stereo / interlace orthogonal transform unit 1408, a stereo / interlace inverse orthogonal transform unit 1412, and a stereo / interlace space prediction unit 1405. Send to.

  More specifically, when the input image is a stereo image (when the stereo image identifier is “1”), the stereo / interlace motion detection unit 1402 uses the input image as a frame image (see FIG. 15A). When prediction is performed (that is, when intra-frame prediction is performed with a frame image), an input image is separated into a left field image (see FIG. 15B) and a right field image (see FIG. 15C). The encoding efficiency is compared with the case where intra-frame prediction is performed (that is, when intra-frame prediction is performed on a field image), and the intra-frame prediction having the higher encoding efficiency is selected.

  Also, when the input image is an interlaced image (when the stereo image identifier is “0”), the stereo / interlace motion detection unit 1402 performs intraframe prediction using the input image as a frame image (see FIG. 16A). (That is, when intra-frame prediction is performed with a frame image), and the input image is an odd-numbered row image (upper field image: see FIG. 16B) and even-numbered row image (lower field image: see FIG. 16C)) Are compared with each other when the intra-frame prediction is performed separately (that is, when intra-frame prediction is performed with a field image), and the intra-frame prediction with the higher encoding efficiency is selected.

  The stereo / interlace space prediction unit 1405 refers to the image signal (reference image signal 1429) of a neighboring block that has been encoded in the frame memory 1404 based on the signal 1428 sent from the stereo / interlace motion detection unit 1402. Then, a predicted image signal 1430 of each macro block is generated and sent to the switch 1406.

  At this time, when the input image is a stereo image (when the stereo image identifier is “1”) and the selected prediction mode is “intraframe prediction in a frame image”, the stereo / interlace space prediction unit 1405 After predicting the macroblock to be converted into a single frame image, a predicted image signal 1430 is generated. When the input image is a stereo image and the selected prediction mode is “intraframe prediction with a field image”, the stereo / interlace space prediction unit 1405 converts the macroblock to be encoded into a left field image and a right field. After performing spatial prediction separately for images, the predicted image signal 1430 is generated by alternately arranging the predicted image signal of the left field and the predicted image signal of the right field for each vertical column.

  On the other hand, when the input image is an interlaced image (when the stereo image identifier is “0”) and the selected prediction mode is “intraframe prediction with a frame image”, the stereo / interlace space prediction unit 1405 performs encoding. After spatial prediction of the target macroblock as one frame image, a predicted image signal 1430 is created. When the input image is an interlaced image and the selected prediction mode is “intraframe prediction with a field image”, the stereo / interlace space prediction unit 1405 converts the macroblock to be encoded into an upper field image and a lower field. After performing spatial prediction separately for images, the predicted image signal 1430 is generated by alternately arranging the predicted image signal of the upper field and the predicted image signal of the lower field for each horizontal row.

  The switch 1406 selects one of the predicted image signal 1427 and the predicted image signal 1430 according to the prediction mode 1431 sent from the stereo / interlace motion detection unit 1402, and sends the selected predicted image signal 1432 to the subtracter 1407. send.

  The subtractor 1407 generates a difference value (prediction residual signal 1433) between the input image signal 1422 and the predicted image signal 1432 and sends the difference value to the stereo / interlace orthogonal transform unit 1408.

  The stereo / interlace orthogonal transform unit 1408 changes the pixel arrangement of the prediction residual signal 1433 sent from the subtractor 1407 based on the signal 1428 or 1441 sent from the stereo / interlace motion detection unit 1402 to perform orthogonal transform. By doing so, an orthogonal transform coefficient 1434 is generated and sent to the quantization unit 1409.

  At this time, FIG. 17 shows the pixel arrangement of the prediction residual signal 1433 when the input image is a stereo image (when the stereo image identifier is “1”). When the prediction mode is “inter-frame prediction with a frame image” or “intra-frame prediction with a frame image”, the stereo / interlace orthogonal transform unit 1408 uses the pixels of the prediction residual signal 1433 as shown in FIG. The orthogonal transform is performed by dividing the block into 4 pixels × 4 lines without changing the arrangement. On the other hand, when the prediction mode is “inter-frame prediction in a field image” or “intra-frame prediction in a field image”, the stereo / interlace orthogonal transform unit 1408 performs the prediction residual signal 1433 as shown in FIG. Is changed to a pixel arrangement separated into a left field prediction residual signal and a right field prediction residual signal, and is divided into blocks of 4 pixels × 4 lines for each field, and orthogonal transformation is performed.

  On the other hand, FIG. 18 shows the pixel arrangement of the prediction residual signal 1433 when the input image is an interlaced image (when the stereo image identifier is “0”). When the prediction mode is “inter-frame prediction with a frame image” or “intra-frame prediction with a frame image”, the stereo / interlace orthogonal transform unit 1408 uses the pixels of the prediction residual signal 1433 as shown in FIG. The orthogonal transform is performed by dividing the block into 4 pixels × 4 lines without changing the arrangement. When the prediction mode is “interframe prediction with a field image” or “intraframe prediction with a field image”, the stereo / interlace orthogonal transform unit 1408 increases the prediction residual signal 1433 as shown in FIG. The pixel arrangement is divided into a field prediction residual signal and a lower field prediction residual signal, and is divided into blocks of 4 pixels × 4 lines for each field, and orthogonal transformation is performed.

  The unit of orthogonal transformation is not limited to 4 pixels × 4 lines, but can be performed in units of 16 pixels × 16 lines, 8 pixels × 8 lines, 16 pixels × 8 lines, 8 pixels × 16 lines.

  The quantization unit 1409 quantizes the orthogonal transform coefficient 1434 sent from the stereo / interlace orthogonal transform unit 1408 to generate a quantized orthogonal transform coefficient 1435, and a variable length coding unit 1410 and an inverse quantization unit 1411. Send to.

  Next, the variable length coding unit 1410 performs coding including information (stereo image identifier) regarding the type of decoded image sent from the moving image type determination unit 1401, sequence information, frame information, slice information, and macroblock information. A signal 1440 combining information on the information, a quantized orthogonal transform coefficient 1435 sent from the quantizing unit 1409, and a signal 1425 containing a prediction mode, a motion vector difference value, and a reference frame number sent from the motion detecting unit 1402 Then, entropy coding is performed, multiplexed into the compressed stream 1436, and transmitted to the outside.

  In addition, the inverse quantization unit 1411 generates an orthogonal transform coefficient 1437 by performing inverse quantization on the quantized orthogonal transform coefficient 1435 sent from the quantization unit 1409, and sends it to the stereo / interlace inverse orthogonal transform unit 1412. send.

  Then, the stereo / interlace inverse orthogonal transform unit 1412 performs inverse orthogonal transform on the orthogonal transform coefficient 1437 sent from the inverse quantization unit 1411 based on the signal 1428 or 1441 sent from the stereo / interlace motion detection unit 1402. , The pixel arrangement is changed, and a prediction residual signal 1438 is generated and sent to the adder 1413.

  At this time, FIG. 19 shows the pixel arrangement change of the prediction residual signal when the input image is a stereo image (when the stereo image identifier is “1”). When the prediction mode is “inter-frame prediction with a frame image” or “intra-frame prediction with a frame image”, the stereo / interlace inverse orthogonal transform unit 1412 has 4 pixels × 4 lines as shown in FIG. The prediction residual signal 1433 is generated without changing the pixel arrangement subjected to inverse orthogonal transform for each block. On the other hand, when the prediction mode is “interframe prediction in a field image” or “intraframe prediction in a field image”, the stereo / interlace inverse orthogonal transform unit 1412 performs inverse orthogonal transform as shown in FIG. The left field prediction residual signal and the right field prediction residual signal are alternately arranged and combined for each vertical column, and a prediction residual signal 1438 is generated.

  On the other hand, FIG. 20 shows a change in the pixel arrangement of the prediction residual signal when the input image is an interlaced image (when the stereo image identifier is “0”). When the prediction mode is “inter-frame prediction with a frame image” or “intra-frame prediction with a frame image”, the stereo / interlace inverse orthogonal transform unit 1412 has 4 pixels × 4 lines as shown in FIG. The prediction residual signal 1433 is generated without changing the pixel arrangement subjected to inverse orthogonal transform for each block. On the other hand, when the prediction mode is “interframe prediction in a field image” or “intraframe prediction in a field image”, the stereo / interlace inverse orthogonal transform unit 1412 performs inverse orthogonal transform as shown in FIG. The upper field prediction residual signal and the lower field prediction residual signal are alternately arranged for each horizontal row and combined to generate a prediction residual signal 1438.

  The adder 1413 adds the prediction residual signal 1438 sent from the stereo / interlace inverse orthogonal transform unit 1412 and the prediction image signal 1432 sent from the switch 1406 to add a frame image signal 1439 that is a locally decoded image. Is sent to the frame memory 1404. The frame image signal 1439 is stored in the frame memory 1404 and used as a reference image signal in the subsequent encoding process. Information about motion vectors and reference frame numbers is also included in the reference frame image and stored at the same time.

  Next, the operation of the moving picture decoding apparatus 210 shown in FIG. 21 will be described. The moving picture decoding apparatus 210 described below is similar to the moving picture encoding apparatus 140 in the H.264 format. This is a decoding device compliant with the H.264 / AVC encoding system.

  The moving picture decoding apparatus 210 has a function of using the compressed stream 1436 output from the moving picture encoding apparatus 140 as an input signal and decoding it into an input video signal.

  As shown in FIG. 21, the moving picture decoding apparatus 210 includes, as functional components, a variable length decoding unit 2101, a stereo / interlace motion vector restoration unit 2102, a stereo / interlace motion compensation unit 2103, a frame A memory 2104, a stereo / interlace space prediction unit 2105, a switch 2106, an inverse quantization unit 2107, a stereo / interlace inverse orthogonal transform unit 2108, and an adder 2109 are configured. Hereinafter, each component will be described.

  After receiving the compressed stream 1436, the variable-length decoding unit 2101 decodes the compressed stream 1436, thereby decoding a synchronization symbol representing the head of the sequence, a sequence header, a frame header, a slice header, a macroblock header, and an image Information on the type (stereo image identifier) and “information on whether the prediction mode in units of macroblocks is inter-frame prediction in a frame image or inter-frame prediction in a field image, or the prediction mode is in a frame image The information 2134 is combined with information indicating whether the prediction is intraframe prediction or intraframe prediction in a field image, and the signal 2134 is decoded into a stereo / interlace motion vector restoration unit 2102 and a stereo / interlace space prediction unit. 2105 and stereo / interlace Sent to the orthogonal transform unit 2108. Also, the variable length decoding unit 2101 decodes the prediction mode and the quantized orthogonal transform coefficient in units of macro blocks as macro block coding information.

  When the prediction mode is the inter-frame prediction mode, the variable length decoding unit 2101 also performs decoding of the motion vector difference value and the reference frame number. The variable length decoding unit 2101 sends the decoded quantized orthogonal transform coefficient 2122 to the inverse quantization unit 2107.

  When the prediction mode is the inter-frame prediction mode, the variable length decoding unit 2101 sends a signal 2121 including the decoded prediction mode, the motion vector difference value, and the reference frame number to the stereo / interlace motion vector restoration unit 2102. At the same time, the restored prediction mode 2126 is sent to the switch 2106. On the other hand, when the prediction mode is the intraframe prediction mode, the variable length decoding unit 2101 sends the decoded prediction mode 2126 to the switch 2106 and the stereo / interlace space prediction unit 2105.

  When the prediction mode is the inter-frame prediction mode, the stereo / interlace motion vector restoration unit 2102, the signal 2134 transmitted from the variable length decoding unit 2101, the motion vector difference value, and the motion vector of the decoded adjacent block The motion vector is restored using the motion vector prediction value calculated from 2124, and the above-described signal 2134 and the signal 2123 including the motion vector, the prediction mode, and the reference frame number obtained by the restoration are stereo / interlace motion compensation units. 2103.

  More specifically, the stereo / interlaced motion vector restoration unit 2102 has a decoding target image (hereinafter referred to as “decoded image”) as a stereo image (that is, when the stereo image identifier is “1”) and the prediction mode is “ In the case of “inter-frame prediction in a frame image”, using the motion vector difference value transmitted from the variable length decoding unit 2101 and the motion vector prediction value calculated from the motion vector 2124 of the decoded adjacent block, Restores the motion vector of the frame image in units of macroblocks. On the other hand, when the decoded image is a stereo image (that is, when the stereo image identifier is “1”) and the prediction mode is “inter-frame prediction with a field image”, the motion vector transmitted from the variable length decoding unit 2101. Using the difference value and the motion vector prediction value calculated from the motion vector 2124 of the adjacent block that has been decoded, the motion vector in each field unit of the left field image and the right field image is restored.

  Also, the stereo / interlaced motion vector restoration unit 2102 has a variable length when the decoded image is an interlaced image (that is, when the stereo image identifier is “0”) and the prediction mode is “inter-frame prediction with a frame image”. Using the motion vector difference value transmitted from the decoding unit 2101 and the motion vector prediction value calculated from the motion vector 2124 of the neighboring block that has been decoded, the motion vector of the frame image in units of macroblocks is restored. On the other hand, when the decoded image is an interlaced image (that is, when the stereo image identifier is “0”) and the prediction mode is “inter-frame prediction with a field image”, the motion vector transmitted from the variable length decoding unit 2101. Using the difference value and the motion vector prediction value calculated from the motion vector 2124 of the neighboring block that has been decoded, the motion vector in each field unit of the upper field image and the lower field image is restored.

  The stereo / interlace motion compensation unit 2103 receives the reference frame transmitted from the frame memory 2104 based on the signal 2134 transmitted from the stereo / interlace motion vector restoration unit 2102, the motion vector, the prediction mode, and the reference frame number. A predicted image signal 2125 is generated using the image 2127 and sent to the switch 2106. The frame memory 2104 stores past decoded frame image signals.

  More specifically, the stereo / interlace motion compensation unit 2103, when the decoded image is a stereo image (that is, when the stereo image identifier is “1”) and the prediction mode is “inter-frame prediction with a frame image”, Based on the signal 2134 transmitted from the stereo / interlaced motion vector restoration unit 2102, the motion vector, the prediction mode, and the reference frame number, the reference image 2127 transmitted from the frame memory 2104 is used for each macroblock. The predicted image signal 2125 of the frame image is generated. On the other hand, when the decoded image is a stereo image (that is, when the stereo image identifier is “1”) and the prediction mode is “inter-frame prediction with a field image”, it is transmitted from the stereo / interlace motion vector restoration unit 2102. Based on the signal 2134, the motion vector, the prediction mode, and the reference frame number, the reference image 2127 transmitted from the frame memory 2104 is used to generate the prediction image signal for each field of the left field image and the right field image. After the generation, the predicted image signal 2125 is created by alternately arranging the predicted image signal of the left field and the predicted image signal of the right field for each vertical column.

  Also, the stereo / interlace motion compensation unit 2103, when the decoded image is an interlaced image (that is, when the stereo image identifier is “0”) and the prediction mode is “inter-frame prediction with a frame image”, is stereo / interlaced. Based on the signal 2134 transmitted from the motion vector restoration unit 2102, the motion vector, the prediction mode, and the reference frame number, a reference image 2127 transmitted from the frame memory 2104 is used to generate a frame image in units of macroblocks. The predicted image signal 2125 is generated. On the other hand, when the decoded image is an interlaced image (that is, when the stereo image identifier is “0”) and the prediction mode is “interframe prediction in a field image”, the stereo / interlace motion compensation unit 2103 is stereo / interlaced. Based on the signal 2134 transmitted from the motion vector restoration unit 2102, the motion vector, the prediction mode, and the reference frame number, the reference image 2127 transmitted from the frame memory 2104 is used, and the upper field image and the lower field image Then, the predicted image signal is generated in units of each field, and the predicted image signal 2125 is generated by alternately arranging the predicted image signal of the upper field and the predicted image signal of the lower field for each horizontal row.

  When the prediction mode is “intraframe prediction mode”, the stereo / interlace space prediction unit 2105 generates a predicted image signal 2128 by referring to the image signal (reference image signal 2127) of the encoded neighboring block. , To the switch 2106.

  More specifically, the stereo / interlace space prediction unit 2105, when the decoded image is a stereo image (that is, when the stereo image identifier is “1”) and the prediction mode is “intra-frame prediction with a frame image”, Based on the signal 2134 and the prediction mode 2126 transmitted from the variable length decoding unit 2101, a reference image 2127 transmitted from the frame memory 2104 is used to generate a predicted image signal 2128 of a frame image in units of macroblocks. . On the other hand, when the decoded image is a stereo image (that is, when the stereo image identifier is “1”) and the prediction mode is “intraframe prediction with a field image”, the stereo / interlace space prediction unit 2105 performs variable length decoding. Based on the signal 2134 transmitted from the conversion unit 2101 and the prediction mode 2126, a reference image 2127 transmitted from the frame memory 2104 is used to generate a predicted image signal for each field of the left field image and the right field image. Thereafter, the predicted image signal 2128 is generated by alternately arranging the predicted image signal of the left field and the predicted image signal of the right field for each vertical column.

  Also, the stereo / interlace space prediction unit 2105 performs variable length decoding when the decoded image is an interlaced image (that is, when the stereo image identifier is “0”) and the prediction mode is “intraframe prediction with a frame image”. Based on the signal 2134 and the prediction mode 2126 transmitted from the conversion unit 2101, a reference image 2127 transmitted from the frame memory 2104 is used to generate a predicted image signal 2128 of a frame image in units of macroblocks. On the other hand, when the decoded image is an interlaced image (that is, when the stereo image identifier is “0”) and the prediction mode is “intraframe prediction with a field image”, the stereo / interlace space prediction unit 2105 performs variable length decoding. Based on the signal 2134 transmitted from the conversion unit 2101 and the prediction mode 2126, a reference image 2127 transmitted from the frame memory 2104 is used to generate a predicted image signal for each field of the upper field image and the lower field image. Thereafter, the predicted image signal 2128 is generated by alternately arranging the predicted image signal of the upper field and the predicted image signal of the lower field for each horizontal row.

  Next, the switch 2106 selects either the prediction image signal 2125 or the prediction image signal 2128 according to the prediction mode 2126 transmitted from the variable length decoding unit 2101, and the selected signal is used as the prediction image signal 2129. Send to adder 2109.

  On the other hand, the inverse quantization unit 2107 dequantizes the quantized orthogonal transform coefficient 2122 transmitted by the variable length decoding unit 2101 to restore the quantized orthogonal transform coefficient 2122 to the orthogonal transform coefficient 2130, and The data is sent to the interlace inverse orthogonal transform unit 2108.

  The stereo / interlace inverse orthogonal transform unit 2108 performs inverse orthogonal transform on the orthogonal transform coefficient 2130 to decode the orthogonal transform coefficient 2130 into the prediction residual signal 2131.

  A more detailed description of the stereo / interlace inverse orthogonal transform unit 2108 is the same as that of the stereo / interlace inverse orthogonal transform unit 1412 of the moving picture coding apparatus 140, and therefore will be described again using FIGS. 19 and 20.

  FIG. 19 shows the pixel arrangement change of the prediction residual signal when the input image is a stereo image (that is, when the stereo image identifier is “1”). When the prediction mode is “inter-frame prediction with a frame image” or “intra-frame prediction with a frame image”, the stereo / interlace inverse orthogonal transform unit 2108 has 4 pixels × 4 lines as shown in FIG. The prediction residual signal 2131 is generated without changing the pixel arrangement subjected to inverse orthogonal transform for each block. On the other hand, when the prediction mode is “interframe prediction in a field image” or “intraframe prediction in a field image”, the stereo / interlace inverse orthogonal transform unit 2108 performs inverse orthogonal transform as shown in FIG. A prediction residual signal 2131 is generated by alternately synthesizing the left field prediction residual signal and the right field prediction residual signal for each vertical column.

  Further, FIG. 20 shows the pixel arrangement change of the prediction residual signal when the input image is an interlaced image (that is, when the stereo image identifier is “0”). When the prediction mode is “inter-frame prediction with a frame image” or “intra-frame prediction with a frame image”, the stereo / interlace inverse orthogonal transform unit 2108 has 4 pixels × 4 lines as shown in FIG. The prediction residual signal 2131 is generated without changing the pixel arrangement subjected to inverse orthogonal transform for each block. On the other hand, when the prediction mode is “interframe prediction with a field image” or “intraframe prediction with a field image”, the stereo / interlace inverse orthogonal transform unit 2108 performs inverse orthogonal transform as shown in FIG. A prediction residual signal 2131 is generated by alternately combining the upper field prediction residual signal and the lower field prediction residual signal for each horizontal row.

  The adder 2109 adds the predicted image signal 2129 transmitted from the switch 2106 and the predicted residual signal 2131 transmitted from the stereo / interlace inverse orthogonal transform unit 2108 to decode the frame image signal 2132. The adder 2109 corresponds to the “image data generation unit” recited in the claims, and the frame image signal 2132 corresponds to the “image data” recited in the claims.

  The decoded frame image signal 2132 is stored in the frame memory 2104 as a reference frame image signal for use in subsequent decoding processing. Here, the frame image signal 2132 has the same value as the frame image signal 1439 having the same number in the moving image encoding device 140. Information about motion vectors and reference frame numbers is also included in the reference frame image signal and stored simultaneously.

  Finally, the frame image signal 2133 is output to a display device (not shown) at a predetermined display timing, and an input video signal (moving image signal) 1421 is reproduced.

  According to the second embodiment described above, as a frame image or a field image composed of a left field and a right field, a stereo moving image signal in which a left-eye image and a right-eye image are alternately arranged every vertical column. By performing the encoding and decoding, it is possible to improve the efficiency of data compression by utilizing the correlation between the left eye image and the right eye image.

  In addition, since an output image having the same pixel arrangement as the input stereo moving image signal is obtained, the order of the lines of the image signal after decoding processing is changed when displaying on a parallax barrier type stereoscopic moving image display device. The same image signal as the input image can be obtained without correction.

  Furthermore, it is the same for a stereo moving image signal in which left-eye images and right-eye images are alternately arranged for each vertical column, and an interlaced moving image signal in which odd-numbered row images and even-numbered row images are alternately arranged for each horizontal row. Can be encoded by the same moving picture encoding apparatus, and can be decoded by the same moving picture decoding apparatus, so that the apparatus can be used effectively.

  In the above, an example is shown in which the input image is divided into two field images obtained by dividing the input image vertically into two or divided into two horizontally, and inter-frame prediction or intra-frame prediction is performed. The input image separation method is not limited to this, and the input image may be separated by an oblique boundary line, or may be separated into three or more in the vertical direction, or three in the horizontal direction. You may isolate | separate above.

  Now, the encoding processing program and the decoding processing program of each of the above embodiments will be outlined below with reference to FIGS.

  FIG. 22 shows a configuration of a moving image encoding program 910 related to the moving image encoding process of the first embodiment. As shown in FIG. 22, the moving image encoding program 910 includes a main module 911 that supervises processing, a moving image type determination module 912, a moving image rotation module 913, a moving image interlaced encoding module 914, and a stereo. An image identifier encoding module 915 and a multiplexing module 916 are provided. The functions that the moving image type determination module 912, the moving image rotation module 913, the moving image interlace encoding module 914, the stereo image identifier encoding module 915, and the multiplexing module 916 perform on the computer are the moving image types shown in FIG. This corresponds to the functions of the determination unit 301, the moving image rotation unit 303, the moving image interlace encoding unit 305, the stereo image identifier encoding unit 306, and the multiplexing unit 307.

  FIG. 23 shows the configuration of a moving picture decoding program 920 related to the moving picture decoding process of the first embodiment. As shown in FIG. 23, the moving picture decoding program 920 includes a main module 921 that supervises processing, a separation module 922, a moving picture interlace decoding module 923, a stereo picture identifier decoding module 924, and processing control. A module 925. The functions that the separation module 922, the moving image interlace decoding module 923, and the stereo image identifier decoding module 924 cause the computer to perform are the separation unit 1101, the moving image interlace decoding unit 1102, and the stereo image identifier decoding of FIG. This corresponds to the function of the unit 1103. The function that the processing control module 925 causes the computer to perform corresponds to the functions of the moving image reverse rotation unit 1105 and the switches 1104 and 1106 in FIG.

  FIG. 24 shows the configuration of a moving image encoding program 930 related to the moving image encoding process of the second embodiment. As shown in FIG. 24, the moving image encoding program 930 includes a main module 931 that controls processing, a moving image type determination module 932, a motion detection module 933, a motion compensation module 934, and a spatial prediction module 935. , An orthogonal transform module 936, a variable length encoding module 937, and an inverse orthogonal transform module 938. The functions that the moving image type determination module 932, motion detection module 933, motion compensation module 934, and spatial prediction module 935 cause the computer to perform are the moving image type determination unit 1401, the stereo / interlaced motion detection unit 1402 in FIG. This corresponds to the functions of the stereo / interlace motion compensation unit 1403 and the stereo / interlace space prediction unit 1405. The functions that the orthogonal transform module 936 causes the computer to perform correspond to the functions of the switch 1406, the subtracter 1407, and the stereo / interlace orthogonal transform unit 1408 in FIG. The functions that the variable length encoding module 937 causes the computer to perform correspond to the functions of the quantization unit 1409 and the variable length encoding unit 1410 in FIG. The functions that the inverse orthogonal transform module 938 performs on the computer correspond to the functions of the quantization unit 1409, the inverse quantization unit 1411, and the stereo / interlace inverse orthogonal transform unit 1412 in FIG.

  FIG. 25 shows the configuration of a moving picture decoding program 940 related to the moving picture decoding process of the second embodiment. As shown in FIG. 25, the moving picture decoding program 940 includes a main module 941 that supervises processing, a variable length decoding module 942, a motion vector restoration module 943, a motion compensation module 944, and a spatial prediction module 945. And an inverse orthogonal transform module 946 and an image data generation module 947. The functions that the variable length decoding module 942, motion vector restoration module 943, motion compensation module 944, and spatial prediction module 945 perform on the computer are the variable length decoding unit 2101 and stereo / interlace motion vector restoration unit shown in FIG. 2102, a stereo / interlace motion compensation unit 2103, and a stereo / interlace space prediction unit 2105. Further, the functions that the inverse orthogonal transform module 946 causes the computer to perform correspond to the functions of the inverse quantization unit 2107 and the stereo / interlace inverse orthogonal transform unit 2108 in FIG. The function that the image data generation module 947 causes the computer to perform corresponds to the function of the adder 2109 in FIG.

  Each of the above-mentioned programs may be recorded and distributed on a computer-readable recording medium (hereinafter simply referred to as “recording medium”), or a part or all of the program may be transmitted from another device to a communication line or the like. It may be configured to be received and recorded by the moving picture coding apparatus or moving picture decoding apparatus according to the present invention via a transmission medium. On the contrary, each of the above programs may be transmitted from the moving picture encoding apparatus or moving picture decoding apparatus according to the present invention to another device via a transmission medium and installed.

  DESCRIPTION OF SYMBOLS 10 ... Filter, 11 ... Liquid crystal display, 12 ... Slit board, 13 ... Left eye, 14 ... Right eye, 30, 140 ... Moving picture encoding apparatus, 110, 210 ... Moving picture decoding apparatus, 301 ... Moving picture type determination part, 302 ... Switch, 303 ... Moving image rotating unit, 304 ... Switch, 305 ... Moving image interlace coding unit, 306 ... Stereo image identifier coding unit, 307 ... Multiplexing unit, 910, 930 ... Moving image coding program, 920 , 940 ... moving picture coding program, 1101 ... separation part, 1102 ... moving picture interlace decoding part, 1103 ... stereo picture identifier decoding part, 1104 ... switch, 1105 ... moving picture reverse rotation part, 1106 ... switch, 1401 ... Moving image type determination unit, 1402... Stereo / interlace motion detection unit, 1403... Stereo / In -Race motion compensation unit, 1404 ... frame memory, 1405 ... stereo / interlace space prediction unit, 1406 ... switch, 1407 ... subtractor, 1408 ... stereo / interlace orthogonal transform unit, 1409 ... quantization unit, 1410 ... variable length coding unit , 1411: inverse quantization unit, 1412: stereo / interlace inverse orthogonal transform unit, 1413 ... adder, 2101 ... variable length decoding unit, 2102 ... stereo / interlace motion vector restoration unit, 2103 ... stereo / interlace motion compensation unit, 2104 ... Frame memory, 2105 ... Stereo / interlace space prediction unit, 2106 ... Switch, 2107 ... Inverse quantization unit, 2108 ... Stereo / interlace inverse orthogonal transform unit, 2109 ... Adder.

Claims (17)

A moving image encoding device that encodes a stereo moving image in which a right eye image and a left eye image are alternately arranged in a vertical column and an interlaced moving image in which an odd row image and an even row image are alternately arranged in a horizontal row. There,
A moving image type determination unit that determines whether the moving image to be encoded is a stereo moving image;
A moving image rotating unit that rotates the moving image by a predetermined angle in a predetermined direction so that the vertical direction in the moving image is changed to a horizontal direction when it is determined that the moving image to be encoded is a stereo moving image;
A moving image interlace encoding unit that interlace-codes a moving image determined not to be a stereo moving image and a moving image determined to be a stereo moving image and rotated by the predetermined angle;
A stereo image identifier encoding unit that encodes a stereo image identifier indicating whether the moving image to be encoded is a stereo moving image;
A multiplexed code is obtained by multiplexing a coded bitstream obtained by interlace coding by the moving image interlace coding unit and a stereo image identifier code obtained by coding by the stereo image identifier coding unit. A multiplexing unit for creating a generalized bitstream;
A video encoding device comprising:   The stereo image identifier encoding unit includes the stereo image identifier so as to encode the information related to the rotation performed on the moving image to be encoded by the moving image rotation unit. Video encoding device. A moving image encoding device that encodes a stereo moving image in which a right eye image and a left eye image are alternately arranged in a vertical column and an interlaced moving image in which an odd row image and an even row image are alternately arranged in a horizontal row. There,
A moving image type determination unit that determines a type of whether the moving image to be encoded is a stereo moving image or an interlaced moving image based on an input image signal representing the moving image to be encoded;
When the inter-frame prediction mode is selected and the type of the moving image obtained by the determination is a stereo moving image, the input image is separated into a right-eye image and a left-eye image when the inter-frame prediction is performed using the input image as a frame image. Compare the coding efficiency with the case predicted by inter-frame prediction, and if the coding efficiency of the case where the input image is frame-predicted as the frame image is higher, select `` inter-frame prediction with frame image ''. If the coding efficiency of the case where the inter-frame prediction is separated into the right-eye image and the left-eye image is higher, select “inter-frame prediction in the field image” as the prediction mode,
When the inter-frame prediction mode is selected and the type of moving image obtained by the determination is an interlaced moving image, the case of inter-frame prediction using the input image as a frame image and the input image as an odd-numbered image and an even-numbered row image Compare the encoding efficiency with the case where the inter-frame prediction is performed separately, and if the encoding efficiency of the case where the inter-frame prediction is performed using the input image as the frame image, input “inter-frame prediction with the frame image”. If the coding efficiency is higher in the case where the image is divided into an odd row image and an even row image and the inter-frame prediction is performed, select “inter-frame prediction in the field image” as the prediction mode,
When the intra-frame prediction mode is selected and the type of moving image obtained by the determination is a stereo moving image, the case where the input image is used as a frame image and the input image is separated into a right-eye image and a left-eye image. Compare the encoding efficiency with the case predicted in the frame, and if the encoding efficiency of the case predicted in the frame using the input image as the frame image is higher, select “intraframe prediction in the frame image”. If the coding efficiency of the case of intra-frame prediction separated into right-eye image and left-eye image is higher, select `` Intra-frame prediction with field image '' as the prediction mode,
When the intra-frame prediction mode is selected and the type of moving image obtained by the determination is an interlaced moving image, the case of intra-frame prediction using the input image as a frame image, and the input image as an odd-numbered image and an even-numbered row image Compare the coding efficiency with the case where the intra-frame prediction is performed separately, and if the coding efficiency of the case where intra-frame prediction is performed using the input image as the frame image, input "Intra-frame prediction with frame image". If the coding efficiency of the case where the image is separated into the odd-numbered image and the even-numbered row image and the intraframe prediction is higher, select “intraframe prediction in the field image” as the prediction mode,
When “prediction between frames in frame image” or “interframe prediction in field image” is selected as the prediction mode, a motion detection unit that detects a motion vector for the moving image to be encoded;
A motion compensation unit that performs motion compensation on the moving image based on the type of the moving image, the selected prediction mode, and the detected motion vector;
A spatial prediction unit that performs spatial prediction on the video based on the type of the video and the selected prediction mode;
Based on the type of the moving image and the selected prediction mode, an orthogonal transformation is performed on a prediction residual signal obtained as a difference between the prediction image signal obtained by the motion compensation or the spatial prediction and the input image signal. An orthogonal transform unit for performing
A variable-length encoding unit that performs predetermined image processing including variable-length encoding on the image data after the orthogonal transformation based on the type of the moving image and the selected prediction mode;
A video encoding device comprising: The moving image according to claim 3 , further comprising: an inverse orthogonal transform unit that performs predetermined image processing including inverse orthogonal transform on the image data after the orthogonal transform based on the type of the moving image and the selected prediction mode. Image encoding device. The motion detection unit, when the encoding target moving image is a stereo moving image and predicts the encoding target region as a field image based on the selected prediction mode, the encoding target region is a left field image and a right field image. 4. The moving picture encoding apparatus according to claim 3 , wherein a motion vector is detected for each of the left and right separated fields. The motion compensation unit, when the moving image to be encoded is a stereo moving image and predicts the encoding target region as a field image based on the selected prediction mode, the encoding target region is a left field image and a right field image. 4. The moving picture coding apparatus according to claim 3 , wherein motion compensation is performed for each of the fields separated into left and right as described above. The spatial prediction unit, when the encoding target moving image is a stereo moving image and predicts the encoding target region as a field image based on the selected prediction mode, the encoding target region is defined as a left field image and a right field image. The video encoding apparatus according to claim 3 , wherein spatial prediction is performed for each of the fields separated as left and right. The orthogonal transform unit, when the encoding target moving image is a stereo moving image and predicting the encoding target region as a field image based on the selected prediction mode, the prediction residual image based on the prediction residual signal is 4. The moving picture coding apparatus according to claim 3 , wherein orthogonal transformation is performed for each of the left and right fields separated as a left field prediction residual image and a right field prediction residual image. The inverse orthogonal transform unit, when the encoding target moving image is a stereo moving image and predicting the encoding target region as a field image based on the selected prediction mode, the image data after the orthogonal transform is a left field image 5. The moving image encoding apparatus according to claim 4 , wherein predetermined image processing including inverse orthogonal transformation is performed for each field separated into left and right as data and right field image data. A moving image decoding apparatus that decodes a stereo moving image in which right-eye images and left-eye images are alternately arranged in vertical columns and an interlaced moving image in which odd-numbered rows and even-numbered rows are alternately arranged in horizontal rows. There,
Type information indicating whether or not a moving image to be decoded is a stereo moving image, prediction mode information regarding a decoding target region, and a variable length decoding unit that decodes orthogonally transformed image data of the decoding target region;
A motion vector restoration unit that restores a motion vector of a decoding target region based on the type information and prediction mode information obtained by the decoding;
A motion compensation unit that performs motion compensation on a decoding target region based on the type information, prediction mode information, and the restored motion vector;
Based on the type information and prediction mode information, a spatial prediction unit that performs spatial prediction on a decoding target region;
Based on the type information and prediction mode information, an inverse orthogonal transform unit that performs predetermined image processing including inverse orthogonal transform on the orthogonal transformed image data of the decoding target region obtained by the decoding;
An image data generation unit that generates image data of a decoding target region from the prediction residual signal obtained by the image processing by the inverse orthogonal transform unit and the prediction image signal obtained by the motion compensation or the spatial prediction; ,
A video decoding device comprising: The motion vector restoration unit, when the decoding target moving image is a stereo moving image and predicting the decoding target region as a field image based on the prediction mode information, the decoding target region is defined as a left field image and a right field image. The moving picture decoding apparatus according to claim 10 , wherein a motion vector is restored for each field separated as left and right. The motion compensation unit, when the decoding target moving image is a stereo moving image and predicting the decoding target region as a field image based on the prediction mode information, the decoding target region as a left field image and a right field image 11. The moving picture decoding apparatus according to claim 10 , wherein motion compensation is performed for each field separated into right and left. When the decoding target moving image is a stereo moving image and the decoding target region is predicted as a field image based on the prediction mode information, the spatial prediction unit sets the decoding target region as a left field image and a right field image. The moving picture decoding apparatus according to claim 10 , wherein spatial prediction is performed for each field separated into right and left. When the moving image to be decoded is a stereo moving image and the decoding target region is predicted as a field image based on the prediction mode information, the inverse orthogonal transform unit sets the decoding target region as a left field image and a right field image. The moving picture decoding apparatus according to claim 10 , wherein inverse orthogonal transformation is performed for each field separated into right and left. A moving image encoding method for encoding a stereo moving image in which a right eye image and a left eye image are alternately arranged in a vertical column, and an interlaced moving image in which an odd row image and an even row image are alternately arranged in a horizontal row. There,
A moving image type determining step for determining whether or not the moving image to be encoded is a stereo moving image;
A moving image rotation step for rotating the moving image by a predetermined angle in a predetermined direction so that the vertical direction in the moving image is changed to the horizontal direction when it is determined that the moving image to be encoded is a stereo moving image;
A moving image interlaced encoding step for interlace encoding a moving image determined not to be a stereo moving image and a moving image determined to be a stereo moving image and rotated by the predetermined angle;
A stereo image identifier encoding step for encoding a stereo image identifier indicating whether or not the moving image to be encoded is a stereo moving image;
A multiplexing step of creating a multiplexed encoded bitstream by multiplexing the encoded bitstream obtained by the interlaced encoding and the stereo image identifier code obtained by the encoding;
A video encoding method comprising: A moving image encoding method for encoding a stereo moving image in which a right eye image and a left eye image are alternately arranged in a vertical column, and an interlaced moving image in which an odd row image and an even row image are alternately arranged in a horizontal row. There,
A moving image type determining step for determining a type of whether the moving image to be encoded is a stereo moving image or an interlaced moving image based on an input image signal representing the moving image to be encoded;
When the inter-frame prediction mode is selected and the type of the moving image obtained by the determination is a stereo moving image, the input image is separated into a right-eye image and a left-eye image when the inter-frame prediction is performed using the input image as a frame image. Compare the coding efficiency with the case predicted by inter-frame prediction, and if the coding efficiency of the case where the input image is frame-predicted as the frame image is higher, select `` inter-frame prediction with frame image ''. If the coding efficiency of the case where the inter-frame prediction is separated into the right-eye image and the left-eye image is higher, select “inter-frame prediction in the field image” as the prediction mode,
When the inter-frame prediction mode is selected and the type of moving image obtained by the determination is an interlaced moving image, the case of inter-frame prediction using the input image as a frame image and the input image as an odd-numbered image and an even-numbered row image Compare the encoding efficiency with the case where the inter-frame prediction is performed separately, and if the encoding efficiency of the case where the inter-frame prediction is performed using the input image as the frame image, input “inter-frame prediction with the frame image”. If the coding efficiency is higher in the case where the image is divided into an odd row image and an even row image and the inter-frame prediction is performed, select “inter-frame prediction in the field image” as the prediction mode,
When the intra-frame prediction mode is selected and the type of moving image obtained by the determination is a stereo moving image, the case where the input image is used as a frame image and the input image is separated into a right-eye image and a left-eye image. Compare the encoding efficiency with the case predicted in the frame, and if the encoding efficiency of the case predicted in the frame using the input image as the frame image is higher, select “intraframe prediction in the frame image”. If the coding efficiency of the case of intra-frame prediction separated into right-eye image and left-eye image is higher, select `` Intra-frame prediction with field image '' as the prediction mode,
When the intra-frame prediction mode is selected and the type of moving image obtained by the determination is an interlaced moving image, the case where intra-frame prediction is performed using the input image as a frame image, and the input image is divided into an odd-numbered image and an even-numbered row image. Compare the coding efficiency with the case where the intra-frame prediction is performed separately, and if the coding efficiency of the case where intra-frame prediction is performed using the input image as the frame image, input "Intra-frame prediction with frame image". If the coding efficiency of the case where the image is separated into the odd-numbered image and the even-numbered row image and the intraframe prediction is higher, select “intraframe prediction in the field image” as the prediction mode,
When “prediction between frames in frame image” or “interframe prediction in field image” is selected as the prediction mode, a motion detection step of detecting a motion vector for the moving image to be encoded;
A motion compensation step of performing motion compensation on the moving image based on the type of the moving image, the selected prediction mode, and the detected motion vector;
A spatial prediction step of performing spatial prediction on the moving image based on the type of the moving image and the selected prediction mode;
Based on the type of the moving image and the selected prediction mode, an orthogonal transformation is performed on a prediction residual signal obtained as a difference between the prediction image signal obtained by the motion compensation or the spatial prediction and the input image signal. Performing an orthogonal transformation step,
A variable-length encoding step for performing predetermined image processing including variable-length encoding on the image data after the orthogonal transformation based on the type of the moving image and the selected prediction mode;
A video encoding method comprising: A moving image decoding method for decoding a stereo moving image in which right-eye images and left-eye images are alternately arranged every vertical column, and an interlaced moving image in which odd-numbered rows and even-numbered rows are alternately arranged every horizontal row. There,
A variable length decoding step for decoding type information on whether or not a moving image to be decoded is a stereo moving image, prediction mode information on a decoding target region, and orthogonally transformed image data of the decoding target region;
A motion vector restoration step for restoring a motion vector of a decoding target region based on the type information and prediction mode information obtained by the decoding;
A motion compensation step for performing motion compensation on a decoding target region based on the type information, prediction mode information, and the restored motion vector;
Based on the type information and prediction mode information, a spatial prediction step for performing spatial prediction on the decoding target region;
Based on the type information and the prediction mode information, an inverse orthogonal transform step for performing predetermined image processing including inverse orthogonal transform on the orthogonally transformed image data of the decoding target region obtained by the decoding;
An image data generation step of generating image data of a decoding target region from the prediction residual signal obtained by the image processing and the prediction image signal obtained by the motion compensation or the spatial prediction;
A video decoding method comprising:

Images