JPH08307902A - Picture signal recording method/device, picture signal reproducing method/device and picture signal recording medium - Google Patents

Abstract

PURPOSE: To record and reproduce a solid picture by means of stereo vision, which has compatibility with a present-use television, in a multilayer disk through the use of compression encoding. CONSTITUTION: A picture for right-eye 301 and a picture for left-eye 302 by stereo vision are generated. They are compression-encoded by encoding devices 303 and 304 and they are recorded into the multilayer disk 305 having plural information recording layers. At that time, a picture signal for one-eye by stereo vision is constituted to be similar to a present-use television signal. At the time of reproduction, a present-use television picture is reproduced by decoding only the signal of a layer where the present-use television signal is recorded by a decoding device 306. Furthermore, the picture by stereo vision is reproduced by decoding the signal of the layer where the present-use signal is recorded as a picture for right-eye 308 and decoding the signal of the other layer as a picture for left-eye 309.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and apparatus for recording an image signal, which is suitable for recording a moving image signal on a recording medium such as a magneto-optical disk and reproducing and displaying the same. The present invention relates to a method and an apparatus and an image signal recording medium.

[0002]

2. Description of the Related Art Devices for recording and reproducing current television signals and optical disks have been put into practical use. When such a moving image signal is recorded on a recording medium such as a magneto-optical disk and is reproduced and displayed on a display or the like, in order to use the recording medium efficiently, line correlation of the image signal or inter-frame The image signal is compressed and encoded by utilizing the correlation. For this compression encoding, ISO / IEC 13818-2, which is commonly called MPEG 2 established by ISO / IEC JTC-1 / SC29 WG11, is used. If the line correlation is used, the image signal, for example, D
It can be compressed by, for example, CT (discrete cosine transform) processing. Further, by using the inter-frame correlation, the image signal can be further compressed and encoded.

[0003]

As described above, the method of compressing and coding the current television signal as moving image data and recording the same on a recording medium such as an optical disc has been put into practical use. However, stereoscopic vision using stereo images is now attracting attention, and a method for efficiently encoding, recording, reproducing, and decoding this is required. Further, since an optical disc in which the current television signal is encoded as moving image data has already been introduced to the market, compatibility with this optical disc is required.

Accordingly, an object of the present invention is to provide an image signal recording method and apparatus, a reproducing method and apparatus, which can efficiently record / reproduce stereoscopically encoded data.
Another object is to provide an image signal recording medium.

Another object of the present invention is to provide an image signal recording method and apparatus and a reproducing method capable of achieving compatibility with an optical disc in which only the current television signals already on the market are recorded. And an apparatus, and an image signal recording medium.

[0006]

SUMMARY OF THE INVENTION The present invention provides a method for recording an image signal on an optical disc having a plurality of information recording layers by utilizing compression encoding, by stereoscopic viewing.
Considering the parallax of both eyes, the image for the right eye and the image for the left eye are generated, and the first encoded data generated by compression encoding the image for the right eye is recorded in the first information recording layer of the optical disc,
This is an image signal recording method for recording second encoded data generated by compression encoding the image for the left eye on the second information recording layer of the optical disc. Further, the present invention reproduces the right-eye image by decoding the signal recorded in the first information recording layer from the optical disc recorded in this way,
The image signal reproducing method is characterized by reproducing the image for the left eye by decoding the signal recorded in the information recording layer.

[0007]

By applying the present invention, the current television signal can be decoded by decoding only the bit stream from the layer in which the current television signal is recorded. Also, by reproducing and decoding the signals from both information recording layers at the same time, it is possible to decode the stereoscopic signals.

Further, at this time, an optical disc in which only the current television signal which has already been introduced into the market is recorded,
Of the stereoscopic signals of the multi-layer disc according to the present invention, if the layers in which the image signals for one eye are recorded are configured the same, an optical disc in which only the current television signals already on the market are recorded Compatibility is realized.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. Prior to the description of the present invention, an example of compression encoding of an image signal using inter-frame correlation will be described. For example, as shown in FIG.
At 1, t2, and t3, frame images PC1 and PC
2 and PC3 respectively, the difference between the image signals of the frame images PC1 and PC2 is calculated to generate PC12, and the difference between the frame images PC2 and PC3 is calculated to generate PC23. Generally in a continuous video,
Since the images of the temporally adjacent frames do not have such a large change, when the difference between them is calculated, the difference signal has a small value. Therefore, if this difference signal is encoded, the code amount can be compressed.

However, if only the differential signal is transmitted, the original image cannot be decoded. Therefore, the image of each frame is set to any one of three types of pictures of I picture, P picture, and B picture,
The image signal is compressed and encoded. FIG. 8 shows an example of processing when compression-encoding an image signal.

In FIG. 8, image signals of 17 frames, frames F1 to F17, are set as a group of pictures, which is one unit of processing. Then, the image signal of the leading frame F1 is encoded as an I picture, the second frame F2 is processed as a B picture, and the third frame F3 is processed as a P picture. Hereinafter, the fourth and subsequent frames F4 to F17 are alternately processed as a B picture or a P picture.

As the image signal of the I picture, the image signal for one frame is encoded and transmitted as it is. On the other hand, as the image signal of the P picture, basically, as shown in FIG. 8A, the difference from the image signal of the I picture or the P picture preceding in time as the predicted image is encoded and transmitted. To do. Further, as the image signal of the B picture, basically, as shown in FIG. 8B, a difference from the average value of both the temporally preceding frame and the temporally following frame is obtained as the predicted image, and the difference is encoded. Convert and transmit.

FIG. 9 shows the principle of the method of encoding a moving image signal in this way. As shown in the figure,
Since the first frame F1 is processed as an I picture, it is transmitted as it is to the transmission path as the transmission data F1X (intra-frame coding). On the other hand, since the second frame F2 is processed as a B picture, the frame F1 that temporally precedes and the frame F that temporally follows.
The difference from the average value of 3 is calculated, and the difference is transmitted as transmission data F2X.

The process for the B picture will be described in more detail. There are four types. The first process is to transmit the data of the original frame F2 as it is as the transmission data F2X (SP1) (intra coding), which is the same process as in the I picture. The second process is to calculate a difference from a frame F3 that is temporally following and transmit the difference (SP2) (backward predictive coding). The third process is to transmit a difference (SP3) from the temporally preceding frame F1 (forward predictive coding). Further, the fourth processing generates a difference (SP4) between the average value of the frame F1 preceding in time and the average value of the frame F3 following in time, and uses this as the transmission data F2.
It is transmitted as X (bidirectional predictive coding). Of these four methods, the method with the least amount of transmission data is adopted.

When transmitting the difference data, the motion vector x1 (frame F1) between the image of the current frame and the image of the frame for which the difference is to be calculated (predicted image).
Between F and F2) (for forward prediction) or x2 (motion vector between frames F3 and F2)
Either (for backward prediction) or both x1 and x2 (for bidirectional prediction) are transmitted with the difference data.

In the frame F3 of the P picture, the frame F1 temporally preceding is used as a predicted image to calculate a difference signal (SP3) from the frame and a motion vector x3, which is transmitted as transmission data F3X. (Forward predictive coding). Alternatively, the data of the original frame F3 is directly transmitted as the transmission data F3X (S
P1) (intra coding). As in the case of the B picture, whichever method is used for transmission is selected so that less transmission data is transmitted.

FIG. 10 shows an example of the configuration of an apparatus for encoding and transmitting a moving image signal and decoding it based on the above-mentioned principle. The encoding device 1 encodes the input video signal and transmits it to the recording medium 3 as a transmission path. Here, an optical disc is assumed as the recording medium 3. Then, the decoding device 2 reproduces the signal recorded on the recording medium 3, decodes the signal, and outputs the decoded signal.

In the encoding device 1, the input video signal is input to the pre-processing circuit 11, where the luminance signal and the chrominance signal (color difference signal in this example) are separated.
A / D conversion is performed by the / D converters 12 and 13. The video signal converted into a digital signal by A / D conversion by the A / D converters 12 and 13 is supplied to and stored in the frame memory 14. In the frame memory 14, the luminance signal is stored in the luminance signal frame memory 15, and the color difference signal is stored in the color difference signal frame memory 16.

The format conversion circuit 17 converts the frame format signal stored in the frame memory 14 into a block format signal. That is, FIG. 11A
As shown in FIG. 5, the video signal stored in the frame memory 14 is frame format data in which V lines of H dots are collected per line. The format conversion circuit 17 converts this 1-frame signal into 1
It is divided into N slices in units of 6 lines. Then, as shown in FIG. 11B, each slice is divided into M macroblocks. Each macroblock is 16x16
It is composed of luminance signals corresponding to individual pixels (dots). This luminance signal is further 8 × as shown in FIG. 11C.
The blocks are divided into blocks Y [1] to Y [4] in units of 8 dots. Then, the luminance signal of 16 × 16 dots includes a Cb signal of 8 × 8 dots and a Cr signal of 8 × 8 dots.
The signals are matched.

The signal thus converted into the block format is supplied from the format conversion circuit 17 to the encoder 18, where it is encoded. The details will be described later with reference to FIG.

The signal encoded by the encoder 18 is recorded as a bit stream on the recording medium 3, for example. Here, an optical disc is used as the recording medium 3.
The bitstream is recorded.

The data reproduced from the optical disk of the recording medium 3 is supplied to the decoder 31 of the decoding device 2 and decoded (decoded). Details of the decoder 31 will be described later with reference to FIG.

The data decoded by the decoder 31 is input to the format conversion circuit 32 and converted from a block format signal to a frame format signal. The luminance signal of the frame format is stored in the luminance signal frame memory 34 of the frame memory 33.
Are stored and stored in. Further, the color difference signal is supplied to and stored in the color difference signal frame memory 35. The luminance signal and the color difference signal read from the luminance signal frame memory 34 and the color difference signal frame memory 35 are respectively D / A converted by the D / A converters 36 and 37, supplied to the post-processing circuit 38, and combined. It Then, it is output and displayed on a display (not shown) such as a CRT.

Next, referring to FIG. 12, the encoder 18
An example of the configuration will be described. The image data to be encoded is the motion vector detection circuit 50 in macroblock units.
Is input to The motion vector detection circuit 50 processes the image data of each frame as an I picture, P picture, or B picture according to a predetermined sequence.
The images of each frame that are sequentially input are
As to which picture of P or B is to be processed, for example, as shown in FIG. 8, the group of pictures composed of the frames F1 to F17 is I, B, P,
It is predetermined to be processed as B, P, ... B, P.

The image data of the frame (for example, the frame F1) processed as the I picture is transmitted from the motion vector detecting circuit 50 to the front original image portion 51a of the frame memory 51.
The image data of the frame (for example, frame F2) that is transferred and stored in the reference original image section 51b is the image data of the frame (for example, frame F3) that is transferred and stored in the reference original image portion 51b. , And is transferred to and stored in the rear original image portion 51c.

At the next timing, B
When an image of a frame to be processed as a picture (frame F4) or P picture (frame F5) is input, the image data of the first P picture (frame F3) stored in the backward original image portion 51c until then is It is transferred to the front original image portion 51a, and the next B picture (frame F
The image data of 4) is stored (overwritten) in the reference original image portion 51b, and the image data of the next P picture (frame F5) is stored (overwritten) in the backward original image portion 51c. Such an operation is sequentially repeated.

The signal of each picture stored in the frame memory 51 is read therefrom, and the prediction mode switching circuit 52 performs the frame prediction mode process or the field prediction mode process. Furthermore, under the control of the prediction determination circuit 54, the calculation unit 53 performs calculation of intra-picture prediction, forward prediction, backward prediction, or bidirectional prediction. Which of these processes is to be performed is determined in accordance with the prediction error signal (difference between the reference image to be processed and the predicted image corresponding thereto). Therefore, the motion vector detection circuit 50 generates the sum of absolute values (or the sum of squares) of the prediction error signal used for this determination.

Here, the frame prediction mode and field prediction mode in the prediction mode switching circuit 52 will be described.

When the frame prediction mode is set, the prediction mode switching circuit 52 supplies the four luminance blocks Y supplied from the motion vector detection circuit 50.
[1] to Y [4] are directly output to the arithmetic unit 53 in the subsequent stage. That is, in this case, as shown in FIG. 13A, the data of the odd field lines and the data of the even field lines are mixed in each luminance block. In this frame prediction mode,
Prediction is performed in units of four luminance blocks (macro blocks), and one motion vector corresponds to each of the four luminance blocks.

On the other hand, when the field prediction mode is set, the prediction mode switching circuit 52
13A shows the signal input from the motion vector detection circuit 50 in the configuration shown in FIG. 13A, as shown in FIG. 13B, among the four luminance blocks, luminance blocks Y [1] and Y [2].
Is composed of only the data of the lines of the odd field, and the other two luminance blocks Y [3] and Y [4] are
It is composed only of the data of the even field lines and is output to the arithmetic unit 53. In this case, one motion vector is associated with the two luminance blocks Y [1] and Y [2], and the other two luminance blocks Y [3] and Y [3].
Another motion vector is associated with [4].

The motion vector detection circuit 50 outputs the sum of absolute values of prediction errors in the frame prediction mode and the sum of absolute values of prediction errors in the field prediction mode to the prediction mode switching circuit 52. Prediction mode switching circuit 5
2 compares the sum of absolute values of prediction errors in the frame prediction mode and the field prediction mode, performs processing corresponding to the prediction mode having a smaller value, and calculates the data by the arithmetic unit 5.
Output to 3.

However, such processing is actually performed by the motion vector detection circuit 50. That is, the motion vector detection circuit 50 outputs a signal having a configuration corresponding to the determined mode to the prediction mode switching circuit 52, and the prediction mode switching circuit 52 outputs the signal as it is to the arithmetic unit 53 in the subsequent stage.

In the frame prediction mode, the color difference signal is supplied to the arithmetic unit 53 in a state where the data of the odd field lines and the data of the even field lines are mixed, as shown in FIG. 14A. In the field prediction mode, as shown in FIG. 14B, the upper four lines of each color difference block Cb, Cr are the luminance block Y.
Color difference signals of odd fields corresponding to [1] and Y [2], and the lower four lines are luminance blocks Y [3],
The color difference signal of the even field corresponding to Y [4] is used.

Further, the motion vector detection circuit 50 uses the prediction determination circuit 54 to predict the intra-image,
A sum of absolute values of prediction errors for determining whether to perform forward prediction, backward prediction, or bidirectional prediction is generated.

That is, the sum ΣAij of the signals Aij of the macroblocks of the reference image is used as the sum of the absolute values of the prediction errors of the intra-picture prediction.
The absolute value | ΣAij | of the macroblock and the sum Σ | Aij | of the absolute values | Aij | of the signal Aij of the macroblock are calculated. Also, as the sum of absolute values of prediction errors in forward prediction, the sum Σ | of the absolute value | Aij-Bij | of the difference Aij-Bij between the signal Aij of the macroblock of the reference image and the signal Bij of the macroblock of the predicted image.
Aij-Bij | is calculated. Further, the sum of absolute values of prediction errors between the backward prediction and the bidirectional prediction is also obtained in the same manner as in the case of forward prediction (changing the predicted image into a different predicted image from that in forward prediction).

The sum of these absolute values is supplied to the prediction determination circuit 54. The prediction determination circuit 54 selects the smallest sum of absolute values of prediction errors of forward prediction, backward prediction, and bidirectional prediction as the sum of absolute values of prediction errors of inter prediction. Furthermore, the sum of absolute values of the prediction error of the inter prediction and the sum of absolute values of the prediction error of the intra-picture prediction are compared, the smaller one is selected, and the mode corresponding to the selected sum of absolute values is set as the prediction mode. select. That is, if the sum of absolute values of prediction errors in intra-picture prediction is smaller, the intra-picture prediction mode is set. If the sum of absolute values of prediction errors in inter prediction is smaller, the mode in which the corresponding sum of absolute values is the smallest is set among the forward prediction, backward prediction, and bidirectional prediction modes.

In this way, the motion vector detection circuit 50
Supplies the signal of the macroblock of the reference image to the arithmetic unit 53 via the prediction mode switching circuit 52 in a configuration corresponding to the mode selected by the prediction mode switching circuit 52 among the frame or field prediction modes. Of the four prediction modes, the prediction determination circuit 54
The motion vector between the prediction image and the reference image corresponding to the prediction mode selected by is detected, and this motion vector is output to the variable length coding circuit 58 and the motion compensation circuit 64.
As described above, the motion vector that minimizes the sum of absolute values of the corresponding prediction errors is selected.

When the motion vector detection circuit 50 is reading the image data of the I picture from the front original image portion 51a, the prediction determination circuit 54 uses the intra-frame (image) prediction mode (the mode in which motion compensation is not performed) as the prediction mode. ) Is set, and the switch 53d of the calculation unit 53 is switched to the contact a side. As a result, the image data of the I picture is DCT
It is input to the mode switching circuit 55.

The DCT mode switching circuit 55, as shown in FIG. 14A or B, is a state in which lines of four luminance blocks are mixed with lines of odd fields and lines of even fields (frame DCT mode), or One of the separated states (field DCT mode) is output to the DCT circuit 56.

That is, the DCT mode switching circuit 55 is
Mixed data of odd field and even field D
Comparing the coding efficiency in the case of CT processing and the coding efficiency in the case of DCT processing in the separated state,
Select a mode with good coding efficiency.

For example, as shown in FIG. 14A, the input signal has a structure in which odd field lines and even field lines are mixed, and the difference between the signal of the odd field line and the signal of the even field line that are vertically adjacent to each other. Is calculated, and the sum (or sum of squares) of the absolute values is calculated.
Also, as shown in FIG. 14B, the input signal has a configuration in which the lines of the odd field and the even field are separated, and the difference between the signals of the odd field lines vertically adjacent to each other and the signal of the line of the even field are Then, the sum of the absolute values (or the sum of squares) is calculated.
Further, both the sum of absolute values obtained by the data structure of FIG. 14A and the sum of absolute values obtained by the data structure of FIG. 14B are compared, and the DCT mode corresponding to a smaller value is set. That is, if the former is smaller, the frame DC
Set the T mode, and if the latter is smaller, set the field DCT mode.

Then, the data having the structure corresponding to the selected DCT mode is output to the DCT circuit 56, and the DCT flag indicating the selected DCT mode is output to the variable length coding circuit 58 and the motion compensation circuit 64.

The prediction mode in the prediction mode switching circuit 52 (FIG. 13) and the DCT mode switching circuit 5
As is clear by comparing the DCT modes in FIG. 5 (FIG. 14), the data structures in both modes are substantially the same for the luminance block.

When the frame prediction mode (a mode in which odd lines and even lines are mixed) is selected in the prediction mode switching circuit 52, the frame DCT mode (in which odd lines and even lines are mixed) is also selected in the DCT mode switching circuit 55. If the field prediction mode (a mode in which the data in the odd field and the data in the even field are separated) is selected in the prediction mode switching circuit 52, the field in the DCT mode switching circuit 55 is high. There is a high possibility that the DCT mode (mode in which the data of the odd field and the data of the even field are separated) is selected.

However, such a selection is not always made, and the prediction mode switching circuit 5
In 2, the mode is determined so that the sum of the absolute values of the prediction errors is small, and in the DCT mode switching circuit 55, the mode is determined so that the coding efficiency is good.

The I-picture image data output from the DCT mode switching circuit 55 is input to the DCT circuit 56, subjected to DCT (discrete cosine transform) processing, and converted into DCT coefficients. The DCT coefficient is input to the quantization circuit 57, quantized by a quantization scale corresponding to the data storage amount (buffer storage amount) of the transmission buffer 59, and then,
It is input to the variable length coding circuit 58.

The variable length coding circuit 58 is a quantization circuit 57.
The image data (in this case, I picture data) supplied from the quantization circuit 57 is converted into a variable-length code such as Huffman code corresponding to the supplied quantization scale, and is sent to the transmission buffer 59. Output.

The variable length coding circuit 58 also determines whether a quantization scale is set by the quantization circuit 57 and a prediction mode (intra-picture prediction, forward prediction, backward prediction, or bidirectional prediction is set by the prediction determination circuit 54). Mode), a motion vector from the motion vector detection circuit 50, a prediction flag (a flag indicating whether the frame prediction mode or the field prediction mode has been set) from the prediction mode switching circuit 52, and the DCT output from the DCT mode switching circuit 55. A flag (a flag indicating whether the frame DCT mode or the field DCT mode is set) is input, and these are also variable length coded.

The transmission buffer 59 temporarily stores the input data and outputs the data corresponding to the storage amount to the quantization circuit 57. The transmission buffer 59 reduces the data amount of the quantized data by increasing the quantization scale of the quantization circuit 57 by the quantization control signal when the remaining data amount increases to the allowable upper limit value. On the contrary, when the data remaining amount decreases to the allowable lower limit value, the transmission buffer 59 reduces the quantization scale of the quantization circuit 57 by the quantization control signal to reduce the data amount of the quantized data. Increase. In this way, overflow or underflow of the transmission buffer 59 is prevented. Then, the data accumulated in the transmission buffer 59 is read out at a predetermined timing, output to the transmission path, and recorded in, for example, the recording medium 3.

On the other hand, the I picture data output from the quantization circuit 57 is input to the inverse quantization circuit 60 and inversely quantized in accordance with the quantization scale supplied from the quantization circuit 57. The output of the inverse quantization circuit 60 is IDCT
After being input to the (inverse DCT) circuit 61 and subjected to inverse DCT processing, it is supplied to and stored in the forward predicted image portion 63a of the frame memory 63 via the calculator 62.

When the motion vector detection circuit 50 processes the sequentially input image data of each frame as, for example, I, B, P, B, P, B ... Pictures, it is input first. After processing the image data of another frame as an I picture, before processing the image data of the next input frame as a B picture, the image data of the next input frame is processed as a P picture. This is because a B picture is accompanied by backward prediction and cannot be decoded unless a P picture as a backward predicted image is prepared in advance.

Then, the motion vector detecting circuit 50 starts the processing of the image data of the P picture stored in the rear original image portion 51c after the processing of the I picture. Then, as in the case described above, the sum of absolute values of the inter-frame difference (prediction error) in macroblock units is supplied from the motion vector detection circuit 50 to the prediction mode switching circuit 52 and the prediction determination circuit 54. Prediction mode switching circuit 52
And the prediction determination circuit 54 sets the frame / field prediction mode, or the prediction mode of intra-picture prediction, forward prediction, backward prediction, or bidirectional prediction in accordance with the sum of the absolute values of the prediction errors of the macroblock of the P picture. To do.

When the intra-frame prediction mode is set, the arithmetic unit 53 switches the switch 53d to the contact a side as described above. Therefore, this data is similar to the I picture data in that the DCT mode switching circuit 55, the DCT
It is transmitted to the transmission line via the circuit 56, the quantization circuit 57, the variable length coding circuit 58, and the transmission buffer 59. Further, this data is supplied to and stored in the backward prediction image section 63b of the frame memory 63 via the inverse quantization circuit 60, the IDCT circuit 61, and the computing unit 62.

In the forward prediction mode, the switch 53d is switched to the contact b, and the image data (in this case, the I-picture image) stored in the forward prediction image portion 63a of the frame memory 63 is read out to move. The compensation circuit 64 compensates for the motion vector output from the motion vector detection circuit 50. That is, when the prediction determination circuit 54 instructs the motion compensation circuit 64 to set the forward prediction mode, the motion compensation circuit 64 sets the read address of the forward predicted image portion 63a to the position of the macroblock currently output by the motion vector detection circuit 50. Read data by shifting from the corresponding position by the amount corresponding to the motion vector,
Generate predicted image data.

The predicted image data output from the motion compensation circuit 64 is supplied to the calculator 53a. Calculator 53a
Subtracts the predicted image data corresponding to this macroblock supplied from the motion compensation circuit 64 from the data of the macroblock of the reference image supplied from the prediction mode switching circuit 52, and outputs the difference (prediction error). To do. This difference data is the DCT mode switching circuit 55, DC
T circuit 56, quantization circuit 57, variable length coding circuit 58,
It is transmitted to the transmission line via the transmission buffer 59. Also,
This difference data is stored in the inverse quantization circuit 60 and the IDCT circuit 6
It is locally decoded by 1 and input to the calculator 62.

The calculator 62 is also supplied with the same data as the predicted image data supplied to the calculator 53a. The calculator 62 adds the predicted image data output by the motion compensation circuit 64 to the difference data output by the IDCT circuit 61. As a result, the image data of the original (decoded) P picture is obtained. The image data of the P picture is supplied to and stored in the backward predicted image portion 63b of the frame memory 63.

In this way, the motion vector detecting circuit 50 executes the processing of the B picture after the data of the I picture and the P picture are stored in the forward prediction image section 63a and the backward prediction image section 63b, respectively. The prediction mode switching circuit 52 and the prediction determination circuit 54 correspond to the magnitude of the sum of absolute values of inter-frame differences in macroblock units,
The frame / field mode is set, and the prediction mode is set to either the intra-frame prediction mode, the forward prediction mode, the backward prediction mode, or the bidirectional prediction mode.

As described above, the switch 53d is switched to the contact a or the contact b in the intra-frame prediction mode or the forward prediction mode. At this time, the same processing as in the P picture is performed and the data is transmitted.

On the other hand, when the backward prediction mode or the bidirectional prediction mode is set, the switch 53d is switched to the contact c or the contact d, respectively.

In the backward prediction mode in which the switch 53d is switched to the contact c, the image (in this case, P picture image) data stored in the backward predicted image section 63b is read out, and the motion compensation circuit 64 is read. Thus, motion compensation is performed corresponding to the motion vector output by the motion vector detection circuit 50. That is, when the prediction determination circuit 54 instructs the motion compensation circuit 64 to set the backward prediction mode,
The read address of the backward predicted image portion 63b is shifted from the position corresponding to the position of the macro block currently output by the motion vector detection circuit 50 by the amount corresponding to the motion vector, and the data is read to generate predicted image data.

The predicted image data output from the motion compensation circuit 64 is supplied to the calculator 53b. Calculator 53b
Subtracts the predicted image data supplied from the motion compensation circuit 64 from the macroblock data of the reference image supplied from the prediction mode switching circuit 52, and outputs the difference. This difference data is stored in the DCT mode switching circuit 5
5, the DCT circuit 56, the quantization circuit 57, the variable length coding circuit 58, and the transmission buffer 59.

In the bidirectional prediction mode in which the switch 53d is switched to the contact point d, the image data (in this case, an I picture image) stored in the forward predicted image portion 63a and the backward predicted image portion 63b are stored. The image data (in this case, the image of the P picture) being read is read out, and the motion compensation circuit 64 causes the motion vector detection circuit 5
Motion compensation is performed according to the motion vector output by 0.
That is, the motion compensation circuit 64, when the bidirectional prediction mode setting is instructed by the prediction determination circuit 54, the motion vector detection circuit 50 now outputs the read addresses of the forward predicted image portion 63a and the backward predicted image portion 63b. The data is read out by shifting the amount corresponding to the motion vector (in this case, there are two for the forward prediction image and the backward prediction image) from the position corresponding to the position of the existing macroblock, and the prediction image data is generated. To do.

The predicted image data output from the motion compensation circuit 64 is supplied to the calculator 53c. Calculator 53c
Subtracts the average value of the predicted image data supplied from the motion compensation circuit 64 from the macroblock data of the reference image supplied from the motion vector detection circuit 50, and outputs the difference. This difference data is transmitted to the transmission line via the DCT mode switching circuit 55, the DCT circuit 56, the quantization circuit 57, the variable length coding circuit 58, and the transmission buffer 59. The B-picture image is not stored in the frame memory 63 because it is not used as a predicted image of another image.

In the frame memory 63, the forward predictive image portion 63a and the backward predictive image portion 63b are bank-switched as necessary, and a predetermined reference image
The one stored in one or the other can be switched and output as the forward prediction image or the backward prediction image.

In the above description, the luminance block is mainly described, but the chrominance block is similarly processed and transmitted in units of macro blocks shown in FIG. The motion vector used for processing the color difference block is obtained by halving the motion vector of the corresponding luminance block in each of the vertical direction and the horizontal direction.

Next, FIG. 15 shows a decoder 31 in FIG.
3 is a block diagram showing a configuration example of FIG. The encoded image data transmitted via the transmission path (recording medium 3) is received by a receiving circuit (not shown) or reproduced by a reproducing device.
After being temporarily stored in the reception buffer 81, it is supplied to the variable length decoding circuit 82. The variable length decoding circuit 82 performs variable length decoding on the data supplied from the reception buffer 81, the motion vector, the prediction mode, the prediction flag and the DCT flag to the motion compensation circuit 87, and the quantization scale to the dequantization circuit. And outputs the decoded image data to the inverse quantization circuit 83.

The inverse quantization circuit 83 is used in the variable length decoding circuit 8
The image data supplied from No. 2 is inversely quantized in accordance with the quantization scale supplied from the variable length decoding circuit 82 and output to the IDCT circuit 84. The data (DCT coefficient) output from the inverse quantization circuit 83 is the IDCT circuit 8
In step 4, inverse DCT processing is performed and the result is supplied to the calculator 85.

When the image data supplied from the IDCT circuit 84 is I-picture data, the data is output from the arithmetic unit 85 and input to the arithmetic unit 85 later (P or B-picture data). Is generated and supplied to the forward prediction image unit 86a of the frame memory 86 to be stored therein. Further, this data is output to the format conversion circuit 32 shown in FIG.

When the image data supplied from the IDCT circuit 84 is P picture data in which the image data one frame before is the predicted image data and is the data in the forward prediction mode, the forward prediction of the frame memory 86 is performed. The image data of one frame before (image data of I picture) stored in the image portion 86a is read out, and the motion compensation circuit 8
At 7, motion compensation corresponding to the motion vector output from the variable length decoding circuit 82 is performed. Then, in the calculator 85, the image data (difference data) supplied from the IDCT circuit 84 is added and output. The added data, that is, the decoded P picture data is
In order to generate predictive image data of image data (B-picture or P-picture data) input later to the calculator 85, it is supplied and stored in the backward predictive image section 86b of the frame memory 86.

Even in the case of P-picture data, the intra-prediction mode data is stored in the backward-prediction image section 86b as it is without any special processing by the arithmetic unit 85, like the I-picture data. Since this P picture is an image to be displayed next to the next B picture, it is not yet output to the format conversion circuit 32 at this point (as described above, the P picture input after the B picture is Processed and transmitted prior to B-pictures).

When the image data supplied from the IDCT circuit 84 is B picture data, it is stored in the forward predicted image portion 86a of the frame memory 86 in accordance with the prediction mode supplied from the variable length decoding circuit 82. Has been I
The image data of the picture (in the case of the forward prediction mode), the image data of the P picture stored in the backward prediction image portion 86b (in the case of the backward prediction mode), or both image data (in the case of bidirectional prediction mode) The motion compensation circuit 87 reads out and performs motion compensation corresponding to the motion vector output from the variable length decoding circuit 82,
A predicted image is generated. However, when motion compensation is not required (in the case of the intra-picture prediction mode), the predicted picture is not generated.

The data thus motion-compensated by the motion compensating circuit 87 is sent to the calculator 85 for IDC.
It is added to the output of the T circuit 84. This addition output is output to the format conversion circuit 32.

However, since this addition output is B picture data and is not used for generating a predicted image of another image, it is not stored in the frame memory 86.

After the B-picture image is output, the P-picture image data stored in the backward-predicted image portion 86b is read out, and the arithmetic unit 85 is passed through the motion compensation circuit 87.
Is supplied to. However, at this time, motion compensation is not performed.

The decoder 31 includes a prediction mode switching circuit 52 and a DC in the encoder 18 of FIG.
Although the circuits corresponding to the T mode switching circuit 55 are not shown, the processing corresponding to these circuits, that is, the configuration in which the signals of the lines of the odd field and the even field are separated is necessary for the original mixed configuration. The process of returning according to
The motion compensation circuit 87 executes this.

Although the processing of the luminance signal has been described above, the processing of the color difference signal is also performed in the same manner.
However, in this case, the motion vector used for the luminance signal is halved in the vertical and horizontal directions.

As described above, the present invention records / reproduces a stereo-viewable image signal by using the method of compressing and coding the current television signal as moving image data and recording it on a recording medium such as an optical disk. It is a thing. FIG.
Figure 3 shows the principle of an image viewed by stereo. Generally, stereoscopic vision is a technique for giving a stereoscopic effect to an image by giving different images to human right and left eyes in consideration of parallax.

In FIG. 1, the object 103 is projected onto the screen 104 from each viewpoint of the right eye 101 and the left eye 102 to obtain the right eye image 105 and the left eye image 106. Therefore, even when the object 103 does not actually exist, by giving the image 105 to the right eye and the image 106 to the left eye by some method, it is possible to make the object 103 look as if it were floating from the screen.

Next, FIG. 2 shows a concrete stereo image display device. The image for the right eye is displayed on the CRT 201,
Similarly, the image for the left eye is displayed on the CRT 202. These signals are projected on the screen 205 via the right-eye polarizing plate 203 and the left-eye polarizing plate 204 which are orthogonal to each other. The right eye and the left eye each have a right-eye polarization plate 203 and a right-eye polarization lens 206 corresponding to the left-eye polarization plate 204, and a left-eye polarization lens 207, respectively, and supply the corresponding right-eye and left-eye images independently.

FIG. 3 shows a stereo image coding / decoding procedure. The right-eye image 301 and the left-eye image 302 are input to the encoding devices 303 and 304, respectively encoded into bit streams, and independently recorded on the recording medium 305. As the encoding performed by the encoding devices 303 and 304, the MPEG method described above can be used, but other methods may be used.

Next, at the time of reproduction, from the recording medium 305,
The right-eye and left-eye bit streams are independently read, input to the corresponding decoding devices 306 and 307, and output to the right-eye image display device 308 and the left-eye image display device 309. An example of these devices 308 and 309 are the CRTs 201 and 202 in FIG. Then, as shown in FIG. 2 and displaying by the method described above, a stereo image is displayed.

FIG. 4 shows a method of recording and reading a single-layer optical disk 701 having a single information recording layer 702 with an optical pickup 703. This is used in the conventional system, and when simply recording the image signal of the current television system, recording and reading are performed by this system.

On the other hand, in FIG. 5, the first information recording layer 705 and the second information recording layer 706 are provided in the thickness direction of the disc, and the optical pickup 70 is provided from one side.
7 shows a single-sided dual-layer type disc 704 in which information is recorded and read by means of a recording medium 708. Of the right-eye image and the left-eye image generated by stereoscopic vision, for example, the right-eye image is configured in the same manner as the signal of the current television system, and is recorded in the first layer 705 of the single-sided dual-layer disc 704. Further, the image for the left eye is recorded on the second layer 706.

As a result, the conventional single-layer optical disk 7
In the case of a reproducing apparatus capable of reproducing 01, the current television signal is decoded by reading and decoding only the first layer 705. In addition, both information recording layers 705,
The image signals by stereoscopic vision are decoded by simultaneously reading out 706 by the optical pickups 707 and 708, combining and decoding. With this method, compatibility with a single-layer disc can be realized.

FIG. 6 shows a double-sided bonded optical disc 709 having information recording layers 710 and 711 on both sides. When the recording layer 710 on the front surface is the first layer and the recording layer 711 on the back surface is the second layer, an optical pickup 712 for recording and reading is provided for the first layer 710, and for the second layer 711. An optical pickup 713 for recording and reading is provided. In this case, one side 2
Similar to the layer-type optical disc 704, of the right-eye image and the left-eye image generated by stereoscopic vision, for example, the right-eye image is configured in the same manner as the signal of the current television system and is recorded in the first layer 710. In addition, the image for the left eye is displayed on the second layer 71.
By recording in No. 1, it is possible to achieve the effect that the image signal can be reproduced by stereoscopic viewing while maintaining compatibility.

As the recordable / reproducible optical disc, an MO (magneto-optical) disc, a PD capable of recording many times is used.
(Phase change type) disc and WO that can record once
You can use a disc. Furthermore, when considering only reproduction, a ROM type optical disk can be used. Furthermore, it is also possible to use a single-sided recording / reading optical disc which is a lamination type in which two single-layer discs are laminated with a transparent adhesive material.

[0087]

According to the present invention, in an optical disc having a plurality of information recording layers in the thickness direction of the disc or on both sides, the left and right image signals of the stereoscopic image signal are respectively recorded in different layers. Therefore, according to the present invention, a stereoscopic image can be reproduced by simultaneously reproducing and decoding the left and right image signals.

Further, according to the present invention, the current television signal and the image signal recorded in one layer are made the same so that the current television signal can be decoded by decoding only the bit stream from this layer. To be done. Therefore,
There is an advantage that compatibility with an optical disc in which only the current television signal already recorded on the market is recorded can be realized.

[Brief description of drawings]

FIG. 1 is a schematic diagram illustrating a principle diagram of a stereo image.

FIG. 2 is a schematic diagram illustrating a stereo image display device.

FIG. 3 is a schematic diagram illustrating recording / reproduction of a stereo image according to the present invention.

FIG. 4 is a schematic diagram illustrating a method of recording and reading a single-layer disc.

FIG. 5 is a schematic diagram illustrating a method for recording and reading a single-sided, dual-layer optical disc.

FIG. 6 is a schematic diagram illustrating a method of recording and reading a disc having a front surface and a back surface bonded to each other.

FIG. 7 is a schematic diagram illustrating the principle of high efficiency encoding that can be used in the present invention.

FIG. 8 is a schematic diagram illustrating a type of picture when image data is compressed.

FIG. 9 is a schematic diagram illustrating the principle of encoding a moving image signal.

[Fig. 10] Fig. 10 is a block diagram illustrating a configuration example of an image signal encoding device and a previously proposed image signal encoding device.

FIG. 11 is a diagram for explaining the format conversion operation of the format conversion circuit in FIG.

12 is a block diagram showing a configuration example of an encoder in FIG.

13 is a schematic diagram illustrating the operation of the prediction mode switching circuit of FIG.

FIG. 14 is a schematic diagram illustrating the operation of the DCT mode switching circuit 55 in FIG.

15 is a block diagram showing a configuration example of a decoder 31 in FIG.

[Explanation of symbols]

 201, 202 CRT 203 Right eye polarizing plate 204 Left eye polarizing plate 205 Screen 206 Right eye polarizing lens 207 Left eye polarizing lens 301 Right eye image 302 Left eye image 303, 304 Encoding device 305 Recording medium 306, 307 Decoding device 308 Right eye Image display device 309 Left eye image display device

Claims (15)

[Claims] 1. A method of recording an image signal on an optical disc having a plurality of information recording layers by using compression coding, wherein a right-eye image and a left-eye image generated by stereoscopic viewing in consideration of parallax between both eyes. Of the first encoded data generated by compression-encoding the right-eye image in the first information recording layer of the optical disc, and the second encoding generated by compression-encoding the left-eye image And a step of recording data on the second information recording layer of the optical disc. 2. An optical disc having a plurality of information recording layers, which is generated by compression-encoding the right-eye image among the right-eye image and the left-eye image generated by stereoscopically considering the parallax of both eyes. From the disc in which the first encoded data is recorded in the first information recording layer of the optical disc, and the second encoded data generated by compression encoding the left-eye image is recorded in the second information recording layer of the optical disc. Reproducing the right-eye image by decoding the signal recorded on the first information recording layer, and reproducing the left-eye image by decoding the signal recorded on the second information recording layer, An image signal reproducing method characterized by the above. 3. An optical disc having a plurality of information recording layers, wherein by stereoscopic vision, a right-eye image and a left-eye image are generated in consideration of parallax between both eyes, and the right-eye image is compression-encoded and generated. The first encoded data is recorded on the first information recording layer of the disc, and the second encoded data generated by compression encoding the left-eye image is recorded on the second information recording layer of the disc. A disk-shaped recording medium characterized by: 4. An apparatus for recording an image signal on an optical disc having a plurality of information recording layers by using compression coding, wherein a right-eye image and a left-eye image generated in consideration of parallax between both eyes by stereoscopic vision. Of these, means for recording the first encoded data generated by compression-encoding the image for the right eye on the first information recording layer of the optical disc, and second encoding generated by compression-encoding the image for the left eye An image signal recording device comprising means for recording data on a second information recording layer of an optical disc. 5. An optical disc having a plurality of information recording layers, which is generated by compressing and encoding a right-eye image among a right-eye image and a left-eye image generated by considering stereoscopic parallax of both eyes. From the disc in which the first encoded data is recorded in the first information recording layer of the optical disc, and the second encoded data generated by compression encoding the left-eye image is recorded in the second information recording layer of the optical disc. Means for reproducing the right-eye image by decoding the signal recorded on the first information recording layer, and reproducing the left-eye image by decoding the signal recorded on the second information recording layer An image signal reproducing device comprising: 6. The image signal recording method according to claim 1, wherein the optical disc is a single-sided multi-layer disc. 7. The image signal reproducing method according to claim 2, wherein the optical disc is a single-sided multi-layer disc. 8. The disc-shaped recording medium according to claim 3, wherein the optical disc is a single-sided multi-layer disc. 9. The image signal recording apparatus according to claim 4, wherein the optical disc is a single-sided multi-layer disc. 10. The image signal reproducing apparatus according to claim 5, wherein the optical disc is a single-sided multi-layer disc. 11. The image signal recording method according to claim 1, wherein the optical disc is a laminated double-sided disc. 12. The image signal reproducing method according to claim 2, wherein the optical disc is a laminated double-sided disc. 13. The disc-shaped recording medium according to claim 3, wherein the optical disc is a laminated double-sided disc. 14. The image signal recording apparatus according to claim 4, wherein the optical disk is a laminated double-sided disk. 15. The image signal reproducing apparatus according to claim 5, wherein the optical disk is a laminated double-sided disk.