JP3332575B2 - 3D video playback device - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an MPEG (Moti
on Picture Cording Expert Group; ISO 11172 (MPEG1), I
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional moving image reproducing apparatus that decodes and reproduces compressed and encoded data that has been compression-encoded by mixing intra-image compression and inter-image compression standardized by the SO 13818 (MPEG2)) method.

[0002]

2. Description of the Related Art Various methods have been proposed for forming a three-dimensional moving image. As a general method, there is a method in which an image for a left eye and an image for a right eye are alternately displayed on an image output device such as a television, and shutter glasses such as a liquid crystal shutter are used. This method uses the binocular parallax of the human eye. In order to create a stereoscopic image using this method, a method is used in which two cameras are placed in the direction of the human eye, and each image is alternately recorded on a recording medium. As these display methods, images of an output device such as a television are interlaced, images are displayed alternately left and right for each field or field set, and in accordance with the switching timing,
By switching the shutter set in the direction of the human eye between left and right, a three-dimensional moving image can be obtained.

In a three-dimensional image reproducing system called a lenticular lens system or an integral photography system, an image is photographed from many directions, and the image is projected from the same arrangement as at the time of photographing. It is possible to provide a three-dimensional image that is less uncomfortable than the two-channel system that simulates both eyes of a human.

However, in such a three-dimensional moving image reproducing apparatus, when a decoding error or the like occurs in image data in one image unit and decoding becomes impossible, it is no longer possible to obtain image data that cannot be decoded. Typically, this image data is skipped and the other remaining image data is decoded. Further, in order to obtain temporally next image data of image data that cannot be decoded, in the case of two channels, the image data of two images ahead and in the case of n channels, the image data of n images ahead need not be decoded. Not be. This is shown in FIG.

FIGS. 10A and 10B are explanatory diagrams showing a decoding error of stereoscopic video data and a recording order of compression-encoded data in the case of two channels. FIG. 10A shows a right-eye image and a left-eye image, and FIG. ) Shows the recording order when recording the compression-encoded data on the recording medium.

In FIG. 10, R in FIG. 10A indicates a right-eye image, and L indicates a left-eye image. (B) shows the recording order when recording the compressed and encoded data on the recording medium. 53R indicates image data that cannot be decoded due to a decoding error or the like.

[0007] Here, as shown in (b), image data is usually recorded alternately left and right, except when recording on two tracks or using two recording media. Therefore, if a decoding error occurs in one of the R or L image data, the image data cannot be decoded, and it is difficult to deal with the error. Also, in the case of a three-dimensional moving image, since a large amount of image data is required, the transfer amount of the compression-encoded data from the recording medium or the like increases, and as a result, the probability that a decoding error occurs at the time of reading is high. There is a possibility of becoming.

Now, for example, in the image data 53R,
It is assumed that reading from the recording medium has failed, or a decoding error has occurred due to the influence of the power supply or other disturbance, and decoding has been impossible. At this time, the compression-encoded data of the image data 53R is undefined. Then, assuming that the image data to be decoded next is 54R, the previously decoded 5
As a result, the decoding order jumps in time from 2R to 54R. When the output image reproduced in this way is viewed, the directional interval of the displayed subject changes greatly, and the image is not temporally connected. Also, in the case where a decoding error occurs only in a part of an image and the other part is successfully decoded, only the undecodable part becomes unnatural data. This results in discomfort to the user such as sticking.

[0009]

As described above, the conventional three-dimensional moving image reproducing apparatus converts each image data obtained by photographing from a plurality of directions into each output image corresponding to each direction. In a three-dimensional moving image reproducing apparatus that reproduces the image data by using the reproducing method, when a decoding error of reading the compressed coded data or a calculation error due to a disturbance occurs, the decoding of the image data becomes impossible. All or part of the compressed image data becomes indefinite, giving a viewer an unpleasant sensation.

Therefore, the present invention provides a three-dimensional object which does not cause discomfort to a viewer of an image display output even in a state where decoding of compressed coded data or decoding is impossible due to an operation error due to disturbance or the like. It is an object of the present invention to provide a moving image reproducing apparatus.

[0011]

According to a first aspect of the present invention, there is provided a three-dimensional moving image reproducing apparatus, comprising: a recording medium on which each image data for each photographing direction obtained by photographing a subject from a plurality of directions is recorded; Recording medium reading means for reading data, decoding means for temporarily storing and decoding the image data read by the recording medium reading means, and decoding error detection for detecting whether an error has occurred in the image data Means, a demultiplexing means for switching the image data obtained by the decoding means to transfer the image data for each channel in each shooting direction, and image data displayed on each channel obtained by the demultiplexing means. An output-side image data storage unit, and, when an error is detected in the image data, another channel in the output-side image data storage unit. It includes image data in image units and a compensating means for compensating instead of the error image data.

A three-dimensional moving image reproducing apparatus according to claim 2 is
Recording medium reading means for reading the image data from a recording medium on which each image data for each shooting direction obtained by shooting an object from a plurality of directions is recorded, and the image read by the recording medium reading means Decoding means for temporarily storing and decoding data, decoding error detecting means for detecting whether or not an error has occurred in the image data, and transferring the image data obtained by the decoding means for each channel in each shooting direction Multiplexing / demultiplexing means for switching, image data storage means for storing image data displayed on each channel obtained by the multiplexing / demultiplexing means, and when an error is detected in a specific area of the image data. In the output-side image data storage means, image data of another channel is supplemented in place of error image data in image area units. ; And a compensation means that.

[0013]

[0014]

According to a third aspect of the present invention, there is provided a three-dimensional moving image reproducing apparatus.
Recording medium reading means for reading the image data from a recording medium on which each image data for each shooting direction obtained by shooting an object from a plurality of directions is recorded, and the image read by the recording medium reading means Decoding means for temporarily storing and decoding data, decoding error detecting means for detecting whether or not an error has occurred in the image data, and transferring the image data obtained by the decoding means for each channel in each shooting direction Demultiplexing means for switching, and output-side image data storage means for storing image data displayed on each channel obtained by the demultiplexing means, and when an error is detected in the image data,
Supplementing means for acquiring image data for generating image data replacing the error image data from image data in the vicinity of the channel of the image data in which the error is detected, and supplementing the image data in place of the error image data; Is provided.

[0016]

According to a fourth aspect of the present invention, there is provided a three-dimensional moving image reproducing apparatus.
When the image data is read from a recording medium on which each image data in each shooting direction obtained by shooting a subject from a plurality of directions is recorded and decoded to obtain a reproduced image, an error occurs in a specific image data. Is detected, the image data of another channel corresponding to the error image data is supplemented in place of the error image data.

[0018]

According to a fifth aspect of the present invention, there is provided a three-dimensional moving image reproducing apparatus.
When the image data is read from a recording medium on which each image data in each shooting direction obtained by shooting a subject from a plurality of directions is recorded and decoded to obtain a reproduced image, an error occurs in a specific image data. Is detected, the image data of the channel adjacent to the channel to which the error image data belongs is supplemented in place of the error image data.

[0020]

According to the first aspect, image data or compression is performed by a recording medium reading means from a recording medium on which digital moving image data for each photographing direction obtained by simultaneously photographing a subject from a plurality of directions is recorded. Read the encoded data. Then, after the image data is once stored, the image data is obtained by decoding by the decoding means. When such a process is performed, the decoding error detection unit detects whether or not an error that disables decoding has occurred in the obtained image data. When normal image data is obtained in this way, the image data is sorted by the demultiplexing means into image data for each photographing direction and input to the output-side image data storage means before being displayed and output. When an error is detected in the image data, the compensating means compensates for the image data of another channel in the output side image data storing means instead of the error image data in image units, and outputs and displays the image data.

According to a second aspect of the present invention, image data or compression is performed by a recording medium reading means from a recording medium on which digital moving image data for each photographing direction obtained by simultaneously photographing a subject from a plurality of directions is recorded. Read the encoded data. Then, after the image data is once stored, the image data is obtained by decoding by the decoding means. When such a process is performed, the decoding error detection unit detects whether or not an error that disables decoding has occurred in the obtained image data. When normal image data is obtained in this way, the image data is sorted by the demultiplexing means into image data for each photographing direction and input to the output-side image data storage means before being displayed and output. When an error is detected in a specific area of the image data, the compensating means compensates for the image data of another channel in the output side image data storing means in place of the error image data in image area units, and outputs and displays it.

[0022]

[0023]

According to a third aspect of the present invention, image data or compression is performed by a recording medium reading means from a recording medium on which digital moving image data for each photographing direction obtained by simultaneously photographing a subject from a plurality of directions is recorded. Read the encoded data. Then, after the image data is once stored, the image data is obtained by decoding by the decoding means. When such a process is performed, the decoding error detection unit detects whether or not an error that disables decoding has occurred in the obtained image data. When normal image data is obtained in this way, the image data is sorted by the demultiplexing means into image data for each photographing direction and input to the output-side image data storage means before being displayed and output. When an error is detected in the image data, the compensating means obtains image data for generating image data instead of the error image data from image data in the vicinity of the channel of the image data in which the error is detected. The image data is supplemented in place of the error image data.

[0025]

According to a fourth aspect of the present invention, the image data is read from a recording medium on which each image data for each photographing direction obtained by photographing the subject from a plurality of directions is recorded, and the read image data is decoded to reproduce a reproduced image. When obtaining, when an error is detected in specific image data, the image data of another channel corresponding to the error image data is supplemented in place of the error image data.

[0027]

According to a fifth aspect of the present invention, the image data is read out from a recording medium on which each image data in each of the photographing directions obtained by photographing the subject from a plurality of directions is read, and the reproduced image is decoded. When obtaining, when an error is detected in specific image data, the image data of a channel adjacent to the channel to which the error image data belongs is supplemented in place of the error image data.

[0029]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below with reference to the drawings.

[First Embodiment] FIG. 1 is a block diagram of a three-dimensional moving image reproducing apparatus according to a first embodiment of the present invention.

In the present embodiment, a description will be given of the case of two channels on the left and right corresponding to human eyes for ease of explanation and understanding. Can be easily extended.

In FIG. 1, reference numeral 11 denotes a recording medium on which stereoscopic moving image data or data obtained by compressing and coding the moving image data is recorded. In this embodiment, the recording medium is a disk. tape,
It is possible to use an IC memory or the like. Further, in the case of using for communication, data transmission from a communication path is not limited to such a recording medium 11 and may be received. However, in general, compression encoded data is recorded on the recording medium 11, and also in this embodiment, it is assumed that digital moving image data recorded on the recording medium 11 is compression encoded data. Numeral 12 denotes a recording medium reading means for reading out the compressed and encoded data recorded on the recording medium 11. Reference numeral 13 denotes an image data storage unit 13 including a buffer memory for temporarily storing the compressed and encoded data read by the recording medium reading unit 12 and absorbing a change in the input data amount. The image data storage means 13 is provided for the following reason. That is, in the compression-encoded image data,
As represented by the MPEG (ISO 11172) system, there is a type in which the amount of data transferred per unit time is not determined. In other words, in the MPEG system, since the data is composed of two types, the compression coding data within the image unit and the compression coding data between the image units, when the data amounts of both are compared, the former compression coding data within the image unit is obviously The coded data has a larger data amount, and the processing time is longer than the latter inter-image compression-encoded data. Therefore, a buffer memory is provided to absorb such a difference in processing time. Decoding means 14 decodes the compression-encoded data into original image data. In this decoding means 14, H.264 For example, compression coding such as compression coding such as H.261 or MPEG, and coding methods such as run length and Huffman coding are used.

Numeral 15 denotes a decoding error detecting means for detecting whether a decoding error has occurred in data handled by the recording medium reading means 12, the image data accumulating means 13 and the decoding means 14 in each processing. Reference numeral 16 denotes a demultiplexing unit that distributes the image data obtained by the decoding unit 14 to corresponding channels for each shooting direction. Reference numeral 19 denotes output-side image data storage means for temporarily storing the image data distributed to each channel by the demultiplexing means 16 before displaying and outputting the image data. The output-side image data storage unit 19R and the output-side image data storage unit 19L have two storage media, and the storage media that are stored immediately after the image data is input from the demultiplexing unit 16 are the first storage medium. 17R and 17
L, the storage medium to be stored next is the second storage medium 18R.
And 18L. Then, the first storage media 17R and 17L store the decoded image data, and under the control of the decoding error detection means 15, temporarily stop the storage operation and store the image data in the first storage media 17L and 17R of the opposite channel. Storage media 17R, 17R on the channel side where a decoding error has occurred in all or a part of
L. The second storage media 18R and 18L store the image data currently displayed and output.

D (R) is error information for the decoding error detecting means 15 to control the first storage media 17R and 17L of the output side image data storing means 19R and 19L when a decoding error occurs. Also, the arrow with the capital letter of the alphabet represented by the bold line in the figure indicates the compressed encoded data,
Alternatively, the arrow indicates the flow of data such as image data, and the arrow with the lowercase letter of the alphabet represented by a thin line indicates the flow of the control system. F is a data transmission path for image data, one of which is a read output and the other is a write input.

Further, in the output side image data storage means 19R and 19L, in the present embodiment, the interval between the image data being decoded and the image data being output is one image unit. Depending on the decoding mode, a longer interval may be required in consideration of the delay in processing time due to decoding.
There is also a case where it is necessary to arrange 1 to absorb the delay time.

First, the compressed and encoded data A is read from the recording medium 11 by the recording medium reading means 12 and is output to the image data storage means 13 as compressed and encoded data B. The compressed and coded data B is sent to the image data storage means 13 and temporarily stored in order to achieve timing matching at the time of decoding the data. Then, the compressed coded data C output from the image data storage unit 13 is sent to the decoding unit 14, where the compressed code is released by a process reverse to the compression coding, and the decoding is performed. Therefore, raw compressed encoded data is handled by each of these three means, and it is considered that the probability of occurrence of a decoding error relating to decoding of the compressed encoded data in the processing of each means is the highest. In a normal time when no decoding error occurs, the image data D decoded by the decoding means 14 is input to the demultiplexing means 16, and the output-side image data storage means 19R, 19R for each channel corresponding to the image data. Transferred to 19L. For example, image data D
Is image data for the right side, the image data D is transferred to the output side image data storage means 19R. In the output side image data storage means 19R, first, the image data E (R) is input to the first storage medium 17R,
It is stored until it reaches one image unit. When the image data reaches one image unit, the second storage medium 1 stores the image data G (R).
8R, and in the second storage medium 18R, the image output H
Obtain (R) and retain it. The output-side image data storage means 19L is also processed in a similar process to obtain an image output H (L).

Next, the above-mentioned recording medium 11, recording medium reading means 12, image data accumulating means 13, and decoding means 14
Error occurs in the compressed and encoded data handled by each means of
As a result, the operation of the decoding error detecting means 15 when decoding fails will be described.

The mode of occurrence of non-decoding is described in the order of processing. First, there is an error in reading from the recording medium 11. This is caused by a problem of the recording medium itself and a case of the recording medium reading means 12. When there is a problem with the recording medium itself, there are factors such as the fact that the information itself recorded on the recording medium itself contains incorrect information, and the fact that if the recording medium is a disc, scratches and dirt are present. And illegal data are read out as the compressed and coded data A, respectively, which causes a state where image data cannot be decoded. This read-related error is caused by the recording medium reading means 12.
Can be given as error information c to the decoding error detection means 15 if it can be recognized as an error. The error information given here includes, for example, a read address, a track position for a disc,
The tape is composed of elements such as the position and read length of the reading means in the case of a tape, and is composed of elements such as the address in the case of a memory. However, even if the recording medium reading means 12 itself has consistency, if the original information itself has an error, or if data is read out so as to be consistent by accident, the information may be lost. The error information cannot be detected by the recording medium reading means 12. Further, when the data supply source is not a recording medium, for example, when communication is used, data errors may occur due to noise such as a line error occurring on a communication path. In this case, the communication device may be able to interpret the content of the error itself as the reception error itself. For example, such information includes the time during communication and the position information on other communication protocols. This is sent to the decoding error detecting means 16 as c.

Next, the image data storage means 13 detects an error such as overflow of the data. Here, since it is impossible to actually know the information of the data itself, the error information in this case is only simple information such as time if the normal data is not handled, and the data handling is performed. In this state, information such as the error position of the data is sent to the decoding error detecting means 15 as error information d.

The error information c and b output to the decoding error detecting means 15 when an error occurs in the recording medium reading means 12 and the image data accumulating means 13 except for the decoding means 14 are used for decoding at the time of decoding. It is used as an early countermeasure against decoding errors such as time reduction and error processing of compressed encoded data that cannot be decoded before decoding.

Next, errors in the decoding means 14 include an operation error at the time of decoding and an error when the input compressed and encoded data itself has a potential error. Therefore, only the decoding means 14 can recognize that decoding is impossible when decoding the compressed coded data in which the decoding error has occurred. Therefore, based on the information of the image data decoded in the past, the information of the unencoded uncompressed encoded data can be obtained for the unencoded uncompressed encoded data, and the error information a The decoding error detection means 15 is notified.

Then, the image data D decoded by the decoding means 14 is switched by the demultiplexing means 16 to a channel corresponding to the photographing direction of the image data and inputted to the output side image data storage means 19R, 19L.
In the first storage media 17R and 17L of the output side image data storage means 19R and 19L, if a decoding error occurs in the stored image data, a situation occurs in which the image data is not stored or a part is not stored. become. At this time, the decoding error detection means 15 issues an instruction to supplement the image data with d (R), d (L).
Will be issued for each channel. Such replenishment methods differ depending on the manner of occurrence of a decoding error, and are roughly classified into a case where the entire image becomes undecodable and a case where a part becomes undecodable.

Therefore, the case where the entire image cannot be decoded will be described first.

The situation in which the entire image cannot be decoded is that the header of the image data and the parameter setting information at the time of the compression encoding when the decoded data was the unencoded compressed encoded data were destroyed. This corresponds to the case where the image data for one image unit cannot be decoded because all the image data is composed of incorrect data.

First, a case where the above-described decoding error occurs in the recording medium reading means 12 and the image data storage means 13 will be described with reference to FIG.

FIG. 2 is an explanatory diagram showing a data arrangement when decoding is impossible on the entire image in the recording medium reading means 12 or the image data accumulating means 13.

In FIG. 2, (O) is the recording order when the compression-encoded data is normally recorded. (P)
Shows a data array when a decoding error occurs in the compressed data R2 in the storage order of (O) and the data is input to the decoding means 14. (Q) is the storage order of the image data E (R) and E (L) stored in the first storage media 17R and 17L.
(M) shows the image data L stored in the first storage medium 17L of the opposite channel by the decoding error detection means 15.
2 is added to the position of the original compressed data R2.

As shown in FIG. 2, it is assumed that an error has occurred in the compressed data R2, which is one of the right-side compressed encoded data, when it is read from the recording medium 11 by the recording medium reading means 12. Then, the image data storage means 13
When the image data R2 is input to the decoding unit 14 through the decoding unit 14, the image data R2 becomes a missing data array as shown in (P).
As shown in (Q), the L side is normally stored in the first storage medium 17L, but the R side stores only R1 and the storage of the image data R2 is skipped. Therefore, the recording medium reading unit 12 that has failed to read the image data R2 notifies the decoding error detection unit 15 of the reading failure to the image data R2 using the error information c. Decoding error detection means 1 that recognizes a failure in reading image data R2 based on error information c
5 indicates the timing at which the decoding means 14 has finished decoding the image data L2 and outputs the image data L2 at the output side.
The first demultiplexing means 16R
The control of temporarily stopping the storage of the image data transferred from the first storage medium 17L is performed by the error information d (R), and the control of the parallel transfer to the opposite first storage medium 17L is performed by the error information d (R).
(L), the decoding error detecting means 15 stores the channel in which the decoding error has occurred in the image data L stored in the first storage medium 17L of the opposite output-side image data storing means 19L.
2 via the first storage medium 17L and the first storage medium 17R
Transfer to As a result of performing such control, FIG.
The image data sequence shown in FIG.
Is supplemented with the image data L2 on one side. Therefore, when displayed and output with this image data sequence, the stereoscopic image temporarily collapses, but the time is very short, ie, one image unit time. There is no discomfort.

The reason why such a replenishing means can be adopted is that when photographing is performed on the left and right, the fact that the left and right images are relatively similar is used. By averaging the images obtained in the vicinity of the direction with respect to the direction, it is also possible to supplement the image data on the side where decoding has failed. In this case, it is possible to obtain an image output with very high quality and little discomfort.

Next, a case where an error occurs in the image data storage means 13 will be described.

Basically, the above-described recording medium reading means 1
As in the case where the reading of the compression-encoded data has failed in step 2, the failure in the buffer is notified to the decoding error detecting means 15 by adding the error information b to the decoding error detecting means 1.
5 is the first storage medium 17R of the channel on which decoding has failed.
On the other hand, the control for temporarily stopping the storage of the image data transferred from the demultiplexing unit 16 is temporarily stopped by the error information d (R).
Do with. At the same time, the decoding error detection means 15 instructs the transfer of the image data stored in the first storage medium 17L on the opposite side of the decoding failure channel to the first storage medium 17R of the decoding failure channel. Then, the output side image data storage means 19 on the opposite side to the channel on which decoding has failed.
The image data stored in the L first storage medium 17L via the data transmission path F is transferred to the first storage medium 17R of the output-side image data storage means 19R of the channel for which decoding failed. Therefore, the image data at the time of decoding failure can be obtained by supplementing the image data of which decoding failed with the image data of one side.

Next, a case where a decoding error occurs in the decoding means 14 will be described with reference to FIG.

FIG. 3 is an explanatory diagram showing a data arrangement of image data when a decoding error occurs when decoding the compressed encoded data in the decoding means 14 and decoding is impossible.

In FIG. 3, (S) shows the data arrangement of the compressed and coded data normally input to the decoding means, and (T) shows that decoding of the compressed and coded data of the image data R2 has failed during decoding. Storage media 17R, 17
3 shows the storage order of the image data stored in L. (U) indicates that the image data L2 stored in the first storage medium 17L of the opposite channel has been added to the original image data R2 position by the decoding error detection means 15.

As shown in FIG. 3, when the compressed coded data is normally input to the decoding means 14 in the data array of (S) and decoded, the compressed coded data of the image data R2 cannot be decoded. If they do, they will be stored in the first storage media 17R and 17L in the data array indicated by (T). Therefore, since the decoding unit 14 decodes the compressed encoded data itself, it can recognize the address of the compressed encoded data that has failed to be decoded. That is, by referring to the address of the image data that could be decoded immediately before the compressed encoded data of the same channel that cannot be decoded, the address of the compressed encoded data that could not be decoded was predicted, and the error information a To the decoding error detection means 15. Decoding error detection means 1
5, based on the content of the error information a, similarly to the above, notifies the decoding error detecting means 15 of the failure in the buffer with the error information a, and the decoding error detecting means 15 The control of temporarily stopping the storage of the image data transferred from the demultiplexing unit 16 to the first storage medium 17R is performed based on the error information d (R). At the same time, the decoding error detecting means 15 instructs to transfer the image data stored in the first storage medium 17L on the opposite side of the decoding failure channel to the first storage medium 17R of the decoding failure channel. Then, the output-side image data storage means 1 on the opposite side of the decoding-failed channel
The 9L first storage medium 17L transfers the image data stored using the data transmission path F to the first storage medium 17R of the output-side image data storage means 19R of the channel where decoding failed. Therefore, the image data at the time of decoding failure can be obtained by supplementing the image data of which decoding failed with the image data of one side.

Next, a case where some images cannot be decoded will be described.

In other words, this is the case where, after decoding the compressed coded data, there is a partial omission in the image data, or the decoding becomes impossible due to a partial operation error or the like. in this case,
Since only a specific area on the image cannot be decoded, the area is specified, and the image data of the area is supplemented in the same manner as described above. This is shown in FIG.

FIG. 4 is an explanatory diagram showing a case where a decoding error occurs in a partial area on an image after decoding the compressed and encoded data, and only that area cannot be decoded.

In FIG. 4, the hatched area in 83R is image data in which an undecodable area has been formed due to a decoding error or the like. At this time, the undecodable area in the 83R is detected by the decoding means 14 which has decoded this image data. That is, the decryption means 14
Image data 8 consisting of compressed encoded data to be decoded
The start and end addresses of the 3R undecodable area are stored and added to the error information a, and transmitted to the decoding error detecting means 15. Then, the decoding error detection unit 15 temporarily stores the image data transferred from the demultiplexing unit 16 next in the first storage medium 17R (or the first storage medium 17L) of the channel on which decoding has failed. The stop control is performed based on the error information d (R). Then, the first storage medium 17R
Discards the image data in the area of the address put on the error information d (R). Further, the decoding error detecting means 15
The first storage medium 17L of the output-side image data storage means 19L on the opposite side to the image data in which the error area has occurred extracts an area according to the above-described address of the image data L2 to be stored, and The transfer of the partial image data of the extracted area to one storage medium 17R is controlled by d (L). At this time, the first storage medium 17R obtains all image data by supplementing the partial image data obtained from the first storage medium 17L to the discarded area based on the instruction of the decoding error detection unit 15.

Therefore, under the control of the decoding error detecting means 15, the incomplete image data stored in the first storage medium 17R is transferred to the first storage medium 17R of the opposite channel.
L, the partial image data of the area corresponding to the area where the error has occurred in the first storage medium 17R is extracted from the image data stored in the first storage medium 17R.
And the first storage medium 17R can obtain image data by supplementing the partial image data transferred to the discarded area.

That is, the image data is read out from the recording medium 11 on which the image data for each of the photographing directions obtained by photographing the subject from a plurality of directions is recorded, and the read-out image data is decoded to obtain a reproduced image. In an image reproducing device,
A recording medium reading unit 12 for reading the image data from a recording medium 11 on which each image data for each of the photographing directions obtained by photographing the subject from a plurality of directions is read, and the image data is read by the recording medium reading unit 12. Decoding means 14 for temporarily storing and decoding the image data, decoding error detecting means 15 for detecting whether an error has occurred in the image data, and photographing the image data obtained by the decoding means 14. Demultiplexing means 16 for switching to transfer for each channel in each direction;
Output-side image data storage means 19R, 19 in which the image data displayed on each channel obtained by step 6 is stored.
L, when an error is detected in the image data, the output side image data storage means 19R, 19L compensates for the image data of the other channels via the data transmission path F in place of the error image data in image units. It can be provided with a supplementing means, and this can be the embodiment of claim 1.

As described above, the image data is read out from the recording medium 11 on which the image data for each of the photographing directions obtained by photographing the subject from a plurality of directions is recorded.
In the three-dimensional moving image reproducing apparatus which decodes the decoded image and obtains a reproduced image, when an error is detected in the image data, the output side image data storage means 19R, 19L is supplied by the compensation means.
In the above, the image data of another channel is supplemented instead of error image data in image units, and output and displayed.

Therefore, when the specific error image data is displayed and output, the property of the stereoscopic moving image is lost, but the entire image is not lost, so that the compressed encoded data is read out, and decoding is performed due to an operation error due to disturbance or the like. Even when the display is impossible, no discomfort is given to a person who views the image display output.

A three-dimensional moving image is obtained by reading the image data from the recording medium 11 on which each image data in each of the photographing directions obtained by photographing the subject from a plurality of directions is recorded, and decoding it to obtain a reproduced image. In an image reproducing device,
A recording medium reading unit 12 for reading the image data from a recording medium 11 on which each image data for each of the photographing directions obtained by photographing the subject from a plurality of directions is read, and the image data is read by the recording medium reading unit 12. Decoding means 14 for temporarily storing and decoding the image data, decoding error detecting means 15 for detecting whether an error has occurred in the image data, and photographing the image data obtained by the decoding means 14. Demultiplexing means 16 for switching to transfer for each channel in each direction;
Output-side image data storage means 19R, 19 in which the image data displayed on each channel obtained by step 6 is stored.
L, when an error is detected in a specific area of the image data, the output side image data storage means 19R, 19L replaces the image data of the other channels with the error image data in image area units and sets the data transmission path F to And a replenishing means for replenishing via an intermediary, and this can be the embodiment of claim 2.

Therefore, by performing the error processing in this way, the image data at the time of occurrence of the error is supplemented by the image data of another channel at the same time, and a three-dimensional reproduced image with no deterioration of the display output even at the time of the occurrence of the error. Obtainable.

As a result of controlling the decoding error detecting means 15 as described above, when a display is output in an image data sequence as shown in FIG. 4, although a stereoscopic image of a part of the display image is temporarily broken, As described above, since the time is as short as one image unit time, a three-dimensional moving image at the time of occurrence of an error can be reproduced without giving the user much or no sense of discomfort.

As a result, in this embodiment, the image data is read from the recording medium on which the image data for each photographing direction obtained by photographing the subject from a plurality of directions is recorded, and the image data is decoded. When an error is detected in specific image data when a reproduced image is obtained, image data of another channel corresponding to the error image data is supplemented in place of the error image data.
This is equivalent to the embodiment of FIG.

Therefore, when the specific error image data is displayed and output, the properties of the stereoscopic moving image are lost, but the entire image is not lost. Even when the image display is not possible, the viewer who views the image display output does not feel uncomfortable and can obtain a natural and comfortable image.

The relationship between the decoding means and the demultiplexing means in the case of carrying out the present invention is such that the demultiplexing means can be first demultiplexed and then decoded by the decoding means. The target position may be processed first. In any case, both can obtain the same effect.

[Second Embodiment] In the second embodiment, when all or a part of the decoded image data of the first embodiment cannot be decoded and cannot be decoded, an image of the opposite channel at the same time is used. In this method, image data that cannot be decoded is obtained by using data, whereas image data that has been decoded in the past on a channel that cannot be decoded is used.

First, a method using past image data will be described with reference to FIG.

FIG. 5 is a block diagram showing a three-dimensional moving image reproducing apparatus according to a second embodiment of the present invention. In the figure, the same reference numerals and symbols as those of the first embodiment indicate the same or corresponding components as those of the first embodiment, and therefore, duplicate description will be omitted.

In FIG. 5, the data transmission paths for transferring undecodable image data are F (R) and F (L) for each of the left and right channels. In this embodiment, since the error processing is performed on the past image data of the same channel, the second storage medium 1 storing the image data currently output in each channel from the decoding error detecting means 15.
For 8R and 18L, there are control signals e (R) and e (L) for transferring the stored image data to the first storage media 17R and 17L. Also, the first storage media 17R and 1R
7L has a function of temporarily stopping the storage of the next image data under the control of the decoding error detecting means 15.
Further, the second storage media 18R and 18L transfer all or a part of the stored image data to the first storage media 17R and 17L under the control of the decoding error detection means 15, and the stored image data is It has a function to keep it as it is. Operations other than these are the same as in the first embodiment.

Similarly to the first embodiment, when an error occurs in the compressed coded data in the storage medium reading means 12, the image data accumulating means 13 and the decoding means 14 where an error can occur, and the decoding becomes impossible, Decoding error detection means 15
The decoding error is detected by the recording medium reading means 12 based on the error information c, the image data accumulating means 13 by the error information b, and the decoding means 14 by the error information a to detect the information content in which the decoding error has occurred.
Also in this embodiment, the decoding error is roughly classified into a case where decoding is impossible due to the entire image and a case where decoding is partially impossible on the image due to a partial decoding error.

First, the case where the entire image cannot be decoded will be described.

In FIG. 5, when an error occurs in the recording medium reading means 12 and the image data accumulating means 13, the decoding error detecting means 15 detects the decoding error. Recognizing that the reading of the encoded data has failed, the decoding means 14 measures the timing of the decoding failure. If a decoding error occurs in the decoding means 14, at the time based on the error information a, for example, If the image data currently stored in the first storage medium 17R is transferred to the second storage medium 17R, the storage of the image data sent from the demultiplexing unit 16 to the next image data is temporarily stopped. An instruction d (R) is issued to the first storage medium 17R. The first storage medium 17R that has received the command transfers the stored image data to the second storage medium 18R. At the same time, the decoding error detection means 15 sends the second storage medium 18R
An instruction e (R) for reversely transferring the currently stored image data to the first storage medium 17R using the data transmission path F (R) is issued. That is, the first storage medium 17R stores the image data from the second storage medium 18R, and obtains the image data stored in the past. In this manner, the second storage medium 18R outputs the image data transferred from the first storage medium 17R to the first storage medium 17R by using the data transmission path F (R) in reverse, thereby outputting the image data at the time of the decoding failure. Image data, that is, image data decoded in the past can be obtained. Therefore, the image data that has failed to be decoded can be supplemented with the image data that has been decoded in the past. Also in this case, under such control of the decoding error detecting means 15, the image data of the second storage media 18R, 18L for storing the image data currently being displayed and output on the first storage media 17R, 17L of the channel in which the decoding error has occurred. To the first storage medium 17R, using the data transmission path F (R).
17L, and the first storage medium stores the image data decoded in the past again. Therefore, image data that cannot be decoded at the time of decoding can be supplemented with the image data decoded in the past.

As a result of such control of the decoding error detecting means 15, although the three-dimensional image is temporarily destroyed, as in the case of the first embodiment, the time is very short, ie, one image unit time. Therefore, the user does not feel much or no discomfort.

In particular, in the method of using image data decoded in the past of the undecodable channel as in the present embodiment, for example, in the MPEG system, past, present and future image data, that is, image mutual When the component of the inter-image compression-encoded data is determined and the change is estimated to be small, it is effective to adopt this method.

Next, a case where some images cannot be decoded will be described.

In this case, since only a specific area on the image cannot be decoded, the area may be specified and the image data of the area may be supplemented in the same manner as in the first embodiment. This is shown in FIG.

FIG. 6 is an explanatory diagram showing a case where a decoding error occurs in a partial area on an image after decoding the compressed and encoded data, and only that part cannot be decoded.

In FIG. 6, the shaded area in the image data 93R is an area that cannot be decoded due to an error or the like. At this time, the area where the decoding error has occurred in the image data 93R is detected by the decoding unit 14 that has decoded the image data. That is, the decryption means 14
Detects the start and end addresses of the undecodable area of the image data 93R composed of the compressed and coded data to be decoded and puts them on the error information a.
Tell 5 Then, the decoding error detecting means 15 first issues a command to temporarily stop storing the image data from the demultiplexing means 16 in the first storage medium 17R based on the error information d (R). At the same time, of the image data currently stored in the second storage medium 18R by the error information e (R), only the image data in the area specified by the address of the error information a is transferred to the second storage medium 18R using the data transmission path F (R). An instruction to perform reverse transfer to one storage medium 17R is issued. Therefore, the first storage medium 17R stores the image data of the area where the decoding error has occurred in the image data of the second storage medium 18R stored in the past, and can be supplemented to the area missing due to the decoding error. .

As a result of such control of the decoding error detecting means 15, although the three-dimensional image of a part of the display image is temporarily destroyed, as in the first embodiment described above, the time is one image unit time. This is a very short time, and does not give the user much or no discomfort.

As described above, in the method of using image data decoded in the past of a channel that cannot be decoded as in the present embodiment, for example, in the MPEG system, the past, present and future image data, that is, When the component of the inter-image compression-encoded data between the images is determined and the change is estimated to be small, it is effective to adopt this method.

That is, the image data is read out from the recording medium 11 on which the image data for each of the photographing directions obtained by photographing the subject from a plurality of directions are recorded, and the read-out image data is decoded to obtain a reproduced image. In an image reproducing device,
A recording medium reading unit 12 for reading the image data from a recording medium 11 on which each image data for each of the photographing directions obtained by photographing the subject from a plurality of directions is read, and the image data is read by the recording medium reading unit 12. Decoding means 14 for temporarily storing and decoding the image data, decoding error detecting means 15 for detecting whether an error has occurred in the image data, and photographing the image data obtained by the decoding means 14. Demultiplexing means 16 for switching to transfer for each channel in each direction;
Output-side image data storage means 19R, 19 in which the image data displayed on each channel obtained by step 6 is stored.
L, when an error is detected in the image data, the output-side image data storage means 19R, 19L replaces the past image data of the same channel with the error image data in image units in data transmission paths F (R), And a compensating means for compensating by reverse transfer using F (L).

As described above, the image data is read from the recording medium 11 on which the image data for each photographing direction obtained by photographing the subject from a plurality of directions is recorded.
In a three-dimensional moving image reproducing apparatus that decodes the decoded image to obtain a reproduced image, when an error is detected in the image data, the compensating unit stores the past image data of the same channel in the output side image data storing units 19R and 19L. The data is supplemented in units of error image data, input to the output side image data storage means 19R, 19L before being displayed and output, and output for display.

Therefore, even when specific error image data is displayed and output, the properties of the three-dimensional moving image are maintained, and when there is little change from the past used image data, it can be almost completely restored. However, if there is a large change from the past used image data, it is not possible to accurately recognize all the images. Therefore, even when decoding is impossible due to readout of the compressed coded data, an operation error due to disturbance, etc. The viewer does not feel uncomfortable with the display output. In particular, MPE
By detecting that there is little change between the past image data and the next corresponding image data by the G method or the like, and by making up for this, a three-dimensional image can be almost completely restored, and a natural and unnatural image can be obtained. .

Therefore, by performing the error processing in this way, the image data at the time of occurrence of the error is supplemented with the previously decoded image data of the same channel, and the stereoscopic reproduced image without deterioration of the display output even at the time of the occurrence of the error. Can be obtained.

Further, the image data is read out from the recording medium 11 on which each image data for each photographing direction obtained by photographing the subject from a plurality of directions is recorded, and is decoded to obtain a reproduced image. In an image reproducing device,
A recording medium reading unit 12 for reading the image data from a recording medium 11 on which each image data for each of the photographing directions obtained by photographing the subject from a plurality of directions is read, and the image data is read by the recording medium reading unit 12. Decoding means 14 for temporarily storing and decoding the image data, decoding error detecting means 15 for detecting whether an error has occurred in the image data, and photographing the image data obtained by the decoding means 14. Demultiplexing means 16 for switching to transfer for each channel in each direction;
Output-side image data storage means 19R, 19 in which the image data displayed on each channel obtained by step 6 is stored.
L, when an error is detected in a specific area of the image data, the output-side image data storage means 19R, 19L replaces the past image data of the same channel in units of image areas with error image data in the data transmission path F. (R),
And a compensating means for compensating by reverse transfer using F (L).

As described above, the image data is read out from the recording medium 11 on which the image data for each photographing direction obtained by photographing the subject from a plurality of directions is recorded.
In the three-dimensional moving image reproducing apparatus that decodes the decoded image to obtain a reproduced image, when an error is detected in a specific area of the image data, the compensating unit outputs the output-side image data storing unit 19.
In R and 19L, the past image data of the same channel is supplemented instead of error image data in image area units.

Therefore, even when specific error image data is displayed and output, the characteristics of the three-dimensional moving image are maintained, the change from the past used image data is reduced, and the image data can be almost completely restored. Therefore, even when decoding is impossible due to readout of compressed encoded data, operation error due to disturbance, etc., it is possible to prevent the viewer of the image display output from feeling uncomfortable. In particular, by detecting that there is little change between the corresponding area of the past image data and the next corresponding area by the MPEG method or the like, and by making up for this, a three-dimensional image can be almost completely restored, and an image that is natural and has no uncomfortable feeling can be obtained. Obtainable.

As a result, in this embodiment, the image data is read from a recording medium on which each image data for each photographing direction obtained by photographing a subject from a plurality of directions is recorded, and is decoded. When an error is detected in specific image data when a reproduced image is obtained, the past image data of the channel to which the error image data belongs is supplemented in place of the error image data.

Therefore, even when specific error image data is displayed and output, the characteristics of the three-dimensional moving image can be maintained, and when there is little change from the past used image data, the image can be almost completely restored. Even when reading of encoded data or decoding is impossible due to an operation error or the like due to a disturbance, it is possible to prevent the viewer of the image display output from feeling uncomfortable. In particular, by detecting that there is little change between the past image data and the next corresponding image data by the MPEG method or the like, and by making up for this, a three-dimensional image can be almost completely restored and a natural and uncomfortable image can be obtained. Can be.

The relationship between the decoding means and the demultiplexing means in practicing the present invention is such that after the demultiplexing is first performed by the demultiplexing means, it can be decoded by the decoding means. The target position may be processed first. In any case, both can obtain the same effect.

[Third Embodiment] Next, a third embodiment of the present invention will be described.

In the above, the case where the number of decoding means is one for multiple channels has been described. However, in the third embodiment, decoding means is provided for each channel so that image data which cannot be decoded is reversed. This is a method of performing decoding error processing by supplementing with image data on the side. Such a third embodiment will be described with reference to FIG.

FIG. 7 is a block diagram showing the structure of a three-dimensional moving picture reproducing apparatus according to a third embodiment of the present invention.

In FIG. 7, the basic structure and operation are the same as those of the first embodiment shown in FIG. 1 in which only one decoding means is used, and when a decoding error occurs, image data on the opposite side is supplemented with undecodable image data. It is. However, the difference is that since the compression-encoded data itself is independent on the right and left, before decoding the compression-encoded data, the demultiplexing means 30 separates the data into channels for each shooting direction, and the decoding is performed separately for each channel. It has two decoding means 31R and 31L. Further, since there are a plurality of decoding means, a plurality of decoding error detecting means for detecting a decoding error are provided in accordance with the number of decoding means, and are constituted by 32R and 32L corresponding to the right and left, respectively. Therefore, the decoding error detecting means is activated only when an error occurs in the channel, thereby reducing power consumption.

When two decoding error detecting means are used as shown in FIG. 7, decoding error detection is performed independently for both channels. Then, even in a case where a decoding error reaches all in image units or a case where decoding cannot be performed in a part, each unit operates in the same manner as the first embodiment,
Decoding error detecting means 32R, 3 for each channel
2L is the first storage medium 17L, 1 of the opposite channel.
7R, using the same error information d (R) and d (L) as in the case where the number of decoding means is one, the image data of the opposite channel is converted to the channel on which decoding is impossible. Of the first storage media 17R, 17L. Then, decoding error processing is performed by means for supplementing this image data with image data that cannot be decoded.

That is, the demultiplexing means 30 for distributing the compressed and coded data to the channels for each photographing direction, and the decoding means 31 for obtaining image data by decoding for each channel.
R, 31L and decoding error detecting means 32 for detecting whether or not an error has occurred in the compressed and coded data handled by each means.
R, 32L and the image data of each channel obtained by the demultiplexing means 30 are temporarily stored before being displayed and output.
And the output side image data storage means 19R and 19L have two independent storage media, one is the first storage medium 17R and 17L, and the other is the second storage medium 1.
8R and 18L, the image data transferred by the demultiplexing means 19R and 19L using the data transmission path F is first stored in the first recording media 17R and 17L in image units. 18R, 18L and 18L.

Therefore, by performing the error processing in this way, the image data at the time of occurrence of the error is supplemented with the image data of another channel at the same time, and a three-dimensional reproduced image with no deterioration of the display output even at the time of occurrence of the error is obtained. Obtainable.

This embodiment corresponds to the first, second and fourth embodiments. Further, as in the embodiment of the present invention, the relationship between the demultiplexing means and the decoding means may be such that, after the demultiplexing is first performed by the demultiplexing means, it is decoded by the decoding means. May be processed first. In any case, both can obtain the same effect.

[Fourth Embodiment] Next, a fourth embodiment of the present invention will be described.

The fourth embodiment has decoding means for each channel of the third embodiment described above, and performs decoding error processing by decoding error detecting means corresponding to the number of decoding means.
In this method, image data that cannot be decoded is supplemented by using past image data of the same channel to compensate for a decoding error. Such a fourth embodiment will be described with reference to FIG. FIG. 8 is a block diagram showing a configuration of a stereoscopic video playback device according to a fourth embodiment of the present invention.

In FIG. 8, the basic structure is the same as that of the third embodiment, and the operation is the same as that of the third embodiment. This is the same as the method of supplementing image data that cannot be decoded. However, the difference is that since the compression-encoded data itself is independent on the right and left, the demultiplexing means 30 that separates the compression-encoded data for each channel for each shooting direction before decoding, and the two It has decoding means 31R and 31L. In addition, there are a plurality of decoding means, and a plurality of decoding error detecting means for detecting a decoding error are provided in accordance with the number of decoding means. In FIG. 8, each of the decoding means includes 32R and 32L corresponding to the right and left sides, respectively. The power consumption can be reduced by activating the decoding error detecting means 32R and 32L only when an error occurs in the channel.

When two decoding error detecting means are used as shown in FIG. 8, decoding error detection is performed independently for both channels. Each unit operates in the same manner as in the second embodiment even when decoding becomes impossible for all images or when decoding becomes impossible for a part.

First, among the respective channels, the decoding error detecting means 32R, 32R,
32L is the first storage medium 17R, 17R of the same channel.
By giving an instruction to L using the same error information d (R) and d (L) as in the case of one decoding means,
The first storage media 17R, 17L are used as decryption means 31R, 31L.
Temporarily stops storing the image data input from. At the same time, the second storage medium 18 of the same channel
The image data stored at the time of decoding failure can be obtained by reversely transferring the stored image data to the first storage media 17R and 17L with respect to R and 18L using the data transmission path F (R). Then, decoding error processing is performed by supplementing this image data with image data that cannot be decoded.

In the present embodiment, the image data decoded in the past of the undecodable channel is used. For example, in the MPEG system, the past, present and future image data, that is, the When the change component of the inter-picture compression encoded data is determined and the change is estimated to be small, it is effective to adopt this method.

That is, if an error occurs in the compressed and coded data handled by the recording medium reading means 12, the image data storage means 13 and the decoding means 14 and decoding is impossible or decoding is failed, decoding by channel is performed. The error detection means 32R and 32L transfer the stored image data being displayed and output to the second storage media 18R and 18L of the output-side image data storage means 19R and 19L of the same channel as the undecodable channel. The image data decoded in the past can be obtained by means of reverse transfer using one of the data transmission paths F (R) and F (L) to one storage medium 17R, 17L. A configuration may be provided that includes means for supplementing as image data to be decoded.

Therefore, by performing the error processing in this manner, the image data at the time of occurrence of the error is supplemented by the previously decoded image data of the same channel, and even when the error occurs, the three-dimensional reproduced image with no deterioration of the display output is obtained. Can be obtained.

As in the embodiment of the present invention, the relationship between the demultiplexing means and the decoding means is such that the demultiplexing is first performed by the demultiplexing means and then decoded by the decoding means. Regarding the circuit position of the demultiplexing means, any of them may be processed first. In any case, both can obtain the same effect.

[Fifth Embodiment] Next, a fifth embodiment of the present invention will be described.

That is, a method is also conceivable in which a plurality of decoding error detecting means corresponding to the number of channels in the third embodiment and the fourth embodiment are unified into one, and decoding error processing for each channel is collectively performed. .

In such a method, image data near the decoding error channel is obtained and averaged, and image data that cannot be decoded is obtained. A method is conceivable in which past image data of a nearby channel is obtained and averaged, and a decoding error can be supplemented by obtaining image data that cannot be decoded with the highest accuracy. Therefore, the error information of each channel including the information of the decoding error is collected in one integrated decoding error means, and the decoding error means needs a function of comparing and judging the error information.

Therefore, the fifth embodiment employs a lenticular lens system which comprises a display device of a plurality of channels and obtains a three-dimensional moving image by outputting images corresponding to the left and right eyes.
This is a method in which a plurality of decoding error detecting means corresponding to the number of channels are unified into one, and decoding error processing of each channel is collectively performed. FIG. 9 shows such a fifth embodiment.

FIG. 9 is an explanatory view showing image data of a three-dimensional moving image when a lenticular lens system is applied to a three-dimensional moving image reproducing apparatus according to a fifth embodiment of the present invention. In FIG. 9, 101 to 105 are lenticular
This is image data at a certain time when a three-dimensional moving image is formed using a lens in which the surface of a display device corresponding to five channels such as a liquid crystal panel has been subjected to semi-cylindrical lens processing based on the lens system. Arrows 101n to 105n indicate shooting or projection directions, and 106 indicates a position where a subject is present by visually observing an image output by the playback device.

In FIG. 9, for example, when decoding of all the image data of 103 becomes impossible, one decoding error detecting means detects this, and the left and right channels centering on the channel on the 103 side, that is, , 102 and 104, the image data stored in the second storage medium of the image data storage means is compared and referenced, an average value is calculated, and additional processing such as future prediction is executed. As a result, image data that will be closest to the 103 image data is generated. Then, by transferring the generated image data to the first storage medium of the image data storage unit 103, the image data that cannot be decoded is supplemented, whereby a more natural image output can be obtained.

In addition, such a method can be similarly processed even when a part of the image is missing. In this case, when a decoding error occurs in 103, an undecodable area in the same time or past image data in a channel near 103 is extracted, compared and referenced, an average value is calculated, and additional processing such as future prediction is performed. Is performed, partial image data that is closest to the partial image data that was lost due to the 103 decoding error is generated. Then, by transferring the generated partial image data to the first storage medium of the image data storage unit 103, the generated partial image data is supplemented to a part of the undecodable image data of the 103, whereby Natural image output can be obtained.

That is, when all or a part of at least one image data of a plurality of image data to be decoded cannot be decoded, all the image data in the shooting direction that cannot be decoded are all Means for extracting image data in the vicinity of a decodable channel from image data decoded at the same time or in the past stored in output side image data storage means 19R, 19L of the channel And a means for comparing and referring to the extracted image data to obtain generated image data, and a means for supplementing the generated image data to undecodable image data. Of the present invention.

Therefore, by performing the error processing in this way, the image data at the time of occurrence of the error is extracted by extracting the image data decoded at the same time or in the past in the vicinity of the channel in which the error occurred, and comparing and extracting the same. It is possible to obtain the generated image data and supplement the image data that could not be decoded with this image data to obtain a three-dimensional reproduced image with no deterioration in display output even when an error occurs.

In this embodiment, the image data is read from the recording medium 11 on which each image data for each photographing direction obtained by photographing a subject from a plurality of directions is recorded.
In a three-dimensional moving image reproducing apparatus that decodes the image data to obtain a reproduced image, the image data is read from a recording medium 11 on which each image data for each photographing direction obtained by photographing a subject from a plurality of directions is recorded. Recording medium reading means 12
And decoding means 14 for temporarily storing the image data read by the recording medium reading means 12 and then decoding the image data.
Decoding error detection means 15 for detecting whether an error has occurred in the image data; demultiplexing means 16 for switching to transfer the image data obtained by the decoding means 14 for each channel in each shooting direction; Output-side image data storage means 19 for storing image data displayed on each channel obtained by the demultiplexing means 16
R, 19L, and when an error is detected in the image data, image data for generating image data to replace the error image data is obtained from image data in the vicinity of the channel of the image data in which the error is detected. And a compensating means for compensating for the image data in place of the error image data, which corresponds to the third embodiment of the present invention.

As a result, the image data is read from the recording medium 11 on which the image data for each of the photographing directions obtained by photographing the subject from a plurality of directions are recorded, and are decoded to obtain a reproduced image. In the moving image reproducing device, when an error is detected in the image data,
Compensation means obtains image data for generating image data replacing the error image data from image data in the vicinity of the channel of the image data in which the error is detected, and compensates for the image data in place of the error image data. Things.

Therefore, at the time of displaying and outputting specific error image data, by using image data in the vicinity of the channel of the image data in which an error is detected, the properties of a three-dimensional moving image can be maintained and almost perfect. Since the image data can be restored, even when the decoding of the compressed coded data is impossible or the decoding is impossible due to an operation error due to a disturbance or the like, a person viewing the image display output does not feel uncomfortable. Thus, it is possible to obtain an image having no discomfort.

As a result, in this embodiment, the image data is read out from the recording medium on which the image data for each photographing direction obtained by photographing the subject from a plurality of directions is recorded, and the image data is decoded. When an error is detected in specific image data when obtaining a reproduced image, each image data for each shooting direction obtained by shooting an image of a channel adjacent to the channel to which the error image data belongs is recorded. Recording medium reading means 12 for reading the image data from the recorded recording medium 11, and the recording medium reading means 12
After temporarily storing the image data read by
Decoding means 14 for decoding, decoding error detection means 15 for detecting whether or not an error has occurred in the image data, and multiplexing for switching the image data obtained by the decoding means 14 so as to be transferred for each channel in each shooting direction. Separating means 16, output side image data storing means 19R and 19L for storing image data to be displayed on each channel obtained by the demultiplexing means 16, and an error is detected when an error is detected in the image data. Compensation means for obtaining image data for generating image data instead of error image data from image data in the vicinity of the detected image data centered on the channel, and compensating for the image data in place of the error image data. This corresponds to the third embodiment.

As a result, the image data is read out from the recording medium 11 on which the image data for each of the photographing directions obtained by photographing the subject from a plurality of directions are recorded, and are decoded to obtain a reproduced image. In the moving image reproducing device, when an error is detected in the image data,
Compensation means obtains image data for generating image data replacing the error image data from image data in the vicinity of the channel of the image data in which the error is detected, and compensates for the image data in place of the error image data. Things.

Therefore, when specific error image data is displayed and output, by using image data in the vicinity of the channel of the image data in which an error is detected, the properties of a three-dimensional moving image can be maintained and almost perfect. Since the image data can be restored, even when the decoding of the compressed coded data is impossible or the decoding is impossible due to an operation error due to a disturbance or the like, a person viewing the image display output does not feel uncomfortable. Thus, it is possible to obtain an image having no discomfort.

As a result, in this embodiment, the image data is read from a recording medium on which each image data for each photographing direction obtained by photographing a subject from a plurality of directions is recorded, and is decoded. When an error is detected in specific image data when a reproduced image is obtained, the image data of a channel adjacent to the channel to which the error image data belongs is compensated for in place of the error image data. This corresponds to the example of item 5.

Therefore, at the time of display output of specific error image data, by using image data in the vicinity of the channel of the image data in which an error is detected, the properties of a three-dimensional moving image can be maintained, and almost completeness can be maintained. Since the image data can be restored, it is possible to obtain an image that is natural and comfortable for a person viewing the image display output even when reading of the compressed coded data or decoding is impossible due to an operation error due to a disturbance or the like. it can.

By the way, for the demultiplexing in the case of implementing the present invention, a technique corresponding to the multiplexing of digital data can be used. That is, as multiplexing of digital data, level multiplexing, time division multiplexing, and the like can be used. In the case of level multiplexing, for example, the uppermost bit of each data word (the smallest unit recognized as data, for example, 8 bits, 16 bits, 32 bits, etc. is used) is the right image data, and the lowermost bit is Appears in the data as left image data. In the case of time division multiplexing, right encoded data and left encoded data are recorded alternately. In the case of alternate recording, the recording is alternately performed for each image, or alternately recorded for each recording unit (eg, sector unit of CD-ROM) on a recording medium. You.

[0130]

As described above, according to the first aspect of the present invention, there is provided a three-dimensional moving image reproducing apparatus, comprising: a recording medium on which each image data for each photographing direction obtained by photographing a subject from a plurality of directions is recorded; In the three-dimensional moving image reproducing apparatus which reads out data and decodes it to obtain a reproduced image, when an error is detected in the image data, the compensating means converts the image data of another channel in the output side image data storing means in image units. Is used to compensate for the error image data instead of the error image data and output the display.

Therefore, when the specific error image data is displayed and output, the property of the stereoscopic moving image is lost, but the entire image is not lost. Therefore, decoding of the compressed coded data, decoding due to an operation error due to disturbance, or the like is performed. Even when the display is impossible, no discomfort is given to a person who views the image display output.

A three-dimensional moving image reproducing apparatus according to claim 2 is
In the three-dimensional moving image reproducing apparatus, the image data is read from a recording medium on which each image data in each photographing direction obtained by photographing a subject from a plurality of directions is recorded, and the reproduced image is decoded to obtain a reproduced image. When an error is detected in a specific area of the image data, the compensating means compensates for the image data of another channel in the output side image data storing means instead of the error image data in image area units, and outputs and displays the error data. .

Therefore, when the specific error image data is displayed and output, the properties of the three-dimensional moving image are lost in a partial area, but the entire image is not lost and only the properties of the three-dimensional image are partially lost. As a result, even if reading of the compressed coded data or decoding is impossible due to an operation error due to a disturbance or the like, it is possible to prevent the viewer of the image display output from feeling uncomfortable. In particular, even if the user is consciously checking the image, the image is not inferior to the extent that it cannot be checked without a considerably skilled person, and a natural and uncomfortable image can be obtained.

[0134]

[0135]

[0136]

[0137]

A three-dimensional moving image reproducing apparatus according to claim 5 is
In the three-dimensional moving image reproducing apparatus, the image data is read from a recording medium on which each image data in each photographing direction obtained by photographing a subject from a plurality of directions is recorded, and the reproduced image is decoded to obtain a reproduced image. When an error is detected in the image data, the compensating means obtains image data for generating image data in place of the error image data from nearby image data centered on the channel of the image data in which the error is detected, and The data is supplemented in place of the error image data.

Therefore, at the time of displaying and outputting the specific error image data, by using the image data in the vicinity of the channel of the image data in which the error has been detected, the properties of the stereoscopic moving image can be maintained and almost perfect. Since the image data can be restored, even when the decoding of the compressed coded data is impossible or the decoding is impossible due to an operation error due to a disturbance or the like, a person viewing the image display output does not feel uncomfortable. Thus, it is possible to obtain an image having no discomfort.

[0140]

A three-dimensional moving image reproducing apparatus according to claim 4 is
When the image data is read from a recording medium on which each image data in each shooting direction obtained by shooting a subject from a plurality of directions is recorded and decoded to obtain a reproduced image, an error occurs in a specific image data. Is detected, the image data of another channel corresponding to the error image data is supplemented in place of the error image data.

Therefore, when the specific error image data is displayed and output, the property of the three-dimensional moving image is lost, but the entire image is not lost. Therefore, the compressed encoded data is read, and decoding is performed due to an operation error due to disturbance. Even when the image display is not possible, the viewer who views the image display output does not feel uncomfortable and can obtain a natural and comfortable image.

[0143]

[0144]

A three-dimensional moving image reproducing apparatus according to claim 5 is
When the image data is read from a recording medium on which each image data in each shooting direction obtained by shooting a subject from a plurality of directions is recorded and decoded to obtain a reproduced image, an error occurs in a specific image data. Is detected, the image data of the channel adjacent to the channel to which the error image data belongs is supplemented in place of the error image data.

Therefore, when specific error image data is displayed and output, by using image data in the vicinity of the channel of the image data in which an error is detected, the properties of a three-dimensional moving image can be maintained and almost perfect. Since the image data can be restored, it is possible to obtain an image that is natural and comfortable for a person viewing the image display output even when reading of the compressed coded data or decoding is impossible due to an operation error due to a disturbance or the like. it can.

[Brief description of the drawings]

FIG. 1 is a block diagram of a three-dimensional moving image reproducing apparatus according to a first embodiment of the present invention.

FIG. 2 is an explanatory diagram showing a data array for explaining image data supplementation when decoding is impossible on an entire image of the stereoscopic video image reproducing apparatus according to the first embodiment of the present invention.

FIG. 3 is an explanatory diagram of a data array for explaining image data supplementation when a decoding error occurs and decoding is impossible in the stereoscopic video playback device according to the first embodiment of the present invention.

FIG. 4 is a diagram showing a case where a decoding error occurs in a partial area on an image after decoding of compression-encoded data of the stereoscopic video playback device according to the first embodiment of the present invention, and only that area cannot be decoded; FIG.

FIG. 5 is a block diagram of a three-dimensional moving image reproducing apparatus according to a second embodiment of the present invention.

FIG. 6 is an explanatory diagram showing a decoding error of stereoscopic video data and a recording order of compression-encoded data in the case of two channels in a stereoscopic video playback device according to a second embodiment of the present invention.

FIG. 7 is a block diagram showing a configuration of a stereoscopic video playback device according to a third embodiment of the present invention.

FIG. 8 is a block diagram showing a configuration of a stereoscopic video playback device according to a fourth embodiment of the present invention.

FIG. 9 is an explanatory diagram showing image data of a three-dimensional moving image when a lenticular lens method is applied to a three-dimensional moving image reproducing apparatus according to a fifth embodiment of the present invention.

FIG. 10 is an explanatory diagram showing a case where a decoding error occurs in a partial area on an image after decoding of the compression-encoded data by the conventional stereoscopic video playback device, and only that part cannot be decoded. .

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 11 Recording medium 12 Recording medium reading means 13 Image data storage means 14, 31R, 31L Decoding means 15, 32R, 32L Decoding error detection means 16 Demultiplexing means 17R, 17L First storage medium 18L, 18R Second storage medium 19R, 19L Output side image data storage means 30 Demultiplexing means F, F (R), F (L) Data transmission path

────────────────────────────────────────────────── ─── Continuing from the front page Examiner Tatsuya Yamazaki (56) References JP-A-6-98287 (JP, A) JP-A 5-145949 (JP, A) (58) Fields investigated (Int. Cl. ⁷⁾ , DB name) H04N 13/00-15/00

Claims (5)

(57) [Claims] 1. A three-dimensional moving image in which image data is read out from a recording medium on which each image data in each photographing direction obtained by photographing a subject from a plurality of directions is recorded, and is decoded to obtain a reproduced image. In the reproducing apparatus, a recording medium reading means for reading the image data from a recording medium on which each image data for each shooting direction obtained by shooting a subject from a plurality of directions is read; Decoding means for temporarily storing the decoded image data and then decoding the image data; decoding error detection means for detecting whether an error has occurred in the image data; and decoding the image data obtained by the decoding means for each shooting direction. Demultiplexing means for switching to transfer for each channel, and image data displayed on each channel obtained by the demultiplexing means. Output-side image data storage means to be stored, and compensation means for, when an error is detected in the image data, supplementing image data of another channel in the output-side image data storage means instead of error image data in image units. A stereoscopic video playback device comprising: 2. A three-dimensional moving image in which image data is read out from a recording medium on which image data for each of the photographing directions obtained by photographing a subject from a plurality of directions are recorded, and the reproduced data is decoded to obtain a reproduced image. In the reproducing apparatus, a recording medium reading means for reading the image data from a recording medium on which each image data for each shooting direction obtained by shooting a subject from a plurality of directions is read; Decoding means for temporarily storing the decoded image data and then decoding the image data; decoding error detection means for detecting whether an error has occurred in the image data; and decoding the image data obtained by the decoding means for each shooting direction. Demultiplexing means for switching to transfer for each channel, and image data displayed on each channel obtained by the demultiplexing means. An output-side image data storage means which is 憶, when an error is detected in the specific area of the image data,
A three-dimensional moving image reproducing apparatus, comprising: a supplementary means for supplementing image data of another channel in the output side image data storage means in place of error image data in image area units. 3. A method for photographing a subject from a plurality of directions.
Thus, the obtained image data for each shooting direction was recorded.
Reading the image data from the recording medium and decoding it
In a three-dimensional moving image reproducing device that obtains a reproduced image, the object is obtained by photographing a subject from a plurality of directions.
Before the recording medium on which each image data for each shooting direction is recorded
A recording medium reading unit reads the serial image data, the image data read by the recording medium reading means
Decoding means for once storing and decoding, and decoding for detecting whether an error has occurred in the image data.
An error detection unit, and a photographing direction of the image data obtained by the decoding unit.
Demultiplexing method to switch to transfer for each channel
Display at each stage and each channel obtained by the demultiplexing means
Output side image data storage device in which the image data to be stored is stored.
And when an error is detected in the image data, the error is detected.
A nearby image centered on the channel of the output image data
From image data, replace image data with error image data
Obtain the image data to be generated and convert the image data to an error image.
And supplementing means for supplementing in place of image data.
Characteristic stereoscopic video playback device. 4. A method for photographing a subject from a plurality of directions.
Thus, the obtained image data for each shooting direction was recorded.
Reading the image data from the recording medium and decoding it
When obtaining a playback image, errors are detected in specific image data.
When issued, another channel corresponding to the error image data
Replaces the image data of the channel with error image data
A three-dimensional moving image reproducing apparatus characterized by the above-mentioned. 5. A method for photographing a subject from a plurality of directions.
Thus, the obtained image data for each shooting direction was recorded.
Reading the image data from the recording medium and decoding it
When obtaining a playback image, errors are detected in specific image data.
Is output, the channel of the error image data belongs to.
Convert adjacent channel image data to error image data
A three-dimensional moving image reproducing apparatus characterized in that compensation is made instead.