JP2005094145A - Image recorder and image reproducer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform recording and reproduction while taking account of the versatility of dynamic image data where 2D image data and 3D image data exist mixedly. <P>SOLUTION: A separating means 2 separates input data Din into control data Hi and image data I and transmits the control data Hi and the image data I, respectively, to a control means 3 and a multiplex means 4. The control means 3 makes a decision whether the input data Din is 2D image data or 3D image data based on existence of 3D control data in the control data Hi. The control means 3 creates control data Ho as the header information of a display file from the control data Hi and transmits it to the multiplex means 4. The multiplex means 4 multiplexes the image data I and the control data Ho as the header information of a file. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image recording apparatus that records a two-dimensional (2D) image and a three-dimensional (3D) image, and an image reproducing apparatus that reproduces the image.

  Conventionally, various methods for displaying a three-dimensional image have been proposed. Among them, what is generally used is a so-called “binocular type” that uses binocular parallax. That is, it is possible to perform stereoscopic viewing by preparing a left-eye image and a right-eye image having binocular parallax and independently projecting them on the left and right eyes.

  A field sequential method and a parallax barrier method have been proposed as representative methods of the binocular system.

  FIG. 20 is a conceptual diagram for explaining the field sequential method. In this field sequential method, as shown in FIG. 20, left-eye images and right-eye images are arranged alternately every other pixel in the vertical direction to display left-eye images and right-eye images. Are displayed alternately. The image for the left eye and the image for the right eye have a vertical resolution of ½ compared to the normal two-dimensional display. The observer wears shutter-type glasses that open and close in synchronization with the display switching cycle. The shutter used here opens the left eye side and closes the right eye side when the left eye image is displayed, and closes the left eye side and opens the right eye side when the right eye image is displayed. By doing so, the image for the left eye is observed only with the left eye, and the image for the right eye is observed only with the right eye, and stereoscopic viewing can be performed.

  FIG. 21 is a conceptual diagram for explaining the parallax barrier method. FIG. 21A is a diagram illustrating the principle of generating parallax. On the other hand, FIG. 21B is a diagram showing a screen displayed by the parallax barrier method.

  In FIG. 21A, an image in which the left-eye image and the right-eye image are arranged alternately every other pixel in the horizontal direction as shown in FIG. 21B is displayed on the image display panel 101. Then, by placing the parallax barrier 102 having slits at an interval narrower than the interval of pixels of the same viewpoint on the front surface of the image display panel 101, the left eye image is only the left eye 103, and the right eye image is the right eye 104. Therefore, stereoscopic observation can be performed.

  In order to perform the stereoscopic viewing as described above, the left-eye image and the right-eye image to be displayed are each photographed with a digital camera or the like. In this case, two files are created. When these files are handled by a general-purpose recording / playback device or transmission device, these images are two pairs of images constituting a left-eye image and a right-eye image for stereoscopic viewing. A problem that cannot be recognized and will be handled as an independent image, causing only one of the left-eye image and the right-eye image to be deleted or transmitted by mistake. was there.

In order to solve such a problem, in Patent Document 1, information other than an image related to the stereo image is added to a stereo (two-lens type) image that includes left and right viewpoint images in one image. A technique relating to an image device configured as one image handling unit (file) and handling an image by the file is disclosed.
JP 2002-77943 A

  However, in Patent Document 1, since information other than images related to stereo images is added to form one image handling unit (file), 2D image data and 3D image data are mixed when applied to a moving image file. There was a problem that video files (mixed files) could not be handled. Here, 2D refers to two dimensions, 3D refers to three dimensions, and a 2D image is an image composed only of a conventional single viewpoint image. On the other hand, a 3D image is an image configured by a set of a plurality of images having parallax.

  FIG. 22 shows an example of a 3D image. The 3D image 112 in this example is a 3D image in which images corresponding to the two viewpoints of the left-eye image 110 and the right-eye image 111 are thinned in a horizontal direction and then arranged side by side.

  Also, such a mixed file cannot be played back by a conventional playback apparatus that cannot display 3D images, or the image for left eye 110 arranged side by side in the horizontal direction as shown in FIG. There has been a problem that the right-eye image 111 is displayed as it is.

The present invention has been made to solve the above problems, and its purpose is as follows.
Each of 2D image data, 3D image data, or data in which 2D image data and 3D image data are mixed, and a moving image composed of at least one or more 2D image data, and at least one or more 3D images An image recording apparatus that automatically records management information that can be viewed and managed in a predetermined time unit by recording it as it is or by compressing or converting it into moving images composed only of data, and the management information Accordingly, an object of the present invention is to provide an image reproduction apparatus that reproduces a moving image each composed of at least one 2D image data or 3D image data.

  The present invention relates to an image recording apparatus that creates and records an image file from input image data including various data, and includes only separation means for separating the input data into at least image data and control data, respectively, and two-dimensional image data. File creating means for creating a two-dimensional image file to be created and a three-dimensional image file composed of only three-dimensional image data, and whether the separated image data is two-dimensional image data based on the control data. Control means for determining whether the image data is dimensional image data and causing the file creation means to create a file based on the determination result.

  Further, the present invention is characterized in that, in the image recording apparatus, the control unit causes the two-dimensional image files to be collectively created and the three-dimensional image files are collectively created.

  The present invention is also characterized in that the image recording apparatus comprises a decoding means for decoding the encoded input data.

  Further, the present invention is characterized in that the image recording apparatus includes encoding means for encoding the image data separated by the separating means, and the file is constituted by encoded image data.

  Further, the present invention is characterized in that the image recording apparatus includes 3D / 2D conversion means for converting 3D image data into 2D image data, and creates a 2D image file from the converted 2D image data. To do.

  In the image recording apparatus, the present invention extracts only data obtained by encoding an area necessary for decoding an image of one viewpoint constituting two-dimensional image data from encoded input data, 3D / 2D conversion means for creating new encoded data for two-dimensional display is provided.

  Further, the present invention is characterized in that the image recording apparatus creates at least one management information file for performing reproduction and file management of a plurality of files recorded by the image recording apparatus. And

  In the image recording apparatus according to the present invention, the management information file includes identification information for identifying a two-dimensional image file and a three-dimensional image file.

  Further, the present invention is characterized in that the image recording apparatus includes offset information of a file managed in the management information file.

  According to the present invention, in the image recording apparatus, if the contents of the control data indicating the characteristics of the image data do not match among the image data constituting the file, the image data further matches the control data. A feature is that the files are created separately from each other.

  Further, the present invention is characterized in that, in the image recording apparatus, the recorded file is arranged under a folder divided for each program.

  In the image recording apparatus, the recorded 2D image file is placed in a folder for 2D image files, and the 3D image file is placed under a folder for 3D image files. .

  Further, the present invention is characterized in that in the image recording apparatus, a file name is created by using a distinction between a two-dimensional image file and a three-dimensional image file, information on the contents of each file, and a reproduction order.

  In the image recording apparatus, when one program is divided and recorded into at least one file, information indicating that the program is the same program and the file constituting the one program And the information of the order in which the file is reproduced are recorded in the file.

  According to the present invention, in an image reproducing apparatus for reproducing and displaying image data based on management information including information relating to file reproduction, data reading means for accessing the data or file and reading the contents, two-dimensional or three-dimensional from the read data Separation means for separating the image data of the dimension and the control data, display means for displaying the image data, and based on the management information, the data reading means reads the necessary data, and the control data And a control means for displaying on the display means.

  Further, the present invention is characterized in that the image reproducing apparatus further includes 3D / 2D conversion means for generating two-dimensional image data by performing two-dimensional conversion on the three-dimensional image data.

  In the image reproduction apparatus according to the present invention, the display means is dedicated to two-dimensional display not corresponding to three-dimensional display, and the control means performs three-dimensional image data when reproducing using the management information. It is characterized by skipping the reproduction of.

  Furthermore, the present invention is characterized in that the image reproducing apparatus includes means for notifying that when reproduction of the three-dimensional image data is skipped.

  Further, the present invention provides the image playback apparatus, wherein, when the control means makes the data reading means random access based on the management information, the playback time of the data or file being randomly accessed and the offset The information is added and reproduced as the current time on the management information.

  According to the image recording apparatus of the present invention, the input data is divided into 2D image data and 3D image data and recorded so as not to create a file in which 2D image data and 3D image data are mixed. Even in a playback device such as a 2D display playback device that cannot reproduce image data or a 3D non-compatible 2D display device that cannot convert 3D image data into 2D image data for display, the recorded data must be at least 2D. All broadcast parts can be played back correctly.

  Furthermore, according to the image recording apparatus of the present invention, since two-dimensional image files and three-dimensional image files are created together, the number of files to be handled can be reduced and management becomes easy.

  Furthermore, according to the image recording apparatus of the present invention, even when encoded data is input, a decoding means is added to the image recording apparatus 1, and the decoding means is arranged between the separating means 2 and the multiplexing means 4, By transmitting the decoded image data to the multiplexing means 4, it is possible to create a file of decoded image data that does not require decoding processing during file reproduction.

  Further, according to the image recording apparatus of the present invention, even when the input of the image recording apparatus is decoded image data or the decoded image data can be handled such that the image recording apparatus includes a decoding unit for the input image encoded data. The encoding unit is added to the image recording apparatus, the decoded image data is input to the encoding unit, and the encoded data is transmitted to the multiplexing unit, thereby creating a file of encoded image data. In addition, the compression rate and file size of the output file can be arbitrarily changed by changing the encoding parameters.

  Furthermore, according to the image recording apparatus of the present invention, 3D / 2D conversion (conversion processing for converting 3D image data into 2D image data) is performed on the input 3D image data, and the 3D is recorded as 2D image data. Even a playback device such as a non-compatible 2D display device can play back a portion broadcast in 3D in 2D. That is, all the programs including 3D image data can be reproduced without skipping the middle of the program.

  Furthermore, according to the image recording apparatus of the present invention, the encoded data is directly operated to extract only the encoded data of the area necessary for decoding the image of one viewpoint, and a new code for 2D display is obtained. By creating digitized data, 3D / 2D conversion can be performed at high speed. Also, by changing the aspect ratio, the size of the image to be encoded can be reduced, so that the compression rate can be increased.

  Further, according to the image recording apparatus of the present invention, the image recording apparatus creates a management information file for each reproducing apparatus that handles only files that can be reproduced by the reproducing apparatus, and each reproducing apparatus stores the created management information file. By using the file to handle the file, it is possible to reproduce the file in common even with a reproducing apparatus having different specifications.

  Furthermore, according to the image recording apparatus of the present invention, by using one management information file and apparently managing it as one file, handling of the user's file is simplified, and when file search or the like is used, Search time can be shortened.

  Furthermore, according to the image recording apparatus of the present invention, a folder reflecting information related to the contents of a file is created for a file to be played specified in the management information file, and the folder is placed under the folder, thereby managing information Even if there is no file, the user can determine the contents of the file from the folder name and its location. In addition, handling of the file itself is simplified, and the time required for the search can be shortened even when the file search is used.

  Furthermore, according to the image recording apparatus of the present invention, by reflecting the file contents and the reproduction order in the file name for the file to be reproduced designated in the management information file, the user can easily change the file contents and The playback order can be determined from the file name, and the handling of the file is simplified.

  Furthermore, according to the image recording apparatus of the present invention, when one program is divided and recorded into at least one or more files, information such as the total number of all moving image files constituting the program and the playback order is stored in the file. By recording the file, it is possible to correctly reproduce even when there is no management information file.

  Further, according to the image recording apparatus of the present invention, for each file to be reproduced designated by the management information file, whether the file is a file composed only of 2D image data or composed only of 3D image data. By using the management information for identifying whether the files are the same file, the same management information can be used in common for all of the 3D-compatible 3D display device, the 3D-compatible 2D display device, and the 3D non-compatible 2D display device.

  Further, according to the image recording apparatus of the present invention, when the user performs reproduction using the management information file on the reproduction apparatus and performs random access, the reproduction time of the currently accessed file and the offset information of the file are added. Is used as the time of access, so that the management information file can be apparently randomly accessed as one file.

  Furthermore, according to the image recording apparatus of the present invention, when the parameter in the 3D control information changes during the moving image sequence, the 3D file is divided and recorded at the time of the changed frame, thereby recording the 3D control information before and after the change. Of these, even a 3D display device that supports only 3D image data having either one of the 3D control information can easily access and play back the corresponding file.

  Further, according to the image reproduction apparatus of the present invention, 3D image data can be decoded by reproducing a file composed only of 2D image data and a file composed only of 3D image data using a management information file. Even if the display device is a display device that cannot decode 3D image data, only a file composed of only 2D image data can be used in common, and the entire data amount can be reduced.

  Further, according to the image reproduction apparatus of the present invention, the reproduction is performed using the management information file obtained by adding the identification management information for identifying the 2D file and the 3D file to the management information, thereby reproducing the 3D image data. Since the same management information file can be used by the device and a playback device that cannot decode 3D image data, the amount of management information files can be reduced without increasing the number of management information files. Becomes easier.

Before describing embodiments of the present invention, terms used in this specification are defined as follows.
Broadcast data is a general term for data transmitted from a broadcasting station, and includes broadcasts transmitted via radio or wire, Internet streaming broadcasts, and the like.
Content generally has the same meaning as a broadcast program, but here is a collection of data including at least one of video data, audio data, and data broadcasting data. The broadcast data includes a plurality of contents.

The program arrangement information is information for managing what kind of content is included in the broadcast data, and is information indicating the contents of a plurality of contents. FIG. 1 shows a configuration example of contents and program arrangement information in broadcast data. Each content includes program sequence information. For example, the program sequence information is recorded in the header portion of the content data.
The 3D image control information is information related to an image arrangement method (the number of viewpoints of each viewpoint image, the arrangement of viewpoint images such as a horizontal alignment, a vertical alignment, and a grid) indicating the characteristics of the 3D image, and controls the display of the 3D image. It is information used at the time.

The 3D display is to display a viewpoint image in which the left eye and the right eye of the observer are different from each other using images from a plurality of viewpoints. On the other hand, 2D display is to display so that the left and right eyes of the observer can observe the same image.
The 2D image data is image data for 2D display, and the 3D image data is image data for 3D display.
A scene composed only of 2D image data is called a 2D scene, and a scene composed only of 3D image data is called a 3D scene.

  A device capable of decoding 3D image data and capable of 3D display is a 3D compatible 3D display device, a device capable of decoding 3D image data and not capable of 3D display is a 3D compatible 2D display device, and 3D image data decoding. A device that cannot perform 3D display and is not capable of 3D display is referred to as a 3D non-compatible 2D display device.

<First Embodiment>
An image recording apparatus according to a first embodiment of the present invention will be described with reference to the drawings.
FIG. 2 is a block diagram showing a configuration example of the image recording apparatus according to the first embodiment of the present invention. In FIG. 2, the image recording apparatus 1 includes a separation unit 2, a control unit 3, a multiplexing unit (file creation unit) 4, and a switch 5.

  The separating means 2 separates multiplexed data obtained by multiplexing a plurality of types of data such as control data such as a header and image data and audio data by a predetermined method into data of respective components. As a multiplexing method, a transport stream (hereinafter referred to as TS) defined by the MPEG-2 system standard, an AVI (Audio Video Interleaved) format, an ASF (Advance Systems Format) format, and the like are known. In addition, the image and audio data include encoded data. For example, MPEG (Moving Picture Experts Group) -1, MPEG-2, MPEG-4, AVC (Advanced Video Coding) for image data, AAC (Advanced Audio Coding), MP3 (MPEG-1 Audio Layer-) for audio data. 3), WMA (Windows® Media Audio) and the like. Note that 2D image data, 3D image data, audio data, and control data may be input separately without using the separating unit 2.

  The control means 3 controls each means and switch so that image data and sound data are appropriately recorded by control data or the like. When the input image data is 3D image data, the control data includes 3D control information necessary for 3D display control. The 3D control information is, for example, the number of viewpoints included in one image, a composition method (3D image format format) for converting a plurality of viewpoints into one image as shown in FIG. 22 or FIG. Information relating to shooting conditions, 3D intensity indicating the degree of pop-out of 3D image data, threshold information for limiting the time for 3D display, and the like are included.

  The control means 3 can determine whether or not the input data is 3D image data based on the presence or absence of the 3D control information. Further, an identifier indicating whether the input data is 2D image data or 3D image data may be included in the 3D control information, and the determination may be made based on the identifier.

  The multiplexing unit 4 multiplexes the image and sound data input from the separating unit 2 and the control data input through the control unit 3 and outputs the multiplexed data to the switch 5. The multiplexing method includes TS, AVI format, ASF format, etc., as described in the demultiplexing means, but is not limited to these.

  The control means 3 switches the switch 5 depending on whether the data output from the multiplexing means 4 is 2D image data or 3D image data, and each of the data (or 2D file) and 3D is composed only of 2D image data. Data (or 3D file) composed only of image data is output.

Next, the operation of the image recording apparatus 1 according to the first embodiment of the present invention will be described in detail using an example in which the input is broadcast data and the output is a file. Hereinafter, for simplification of description, the audio data is omitted.
In the following, description will be made using parallax barrier image data as shown in FIG. 22 as an example of 3D image data to be handled.

FIG. 3 is an example of broadcast data in which 2D scenes and 3D scenes are mixed.
Table 1 summarizes the relationship between the recording time and the output file.

The time when the user started recording is t1, the time when the program P2 is started is t2, the time when the 2D scene is switched to the 3D scene within the program P2, and the time when the 3D scene is switched from the 3D scene to the 2D scene within the program P2. It is assumed that the time when the program P3 is started is t5, and the time when the user ends the recording is t6.
The programs P1 and P3 are programs composed only of 2D scenes, and the program P2 is a program in which 2D scenes and 3D scenes are mixed in one program.

From time t1 to t2, program P1, which is a broadcast of only a 2D scene, is input to Din, and a 2D file is created.
Input data Din is input to the separating means 2. Separating means 2 separates input data Din into control data Hi and image data I, and transmits control data Hi to control means 3 and 2D image data I to multiplexing means 4. The control data Hi separated from the broadcast data includes program arrangement information, and the program arrangement information includes 3D control information when 3D image data is broadcast in the program. Therefore, since the program P1 is only a 2D scene, there is no 3D control information in the control data Hi at this time.

  Since the 3D control information does not exist in the control data Hi, the control unit 3 determines that the input data Din currently input is 2D image data. In this case, the control unit 3 creates control data Ho as header information of the moving image file for 2D display from the control data Hi, and transmits the control data Ho to the multiplexing unit 4.

  The multiplexing unit 4 multiplexes the 2D image data I and the control data Ho as file header information to create a 2D file F1 composed of only 2D image data. The created 2D file F1 is output via the switch 5 under the control of the control means 3. The 2D file at this time has the same configuration as that of the conventional 2D moving image file.

  In the following description, the separating unit 2 operates in the same manner as the operation from the time t1 to the time t2, and the description thereof is omitted. When creating a 2D file, the multiplexing unit 4 operates in the same manner as the operation from the time t1 to the time t2, and the description thereof is omitted.

  From time t2 to t3, only the first 2D scene in the program P2 is input to Din, and a 2D file is created. The program arrangement information in the control data Hi at this time includes 3D control information, and the 3D control information includes identifier information indicating that the input data Din is 2D image data.

  The control means 3 determines the type of the input data Din from the identifier information. When it is determined that Din is 2D image data, the control unit 3 and the switch 5 perform the same operation as the operation from the time t1 to the time t2 to create and output the 2D file F2. Further, the control data Ho at this time does not include 3D control information.

  From time t3 to t4, only the 3D scene of the program P2 is input to Din, and a 3D file is created. The program arrangement information in the control data Hi at this time includes 3D control information, and the 3D control information further includes identifier information indicating that the input data Din is 3D image data.

  The control means 3 determines the type of the input data Din from the identifier information. When it is determined that Din is 3D image data, the control unit 3 creates control data Ho as header information of the moving image file for 3D display from the control data Hi and transmits the control data Ho to the multiplexing unit 4. The header information of the moving image file for 3D display created by the control means 3 at this time is information obtained by adding 3D control information to the extension area in the header information of the moving image file for 2D display.

The multiplexing unit 4 multiplexes the input 3D image data I and the control data Ho as file header information to create a 3D file F3, which is a file composed only of 3D image data. Further, the multiplexing means 4 stores 3D control information or a part thereof (for example, identifier information indicating whether the image is 2D image data or 3D image data) in the data of the frame unit of the image (for example, as extended information), and The file F3 may be created.
The created 3D file F3 is output via the switch 5 under the control of the control means 3.

  From time t4 to t5, only the 2D scene of the program P2 is input to Din, and the image recording apparatus 1 creates the 2D file F4 in the same manner as the operation from time t2 to t3. From time t5 to t6, only the 2D scene of the program P3 is input to Din, and the image recording apparatus 1 creates the 2D file F5 in the same manner as the operation from time t1 to t2.

A method for determining the input data Din data and the type of file to be output in the control means 3 using the control data Hi described above will be described with reference to a flowchart.
FIG. 4 is a flowchart showing a method of determining the data of the input data Din and the type of file to be output in the control means 3.

In step S 1, the control data Hi is input to the control means 3.
In determination step S2, it is determined whether 3D control information is included in the control data Hi, and if it is included, the process proceeds to determination step S3. If not included, it is determined that the type of input data is 2D image data and the file to be recorded is also a 2D file, and the determination process in the control means 3 is terminated.

In the determination step S3, it is determined whether or not identifier information indicating that the image data I is 3D image data exists in the 3D control information. If the identifier information exists, the type of the input data is 3D image data. The file to be recorded is also determined as a 3D file, and the determination process in the control means 3 is terminated. If it does not exist, it is determined that the type of input data is 2D image data and the file to be recorded is also a 2D file, and the determination process in the control means 3 is terminated.
By the determination method described above, the control means 3 determines the data of the input data Din and the type of file to be output.

In the above description, the files are divided into five files and output. However, among the files to be output, 2D files may be output together as arbitrary 2D files, and 3D files may be output together as arbitrary 3D files. For example, the file F1 and the file F2 that are 2D files may be one 2D file. Similarly, the file F4 and the file F5 that are 2D files may be one 2D file, or a file that is a 2D file of the same program. F3 and F5 may be a single 2D file, or all 2D files may be a single 2D file. Even if the files F3 and F5, which are 2D files, are output as one file by including information specifying which part of the file to be reproduced to realize the partial reproduction of the file in the management information, The program P2 can be reproduced separately.
As described above, 2D files are output between arbitrary 2D files, and 3D files are output together as arbitrary 3D files, so that the number of files to be handled can be reduced and management becomes easy.

  As described in the above description, the image recording apparatus 1 divides and records the input broadcast data into five files from the recording start time t1 to the recording end time t6.

  As described above, 2D image data cannot be reproduced by recording the input data separately for 2D image data and 3D image data so as not to create a file in which 2D image data and 3D image data are mixed. Even a playback device such as a display playback device or a 3D incompatible 2D display device that cannot convert 3D image data into 2D image data for display, a portion of recorded data broadcast as at least 2D image data Can all play correctly.

  In addition, the above description is based on the assumption that video data is input. However, when still images are transmitted by data broadcasting or the like, there are still image data for 2D display and 3D display in one data. Similarly, 2D files and 3D files can be recorded separately.

  When the image data I output from the separating unit 2 of the image recording apparatus 1 described above is encoded data, a decoding unit for decoding the image data I is arranged to decode the image data I, The decoded image data may be input to the multiplexing unit 4 to create a file.

FIG. 5 is a block diagram in which the image recording apparatus 1 according to the first embodiment of the present invention is provided with conversion means for converting the image data I.
The image recording apparatus 20 in FIG. 5 receives the data output from the separation unit 2 as input to the image recording apparatus 1 in FIG. 2, and the input data is decoded, re-encoded, and 3D / 2D converted. And the conversion means 21 for outputting to the multiplexing means 4 is added, and the separating means 2, multiplexing means 4, and switch 5 perform the same operations as described in the image recording apparatus 1.

  The control means 22 has a function of inputting a signal for controlling the conversion means 21 to the control means 3, and the signal inputted at this time is ON of the operation of each means constituting the conversion means 21. / OFF is a signal for switching each independently. For example, when the converting means 21 is constituted by a decoding means, an encoding means, a means for performing 3D / 2D conversion, or the like, the operation of each means can be switched independently.

  Next, the configuration and operation of the conversion means 21 when the conversion means 21 performs decoding will be described, and the description when re-encoding or 3D / 2D conversion is performed will be described later.

FIG. 6 is a block diagram showing a configuration example of the conversion means 21a when performing decoding.
The conversion means 21a at this time is composed only of the decoding means 31, and performs decoding on the input image data I which is encoded data, and outputs decoded image data. The multiplexing unit 4 multiplexes the decoded image data and the control data Ho output from the conversion unit 21a in the same manner as described with reference to FIG. 2, and creates a file.

  If the input image data I is unencoded image data, the control means 22 turns off the operation of the decoding means 31, and the conversion means 21a outputs unencoded image data. Create a file in the same way as

  As described above, even when encoded data is input, decoding means is added to the image recording apparatus 1, the decoding means is arranged between the separating means 2 and the multiplexing means 4, and the decoded image data is multiplexed. By transmitting the data to the converting means 4, it is possible to create a file of decoded image data that does not require a decoding process when the file is reproduced.

  Next, the configuration and operation of the conversion unit 21 when the conversion unit 21 performs re-encoding will be described.

  FIG. 7 is a block diagram illustrating a configuration example of the converting unit 21b when performing re-encoding. The conversion means 21 at this time is composed of a decoding means 31 and an encoding means 32. The decoding means 31 decodes the input image data I which is the encoded data, and the encoding means 32 receives the decoded image. Output data. The encoding unit 32 encodes the input image data, and the encoded image data is output to the multiplexing unit 4. Multiplexing means 4 multiplexes the output encoded data and control data Ho in the same manner as described with reference to FIG. 2 to create a file.

  When decoding is performed by the decoding unit 31, data in the middle of decoding may be output to the encoding unit and used for re-encoding. For example, if a motion vector or the like is used, the encoding unit 32 can omit a large motion vector detection process.

  As described above, even when the input of the image recording apparatus 1 is decoded image data or the image recording apparatus 1 includes a decoding unit for the input image encoded data and can handle the decoded image data, the image recording apparatus 1 performs encoding. By adding means, a file of encoded image data can be created. Furthermore, if the encoding parameters are changed, the compression ratio and file size of the output file can be arbitrarily changed.

  Examples of the encoding / decoding method used in the encoding means and decoding means include, but are not limited to, MPEG-2 video, MPEG-4 video, Motion-JPEG, and the like.

  Next, the configuration and operation of the conversion unit 21 when the conversion unit 21 performs 3D / 2D conversion will be described. Here, the 3D / 2D conversion means is means for converting 3D image data into 2D image data.

FIG. 8 is a diagram for explaining the state of the 3D / 2D conversion means.
In FIG. 8, the 3D image data 40 is configured by horizontally arranging left-eye image data and right-eye image data thinned by a half in the horizontal direction. The left-eye image data is selected from the 3D image data 40, and the 2D image data 42 is created by performing aspect conversion (horizontal enlargement) twice.
The 2D image data 42 may be created using the right eye image data.

FIG. 9 is a block diagram illustrating a configuration example of the conversion unit 21c when performing 3D / 2D conversion.
The conversion means 21c at this time is composed of a decoding means 31, a 3D / 2D conversion means 33, and an encoding means 32, and the decoding means 31 applies to input image data I which is encoded data. Decoding is performed, and the decoded image data is output to the 3D / 2D conversion means 33.

  The 3D / 2D conversion unit 33 receives information indicating whether or not the image data input from the control unit 22 to the conversion unit 21 is 3D image data. If the 3D image data is 3D / 2D, the 3D / 2D described above is input. Otherwise, the converted image data is output to the encoding means 32 as it is without performing 3D / 2D conversion on the input image data.

  The encoding unit 32 encodes the input image data, and the encoded image data is output to the multiplexing unit 4. The multiplexing unit 4 multiplexes the encoded data and the control data Ho to create a 2D file.

The control unit 22 transmits the control data Ho that does not include the 3D control information to the multiplexing unit 4, and controls the switch 5 so that the 2D file is output.
When 3D / 2D conversion is not performed, a 2D file is created in the same manner as when re-encoding is performed (FIG. 7).

  As described above, 3D / 2D conversion is performed on the input 3D image data and recorded as 2D image data, so that even a playback device such as a 3D non-compliant 2D display device has been broadcast in 3D. The part can be played back in 2D. That is, all the programs including 3D image data can be reproduced without skipping the middle of the program.

  Further, the 3D / 2D conversion means may extract only encoded data corresponding to an image of one viewpoint from the encoded data without using the decoding means to create new encoded data for 2D display. Good. At this time, since the extracted data corresponds to the image thinned by half in the horizontal direction, the horizontal aspect ratio information in the control data Hi or the encoded data is changed so that the image data is horizontally Reflects that it has been thinned by half.

  Further, when the encoded data is block-based encoding using motion prediction such as MPEG, image data of another viewpoint may be required to decode an image of one viewpoint. For example, in motion predictive coding for predicting motion from the previous frame (reference frame), this is the case when prediction is performed from a part of another viewpoint in the reference frame.

In this case, only the encoded data of the viewpoint to be extracted is extracted, and at the same time, all the encoded data is decoded using the decoding means, and only when the prediction is performed from the image area of the other viewpoint, the encoding means is used. Then, re-encoding is performed so that motion is predicted only from the image area of the viewpoint to be extracted, or re-encoding is performed using intra-picture encoding that does not use motion prediction.
Similarly, in motion vector prediction and DC / AC prediction, all regions that use data in image regions of other viewpoints are re-encoded.

  Also, in order to reduce the processing for the above re-encoding, the encoding means and the decoding means are not used, and the re-encoding is not performed, and only the necessary block encoded data is extracted to create a 2D file. May be. In this case, mismatching may occur in motion compensation, motion vector prediction, DC / AC prediction, etc., but 2D image data can be created at high speed. The region where such mismatch occurs is small, and normally, intra-frame encoded frames periodically enter. Therefore, mismatch does not accumulate over a long period of time, and image quality degradation is considered to be small.

  As described above, the encoded data is directly manipulated to extract only the encoded data of the area necessary for decoding the image of one viewpoint, and new encoded data for 2D display is created. As a result, 3D / 2D conversion can be performed at high speed. Also, by changing the aspect ratio, the size of the image to be encoded can be reduced, so that the compression rate can be increased.

  The 3D / 2D conversion means described above is a means for converting the input 3D image data into 2D image data and outputting it, but in parallel with outputting the converted 2D image data, You may output 3D image data simultaneously.

  In addition, a management information file may be separately created so that the 2D files and 3D files created as described above can be continuously played back in a recording unit or a program unit. Although it has been described that five files are created in the description of the image recording apparatus 1, the management information in this case will be described with an example.

  Table 2 summarizes the moving image file names, the recorded programs, and the types of data constituting the files.

An example of the management information file is shown in FIGS.
FIG. 10A is an example of a management information file for a 3D-compatible 3D display device and a 3D-compatible 2D display device.

  The management information includes information on the names of the video files to be played and their playback order. As shown in FIG. 10 (a), the video file names are listed and played back in order from the video files listed above. I do. Further, the management information file in FIG. 10 (a) is all the moving image files (F1, F2, F3, F4, F4, F3, F4, F4, F4, F4, F4, F4, F4, F4, F4, F3, F4, F4, F4, F4, F4). This is a management information file including F5).

FIG. 10B is an example of a management information file for a 3D non-compatible 2D display device.
The management information file in FIG. 10B includes all 2D files (F1, F2, F4, F5) recorded from the start to the end of recording by the user, and does not include 3D files. This is a configured management information file.

  FIG. 11 is an example of a management information file for a 3D-compatible 3D display device and a 3D-compatible 2D display device. The management information files in FIGS. 11A, 11B, and 11C are obtained by dividing the management information file in FIG. 10A into program units.

  On the other hand, FIG. 12 is an example of a management information file for a 2D display device that does not support 3D. The management information files in FIG. 12A, FIG. 12B, and FIG. 12C are obtained by dividing the management information file in FIG. 10B into program units.

In the above description, the moving image file is described. However, the present invention can be similarly applied to a still image file and a data file such as a data broadcast.
In addition, when creating management information in which a 3D file is skipped as shown in FIGS. 10B and 12B, information indicating that there is a skipped file in the management information, or the skipped file is a 2D file. Or information indicating whether the file is a 3D file or information such as the playback time length of the skipped file may be included.

  As described above, at least one management information file is created by the image recording apparatus 1 to manage a file composed only of 2D image data or a file composed only of 3D image data. That is, the image recording apparatus 1 creates a management information file that handles only files that can be played back by the playback apparatus for each playback apparatus, and each playback apparatus handles the file using the created management information file. Thus, it is possible to play back files in common even with playback devices of different specifications. For example, a 3D non-compatible 2D display device can reproduce only a 2D file using a management information file excluding the 3D file name.

Also, by using one management information file and managing it as a single file, the handling of the user's file is simplified, and when searching for a file is used, the time required for the search can be shortened. I can do it.
Further, the management information itself may be stored in the header area of each moving image file without creating the management information file.
The image recording apparatus of the present invention may create a plurality of management information files at the same time. For example, when the input image data is 3D image data, a plurality of management information files each including a 2D file created by performing 3D / 2D conversion and a 3D file created without performing 3D / 2D conversion are created. May be.
At this time, conversion information indicating that the file is a 2D file created by performing 3D / 2D conversion may be included in the management information file.

  In addition, files reproduced according to one management information file may be placed under the same folder. For example, if you have created all the files recorded at a certain date and time and the management information file to play them, you can place all those files under that folder with the recorded date and time as the folder name. Good.

  Alternatively, a folder may be created for each program, and the files for each program may be placed in the corresponding folder. Further, the 2D file and the 3D file may be managed in separate folders. Further, folder management may be performed in a combination of all of these.

FIG. 13 shows an example of a folder created when managing at least one 2D file and 3D file in a folder.
For example, when there is a management information file for recording programs P1, P2, and P3 separately as 2D files and 3D files as shown in FIG. As described above, a recording date / time folder indicating the time at which recording is started (or ended) is first created, a program folder indicating each program is created thereunder, and a folder for a 2D file is created under the folder for each program. Create folders for 3D files. Then, the file F1 is placed in the 2D folder of the program P1, the files F2 and F4 are placed in the 2D folder of the program P2, the file F3 is placed in the 3D folder of the program P2, and the file F5 is placed in the 2D folder of the program P3. .

Here, the program name may be input by the user, or the program name in the program arrangement information may be used. Further, it is not necessary to create a folder without a file to be stored. In the above example, the date and time, the program name, and 2D / 3D are created from the upper folder in this order, but they are not necessarily created in this order. For example, a folder for 2D files and a folder for 3D files may be set as the highest folder, and may be in any order. The date / time folder need not be created. Also, a folder indicating the playback order may be created.
At this time, information related to the contents of the file, such as the file recording date and time, the program name, the distinction between 2D files and 3D files (hereinafter referred to as file types), and the playback order of the files, is referred to as file attribute information.

  As described above, by creating a folder that reflects the file attribute information for the playback target file specified in the management information file and placing it under the folder, the user can manage the file even if there is no management information file. Can determine the contents of a file from the folder name and its location. In addition, handling of the file itself is simplified, and the time required for the search can be shortened even when the file search is used.

  In the above description, the file is arranged under the folder reflecting the file attribute information. However, this information may be reflected in the file name. For example, the file name may be composed of the date and time, the program name, the file type, and the extension. In the case of the file F1 in FIG. 10A, the name may be “January 1, 2003 0: 0: 0_program P1_2D. Extension”.

  Furthermore, information on the order of reproducing files in the management information may be reflected in the file name. For example, the file F1 shown in FIG. 10 (a) is “January 1, 2003 0: 0: 0_program P1_2D_001.extension”, and F2 is “January 1, 2003 0: 0: 0_program”. A file name may be created by adding a serial number indicating the reproduction order after the file type, such as “P2_2D — 002. extension”.

  As described above, by reflecting the file contents and playback order in the file name for the playback target file specified in the management information file, the user can easily change the file contents and playback order to the file. It can be judged from the name, and the handling of the file becomes simple.

Further, information regarding the program name may be included in the moving image file itself.
As described above, when one program is divided and recorded into at least one 2D file and 3D file, each file indicates that the file alone is only part of the program structure. Information, for example, information such as the total number of all moving image files constituting the program and the order of reproduction may be included in the moving image file. For example, in the case of FIG. 12B, the program name of the program P2 and the information “1/3” as the playback order / total number may be stored in the file F2 in the extension area of the header.

  As described above, when one program is divided and recorded into at least one file, by recording information such as the total number of all video files constituting the program and the order of playback in the file, Even when there is no management information file, one program can be reproduced correctly.

Further, identification management information for identifying the 2D file and the 3D file may be added to each of the reproduction target files specified in the management information file described above.
With the above identification management information, all files are played back on a 3D-compatible 3D display device or a 3D-compatible 2D display device, while a 2D file and a 3D-compatible 2D display device are played back. It is possible to reproduce only the 2D file by skipping the 3D file.

The 3D-compatible 2D display device is a device that includes 3D / 2D conversion means, converts the decoded 3D image data into 2D image data, and performs 2D display.
The 3D non-compatible 2D display device may be provided with means for notifying the user when a 3D file is skipped.

  As described above, the identification management information for identifying whether the file is a 2D file or a 3D file is the same for each reproduction target file specified in the management information file. Can be used in common for all 3D compatible 3D display devices, 3D compatible 2D display devices, and 3D non-compatible 2D display devices.

The management information may include offset time information for each file to be reproduced. This offset time information is information used when performing random access.
Table 3 shows an example of offset information for each file in the management information of FIG.

In Table 3, the offset information of the file F1 is 0, the offset information of the file F2 is the reproduction time length of the file F1, the offset information of the file F3 is the sum of the reproduction time lengths of the files F1 and F2, and the offset information of the file F4 is the file F1. , F2 and F3, and the offset information of the file F5 is the sum of the reproduction times of the files F1, F2, F3 and F4.
Since the file F1 is the first file, the offset information may be omitted.

  As described above, when the user performs playback using the management information file on the playback device and performs random access, the playback time of the currently accessed file and the offset information of the file are added as the time of access. By using it, it is possible to access the management information file at random as an apparent one file.

  In the above example, it has been described that the file is divided from the 2D image data to the 3D image data, or from the time when the 3D image data changes to the 2D image data, the end of the program, the start time, etc. However, if the 3D control information changes such that the format of the 3D image or the number of viewpoints included in one 3D image frame is different at a certain time, the 3D image data is divided at that time. May be recorded.

  For example, if the number of viewpoints changes from 2 to 3, or the image format changes from sequential image data in FIG. 20 to image data 102 for the parallax barrier method in FIG. 22, the time at which the change occurred 3D image data may be divided and recorded.

  When the parameter in the 3D control information changes during the 3D moving image sequence, the 3D file may be divided and recorded at the time of the changed frame. At this time, a management information file that reproduces only a 3D file having the same 3D control information may be created.

  As described above, when the parameter in the 3D control information changes in the middle of the 3D moving image sequence, the 3D file is divided and recorded at the time of the changed frame, so that either one of the 3D control information before and after the change is recorded. Even a 3D display device that supports only 3D image data having 3D control information can easily access and play back the corresponding file.

In the description of the first embodiment described above, the case where the input of the image recording apparatus 1 is broadcast data has been described. However, this input is not limited to broadcast data, and may be a file, a magnetic tape, an optical disk, or the like. It is not limited to these formats.
In addition, the input at this time is data composed only of 2D image data or data composed only of 3D image data, and is composed of both 2D image data and 3D image data. It does not matter.

  Further, the control data Hi at this time is program arrangement information if the input is broadcast data, header information if it is a file, track information if it is a magnetic tape, track information or sector information if it is an optical disk. For example, a digital video tape is an example of a magnetic tape. Here, the track format of the digital video tape will be briefly described.

  A generally used digital VTR employs a method called helical scan, in which data is recorded on discontinuous tracks on a tape. FIG. 14 shows this state. A plurality of tracks 50 exist on the tape, and one frame of 3D image data is also divided into a plurality of tracks 50 and recorded. The tape travel direction is from left to right in FIG. 14, and the rightmost track is scanned from the bottom to the top, and then the track on the left is scanned from the bottom to the top.

  FIG. 15 is an enlarged view of one of the tracks 50, and shows an example of the track format of the digital VTR. The track 50 includes an ITI (Insert and Track Information) area 60 for ensuring after-recording, an audio recording area 61 in which data relating to audio is recorded, an image recording area 62 in which data relating to an image is recorded, and accompanying information such as a time code. Is formed of a subcode recording area 63 in which is recorded.

  The image recording area 62 can record not only the 3D image data itself but also accompanying information related to the 3D image data. Similarly, in the sound recording area 61, not only the sound itself but also accompanying information related to the sound can be recorded. In addition to these two, accompanying information can be recorded in the subcode recording area 63 as described above. In addition, there is a margin between the areas, so that after-recording is possible.

  FIG. 16 is an enlarged view of the image recording area 62. The image recording area 62 includes a preamble 70 in which a synchronization pattern or the like is recorded, a VAUX (Video AUXiliary data) α71 and VAUX β73 in which incidental information about the image is recorded, an image encoded data recording area 72 in which image encoded data is recorded, The error correction code 74 is composed of a postamble 75 having a function for earning a margin.

  The area in which the accompanying information about the image is recorded is divided into VAUX α71 and VAUXβ73. Hereinafter, these two are collectively referred to as a VAUX region. Although not shown, the audio recording area 61 is also provided with an AAUX (Audio AUXiliary data) area as an area for recording accompanying information related to audio.

  The 3D control information is recorded in any one of the VAUX area, the AAUX area, and the subcode area. Further, for example, the 3D control information may be divided and recorded in a VAUX area and a subcode area, or the same data may be recorded in all of the VAUX area, the AAUX area, and the subcode area. Since each area can be individually overwritten by after-recording, information that may be changed during editing should be recorded in a subcode area that is easy for after-recording.

There is also a method of recording all in a VAUX area. In this case, the ease of post-recording is lost, but there is an advantage that handling is simplified because the accompanying information about the image is gathered in one place. For example, when making a copy on a medium having a different recording format, if only a copy of the image recording area is made, all information relating to the image can be acquired, and there is no need to handle the subcode area. Also, in order to avoid erasing these pieces of information due to overwriting by dubbing, a method of recording the same information in both the subcode area and the VAUX area is possible.
Alternatively, since the storage areas of the subcode area and the VAUX area are limited in size, it is possible to record the 3D control information in the AAUX area when the subcode area and the VAUX area cannot be stored in these areas.

  Note that the format of the digital video tape described above also conforms to the digital VTR system that is widely used for home use, except for a portion specific to 3D image data. For this reason, if 3D control information, which is accompanying information specific to 3D image data, is recorded in an extension area that is allowed to be extended in the home digital VTR format, the planar image and the 3D image data are recorded. Can be recorded on the same tape.

  In the case of such input data, the separating means 2 uses the accompanying information and 3D control information stored in the track area as control data, and multiplexes a plurality of types of data such as image data and audio data by a predetermined method. The multiplexed data is separated into each component data and output.

<Second Embodiment>
An image reproduction apparatus according to a second embodiment of the present invention will be described with reference to the drawings.
An image reproduction apparatus according to an embodiment of the present invention is a reproduction apparatus that reproduces 2D image data and 3D image data in accordance with input management information, and includes a 3D-compatible 3D display device, a 3D-compatible 2D display device, and a 3D non-compatible 2D display. The device hits it.

First, a 3D-compatible 3D display device will be described.
FIG. 17 is a block diagram showing a configuration example of an image reproduction apparatus according to the second embodiment of the present invention. In FIG. 17, the image reproducing device 80 includes a control unit 81, a data reading unit 82, a separating unit 83, a decoding unit 84, and a display unit 85.

The control unit 81 controls the data reading unit 82 in accordance with the management information input from the outside, and further controls the display unit 85 in accordance with the control data input from the separation unit 83 to appropriately reproduce the data. Here, the management information is the same information as described in the first embodiment.
The control unit 81 is a unit that can switch the operation of the decoding unit ON / OFF. When the input image data I ′ is unencoded image data, the control unit 81 uses the decoding unit 31. Turn off the operation.

The data reading unit 82 is a unit that accesses data or a file and reads the contents thereof. The data reading unit 82 reads and outputs data according to control information Ai input from the control unit 81. Here, the control information Ai is information indicating which data is to be read.
The separating means 83 operates in the same manner as the separating means 2 in FIG.

The decoding unit 84 is a unit that decodes input encoded data and outputs image data, and performs the same operation as the decoding unit of FIG.
The display means 85 is means for displaying input image data by switching between 2D display and 3D display in accordance with control information Ao input from the control means 81. Here, the control information Ao is information for instructing whether to perform 2D display or 3D display.

Next, the operation of the image reproduction device 80 according to the second embodiment of the present invention will be described in detail using an example.
Hereinafter, for simplification of description, the audio data is omitted as in the case of the first embodiment. Further, description will be made using parallax barrier image data as shown in FIG. 22 as an example of 3D image data to be handled.

  The image reproduction device 80 receives the management information file shown in FIG. 10A and performs reproduction according to the file. This file is a management information file created when broadcast data in which 2D scenes and 3D scenes are mixed as described in FIG. 3 is recorded.

Next, the operation of the image playback device 80 when playing back a 2D file will be described.
First, a management information file is input to the control means 81. The control means 81 transmits control information Ai instructing to read the data of the file F1 to be reproduced first to the data reading means 82.

Next, the data reading means 82 reads the file F1 based on the inputted control information Ai and transmits it to the separating means 83. The separation unit 83 transmits the header information of the input file F1 as control data H′i to the control unit 81 and the image data of F1 to the decoding unit 84. The decoding unit 84 decodes the image data and transmits the decoded image to the display unit 85.
At the same time, the control unit 81 analyzes the header information of the control data H′i, determines that it is a 2D file because there is no 3D control information, and transmits control information Ao indicating that 2D display is performed on the display unit 85. .
The display means 85 displays the input image data in 2D according to the control information Ao.

  When the data file reading unit 82 finishes reading the file F1, the data file reading unit 82 transmits read completion information indicating that the reading of the file is completed to the control unit 81. When the control means 81 receives the reading end information, if there is a file to be reproduced next, the control means 81 transmits control information Ai instructing to read the data to the data reading means 82, and if there is no file, reproduction ends.

  The 2D file is played back by repeating as described above. Since the files F2, F4, and F5 are reproduced in the same manner as F1, the description thereof is omitted.

Next, the operation of the image playback device 80 when playing back a 3D file will be described.
When the data file reading unit 82 finishes reading the file F2, the data file reading unit 82 transmits to the control unit 81 reading end information indicating that the reading of the file has ended. When receiving the reading end information, the control unit 81 transmits control information Ai for instructing to read the 3D file F3 to be reproduced next to the data reading unit 82.
The data file reading unit 82, the separating unit 83, and the decoding unit 85 perform the same operations as described when reproducing the 2D file.

  At the same time, the control unit 81 analyzes the header information of the control data H′i, determines that it is a 3D file because there is 3D control information, and transmits the control information Ao to the display unit 85. The control information Ao at this time includes information indicating 3D display and information indicating the format of image data input to the display unit 85.

  The display means 85 performs 3D display according to information indicating that the control information Ao is displayed in 3D. At this time, the display unit 85 rearranges the input image data into a 3D display format based on the information on the format of the input image data in the control information Ao, and displays the 3D image.

  When the data file reading unit 82 finishes reading the file F3, the data file reading unit 82 transmits read completion information indicating that the reading of the file is completed to the control unit 81. Thereafter, as in the case of the 2D file, the control means 81 performs reproduction if there is a next file, and ends reproduction if there is no next file.

  As described above, the image playback device 80 (3D-compatible 3D display device) performs playback according to the management information file.

Next, a 3D-compatible 2D display device will be described.
In the case of a 3D-compatible 2D display device, the description can be made only by changing the display means 85 of the image reproduction device 80. Therefore, the 3D-compatible 2D display device performs operations peculiar to the 3D-compatible 2D display device, such as the control unit 81, the data reading unit 82, the separation unit 83, and the decoding unit 84 that perform the same operations as those described in the image reproducing device 80. It comprises display means. Description of the means having the same operation is omitted.

  The display means in the 3D-compatible 2D display device has a 3D / 2D conversion function. When the input image data is 3D image data, the display means displays 2D image data that has undergone 3D / 2D conversion. Control information Ao is input from the control means 81 to the display means. The control information Ao is the same as that described with reference to FIG.

When the control information Ao indicates that the control information Ao is 3D image data, the display means at this time performs 3D / 2D conversion based on the format information of the control information Ao, converts it to 2D image data, and displays it in 2D. The input image data is displayed in 2D as it is.
In this way, the 3D-compatible 2D display device performs reproduction in 2D display according to the management information file.

The 3D non-compliant 2D display device indicates a conventional 2D display device capable of reproducing and displaying a 2D file, and description of the configuration and operation thereof is omitted. In this case, reproduction is performed using a management information file indicating that only a file dedicated to 2D display is reproduced.
Further, in the 3D-compatible 3D display device and the 3D-compatible 2D display device described above, when it is determined that the image data input by the control unit is 3D image data, the input image data is 3D image data. May be displayed in a predetermined area of the screen.

  As described above, even a display device that can decode 3D image data by playing back a file composed only of 2D image data and a file composed only of 3D image data using the management information file. Even in a display device that cannot decode 3D image data, only a file composed only of 2D image data can be used in common, and the entire data amount can be reduced.

  Next, operations of the 3D-compatible 3D display device, the 3D-compatible 2D display device, and the 3D non-compatible 2D display device when the management information file to which the identification management information is added are reproduced will be described.

  Regarding the 3D-compatible 3D display device and the 3D-compatible 2D display device, even if a management information file with identification management information is input, the configuration and operation thereof are the same as when a management information file without identification management information is input. Therefore, explanation is omitted. However, if the file type in the identification management information does not match the file type determined from the presence / absence of the 3D control information, the control unit may display a message to that effect.

Next, the operation of the 3D non-compliant 2D display device when a management information file having identification management information is input will be described.
FIG. 18 is an example of a management information file having identification management information. This is obtained by adding identification management information for identifying a 2D file and a 3D file to the management information file described with reference to FIG.

FIG. 19 is a block diagram showing a 3D incompatible 2D display device which is another configuration example of the image reproducing device according to the second embodiment of the present invention.
The image playback device 220, which is a 3D non-compatible 2D display device, operates in the same manner as described for the 3D compatible 3D display device, the data reading means 82, the separating means 83, the decoding means 84, and the operations specific to the 3D compatible 2D display device. Display means 92 for performing the above and control means 91 for controlling them. Description of the means having the same operation is omitted.

  A management information file is input to the control means 91. The control means 91 reads the identification management information from the management information file, and determines that the 3D file F3 is skipped and reproduced. Then, the control unit 91 controls the data reading unit 82 so as to read the 2D files F1, F2, F4, and F5 in this order. The display unit 92 displays the input image data as it is in 2D.

  As described above, the image reproduction device 90 reads the identification management information from the management information file, determines the 3D file to be skipped, and does not reproduce the 3D-compatible 3D display device, the 3D-compatible 2D display device, or the 3D non-compatible 2D display. A common management information file can be used in the device.

Further, instead of skipping the playback of the 3D file, a predetermined image may be displayed on the 3D file and only the audio may be played back.
Further, in the 3D incompatible 2D display device, when the 3D file is skipped or a predetermined image is displayed and only the sound is reproduced, the image reproducing device 220 may be provided with a means for notifying the user of that fact.
In addition, when the image reproduction device 90 described above determines that the image data input by the control unit 92 is 3D image data, a message indicating that the input image data is 3D image data is displayed on the screen. It may be displayed in the area.

  As described above, a playback apparatus capable of decoding 3D image data by playing back using the management information file in which identification management information for identifying the 2D file and the 3D file is added to the management information, and the 3D image data However, since the same management information file can be used in a playback device that cannot be decoded, the number of management information files does not increase, and the data amount of all management information files can be reduced and management becomes easy.

  In addition, in the image apparatus according to the second embodiment of the present invention described above, when management information includes offset time information and random access is performed, the access is performed in the same manner as described in Table 3. You may calculate the time of a place and play based on it.

It is a conceptual diagram which shows the structural example of the content in broadcast data, and program arrangement | sequence information. 1 is a block diagram illustrating a configuration example of an image recording apparatus according to a first embodiment of the present invention. It is a conceptual diagram which shows an example of the broadcast data in which 2D scene and 3D scene were mixed. 4 is a flowchart showing a method for determining the type of input / output data in the control means 3; It is a block diagram which shows the structural example at the time of providing the image recording device 1 by the 1st Embodiment of this invention with the conversion means which converts data. It is a block diagram which shows the structural example of the conversion means 141 at the time of decoding. It is a block diagram which shows the structural example of the conversion means 141 at the time of performing re-encoding. It is a conceptual diagram explaining the mode of a 3D / 2D conversion means. It is a block diagram which shows the structural example of the conversion means 141 at the time of performing 3D / 2D conversion. It is a conceptual diagram which shows an example of a management information file. It is a conceptual diagram which shows an example of a management information file. It is a conceptual diagram which shows an example of a management information file. It is a conceptual diagram which shows an example of the management by the folder of at least 1 or more file. It is a conceptual diagram which shows an example of the track | truck arrange | positioned on the tape of digital VTR. It is a conceptual diagram which shows an example of the track format of digital VTR. It is a conceptual diagram which shows an example of the image recording area in the track format of digital VTR. It is a block diagram which shows the structural example of the image reproduction apparatus by the 2nd Embodiment of this invention. It is a conceptual diagram which shows an example of the management information file with identification management information. It is a block diagram which shows another structural example of the image reproduction apparatus by the 2nd Embodiment of this invention. It is a conceptual diagram for demonstrating a field sequential system. It is a conceptual diagram for demonstrating a parallax barrier system. It is a conceptual diagram which shows an example of 3D image.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image recording apparatus 2 Separation means 3 Control means 4 Multiplexing means 5 Switch 40 3D image data 41 2D image data 80 Image reproduction apparatus 81 Control means 82 Data reading means 83 Separation means 84 Decoding means 85 Display means 110 Left eye image 111 Right eye image 112 3D image 101 Image display panel 102 Parallax barrier 103 Left eye 104 Right eye 20 Image recording device 21 Conversion unit 31 Decoding unit 32 Encoding unit 33 3D / 2D conversion unit 50 Track 60 ITI region 61 Audio recording region 62 Image recording area 63 Subcode recording area 70 Preamble 71 VAUXα
72 VAUXβ
73 Image encoded data recording area 74 Error correction code 75 Postamble 90 Image reproduction device 91 Control means 92 Display means

Claims (19)

In an image recording apparatus for creating and recording an image file from input image data including various data,
Separation means for separating input data from at least image data and control data,
File creation means for creating a two-dimensional image file composed of only two-dimensional image data and a three-dimensional image file composed of only three-dimensional image data;
Control means for determining whether the separated image data is two-dimensional image data or three-dimensional image data based on the control data, and causing the file creation means to create a file based on the determination result;
An image recording apparatus comprising:   2. The image recording apparatus according to claim 1, wherein the control unit causes the two-dimensional image files to be collectively created to create a file, and the three-dimensional image files to be collectively created.   3. The image recording apparatus according to claim 1, further comprising decoding means for decoding the encoded input data. Encoding means for encoding the image data separated by the separation means,
The image recording apparatus according to claim 1, wherein the file is composed of encoded image data. 3D / 2D conversion means for converting 3D image data into 2D image data,
The image recording apparatus according to claim 1, wherein a two-dimensional image file is created from the converted two-dimensional image data.   Extracts only the data that encodes the area necessary to decode the image of one viewpoint constituting the 2D image data from the encoded input data, and creates new encoded data for 2D display The image recording apparatus according to claim 1, further comprising a 3D / 2D conversion unit configured to perform the 3D / 2D conversion.   The at least one management information file for performing reproduction and file management of a plurality of files recorded by the image recording apparatus is created. Image recording device.   8. The image recording apparatus according to claim 7, wherein the management information file includes identification information for identifying a two-dimensional image file and a three-dimensional image file.   8. The image recording apparatus according to claim 7, further comprising offset information of a file managed in the management information file.   If the contents of the control data indicating the characteristics of the image data do not match among the image data constituting the file, the file is further divided and created with the image data with the matching control data. The image recording apparatus according to claim 1.   11. The image recording apparatus according to claim 1, wherein the recorded file is arranged under a folder divided for each program.   11. The image according to claim 1, wherein the recorded 2D image file is placed in a folder for 2D image files, and the 3D image file is placed under a folder for 3D image files. Recording device.   The image recording apparatus according to any one of claims 1 to 10, wherein a file name is created using a distinction between a two-dimensional image file and a three-dimensional image file, information on the contents of each file, and a reproduction order.   When one program is divided and recorded into at least one file, information indicating that the programs are the same, the total number of the files constituting the one program, and information on the order in which the files are reproduced 14. The image recording apparatus according to claim 1, wherein each of the images is recorded in the file. In an image reproducing apparatus for reproducing and displaying image data based on management information including information related to file reproduction,
Data reading means for accessing data or files and reading the contents;
Separating means for separating the two-dimensional or three-dimensional image data and the control data from the read data;
Display means for displaying the image data;
An image reproducing apparatus comprising: control means for causing the data reading means to read necessary data based on the management information and causing the display means to display the data based on the control data.   16. The image reproducing apparatus according to claim 15, further comprising 3D / 2D conversion means for generating two-dimensional image data by performing two-dimensional conversion on the three-dimensional image data. The display means is dedicated to two-dimensional display not corresponding to three-dimensional display,
16. The image reproduction apparatus according to claim 15, wherein the control unit skips reproduction of the three-dimensional image data when performing reproduction using the management information.   18. The image reproducing apparatus according to claim 17, further comprising means for notifying that the reproduction of the three-dimensional image data is skipped.   When the control means allows the data reading means to be randomly accessed based on the management information, it adds the reproduction time of the randomly accessed data or file and the offset information to the current information on the management information. The image reproducing apparatus according to claim 15, wherein the image reproducing apparatus is used for reproduction as time.

Images