JP2005184377A - Image conversion apparatus and image recording apparatus using it - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow easily taking out image data by converting a 2D image to a 3D still image or 3D animation or from a 3D image to a 2D still image or 2D animation as a user desires. <P>SOLUTION: A switch 11 selects outputting of an inputted 3D animation data to an image conversion means 12, outputting to an encoder 14, or turning OFF the output, based on an output selection information which is the mode information of an output image. The image conversion means 12 converts a 3D animation data to a 2D animation data based on an input format information and output format information. A still image capturing means 13 captures a still image from the 2D animation having been converted by the image conversion means 12 or from the 3D animation with no conversion based on the output format information, and outputs it to the encoder 14. The encoder 14 encodes the still image which has been captured, and a multiplexing means 16 multiplexes the information such as header information generated by an information generating means 15 with an image data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image conversion apparatus capable of converting a three-dimensional (3D) or two-dimensional (2D) still image or moving image into a two-dimensional (2D) or three-dimensional (3D) still image or moving image, and image recording using the same. It relates to the device.

  Conventionally, various methods for displaying a three-dimensional image have been proposed. Among them, what is generally used is a so-called “binocular type” that uses binocular parallax. In other words, a left-eye image and a right-eye image having binocular parallax are prepared, and stereoscopic vision is performed by projecting them to the left and right eyes independently.

  FIG. 16 is a conceptual diagram for explaining a “time division method”, which is one of the typical two-lens methods. In this time division method, as shown in FIG. 16, the left-eye image and the right-eye image are alternately arranged every other pixel in the vertical direction to display the left-eye image and the right-eye image. Are alternately displayed. The image for the left eye and the image for the right eye have a vertical resolution of ½ compared to the normal two-dimensional display. The observer wears shutter-type glasses that open and close in synchronization with the display switching cycle. The shutter used here opens the left eye side and closes the right eye side when the left eye image is displayed, and closes the left eye side and opens the right eye side when the right eye image is displayed. By doing so, the image for the left eye is observed only with the left eye, and the image for the right eye is observed only with the right eye, and stereoscopic viewing can be performed.

  FIG. 17 is a conceptual diagram for explaining a “parallax barrier method” which is another representative method of the two-lens method. FIG. 17A is a diagram illustrating the principle of generating parallax. On the other hand, FIG. 17B is a diagram showing a screen displayed by the parallax barrier method.

  In FIG. 17A, an image in which left-eye images and right-eye images are arranged alternately every other pixel in the horizontal direction as shown in FIG. Then, by placing the parallax barrier 402 having slits at intervals smaller than the interval between pixels of the same viewpoint on the front surface of the image display panel 401, the left eye image is only the left eye 403, and the right eye image is the right eye 404. Therefore, stereoscopic observation can be performed.

  Incidentally, as in the parallax barrier method, there is a “lenticular method” as a method for three-dimensionally displaying an image as shown in FIG. An example of a recording data format for use in this lenticular method is disclosed in Patent Document 1 described later.

FIG. 18 is a conceptual diagram showing an example of the recording data format of such a parallax barrier method or lenticular method. From the left-eye image 501 shown in FIG. 18 (a) and the right-eye image 502 shown in FIG. 18 (b), each is thinned by half in the horizontal direction, and one mixed image shown in FIG. 18 (c) is obtained. An image 503 is created and recorded. At the time of reproduction, the mixed image 503 is rearranged to create a composite image as shown in FIG.
Although the above description is a method for forming a 3D image by combining images from two viewpoints, it is naturally conceivable to form an image from multiple viewpoints. In this case, images viewed from each viewpoint are arranged based on a certain rule.

  Now, an apparatus for extracting a 2D image or 3D image from a 2D image or 3D image has been considered. In this case, it does not matter whether it is a moving image or a still image. For example, there are patent documents as shown below.

Patent Document 2 discloses a video camera that captures a 2D moving image as a 2D still image and records it in a memory adapter. Patent Document 3 discloses an example in which a 3D image is converted into a 2D image using either the left or right image and displayed in 2D. Patent Document 4 discloses an example in which 2D images are used to form left and right images so as to have parallax, converted into 3D images, and displayed in 3D.
Japanese Patent Laid-Open No. 11-41627 JP-A-8-275098 JP-A-9-164253 JP 2000-228778 A

  However, in the invention of Patent Document 2, when a video camera that captures a 2D image while capturing a 2D moving image is applied to the 3D moving image, a 3D still image is captured, and thus the 2D still image cannot be captured. In addition, when the invention of Patent Document 2 is applied to a 2D moving image, a 2D still image is captured, and thus a 3D still image cannot be captured.

  Therefore, in order to capture a 2D image (or 3D image) from a 3D image (or 2D image), the captured 3D (or 2D) image is converted into a 2D (or 3D) image as in Patent Documents 3 and 4. It is possible. However, this causes image conversion in a fixed format, and there is a problem that image conversion cannot be performed as desired by the user.

  Further, in the conventional image conversion, the form information of the image before the conversion and the form information of the image that has been converted and output are unknown. Therefore, when performing a process such as a further conversion process on the converted image, it is appropriate. There was a problem that it could not be processed.

  In view of such circumstances, the present invention converts an 2D / 3D image into a 3D / 2D still image or a 3D / 2D video as desired by a user, and an image conversion device that can easily extract image data. An object is to provide an image recording apparatus used.

  The present invention provides an image conversion means for converting 2D or 3D into a 3D or 2D image based on input image data form information and output image data form information, and based on the output image form information. An image conversion apparatus comprising: output switching means for switching whether input image data is output to the conversion means or output without conversion.

  The image conversion apparatus includes information creating means for creating information including the input image form information, and multiplexing means for multiplexing the information created by the information creating means and the output image data. To do.

  The image conversion apparatus includes information creating means for creating information including the output image form information, and multiplexing means for multiplexing the information created by the information creating means and the output image data. To do.

  Here, the multiplexing means writes the information created by the information creating means in a header part.

  Further, the present invention is characterized in that an image output from the image conversion device is recorded on a recording medium. This recording medium is, for example, an optical recording medium such as a CD-R or DVD-R, a hard disk, a memory card, paper, or the like.

  As described above, according to the present invention, since the input image is automatically converted based on the information of the output image selected by the user, the user's desired image can be easily obtained. In addition, since the input image and the output image form information are added to the output image, the data history of the conversion can be known, and even when the converted image is corrected, more accurate processing can be performed.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing an embodiment of a 2D / 3D still image capturing apparatus according to the present invention. The 2D / 3D still image capture device as this image conversion device is a switch 11 that switches between outputting the 3D moving image data to the image converting means 12 and the still image capturing means 13. Image for converting a 3D moving image into a 2D moving image Conversion means 12, still picture capture means 13 for capturing still pictures from 2D moving pictures or 3D moving pictures, an encoder 14 for encoding image data, information creation means 15 for creating header information, management information, additional information, etc. Multiplexing means 16 for multiplexing image data and information created by the information creating means 15 is provided.

  The switch 11 outputs the input 3D moving image data to the image conversion unit 12 based on output selection information (2D still image / 3D still image / OFF) which is the form information of the output image, or the still image capture unit 13. Or whether to turn off the output. Here, the output selection information is information that the user selects which type of image (2D / 3D still image or moving image or output is OFF) is selected, and the user uses a keyboard, mouse, or the like from the outside. Entered.

The image conversion means 12 converts 3D moving image data into 2D moving image data based on input format information (3D moving image format information), output selection information, and output format information.
Table 1 shows format information names used as input and output format information and types of information included in the format information.

The 3D moving image format information is 3D moving image format information and includes existing moving image header information and 3D control information.
The 2D moving image format information is 2D moving image format information and includes existing moving image header information.
The 3D still image format information is 3D still image format information and includes existing still image header information and 3D control information.
The 2D still image format information is 2D still image format information and includes existing still image header information.
Here, the existing moving image header information is the same as the header information of the existing 2D moving image, and is information other than the display of the 3D image and its control.

When the output data is compressed image data such as MPEG (Moving Picture Experts Group) -4, for example, the existing moving image header information is the header information in MPEG-4, the Visual Object Sequence and the Video Object Layer, or the Video Object Layer. Point to. Besides this, the compressed image data includes MPEG-1, MPEG-2, AVC (Advanced Video Coding), etc., and the existing moving image header information may be header information of the moving image compressed data.
When the output data is a PC video file format such as AVI (Audio Video Interleaved) format, the existing video header information indicates a header of AVI format and ASF (Advanced Systems Format) format.

The existing still image header information is the same as the header information of the existing 2D still image, and is information other than the display of the 3D image and its control. For example, in the case of JPEG (Joint Picture Experts Group), the existing still picture header information includes an application data segment.
In addition, 3D control information includes 3D identification information for identifying a 3D image, 3D image display such as the presence / absence of reduction, the presence / absence of combining, the arrangement order and arrangement method of images, and information related to the control. Formatted.

At this time, the 3D moving image format information that is input format information includes, for example, the above described 3D control information and existing moving image header information such as an image size.
The output format information is the format information of the output image of the 2D / 3D still image capture device 10, and in the case of a 2D still image, indicates how to convert the 2D still image format information and the 3D moving image into a 2D image. This is information such as image conversion information. In the case of a 3D still image, it is 3D still image format information. Table 2 summarizes each input / output format information and information included in the format information in the 2D / 3D still image capture device 10.

  The output format information may be set in advance in the 2D / 3D still image capture device 10 or may be stored in advance in an image recording device (for example, a video camera) using the 2D / 3D still image capture device 10. The set information may be input to the 2D / 3D still image capture device 10 as output format information.

  For example, when the output selection information is 2D, the left-eye and right-eye viewpoint images as shown in FIG. 18C are halved horizontally from the 3D video format information included in the input format information. Video format information consisting of images that are thinned out and arranged horizontally is obtained, and the image conversion information included in the output format information is used to horizontally adjust the aspect ratio for the left-eye image. If information for creating a 2D moving image is obtained using an image that has been doubled, the image conversion means 12 performs such conversion.

  The still image capturing unit 13 captures a still image from the 2D moving image converted by the image converting unit 12 or the non-converted 3D moving image based on the output format information, and outputs the captured still image to the encoder 14. The encoder 14 encodes the captured still image and outputs the encoded still image to the multiplexing unit 16.

  The information creating unit 15 converts at least one or more additional information obtained by converting header information, input and output image form information and management information, or any combination thereof into a predetermined format from the input format information and the output format information. Create Input and output image form information, management information, header information, and additional information will be described later.

  Here, the information creation means 15 will be described. FIG. 5 is a block diagram showing the configuration of the information creation means 15. The information creating unit 15 includes a header information creating unit 17 and an additional information creating unit 18, and creates header information from 3D video format information and output format information included in the input format information input to each creating unit. The header information is created by the means 17 and the additional information is created by the additional information creating means 18 and outputted to the multiplexing means 16.

  Next, an example of the format of still image data multiplexed by the multiplexing means 16 and each of header information, additional information, input and output image form information, and management information will be described in detail with reference to FIGS. explain. FIG. 2 is a format example of still image data multiplexed by the multiplexing means 16 when the output selection information is 2D and the input and output image form information and management information are additional information. The still image data is composed of header information, one additional information, and output image data. Here, the header information is header information necessary to decode the image data encoded by the encoder 14, and is the same as the header information of the existing 2D image data (existing still image header information). It is.

  Next, additional information will be described. As shown in FIG. 2, the format of the additional information includes a descriptor D1 for identifying storage information stored in the additional information, input and output image form information, and storage information of management information. ing. Further, FIG. 2 illustrates the case where the output selection information is 2D. However, even if the output selection information is 3D, the contents of the input and output image form information and management information are shown in Table 3, as shown in Table 3. Just change it. Table 3 summarizes input and output image form information and management information included in one additional information in the 2D / 3D still image capture device 10.

  The input image form information is 3D video format information included in the input format information. The output image form information is information included in the output format information. When the output selection information is 2D, it is 2D still image format information, and when it is 3D, it is 3D still image format information. Management information refers to information that is not directly related to image data, such as creation date and creator, and this information is used mainly for editing, such as the state before conversion, the date of conversion, and the creator of the data. This is useful information. When the output selection information is 2D, the management information includes image conversion information included in the output format information. For example, when the input image data is a 3D moving image and the output image data is a 2D still image, an apparatus that handles the output image data at this time uses the image conversion information included in the management information to relate to that fact and the conversion method. Information is obtained. For example, as described in the image conversion unit 12, since it is understood that the 3D moving image data is data created by interpolation such as horizontal enlargement, the image quality is improved when displaying such output image data. Filter processing for the display can be performed at the time of display.

  Information necessary for decoding the output image data is only header information and output image data, and input and output image form information and management information are not necessary. Therefore, as described above, the information unnecessary for decoding is used as additional information, and the format is separated from the information required for decoding, so that at least the image can be decoded even if the additional information cannot be decoded. it can. In addition, since the header information and the output image data included in the output image data are data in the existing image format, compatibility with the conventional image data becomes very high.

  As shown in FIG. 2, the multiplexing unit 16 multiplexes the additional information, header information, and image data from the encoder 14 and outputs the multiplexed data. A recording device such as an IC memory, a magneto-optical disk, a magnetic tape, or a hard disk, or a communication device such as a LAN or a modem is connected to the output destination.

  In the above description, the input and output image form information and management information are stored as one additional information. However, the number of additional information is not limited to one, and the input and output image form information and management information Define different descriptors for each of the three types of information, or for arbitrary combinations such as one for input and output image form information, one for management information, etc. It may be stored as information.

  A format example of still image data in this case will be described. FIG. 3 is a format example of still image data multiplexed by the multiplexing means 16 when each of input and output image form information and management information is set as additional information. In FIG. 3, the header information and the output image data are the same data as described in FIG. In the format of this example, each of input and output image form information and management information is included as three additional information. The input image form information is management information from the descriptor D2 and the 3D video format at the time of input as storage information, and the output image form information is from the descriptor D3 and the 3D video format at the time of output as storage information. Is composed of a descriptor D4 and information that is not directly related to image data, such as creation date and creator, which are stored information. By configuring as described above, different descriptors are defined for each of input and output image form information and management information, or any combination thereof, and stored as separate additional information. Can be recorded.

  In the above description, the format of storing input and output image form information and management information as additional information has been described. However, the information is expanded using a mechanism for extending a header prepared in an existing format. You may store in the extension area | region of the header called a header.

  The information creation means 15 in this case will be described in detail. FIG. 6 is a block diagram showing another configuration of the information creating means 15. The information creating unit 15 includes a header information creating unit 19, and header information including an extension header is created by the header information creating unit 19 from the 3D video format information and the output format information included in the input format information. Is output to the converting means 16. As shown in FIG. 4, the multiplexing means 16 multiplexes the header information including the extension header and the image data from the encoder 14 and outputs them.

  FIG. 4 is a format example of still image data multiplexed by the multiplexing means 16 when each of input and output image form information and management information is stored in an extension header. In FIG. 4, the output image data, the input and output image form information, and the management information are the same data as described in FIG. The header information is composed of an existing header and an extension header. The extension header stores and records input and output image form information and management information. By using the extension header in this way, the output data can be made compatible with the format of the existing data as in the case of the additional information.

In any of the formats described above, the input image form information and management information are used for the purpose of editing and for improving the image quality at the time of display. It is not used for 3D display or control of images.
Therefore, each of the input image form information and management information, or a part of the information, omits at least one or more of each format information as necessary, and includes header information including additional information and header information or an extension header. May be created by the information creating means 15 and multiplexed by the multiplexing means 16. For example, input image form information or management information itself may be omitted, information in the management information that is not directly related to image data such as a creation date or a creator may be omitted, and output selection information may be omitted. Image conversion information included in management information in the case of 2D may be omitted. Further, only 3D identification information indicating 3D image data may be recorded as 3D control information included in the 3D video format information as the input image form information.

Furthermore, if there is information that overlaps the header information for the output image form information, the redundant information may be omitted from the output image form information. For example, the 2D still image format information and the 3D still image format information in the output image form information include existing still image header information, and the existing still image header information and the header information in the header part overlap with each other. In some cases, the existing still image header information may be omitted. At this time, if it is 2D still image format information, itself can be omitted, and if it is 3D still image format information, only 3D control information is a component.
Table 4 summarizes information that can be omitted in the input and output image form information and management information.

  An example in which the additional information in FIG. 2 is omitted as described above will be described with reference to FIGS. 19 and 20. FIG. 19 is a format example of still image data in which additional information is omitted when the output selection information is 2D. At this time, output image form information and management information are omitted as additional information, and input image form information is 3D control information in 3D video format information, except for 3D identification information indicating 3D image data. Omitted. FIG. 20 is a format example of still image data in which additional information is omitted when the output selection information is 3D. In this case, the additional image information is omitted from the input image form information and the management information, and the output image form information is omitted except for the 3D control information in the 3D video format information.

  As described above, by omitting input and output image form information and management information or a part thereof, duplicate information and information not used for display are not recorded, so that the amount of data can be reduced.

  Further, as the additional information descriptor described above, for example, an application marker may be used in JPEG. Further, input and output image form information and management information may be output as completely different data without being stored as additional information or an extension header.

  The input and output image form information and management information included in the additional information and the extension header have been described in the case where the output image data is still image data, but can be applied in the same manner even in the case of moving image data. Next, a 2D / 3D moving image capturing apparatus according to the present invention will be described with reference to FIGS.

FIG. 7 is a block diagram showing an embodiment of a 2D / 3D moving image capture apparatus according to the present invention.
The 2D / 3D moving image capture device 30 as the image conversion device in FIG. 7 is a device that receives 3D moving image data and converts it into 2D moving image data or 3D moving image data. The configuration is such that the still image capture means 13 is removed from the 2D / 3D still image capture device described with reference to FIG. 1, and the encoder 14, the information creation means 15, and the multiplexing means 16 are each encoded with the input moving image data. Encoder 32 for moving image, header information and additional information of output moving image data, information creating means 33 for generating header information having extension header, multiplexing moving image data and header information and additional information, or moving image data The header information having the extension header is replaced with the multiplexing means 34 for multiplexing, and the moving image data is encoded by the encoder 32 according to the encoding information for specifying whether the output is compressed moving image data or uncompressed moving image data. And a switch 31 for switching the output to which of the multiplexing means 34. Therefore, the switch 11 and the image conversion means 12 are the same and the numbers are also the same, and the description thereof is omitted.

  Here, the input format information, the output selection information, and the 3D moving image are the same as those described with reference to FIG. The output format information at this time is the format information of the output image of the 2D / 3D video capture device 30. In the case of 2D video, it indicates 2D video format information and how to convert the 3D video to 2D video. This is information such as image conversion information, and in the case of a 3D moving image, it is 3D moving image format information. Table 5 summarizes the output format information and information included in the 2D / 3D moving image capture device 30.

  The output format information may be set in advance in the 2D / 3D moving image capture device 30 or set in advance in an image recording device (for example, a video camera) using the 2D / 3D moving image capture device 30. May be input to the 2D / 3D moving image capture device 30 as output format information. Further, the image conversion information included in the output format information is the same information as in the description of the 2D / 3D still image capture device 10.

  The 2D / 3D moving image capture device 30 switches the switch 11 based on the output selection information, and outputs the 2D moving image data converted by the image conversion means 12 or the non-converted 3D moving image data to the switch 31 based on the output format information. To do. The 2D / 3D moving image capture device 30 switches the switch 31 based on the encoding information, and outputs the moving image data input to the switch 31 to either the encoder 32 or the multiplexing unit 16. If the encoding information is information for instructing the output to be compressed moving image data, the moving image data is output to the encoder 32. The encoder 32 encodes the input moving image data and outputs it to the multiplexing means 16. If the encoded information is information indicating that the output is compressed moving image data, the uncompressed moving image data is output to the multiplexing unit 16 without being encoded.

  The information creating unit 33 converts at least one or more additional information obtained by converting header information, input and output image form information and management information, or any combination thereof into a predetermined format from the input format information and the output format information. Create The input image form information and management information at this time are the same as those described in Table 3. Further, as shown in Table 6, the output image form information is merely changed from the still image to the moving image format information. Also, the header information is only changed from the existing still image header information to the existing moving image header information. Also, a method for storing input and output image form information and management information in moving image data using additional information and an extension header, additional information at that time, and the structure of the extension header are 2D / 3D still images. This is the same as that described for the capture device 10.

Here, the operation of the information creation means 33 will be described.
First, the case where input and output image form information and management information are stored in additional information will be described. FIG. 8 is a block diagram showing the configuration of the information creation means 33 when storing in additional information. The information creation means 33 is composed of a header information creation means 35 and an additional information creation means 36, and header information creation from the 3D video format information and output format information included in the input format information input to each creation means. The header information is created by the means 35 and the additional information is created by the additional information creating means 36 and outputted to the multiplexing means 16. The multiplexing means 16 multiplexes and outputs at least one or more additional information, header information, and image data from the encoder 14 as described with reference to FIGS.

  Next, the case where input and output image form information and management information are stored in an extension header will be described. FIG. 9 is a block diagram showing the configuration of the information creation means 33 when stored in the extension header. The information creating unit 15 includes a header information creating unit 37. The header information creating unit 37 creates header information including an extension header from the 3D video format information and the output format information included in the input format information. Is output to the converting means 16. The multiplexing means 16 multiplexes the header information having the extension header and the image data from the encoder 14 and outputs the same as described with reference to FIG.

  Similarly to the case described in the case of the 2D / 3D still image capture device 10, at least one or more input image form information and management information may be omitted from each format as necessary, and may not be recorded. Only 3D identification information may be recorded as input image form information.

  Further, the 2D / 3D still image capturing device 10 described in FIG. 1 and the image conversion means 12 in the 2D / 3D moving image capture device 30 described in FIG. 7 convert the input 3D moving image data into 2D moving image data and output it. However, the converted 3D moving image data may be output. At this time, the input is converted to output 3D moving image data having a smaller number of viewpoints than the input 3D moving image data and output.

  FIG. 21 shows another configuration example of the 2D / 3D still image capture device 10 in this case. Here, the still image capturing means 13, the encoder 14, the information creating means 15, and the multiplexing means 16 are the same as those described in FIG. 1, and the numbers are also the same. Omitted. Also, the output selection information described in FIG. 1 is changed from the three types of 2D / 3D / OFF to four types of 2D / 3D / conversion 3D / OFF. The 2D / 3D still image capture device 10 includes an image conversion unit 101 or a still image capture unit 13 that converts an input 3D moving image to a unit other than the still image capture unit 13, the encoder 14, the information creation unit 15, and the multiplexing unit 16. The switch 100 for switching to any of the above and the input 3D video are converted, and when the output selection information is 2D, the 2D video is output, and when the conversion is 3D, the converted 3D video is output. Means 101 is comprised.

  Next, the operation of the 2D / 3D still image capture device 10 in this case will be described. Here, the 2D / 3D still image capture device 10 performs the same operation as described in FIG. 1 when the output selection information is other than the conversion 3D.

  A case where the output selection information is conversion 3D will be described. For example, when the input 3D moving image data is data of N viewpoints (N is an integer of 3 or more), 3D moving image data of M viewpoints (M is an integer of 2 or more and N> M) is output therefrom. In this case, the switch 100 is switched so that the input 3D moving image is input to the image conversion unit 101. The image conversion means 101 converts the input N-view video to M-view 3D video according to the image conversion information included in the output image format information, and outputs it to the still image capture means 13. In this way, the 3D moving image converted from the input 3D moving image can be captured by the still image capturing means 13, and a 3D still image can be generated and output.

  FIG. 22 shows another configuration of the 2D / 3D moving image capture device 30 in this case. Here, the encoder 32, the information creation means 33, and the multiplexing means 34 are the same as those described in FIG. 7, and the switch 100 and the image conversion means 101 are the same as those described in FIG. As for the same, the description and operation thereof will be omitted. Furthermore, the output selection information is also changed to four types of 2D / 3D / conversion 3D / OFF as in the case described with reference to FIG. In addition to the encoder 32, the information creation unit 33, the multiplexing unit 34, the switch 100, and the image conversion unit 101, the 2D / 3D video capture device 30 converts the input 3D video to either the encoder 32 or the multiplexing unit 34. The switch 102 is configured to switch to and output.

  Next, the operation of the 2D / 3D moving image capture device 30 in this case will be described. Here, when the output selection information is other than conversion 3D, the 2D / 3D moving image capture device 30 performs the same operation as that described with reference to FIG.

  Next, a case where the output selection information is conversion 3D will be described. For example, when the input 3D moving image data is data of N viewpoints (N is an integer of 3 or more), 3D moving image data of M viewpoints (M is an integer of 2 or more and N> M) is output therefrom. In this case, as described with reference to FIG. 21, the switch 100 is switched so that the input 3D moving image is input to the image conversion unit 101. The image conversion means 101 converts the input N-view video to M-view 3D video according to the image conversion information included in the output image format information, and outputs it to the still image capture means 13. When the image conversion information is conversion 3D, the switch 102 is switched to output the input 3D moving image to the encoder 32. In this way, a 3D moving image converted from the input 3D moving image can be generated and output.

  FIG. 10 is a block diagram illustrating an image recording apparatus using the 2D / 3D still image capture device of FIG. 1 and the 2D / 3D moving image capture device of FIG. The image recording device 40 includes a 2D / 3D still image capture device 10 and a 2D / 3D moving image capture device 30.

  For example, when 3D moving image data is input to the image recording device 40 as an input from the camera, the 2D / 3D moving image capturing device 30 receives each input from the external inputs 1 and 2 as described with reference to FIG. According to the information, the moving image data captured from the 3D moving image data is output. The moving image data at this time includes compressed data and uncompressed data. Further, as described with reference to FIG. 1, the 2D / 3D still image capture device 10 outputs still image data captured from 3D moving image data in accordance with each information input from the external inputs 2 and 3. The moving image data of the 2D / 3D moving image capture device 30 is recorded on a video tape, a DVD-RAM, or the like, and the still image data of the 2D / 3D still image capture device 10 is recorded on a memory card or the like.

  FIG. 11 is a block diagram showing another example of an image recording apparatus using the 2D / 3D still image capture device of FIG. 1 and the 2D / 3D moving image capture device of FIG. The image recording device 50 is intended to read out image data from a recording medium recorded by the image recording device 40, for example, and to perform still image capture processing or moving image re-capture processing. 2D / 3D still images The capture device 10, the 2D / 3D moving image capture device 30, a separating unit 51, and a decoder 53 are included. Separating means 51 separates 3D video format information and image data from the input 3D video data. The 3D video format information is input to the 2D / 3D video capture device 30, the 2D / 3D still image capture device 10, and the switch 52. Further, the image data is input to the switch 52. The switch 52 switches whether to output the 3D moving image data to the 2D / 3D moving image capture device 30 and the 2D / 3D still image capture device 10 or to the decoder 53 based on the 3D moving image format information. The decoder 53 decodes moving image data from the input image data.

  Further, output format information, output selection information, and 3D moving image data from the external input 1 are input to the 2D / 3D moving image capture device 30, and desired moving image data based on the output selection information is output. Further, output format information and output selection information are further input to the 2D / 3D still image capture device 10 from the external input 2, and desired still image data based on the output selection information is output.

  FIG. 12 is a block diagram showing another 2D / 3D still image capture device. The 2D / 3D still image capture device 60 is a device that captures an input 2D moving image into a 3D still image, unlike FIG.

Here, the still image capturing means, the encoder, the information creating means, and the multiplexing means are the same means as the respective means in FIG.
Based on the output selection information (2D still image / 3D still image / OFF) selected by the user, the switch 61 outputs the 2D moving image data to the image conversion unit 62, the output to the still image capture unit 13, or Switches whether to turn off the output. The image conversion means 62 converts the 2D moving image into a 3D moving image based on the 2D moving image format information and the output format information of the 3D still image. At this time, the 2D moving image format information is the format information of the input 2D moving image, and is the existing moving image header information. The output format information of the 3D still image is format information of the output image of the 2D / 3D still image capture device 60, and is the above-described existing still image header information and 3D control information. The output selection information and output format information shown in FIG. 6 are input to each means by using information set by the user as external input information. However, the information may be set in advance in the 2D / 3D still image capture device 60, or may be information set in advance in an image recording device (for example, a video camera) using the 2D / 3D still image capture device 60. Yes, it may be input to the 2D / 3D still image capture device 60 as output format information.

The image conversion means 62 converts 2D moving image data into 3D moving image data based on input format information (2D moving image format information) and output format information.
At this time, 2D moving image format information, which is input format information, is existing moving image header information such as an image size, for example. The output format information is the format information of the output image of the 2D / 3D still image capture device 60. When the output still image is a 3D still image, the 3D still image format information and how the 2D image is converted into a 3D image. This is information such as image conversion information indicating whether or not to convert to 2D still image format information in the case of a 2D still image. Table 7 summarizes each input / output format information and information included in the format information in the 2D / 3D still image capture device 60.

  The output format information may be set in advance in the 2D / 3D still image capture device 60, or may be stored in advance in an image recording device (for example, a video camera) using the 2D / 3D still image capture device 60. The set information may be input to the 2D / 3D still image capture device 60 as output format information.

  The still image capturing unit 13 captures a still image from the 3D moving image converted by the image converting unit 62 or the non-converted 2D moving image based on the output format information, and outputs the still image to the encoder 14. The encoder 14 encodes the captured still image and outputs the encoded still image to the multiplexing unit 16.

  2, 3, and 4, the information creating unit 15 converts the header information, the input and output image form information, and the management information into a predetermined format, respectively, or a multiplexing unit. 16 is output.

The multiplexing means 16 multiplexes the header information and the image data from the encoder 44 and outputs them as shown in FIGS. A recording device such as an IC memory, a magneto-optical disk, a magnetic tape, or a hard disk, or a communication device such as a LAN or a modem is connected to the output destination.
At this time, the image conversion information is not necessary when decoding the image and may be omitted.

  FIG. 13 is a block diagram showing another 2D / 3D moving image capturing apparatus. The 2D / 3D moving image capture device 70 is a device that captures an input 2D moving image into a 3D moving image, unlike FIG.

  The switch 31, encoder 32, information creation means 33, and multiplexing means 34 in FIG. 13 are the same means as those explained in FIG. Here, the switch 71 outputs the 2D moving image data to the image conversion unit 72 or the encoder 32 based on the output selection information (2D still image / 3D still image / OFF) selected by the user, or Switches whether to turn off the output. The image conversion means 72 converts the 2D moving image into a 3D moving image based on the 2D moving image format information and the output format information of the 3D moving image. The input format information is the same information as described with reference to FIG. The output format information of the 3D moving image is format information of the output image of the 2D / 3D moving image capture device 70, and is existing moving image header information and 3D control information. The output selection information and the output format information shown in FIG. 13 are input to each means using information set by the user as external input information. However, it may be set in advance in the 2D / 3D moving image capture device 70, or is information set in advance in an image recording device (for example, a video camera) using the 2D / 3D moving image capture device 70, You may input into this 2D / 3D moving image capture device 70 as output format information.

  The image conversion means 72 converts 2D moving image data into 3D moving image data based on input format information (2D moving image format information) and output format information.

  At this time, the input format information is the same as that described with reference to FIG. The output format information is the format information of the output image of the 2D / 3D video capture device 70. If the output video is a 3D video, the 3D video format information and how to convert the 2D image into a 3D image In the case of a 2D moving image, it is 2D moving image format information. Table 7 summarizes output format information and information included in the 2D / 3D moving image capture device 70.

  The output format information may be set in advance in the 2D / 3D moving image capture device 70, or set in advance in an image recording device (for example, a video camera) using the 2D / 3D moving image capture device 70. Information may be input to the 2D / 3D moving image capture device 70 as output format information.

  The 2D / 3D moving image capture device 70 outputs the 2D moving image data converted by the image conversion means 62 or the non-converted 3D moving image data to the switch 31 based on the output format information, and switches the switch 31 based on the encoding information. These moving image data are output to the encoder 32 or the multiplexing means 34. The encoder 32 encodes the moving image data and outputs it to the multiplexing unit 34.

  2, 3, and 4, the information creating unit 33 converts the header information, the input and output image form information, and the management information into a predetermined format, respectively, or a multiplexing unit. 34.

The multiplexing means 34 multiplexes the header information and the image data from the encoder 32 and outputs them as shown in FIGS. A recording device such as an IC memory, a magneto-optical disk, a magnetic tape, or a hard disk, or a communication device such as a LAN or a modem is connected to the output destination.
At this time, the image conversion information is not necessary when decoding the image and may be omitted.

  FIG. 14 is a block diagram illustrating an image recording apparatus using the 2D / 3D still image capture device of FIG. 12 and the 2D / 3D moving image capture device of FIG. The image recording device 80 includes a 2D / 3D still image capture device 60 and a 2D / 3D moving image capture device 70.

  For example, when 2D moving image data is input to the image recording device 80 as an input from the camera, the 2D / 3D moving image capturing device 70, as described in FIG. According to the information, the moving image data captured from the 2D moving image data is output. The moving image data at this time includes compressed data and uncompressed data. Further, as described with reference to FIG. 12, the 2D / 3D still image capturing device 60 outputs still image data captured from 2D moving image data in accordance with each information input from the external inputs 2 and 3. The moving image data of the 2D / 3D moving image capture device 70 is recorded on a video tape, a DVD-RAM, or the like, and the still image data of the 2D / 3D still image capture device 60 is recorded on a memory card or the like.

  15 is a block diagram showing an image recording apparatus using the 2D / 3D still image capture device of FIG. 12 and the 2D / 3D moving image capture device of FIG. The image recording device 90 is intended to read, for example, existing 2D moving image data and perform still image capture processing or moving image recapture processing. The 2D / 3D still image capturing device 60, 2D / 3D moving image A capture device 70, a separation unit 91, a switch 92, and a decoder 53 are included. Here, since the decoder 31 is the same as that described in FIG. 11, the number is also the same.

Separating means 91 separates 2D moving image format information and image data from the input 2D moving image data. The 2D moving image format information is input to the 2D / 3D moving image capture device 70, the 2D / 3D still image capture device 60, and the switch 92. Further, the image data is input to the switch 92. The switch 92 switches whether to output 2D moving image data to the 2D / 3D moving image capture device 70 and the 2D / 3D still image capture device 60 or to the decoder 53 based on the 2D moving image format information. The decoder 53 decodes moving image data from the input image data. Output format information, output selection information, and 3D moving image data from the external input 1 are further input to the 2D / 3D moving image capture device 70, and desired moving image data based on the output selection information is output.
Further, output format information and output selection information are further input from the external input 2 to the 2D / 3D still image capture device 60, and desired still image data based on the output selection information is output.

  It should be noted that the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made without departing from the gist of the present invention. For example, FIGS. 1 and 12 show the 2D / 3D still image capture devices 10 and 60, but the image conversion device may be an image conversion device that outputs a moving image by removing the still image capture means 13. An image recording apparatus that records a converted image that outputs the image is also conceivable. Moreover, although the image recording apparatus describes what records electronic data on a recording medium (tape, DVD-R, memory, etc.), the recording medium is paper, on which an image is recorded with toner, ink, or the like. You may do it.

1 is a block diagram illustrating an embodiment of a 2D / 3D still image capture device according to the present invention. FIG. It is explanatory drawing which shows the example of a format of the multiplexed still image data. It is explanatory drawing which shows the example of a format of the multiplexed still image data. It is explanatory drawing which shows the example of a format of the multiplexed still image data. 4 is a block diagram showing a configuration of information creating means 15. FIG. It is a block diagram which shows the other structure of the information preparation means 15. FIG. 1 is a block diagram illustrating an embodiment of a 2D / 3D video capture device according to the present invention. 3 is a block diagram showing a configuration of information creation means 33. FIG. It is a block diagram which shows the other structure of the information preparation means. It is a block diagram which shows one Embodiment of the image recording apparatus using the 2D / 3D still image capture apparatus of FIG. It is a block diagram which shows other embodiment of the image recording apparatus using the 2D / 3D still image capture apparatus of FIG. It is a block diagram which shows other embodiment of the 2D / 3D still image capture device which concerns on this invention. It is a block diagram which shows other embodiment of the 2D / 3D moving image capture device which concerns on this invention. It is a block diagram which shows one Embodiment of the image recording apparatus using the 2D / 3D still image capture apparatus of FIG. FIG. 13 is a block diagram illustrating another embodiment of an image recording device using the 2D / 3D still image capture device of FIG. 12. It is a figure which shows the display format of the image in a time division system. It is a figure for demonstrating the concept of a parallax barrier system. It is a figure for demonstrating the display format of the image in a parallax barrier system. It is explanatory drawing which shows the example of a format of the multiplexed still image data. It is explanatory drawing which shows the example of a format of the multiplexed still image data. It is explanatory drawing which shows another structure of the 2D / 3D still image capture device. It is explanatory drawing which shows another structure of the 2D / 3D moving image capture device.

Explanation of symbols

10 2D / 3D still image capture device 11 switch 12 image conversion means 13 still image capture means 14 encoder 15 information creation means 16 multiplexing means 17 header information creation means 18 additional information creation means 19 header information creation means 30 2D / 3D video capture Device 31 Switch 32 Encoder 33 Information creation means 34 Multiplexing means 35 Header information creation means 36 Additional information creation means 37 Header information creation means 40 Image recording device 50 Image recording device 51 Separation means 52 Switch 53 Decoder 60 2D / 3D still image capture Device 61 Switch 62 Image conversion means 70 2D / 3D video capture device 71 Switch 72 Image conversion means 80 Image recording device 90 Image recording device 91 Separation means 92 Switch 100 Switch 101 Image conversion means 102 Switch

Claims (5)

Image conversion means for converting a two-dimensional or three-dimensional image into a three-dimensional or two-dimensional image based on the input image data form information and the image data form information to be output;
Switching means for switching whether to output the input image data to the conversion means or to output without conversion based on the output image form information;
An image conversion apparatus comprising: Information creating means for creating information including the input image form information;
Multiplexing means for multiplexing the information created by the information creating means and the output image data;
The image conversion apparatus according to claim 1, further comprising: Information creating means for creating information including the output image form information;
Multiplexing means for multiplexing the information created by the information creating means and the output image data;
The image conversion apparatus according to claim 1, further comprising:   4. The image conversion apparatus according to claim 2, wherein the multiplexing unit writes the information created by the information creating unit in a header portion.   An image recording apparatus, wherein the image output from the image conversion apparatus according to claim 1 is recorded on a recording medium.

Images