JP2011097451A - Three-dimensional image display device and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve the visibility of an image and reduce the feeling of fatigue of a viewer in reproducing at fast speed a plurality of images in which 2D images and 3D images are mixed. <P>SOLUTION: In reproducing images in which 2D images and 3D images are mixed, the following steps are passed through; discriminating whether a fast-forwarding reproduction is performed or not (step S12); producing and displaying a 2D image for display (a left image for a 3D file) when it is determined that the fast-forwarding reproduction has been being performed (steps S14, S16, S18, S20); on the contrary when it is determined that the fast-forwarding reproduction has been not performed (a frame-by-frame advance was being performed), producing and displaying a 2D image for display or a 3D image for display depending on the situation in which an image file now being read out is 2D file or 3D file (steps S28, S30, S32, S34). As a result, in performing fast-forwarding reproduction, only a 2D image is displayed irrespective of 2D image file or 3D image file, which is subject to readout, thus permitting the visibility of an image rapidly switching to be improved. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a three-dimensional image display apparatus and method, and more particularly to a three-dimensional image display apparatus and method for reading out and reproducing a desired image from a recording medium in which two-dimensional images and three-dimensional images are recorded together.

  A digital camera having a photographing function of a two-dimensional image (2D image) and a three-dimensional image (3D image) records a 2D image and a 3D image in a mixed state on one recording medium. Since a 2D image and a 3D image are mixedly recorded on a recording medium on which an image is recorded by this type of digital camera, the image on the recording medium is recorded by, for example, a file name order (photographing). When sequentially reproduced in the order of date and time), 2D images and 3D images are mixedly reproduced.

  When a plurality of images in which a 2D image and a 3D image are mixed are sequentially played back sequentially, the display changes from a 2D image to a 3D image, or from a 3D image to a 2D image. The change of the image without feeling continues, and may give fatigue to the observer of the image.

  Conventionally, in order to solve this feeling of fatigue, it is determined whether an input image is a 2D image or a 3D image. When the input image is determined to be a 2D image, a pseudo parallax image is formed from the 2D image by calculation (a 2D image is converted into a 2D image). An image display device that has been converted to a 3D image and displayed in 3D has been proposed (Patent Document 1).

JP 2008-42645 A

  However, as in the invention described in Patent Document 1, a pseudo 3D image is generated from a 2D image, and a desired image is searched even when 3D display is performed for all images in which 2D images and 3D images are mixed. Therefore, when fast-forward playback (including fast-rewind playback), the frames are switched before the eyes adapt to the 3D images with various parallaxes, so that the 3D images are not easy to see, There is a problem of giving fatigue.

  The present invention has been made in view of such circumstances, and can improve the visibility of an image when fast-forwarding and reproducing a plurality of images in which two-dimensional images and three-dimensional images are mixed. An object of the present invention is to provide a three-dimensional image display device and method that can reduce fatigue.

  In order to achieve the above object, a 3D image display device according to claim 1 records a 3D image including a 2D image file in which a 2D image is recorded and a plurality of images obtained by photographing the same subject from a plurality of viewpoints. Is a means for instructing reading of an image file from a recording medium recorded in a mixed manner with a three-dimensional image file that is recorded in a frame-by-frame playback mode or longer than the frame-by-frame playback time. A reproduction instruction means for instructing fast-forward reproduction with a short time, an image acquisition means for acquiring an image file from the recording medium based on a read instruction by the reproduction instruction means, and an image file acquired by the image acquisition means is a two-dimensional image A discriminating unit for discriminating whether the file is a three-dimensional image file; and when the image acquiring unit acquires a two-dimensional image file, the two-dimensional When a two-dimensional display image is generated based on an image in the image file, frame-by-frame reproduction is instructed by the reproduction instruction means, and the image acquisition means acquires a three-dimensional image file, the acquired 3 When a three-dimensional display image having a parallax is generated from an image in a three-dimensional image file, fast-forward reproduction is instructed by the reproduction instruction unit, and the image acquisition unit acquires the three-dimensional image file, the acquisition Display image generating means for generating a two-dimensional display image from the image in the three-dimensional image file, and two-dimensional display based on the two-dimensional display image or the three-dimensional display image generated by the display image generating means. And image display means for displaying an image or a three-dimensional image.

  According to the first aspect of the present invention, in the case of sequentially reading an image file from a recording medium in which a two-dimensional image file and a three-dimensional image are mixedly recorded and reproducing an image corresponding to the read image file, each frame is reproduced. When performing fast-forward playback with a short playback time, the read image file is played back as a two-dimensional image regardless of whether the read image file is a two-dimensional image file or a three-dimensional image file. That is, even if the read image file is a three-dimensional image file, an image corresponding to the three-dimensional image file is reproduced as a two-dimensional image.

  Thereby, it is possible to improve the visibility of an image displayed for a short time during fast-forward playback and to reduce the observer's feeling of fatigue. Note that fast-forward playback is playback when searching for a desired image from a large number of images, and is not playback for viewing images. Therefore, even if a three-dimensional image is displayed as a two-dimensional image, the purpose of fast-forward playback is Is achieved.

  According to a second aspect of the present invention, in the three-dimensional image display device according to the first aspect, the reproduction instruction means includes a frame advance operation means for instructing one frame advance or one frame return every time one push is performed, When the frame advance operation means is kept pressed for a predetermined time or longer, it is instructed to perform fast forward reproduction for reading an image file at a preset time interval.

  As a result, frame advance playback and fast forward playback can be instructed using the same frame advance operation means. When the pressing of the frame advance operation means is stopped, the fast forward reproduction is also stopped and switched to the frame advance reproduction. As a result, the stopped image is switched from the secondary original image to the three-dimensional image.

  According to a third aspect of the present invention, in the three-dimensional image display device according to the first aspect, the reproduction instruction means includes a frame advance operation means for instructing one frame advance or one frame return every time one push is performed, A fast-forward operation means for instructing a return, and when the fast-forward operation means is operated, a fast-forward reproduction for reading an image file at a preset time interval is instructed.

  4. The three-dimensional image display device according to claim 1, wherein the three-dimensional image file is a multi-stored image in which one or a plurality of images are stored successively after the head image. The display image generation means is a picture file, and when the fast-forward reproduction is instructed by the reproduction instruction means and the image acquisition means acquires a three-dimensional image file, the display image generation means obtains a head image from the acquired three-dimensional image file. The two-dimensional display image is generated based on the head image. That is, if the information from the 3D image file (multi-picture file) to the top image is acquired, the 2D image can be reproduced, thereby reducing the processing amount and processing time for the 3D image file during fast forward reproduction. it can.

  The three-dimensional image display device according to any one of claims 1 to 3, wherein the three-dimensional image file is a multi-stored image in which one or a plurality of images are successively stored after the head image. The display image generation means is a picture file, and when the fast-forward reproduction is instructed by the reproduction instruction means and the image acquisition means acquires a three-dimensional image file, the display image generation means obtains a head image from the acquired three-dimensional image file. A thumbnail image in the attached information corresponding to is acquired, and the two-dimensional display image is generated based on the thumbnail image. According to the fifth aspect of the present invention, it is possible to further reduce the amount of processing and the processing time for the three-dimensional image file during fast-forward playback compared to the case of the fourth aspect.

  The three-dimensional image display device according to any one of claims 1 to 5, wherein the determination unit is configured to perform the determination based on an extension of the image file or attached information stored in the image file. It is characterized by determining whether the image file is a two-dimensional image file or a three-dimensional image file.

  The three-dimensional image display device according to any one of claims 1 to 6, wherein the image display means displays three or more directional images having directivity in the left-right direction. The display image generating means generates the display image as a first directional image when the image display means is viewed from the front, and the image display means is A second directivity image when visually recognized is generated, and a display image different from the first directivity image is generated.

  That is, when the image display means is observed from the front, a two-dimensional image or a three-dimensional image (first directivity image) can be visually recognized as in the inventions according to claims 1 to 6, When the image display means is tilted in the left-right direction and the image display means is observed from the left-right direction, a second directional image different from the first directional image is displayed. In particular, since only a 2D image is displayed during fast-forward playback, it cannot be distinguished whether the displayed 2D image is generated from a 2D image file or a 3D image file. However, these images can be distinguished by observing the image display means from the left-right direction and visually recognizing the second directional image.

  The three-dimensional image display device according to claim 7, wherein the second directional image is generated from the two-dimensional image generated from the secondary image file and the three-dimensional image file. The image is characterized in that it can be classified into a two-dimensional image.

  9. The three-dimensional image display device according to claim 8, wherein the second directional image is displayed on the two-dimensional image displayed simultaneously with the two-dimensional image generated from the secondary image file. One of the related information and the information related to the three-dimensional image displayed at the same time as the two-dimensional image generated from the tertiary image file is characterized.

  The three-dimensional image display method according to claim 10, wherein a two-dimensional image file in which a two-dimensional image is recorded, and a three-dimensional image file in which a three-dimensional image including a plurality of images obtained by photographing the same subject from a plurality of viewpoints are recorded; Is a step of accepting reading of an image file from a recording medium recorded in a mixed manner, and an instruction for frame-by-frame playback with a long playback time of one frame or fast-forward playback with a playback time shorter than the playback time of the frame-by-frame playback is given A step of receiving, a step of acquiring an image file from the recording medium by an image acquisition unit based on the received reproduction instruction, and whether the image file acquired by the image acquisition unit is a two-dimensional image file or a three-dimensional image file. A step of discriminating by the discriminating unit; and when the image acquiring unit acquires a two-dimensional image file, the two-dimensional image When a two-dimensional display image is generated based on the image in the file, the frame advance reproduction is accepted, and the image acquisition means acquires a three-dimensional image file, the image in the acquired three-dimensional image file When a three-dimensional display image having parallax is generated from the image, the fast-forward playback is accepted, and the image acquisition unit acquires a three-dimensional image file, a two-dimensional image is obtained from the acquired three-dimensional image file. A step of generating a display image, and a step of displaying a two-dimensional image or a three-dimensional image on an image display means based on the generated two-dimensional display image or three-dimensional display image. Yes.

  The three-dimensional image display method according to claim 10, wherein the three-dimensional image file is a multi-picture file in which one or a plurality of images are continuously stored following the head image. In the step of generating the image for 2D display, when the fast-forward reproduction is accepted and the image acquisition unit acquires a 3D image file, information from the acquired 3D image file to the top image is acquired. The two-dimensional display image is generated based on the head image.

  The three-dimensional image display method according to claim 10, wherein the three-dimensional image file is a multi-picture file in which one or a plurality of images are successively stored following the head image, In the step of generating the two-dimensional display image, when the fast-forward reproduction is accepted and the image acquisition unit acquires a three-dimensional image file, additional information corresponding to the first image from the acquired three-dimensional image file Information is acquired, and the two-dimensional display image is generated based on the thumbnail image included in the attached information.

  According to the present invention, when fast-forwarding a plurality of images in which a two-dimensional image and a three-dimensional image are mixed, even a three-dimensional image is reproduced as a two-dimensional image. There is no need to observe a changing image, thereby improving the visibility of the image during fast-forward playback, and reducing the observer's fatigue.

FIG. 1 is an external view showing a three-dimensional image display apparatus according to a first embodiment of the present invention. FIG. 2 is a block diagram showing an internal configuration of the three-dimensional image display apparatus shown in FIG. FIG. 3 is a diagram showing a directory structure of a memory card in which image files are recorded. FIG. 4 is a diagram illustrating a data structure of a 3D image file for n-viewpoint 3D images. FIG. 5 is a diagram illustrating a data structure of a 3D image file for a 2D 3D image. FIG. 6 is a flowchart showing the operation of the three-dimensional image display apparatus according to the present invention. FIG. 7 is an image diagram of a two-dimensional image or a three-dimensional image sequentially reproduced by the three-dimensional image display device according to the present invention. FIG. 8 is a front view of a digital camera provided with the three-dimensional image display device according to the second embodiment of the present invention. FIG. 9 is a rear view of a digital camera provided with the three-dimensional image display device according to the second embodiment of the present invention. FIG. 10 is a block diagram showing an internal configuration of the digital camera shown in FIGS. FIG. 11 is a diagram illustrating the principle of a 3D image display device in which different images can be visually recognized from four different directions in the left-right direction. FIG. 12 is a rear view of the digital camera according to the third embodiment of the present invention, as seen from the front. FIG. 13 is a rear view of the digital camera according to the third embodiment of the present invention, as viewed from the right. FIG. 14 is a rear view of the digital camera according to the third embodiment of the present invention, as viewed from the left.

  Embodiments of a 3D image display apparatus and method according to the present invention will be described below with reference to the accompanying drawings.

[First embodiment of three-dimensional image display apparatus]
FIG. 1 is an external view showing a three-dimensional image display apparatus according to a first embodiment of the present invention.

  As shown in FIG. 1, this three-dimensional image display device (3D image display device) 10 is a digital photo frame equipped with a color three-dimensional liquid crystal display (hereinafter referred to as “3D LCD”) 12. An operation unit 14 including a power switch, a frame advance switch, a switch for selecting normal display / slideshow, and the like is provided, and a memory card slot 16 is provided on a side surface.

  FIG. 2 is a block diagram showing an internal configuration of the 3D image display apparatus 10.

  As shown in FIG. 2, the 3D image display apparatus 10 includes a central processing unit (CPU) 20, a work memory 22, a card interface (card I / F) 24, a display controller 26, in addition to the 3D LCD 12 and the operation unit 14. A buffer memory 28, an EEPROM 30, and a power supply unit 32 are provided.

  The 3D LCD 12 may be one that displays a plurality of images (right-eye image, left-eye image) with directional images each having a predetermined directivity using a lenticular lens, a parallax barrier, or the like.

  The CPU 20 functions as a control unit that performs overall control of the overall operation of the 3D image display apparatus 10 according to a predetermined control program based on an input from the operation unit 14. The contents of control by the CPU 20 will be described later.

  The work memory 22 includes a calculation work area for the CPU 20 and a temporary storage area for image data.

  The card I / F 24 is electrically connected to the memory card 34 when a memory card 34 that is a recording medium of the digital camera is inserted into the memory card slot 16, and data (image data) is exchanged with the memory card 34. It is an apparatus for performing transmission and reception.

  The display controller 26 repeatedly reads out 3D display image data (a plurality of image data) from the buffer memory 28, which is a temporary storage area dedicated to display image data, and converts it into a 3D display signal on the 3D LCD 12. Output to the 3D LCD 12. As a result, a 3D image is displayed on the 3D LCD 12.

  The power supply unit 32 controls power from a battery (not shown) or a commercial power supply and supplies operating power to each unit of the 3D image display device 10.

  The operation unit 14 includes an infrared remote control device that transmits an infrared remote control signal for operation from the infrared remote control device to an infrared reception unit (not shown) of the 3D image display device 10.

<Memory card directory structure>
FIG. 3 shows an example of the directory structure of the memory card 34 mounted on the 3D image display device 10.

  As shown in FIG. 3, a 2D image or a 3D image file is arranged in a folder (100_PICT) in a hierarchy immediately below the image root directory DCIM (Digital Camera IMages).

  Each image file is given a file name based on a predetermined naming rule, and in this embodiment, the file name is given by four alphabetic characters (free characters) + four digit file number. The file number is automatically assigned a sequential number of the maximum number + 1 in the order of image file creation.

  Also, the extension of the image file is different between the 2D image and the 3D image. In this embodiment, the extension of the image file of the 2D image is “JPG” representing the JPEG image, and the extension of the image file of the 3D image. The extension is “MPO” representing one multi-picture file created by connecting a plurality of JPEG images.

  Note that multi-picture files include those for panoramic images and multi-angle images in addition to those for 3D images (stereoscopic view). In this embodiment, multi-picture files for 3D images are applied.

  FIG. 4 is a diagram illustrating an example of a data structure of a multi-picture file (3D image file).

  As shown in FIG. 4, the 3D image file F uses the Exif standard file format and adopts a file format in which a plurality of images are integrated and recorded. Individual image (1) (first image) A1, individual image (2) A2, individual images (2) A2,..., Individual images (n) An are connected.

  Each individual image area is divided into an SOI (Start of Image) indicating the start position of each individual image and an EOI (End of Image) indicating the end position. Exif attached information of the individual image follows the SOI. An APP1 marker segment to be recorded and an APP2 marker segment in which multi-viewpoint accessory information is recorded are provided, and then a viewpoint image (individual image) is recorded.

  The APP1 marker segment is provided with Exif identification information, a TIFF header, and an IFD (Image file directory) area (IFD0 area (0th IFD) and IFD1 area (1st IFD)). A thumbnail image generated from an individual image is stored in the IFD1 area (1st IFD). The APP2 marker segment includes individual information IFD.

  The individual information IFD includes an individual image type (3D, panorama, multi-angle), the number of individual images, an individual image number, a convergence angle, a baseline length, and the like.

  FIG. 5 is a diagram illustrating an example of a data structure of a multi-picture file in which images of two viewpoints (a left image and a right image) are stored. The multi-picture file of this embodiment stores a left image as a viewpoint image (1) (first image) and a right image as a viewpoint image (2).

<Operation of 3D Image Display Device 10>
Next, the operation of the 3D image display apparatus 10 will be described with reference to the flowchart shown in FIG.

  In FIG. 6, when the power switch of the operation unit 14 of the three-dimensional image display device 10 is turned on and the normal playback for playing back still images one frame at a time is set as the playback mode, the CPU 20 stores the memory card slot 16. The image file of the first frame (one frame with the smallest file number) is read from the memory card 34 attached to the card via the card I / F 24 (step S10). In the memory card 34, 2D image files and 3D image files are mixedly recorded.

  Subsequently, the CCD 20 determines whether or not fast-forward playback for switching and playing back frame images one after another at a preset short time interval (for example, 1 second or less) is instructed from the operation unit 14 (step S12).

  For example, if a frame advance switch that instructs one frame advance or one frame return every time one push is held down for a predetermined time or more, it can be determined that fast forward playback is instructed. Further, when it is determined that the fast-forward playback has been instructed in this way, it is possible to determine that the fast-forward playback has been switched to the frame-forward playback when the pressing of the frame advance switch is stopped. If a dedicated switch for instructing fast forward playback (fast reverse playback) is provided in addition to the frame advance switch, it is possible to determine whether or not fast forward playback has been instructed by inputting the dedicated switch. .

  If it is determined in step S12 that fast-forward playback is instructed (in the case of “Yes”), the CCD 20 determines whether the currently read image file is a 2D image file or a 3D image file and expands the image file. A determination is made based on the child (step S14). That is, when the extension is “JPG”, it is determined as a 2D image file, and when the extension is “MPO”, it is determined as a multi-picture file (3D image file). In addition, since a multi-picture file may store a panorama image or the like in addition to a 3D image, it is further determined whether or not it is a 3D image file by reading individual image type management information in the attached information of the image file. You may make it do.

  If it is determined in step S14 that the file is a 2D image file, the CPU 20 reads the image (main image) stored in the image file and generates a 2D display image to be displayed on the 3D LCD 12 (step S16). On the other hand, if it is determined that the file is a 3D image file, the CPU 20 reads the left image (first image (viewpoint image (1) shown in FIG. 5)) stored in the image file and displays it on the 3D LCD 12. A work image is generated (step S18).

  The CPU 20 temporarily stores the 2D display image generated as described above in the buffer memory 28, and the display controller 26 reads the 2D display image from the buffer memory 28 and outputs it to the 3D LCD 12. Thereby, a 2D image is displayed on the 3D LCD 12 (step S20).

  Subsequently, it is determined whether or not the frame is displayed for a certain time, which is the playback time of one frame during fast-forward playback (step S22). If it is less than the certain time, the process proceeds to step S20 via step S24 and continues to 2D. Display an image.

  On the other hand, if it is determined in step S22 that the image has been displayed for a certain period of time (in the case of “Yes”), after reading the next one frame image file (step S26), the process proceeds to step S12.

  As a result, when fast-forward playback is instructed, the frame images are switched and played back at short time intervals. In this case, regardless of whether the sequentially read image file is a 2D image file or a 3D image file, It is reproduced as a 2D image.

  On the other hand, if it is determined in step S12 that frame-by-frame playback is performed instead of fast-forward playback (in the case of “No”), the CCD 20 determines whether the currently read image file is a 2D image file as in step S14. Whether the file is a 3D image file is determined based on the extension of the image file or the like (step S28).

  When the CPU 20 determines that the file is a 2D image file, the CPU 20 reads the image stored in the image file and generates a 2D display image for display on the 3D LCD 12 (step S30). When it is determined, the CPU 20 reads out the left image and the right image (the viewpoint image (1) and the viewpoint image (2) shown in FIG. 5) stored in the image file, and displays them on the 3D LCD 12 for 3D display. A work image is generated (step S32).

  The CPU 20 temporarily stores the 2D display image or 3D display image generated as described above in the buffer memory 28, and the display controller 26 reads the 2D display image or 3D display image from the buffer memory 28, Output to the 3D LCD 12. Thereby, a 2D image or a 3D image is displayed on the 3D LCD 12 (step S34).

  Subsequently, the CPU 20 determines whether or not a frame advance instruction for one frame advance or one frame return is input from the frame advance switch (step S36), and when there is no frame advance instruction input (in the case of “No”). Transits to step S34 via step S38, and continuously displays the 2D image or 3D image currently displayed.

  On the other hand, if it is determined in step S36 that a frame advance instruction has been input (in the case of “Yes”), the next one frame image file is read (step S26), and then the process proceeds to step S12.

  As a result, when frame advance playback is instructed, an image file is read each time a frame advance instruction is input by the frame advance switch, and when the read image file is a 2D image file, A 2D image is displayed, and in the case of a 3D image file, a 3D image is displayed.

  In step S24 and step S38, when the power switch is turned off or another playback mode such as a slide show is selected, the normal playback mode by normal playback is terminated.

  FIG. 7 is an image diagram of a 2D image or a 3D image reproduced as described above. As shown in the figure, during fast-forward playback, a 2D image is displayed regardless of whether the image file to be read is a 2D image file or a 3D image file. On the other hand, during frame-by-frame playback, the read image file is a 2D image file. Displays a 2D image, and in the case of a 3D image file, a 3D image is displayed.

  In other words, since a 3D image is reproduced as a 2D image during fast-forward playback, there is no need to observe an image whose parallax changes in a short time, thereby improving the visibility of the image during fast-forward playback. It is possible to reduce fatigue of the observer.

  The fast-forward playback is playback when searching for a desired image from a large number of images, and is not playback for viewing images. Therefore, even if a 3D image is displayed as a 2D image, the purpose of fast-forward playback is achieved. Is done.

  Also, during fast-forward playback, images are switched and displayed one after another in a short time, which increases the amount of image processing. However, since 3D images are displayed as 2D images as described above, image processing for 3D display becomes unnecessary. The processing time can be shortened. In addition, if the top image (area A1 in FIG. 5) of a plurality of individual images stored in the 3D image file is read, a 2D display image can be generated. Can be processed in the same manner as a 2D image file. That is, it is not necessary to read out information on the area A2 in the 3D image file shown in FIG.

  Note that during fast-forward playback, the read image file is played back as a 2D image regardless of whether it is a 2D image file or a 3D image file, so the determination in step S14 in the flowchart shown in FIG. 6 can be omitted.

  In this embodiment, the display image is generated by reading the main image from the image file. However, the present invention is not limited to this, and the thumbnail image included in the attached information of the image file is read out during fast-forward playback. A display image may be generated from the image.

  Since thumbnail images are small in size, it is necessary to resize them to an image size corresponding to the display size of the 3D LCD 12 by interpolation processing or the like. This reduces image quality, but is not intended for viewing images during fast-forward playback. Therefore, there is no problem. Further, when displaying thumbnail images during fast-forward playback, it is only necessary to read out the information of the first area a1, or the areas a1 and a2 of the image file, as shown in FIG. Can be planned.

[Second Embodiment of Three-Dimensional Image Display Device]
8 and 9 are a front view and a rear view, respectively, of a digital camera provided with the three-dimensional image display device according to the second embodiment of the present invention.

  As shown in these drawings, the digital camera 100 is provided with a pair of left and right photographing lenses 160L and 160R on the front surface (front surface), and a 3D LCD 150 and an operation unit 116 on the rear surface.

  FIG. 10 is a block diagram showing an internal configuration of the digital camera 100 shown in FIGS.

  As illustrated in FIG. 10, the digital camera 100 is a compound eye camera including two photographing units 112R and 112L, and a 3D image composed of a plurality of images photographed by the plurality of photographing units 112R and 112L is used for one 3D display. Can be recorded as a 3D image file.

  A main CPU 114 (hereinafter referred to as “CPU 114”) controls the overall operation of the digital camera 100 according to a predetermined control program based on an input from the operation unit 116.

  A ROM 124, an EEPROM 126, and a work memory 128 are connected to the CPU 114 via a system bus 122. The ROM 124 stores a control program executed by the CPU 114 and various data necessary for control. The EEPROM 126 stores various setting information relating to the operation of the digital camera 100 such as user setting information. The work memory 128 includes a calculation work area for the CPU 114 and a temporary storage area for image data.

  The operation unit 116 is a means for a user to perform various operation inputs, and includes a power / mode switch, a mode dial, a release switch, a cross key, a zoom button, a MENU / OK button, a DISP button, and a BACK button. . The operation display unit 118 is a means for displaying an operation input result from the operation unit 116, and includes, for example, a liquid crystal panel or a light emitting diode (LED).

  The power / mode switch is means for switching on / off the power of the digital camera 100 and switching the operation mode (playback mode and photographing mode) of the digital camera 100. When the power / mode switch is turned on, power supply from the power supply unit 120 to each unit of the digital camera 100 is started, and various operations of the digital camera 100 are started. When the power / mode switch is turned off, the supply of power from the power supply unit 120 to each unit of the digital camera 100 is stopped.

  The mode dial is an operating means for switching the shooting mode of the digital camera 100. The 2D still image shooting mode for shooting a 2D still image according to the setting position of the mode dial, and the 2D movie shooting for shooting a 2D movie. The shooting mode is switched between a mode, a 3D still image shooting mode for shooting a 3D still image, and a 3D moving image shooting mode for shooting a 3D moving image. When the shooting mode is set to the 2D still image shooting mode or the 2D moving image shooting mode, a flag indicating that the 2D mode for shooting a 2D image is set in the shooting mode management flag 130. When the shooting mode is set to the 3D still image shooting mode or the 3D moving image shooting mode, the shooting mode management flag 130 is set to indicate a 3D mode for shooting a 3D image. The CPU 114 refers to the shooting mode management flag 130 to determine the shooting mode setting.

  The release switch is composed of a two-stage stroke type switch composed of so-called “half-press” and “full-press”. When the release switch is pressed halfway in still image shooting mode, shooting preparation processing (for example, AE (Automatic Exposure) processing, AF (Auto Focus) processing, AWB (Automatic White Balance)) (Balance) processing) is performed, and when the release switch is fully pressed, still image shooting / recording processing is performed. In the moving image shooting mode, moving image shooting starts when the release switch is fully pressed, and moving image shooting ends when the release switch is fully pressed again. Note that a release switch for still image shooting and a release switch for moving image shooting may be provided separately.

  The 3D LCD 150 is a 3D image display similar to the 3D LCD 12 of the 3D image display device 10 illustrated in FIG. 1, and functions as an image display unit for displaying a captured 2D image or 3D image, and at the time of various settings. It functions as a GUI. The 3D LCD 150 functions as an electronic viewfinder for confirming the angle of view in the shooting mode.

  The vertical / horizontal shooting detection circuit 132 includes, for example, a sensor for detecting the orientation of the digital camera 100, and inputs the detection result of the orientation of the digital camera 100 to the CPU 114. The CPU 114 switches between vertical shooting and horizontal shooting when the digital camera 100 is oriented.

  Next, the shooting function of the digital camera 100 will be described. In FIG. 10, each part in each of the photographing units 112R and 112L is distinguished from each other by adding reference signs R and L. However, since the functions of the respective parts are substantially the same, in the following description, reference signs R and L are used. The description is omitted.

  The photographing lens 160 includes a zoom lens, a focus lens, and a diaphragm. The zoom lens and the focus lens move back and forth along the optical axis (LR and LL in the drawing) of each photographing unit. The CPU 114 performs zooming by controlling the position of the zoom lens by controlling the driving of a zoom actuator (not shown) via the photometry / ranging CPU 180, and controls the driving of the focus actuator via the photometry / ranging CPU 180. Thus, focusing is performed by controlling the position of the focus lens. Further, the CPU 114 controls the aperture amount (aperture value) of the diaphragm by controlling the driving of the diaphragm actuator via the photometry / ranging CPU 180, and controls the amount of light incident on the image sensor 162.

  When shooting a plurality of images in the 3D mode, the CPU 114 drives the shooting lenses 160R and 160L of the shooting units 112R and 112L in synchronization. That is, the photographing lenses 160R and 160L are always set to the same focal length (zoom magnification). In addition, the aperture is adjusted so that the same incident light amount (aperture value) is always obtained. Further, in the 3D mode, focus adjustment is performed so that the same subject is always in focus.

  The flash light emitting unit 176 is constituted by, for example, a discharge tube (xenon tube), and emits light as necessary when photographing a dark subject or in backlight. The charge / light emission control unit 178 includes a main capacitor for supplying a current for causing the flash light emission unit 176 to emit light. The CPU 114 transmits a flash emission command to the photometry / ranging CPU 180 to perform charge control of the main capacitor, discharge (light emission) timing of the flash light emission unit 176, control of the discharge time, and the like. Note that a light emitting diode may be used as the flash light emitting unit 176.

  The imaging unit 112 captures a distance light emitting element 186 (for example, a light emitting diode) for irradiating the subject with light and an image of the subject irradiated with light by the distance light emitting element 186 (ranging image). A distance image sensor 184.

  The photometry / ranging CPU 180 causes the distance light emitting element 186 to emit light at a predetermined timing based on a command from the CPU 114 and controls the distance imaging element 184 to photograph a distance measuring image.

  The distance measurement image captured by the distance image sensor 184 is converted into digital data by the A / D converter 196 and input to the distance information processing circuit 198.

  The distance information processing circuit 198 uses the distance measurement image acquired from the distance image sensor 184 to connect between the subject photographed by the photographing units 112R and 112L and the digital camera 100 based on the principle of so-called triangulation. The distance (subject distance) is calculated. The subject distance calculated by the distance information processing circuit 198 is recorded in the distance information storage circuit 103.

  As a method for calculating the subject distance, the light flight time from when the distance light emitting element 186 emits light until the light emitted by the distance light emitting element 186 is reflected by the subject and reaches the distance imaging element 184 is used. A TOF (Time of Flight) method for calculating the subject distance from the (delay time) and the speed of light may be used.

  The photographing unit 112 includes an interval / convergence angle driving circuit 188 and an interval / convergence angle detection circuit 190.

  The interval / convergence angle driving circuits 188R and 188L drive the imaging units 112R and 112L, respectively. The CPU 114 operates the interval / convergence angle driving circuits 188R and 188L via the interval / convergence angle control circuit 192 to adjust the interval and the convergence angle between the photographing lenses 160R and 160L.

  The interval / convergence angle detection circuits 190R and 190L include means for transmitting and receiving radio waves, for example. The CPU 114 operates the interval / convergence angle detection circuits 190R and 190L via the interval / convergence angle control circuit 92 to transmit and receive radio waves, thereby measuring the interval and the convergence angle between the photographing lenses 160R and 160L. . The measurement results of the interval between the photographing lenses 160R and 160L and the convergence angle are stored in the lens interval / convergence angle storage circuit 102.

  The image sensor 162 is constituted by a color CCD solid-state image sensor, for example. A large number of photodiodes are two-dimensionally arranged on the light receiving surface of the image sensor 162, and color filters of three primary colors (R, G, B) are arranged in predetermined photodiodes on each photodiode. Yes. The optical image of the subject formed on the light receiving surface of the image sensor 62 by the photographing lens 160 is converted into signal charges corresponding to the amount of incident light by the photodiode. The signal charge accumulated in each photodiode is sequentially read out from the image sensor 162 as a voltage signal (R, G, B signal) corresponding to the signal charge based on a drive pulse given from the TG 164 according to a command from the CPU 114. The image sensor 162 has an electronic shutter function, and the exposure time (shutter speed) is controlled by controlling the charge accumulation time in the photodiode.

  As the image sensor 162, an image sensor other than a CCD such as a CMOS sensor can be used.

  The analog signal processing unit 166 outputs a correlated double sampling circuit (CDS), R, G, and B signals for removing reset noise (low frequency) included in the R, G, and B signals output from the image sensor 162. An AGS circuit for amplifying and controlling to a certain level is included. Analog R, G, and B signals output from the image sensor 162 are subjected to correlated double sampling processing and amplified by the analog signal processing unit 166. The analog R, G, and B signals output from the analog signal processing unit 166 are converted into digital R, G, and B signals by the A / D converter 168 and input to the image input controller (buffer memory) 170. The

  The digital signal processing unit 172 includes a synchronization circuit (a processing circuit that interpolates a spatial shift of a color signal associated with a color filter arrangement pixel of a single CCD and converts the color signal into a simultaneous expression), a white balance adjustment circuit, a floor A tone conversion processing circuit (gamma correction circuit), a contour correction circuit, a luminance / color difference signal generation circuit, and the like are included. Digital R, G, and B signals input to the image input controller 170 are subjected to predetermined processing such as synchronization processing, white balance adjustment, gradation conversion, and contour correction by the digital signal processing unit 172, It is converted into a Y / C signal composed of a luminance signal (Y signal) and a color difference signal (Cr, Cb signal).

  When the live view image (through image) is displayed on the 3D LCD 150, the Y / C signal generated in the digital signal processing unit 172 is sequentially supplied to the buffer memory 144. The display controller 142 reads the Y / C signal supplied to the buffer memory 144 and outputs it to the YC-RGB conversion unit 146. The YC-RGB conversion unit 146 converts the Y / C signal input from the display controller 142 into R, G, and B signals and outputs them to the 3D LCD 150 via the driver 148. Thereby, the through image is displayed on the 3D LCD 150.

  Here, when the camera mode is the shooting mode and in the 2D mode, a recording image is shot by a predetermined one shooting unit (for example, 112R). In the 2D mode, an image photographed by the photographing unit 112R is compressed by the compression / decompression processing unit 174R. The compressed image data is recorded on the memory card 34 as an image file in a predetermined format via the memory controller 134 and the card I / F 138. For example, JPEG (Joint Photographic Experts Group) for still images, MPEG2 or MPEG4 for moving images, and H.264. It is recorded as a compressed image file conforming to the H.264 standard.

  The camera mode is a shooting mode, and in the 3D mode, images are shot in synchronization by the shooting units 112R and 112L. In the 3D mode, AF processing and AE processing are performed based on the image signal acquired by one of the imaging units 112R and 112L. In the 3D mode, the two viewpoint images captured by the imaging units 112R and 112L are respectively compressed by the compression / decompression processing units 174R and 174L, stored in one 3D image file, and recorded on the memory card 34. The 3D image file stores subject distance information, information on the distance between the taking lenses 160R and 160L, information on the convergence angle, and the like, as well as compressed image data of two viewpoints.

  On the other hand, when the operation mode of the camera is the playback mode, the last image file (last recorded image file) recorded on the memory card 34 is read out, and the compression / decompression processing unit 174 performs uncompressed Y / After being expanded to the C signal, it is input to the buffer memory 144. The display controller 142 reads the Y / C signal supplied to the buffer memory 144 and outputs it to the YC-RGB conversion unit 146. The YC-RGB conversion unit 146 converts the Y / C signal input from the display controller 142 into R, G, and B signals and outputs them to the 3D LCD 150 via the driver 148. As a result, the image of the image file recorded on the memory card 34 is displayed on the 3D LCD 150.

  If the image file read from the memory card 34 is a 2D image file, the 2D image is read from the 2D image file and displayed on the 3D LCD 150 as a 2D image.

  On the other hand, when the image file read from the memory card 34 is a 3D image file, a right-eye image and a left-eye image taken from different viewpoints are extracted from the 3D image file, and the 3D LCD 150 generates a 3D image. Is displayed.

  Further, by operating the DISP button of the operation unit 116 in the playback mode, an index image composed of a plurality of reduced images (thumbnail images) can be displayed on the 3D LCD 150.

  In the digital camera 100, when fast-forward playback is instructed in the playback mode, a 2D image is read regardless of whether the image file to be read is a 2D image file or a 3D image file, similarly to the 3D image display device 10 shown in FIG. On the other hand, at the time of frame-by-frame playback, a 2D image is displayed when the read image file is a 2D image file, and a 3D image is displayed when the image file is a 3D image file.

[Third embodiment of three-dimensional image display apparatus]
As described above, when fast-forward playback is instructed, since the 2D image is displayed regardless of whether the image file to be read is a 2D image file or a 3D image file, is the displayed image generated from the 2D image file? It cannot be identified whether the file is generated from a 3D image file.

  The 3D image display device according to the third embodiment can distinguish between 2D images and 3D images even during fast-forward playback.

  FIG. 11 is a diagram illustrating the principle of a 3D image display device in which different images can be visually recognized from four different directions in the left-right direction.

In the 3D image display shown in FIG. 11, a lenticular lens 202 is provided on a pixel 200, and each pixel n _4i-3 , pixel n _4i-2 , and pixel n _4i-1 have the same directivity every three pixels. , And the pixel group for each pixel n _4i (i = 1, 2, 3,...) Can display four directional images having directivity in the horizontal direction.

That is, the pixel group of pixels _{n 4i-3} is a wrench by lenticular lens 202 can display the direction of the directional images of the viewpoint _{P 1,} similarly pixel _{n 4i-2,} pixel _{n 4i-1,} and the pixel _{n 4i} These pixel groups can display directional images in the directions of the viewpoints P ₂ , P ₃ , and P ₄ by the lenticular lens 202, respectively.

Here, when the 3D image display is viewed from the front (when the positions of the left and right eyes are at the viewpoints P ₂ and P ₃ ), _two pixels from the pixel group of the pixel n _4i-2 and the pixel n _4i-1 are displayed. Each image can be viewed, and similarly, when the 3D image display is viewed from the right (when the positions of the left and right eyes are at the viewpoints P ₁ and P ₂ ), the pixel n _4i-3 and the pixel n _4i-2 When viewing the 3D image display from the left (when the positions of the left and right eyes are at the viewpoints P ₃ and P ₄ ), the pixels n _4i−1 , Two images from the pixel group of pixel n _4i can each be seen.

Therefore, when the same image is displayed as the four directional images corresponding to the viewpoints P _{1 to} P ₄ , the same image can be viewed from any position, and the four viewpoint parallax images having parallax are displayed. By doing so, a different parallax image for each viewpoint position can be viewed (stereoscopically).

  12 to 14 are rear views of a digital camera 100 ′ provided with the 3D image display device according to the third embodiment. The digital camera 100 ′ has substantially the same configuration as the digital camera 100 of the second embodiment shown in FIG. 9, but the back 3D LCD 150 ′ can visually recognize different images from the four directions shown in FIG. A 3D image display is applied, and at the time of fast-forward playback, as shown below, the 3D LCD 150 ′ displays different types of directional images, which is different from the second embodiment.

  That is, the digital camera 100 ′ reproduces the 3D LCD 150 ′ so that different images can be visually recognized when viewed from the front, when viewed from the right, and when viewed from the left during fast-forward playback.

<When viewing the 3D LCD 150 'from the front>
When the 3D LCD 150 ′ is viewed from the front, two directional images of the pixel group of the pixel n _4i-2 and the pixel n _4i-1 can be viewed from the viewpoints P ₂ and P ₃ as illustrated in FIG. it can. The digital camera 100 ′ displays the same image as the two directional images. Thereby, the same image is seen by the left and right eyes, and is visually recognized as a 2D image. This is the same as the first and second embodiments described above.

<When viewing 3D LCD 150 'from the right>
When viewing the 3D LCD 150 ′ from the right, as shown in FIG. 11, two directional images of the pixel groups of the pixels n _4i-3 and n _{4i-2 from} the viewpoints P ₁ and P ₂ can be viewed. it can. The directivity image of the pixel group of the pixel n _{4i-3 is 2} of the pixel group of the pixel n _4i-2 and the pixel n _4i-1 when the currently read image file is a 2D image file. If the image file currently read out is a 3D image file, the 3D image file name, the number of viewpoints, the shooting date, etc. are displayed as shown in FIG. Information related to the 3D image such as shooting information not to be displayed is displayed.

  As a result, during fast-forward playback, the currently read image file is played back as a 2D image regardless of whether it is a 2D image file or a 3D image file, so that the image being played back has been generated from a 2D image file, or 3D If the left image (2D image) generated from the 3D image file is reproduced by viewing the 3D LCD 150 ′ from the right, the 3D LCD 150 ′ cannot be distinguished. Since information related to an image file (3D image) can be visually recognized, it is possible to distinguish between a 2D image generated from a 2D image file and a 2D image generated from a 3D image file.

  Note that only the information related to the 3D image is displayed on the 3D LCD 150 ′ in FIG. 13, but a directional image of the 2D image generated from the 3D image file is also displayed at the same time. Each is visible.

<When viewing 3D LCD 150 'from the left>
When the 3D LCD 150 ′ is viewed from the left, as shown in FIG. 11, two directional images of the pixel groups of the viewpoints P ₃ and P _{4, the} pixel n _4i−1 , and the pixel n _4i can be visually recognized. When the currently read image file is a 3D image file, the directivity image of the pixel group of the pixel n _4i is the two directivity images of the pixel group of the pixel n _4i-2 and the pixel n _4i-1. If the currently read image file is a 2D image file, the 2D image file name, shooting date, and other shooting information not shown are displayed as shown in FIG. Information related to the 2D image is displayed.

  As a result, during fast-forward playback, the currently read image file is played back as a 2D image regardless of whether it is a 2D image file or a 3D image file, so that the image being played back has been generated from a 2D image file, or 3D Although it is impossible to distinguish whether the image is generated from an image file, when the 2D image generated from the 2D image file is reproduced by looking at the 3D LCD 150 ′ from the left, the 2D image file (2D Since the information related to (image) can be visually recognized, it is possible to distinguish between a 2D image generated from a 2D image file and a 2D image generated from a 3D image file.

  Note that only the information related to the 2D image is displayed on the 3D LCD 150 ′ in FIG. 14. At the same time, a directional image of the 2D image generated from the 2D image file is also displayed. Each is visible.

  [Table 1] below summarizes images that can be viewed according to the direction in which the 3D LCD 150 ′ is viewed and the type of image file during fast-forward playback.

  According to the third embodiment, when searching for a desired image from a 2D image file during fast-forward playback or when searching for a desired image from a 3D image file, the digital camera 100 ′ is tilted in the left-right direction. It is possible to search for an image desired to be distinguished from a 2D image and a 3D image.

  The 3D LCD 150 ′ is not limited to that of the third embodiment, and any 3D LCD 150 ′ may be used as long as it can display directional images in two or more directions that can display a 3D image.

  Moreover, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Three-dimensional image display apparatus (3D image display apparatus), 12, 150, 150 '... Three-dimensional liquid crystal display (3D LCD), 20, 114 ... Central processing unit (CPU), 22, 128 ... Work memory, 26, 100, 100 '... digital camera, 142 ... display controller, 28, 136 ... buffer memory, 30, 126 ... EEPROM

Claims (12)

An image file from a recording medium in which a two-dimensional image file in which a two-dimensional image is recorded and a three-dimensional image file in which a three-dimensional image composed of a plurality of images taken from the same subject is recorded are mixed. A playback instruction means for instructing frame-by-frame playback with a long playback time of one frame or fast-forward playback with a playback time shorter than the playback time of the frame-by-frame playback;
Image acquisition means for acquiring an image file from the recording medium based on a read instruction by the reproduction instruction means;
Determining means for determining whether the image file acquired by the image acquiring means is a two-dimensional image file or a three-dimensional image file;
When the image acquisition unit acquires a 2D image file, a 2D display image is generated based on the image in the 2D image file, frame playback is instructed by the playback instruction unit, and When the image acquisition means acquires a 3D image file, a 3D display image having parallax is generated from the images in the acquired 3D image file, and fast-forward playback is instructed by the playback instruction means, And when the image acquisition means acquires a 3D image file, a display image generation means for generating a 2D display image from the image in the acquired 3D image file;
Image display means for displaying a two-dimensional image or a three-dimensional image based on the two-dimensional display image or the three-dimensional display image generated by the display image generation means;
A three-dimensional image display device comprising:   The reproduction instruction means has a frame advance operation means for instructing one frame advance or one frame return every time one push is performed, and when the frame advance operation means is kept pressed for a predetermined time or more, a predetermined time interval is set. The three-dimensional image display device according to claim 1, wherein fast-forward playback for reading an image file is instructed.   The reproduction instruction means includes a frame advance operation means for instructing one frame advance or one frame return every time one push is performed, and a fast forward operation means for instructing fast forward or fast reverse, and the fast forward operation means is operated. 2. The three-dimensional image display device according to claim 1, wherein fast-forward reproduction for reading an image file at a preset time interval is instructed. The three-dimensional image file is a multi-picture file in which one or a plurality of images are continuously stored following the head image.
The display image generation means acquires a head image from the acquired three-dimensional image file when fast playback is instructed by the reproduction instruction means and the image acquisition means acquires a three-dimensional image file, The three-dimensional image display device according to claim 1, wherein the two-dimensional display image is generated based on a head image. The three-dimensional image file is a multi-picture file in which one or a plurality of images are continuously stored following the head image.
The display image generation means, when fast playback is instructed by the reproduction instruction means, and when the image acquisition means acquires a 3D image file, additional information corresponding to the head image from the acquired 3D image file. 4. The three-dimensional image display device according to claim 1, wherein a thumbnail image is acquired, and the two-dimensional display image is generated based on the thumbnail image. 5.   The determination unit determines whether the image file is a two-dimensional image file or a three-dimensional image file based on an extension of the image file or attached information stored in the image file. The three-dimensional image display device according to any one of 5. The image display means is a three-dimensional image display means for displaying two or more directional images having directivity in the left-right direction;
The display image generation unit generates the display image as a first directional image when the image display unit is viewed from the front, and the display image generation unit displays the first image when the image display unit is viewed from the left-right direction. 7. The three-dimensional image display device according to claim 1, wherein the three-dimensional image display device generates a display image different from the first directivity image.   The second directivity image is an image that enables a type of a two-dimensional image generated from the secondary image file and a two-dimensional image generated from the three-dimensional image file. The three-dimensional image display device according to claim 7.   The second directional image is displayed simultaneously with the information related to the two-dimensional image to be displayed simultaneously with the two-dimensional image generated from the secondary image file or the two-dimensional image generated from the tertiary image file. The three-dimensional image display device according to claim 8, wherein the information is any one of information related to the three-dimensional image to be generated. An image file from a recording medium in which a two-dimensional image file in which a two-dimensional image is recorded and a three-dimensional image file in which a three-dimensional image composed of a plurality of images taken from the same subject is recorded are mixed. A step of accepting reading of the frame, and accepting an instruction for frame-by-frame playback with a long playback time of one frame or fast-forward playback with a playback time shorter than the playback time of the frame-by-frame playback;
Acquiring an image file from the recording medium by an image acquisition means based on the received reproduction instruction;
Determining by the determining means whether the image file acquired by the image acquiring means is a two-dimensional image file or a three-dimensional image file;
When the image acquisition unit acquires the 2D image file, the image acquisition unit generates a 2D display image based on the image in the 2D image file, accepts the frame advance reproduction, and the image acquisition unit 3 When a three-dimensional image file is acquired, a three-dimensional display image having a parallax is generated from the images in the acquired three-dimensional image file, the fast-forward playback is accepted, and the image acquisition means is a three-dimensional image file. When obtaining a two-dimensional display image from the image in the obtained three-dimensional image file,
Displaying a two-dimensional image or a three-dimensional image on an image display means based on the generated two-dimensional display image or three-dimensional display image;
A three-dimensional image display method comprising: The three-dimensional image file is a multi-picture file in which one or a plurality of images are continuously stored following the head image.
In the step of generating the image for 2D display, when the fast-forward reproduction is accepted and the image acquisition unit acquires a 3D image file, information from the acquired 3D image file to the top image is acquired. The three-dimensional image display method according to claim 10, wherein the two-dimensional display image is generated based on the head image. The three-dimensional image file is a multi-picture file in which one or a plurality of images are continuously stored following the head image.
In the step of generating the two-dimensional display image, when the fast-forward reproduction is accepted and the image acquisition unit acquires a three-dimensional image file, additional information corresponding to the first image from the acquired three-dimensional image file 11. The three-dimensional image display method according to claim 10, wherein the two-dimensional display image is generated based on a thumbnail image included in the attached information.

Images