JP5049231B2 - Three-dimensional display device, method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make an object easy to view when the object is displayed in an image displayed three-dimensionally. <P>SOLUTION: A three-dimensional processing unit 30 performs a 3D process on first and second images G1, G2 obtained respectively by imaging units 21A, 21B and displays the images three-dimensionally in a monitor 20. A display control unit 28 calculates an amount of disparity between the first and second images G1, G2. When the amount of disparity is equal to or greater than a threshold value Th1, a background is given to an object displayed over the image displayed. When the amount of disparity is less than the threshold value Th1, no background is given to the object. <P>COPYRIGHT: (C)2010,JPO&amp;INPIT

Description

  The present invention relates to a three-dimensional display device and method for three-dimensionally displaying a plurality of images so as to be stereoscopically viewed, and a program for causing a computer to execute the three-dimensional display method.

  It is known that stereoscopic viewing can be performed using parallax by combining a plurality of images and displaying them three-dimensionally. In such a stereoscopic view, a plurality of images are acquired by photographing the same subject from different positions using a plurality of cameras, and the plurality of images are three-dimensionally obtained using the parallax of the subjects included in the plurality of images. It can be generated by displaying.

  Specifically, in the case of a method for realizing stereoscopic vision by the naked eye balance method, a plurality of images can be arranged side by side to perform three-dimensional display. In addition, a plurality of images are overlapped with different colors such as red and blue, or a plurality of images are overlapped with different polarization directions, and a plurality of images are combined to perform three-dimensional display. Can do. In this case, stereoscopic viewing can be performed by using image separation glasses such as red-blue glasses and polarizing glasses to fuse the three-dimensionally displayed image with the auto-focus function of the eyes (an anaglyph method, a polarizing filter method). ).

  Further, it is also possible to display a plurality of images on a three-dimensional display monitor that can be stereoscopically viewed and stereoscopically viewed without using polarized glasses or the like, as in the parallax barrier method and the lenticular method. In this case, three-dimensional display is performed by cutting a plurality of images into strips in the vertical direction and arranging them alternately. In addition, a method of performing three-dimensional display by alternately displaying the left and right images while changing the light beam direction of the left and right images by using image separation glasses or attaching an optical element to the liquid crystal has been proposed. (Scan backlight method).

  In addition, a compound eye camera having a plurality of photographing units that performs photographing for performing such three-dimensional display has been proposed. Such a compound eye camera includes a 3D display monitor, generates a 3D display image from images acquired by a plurality of imaging units, and displays the generated 3D display image on the 3D display monitor in a 3D manner. it can.

  Also, in such a compound eye camera, shooting conditions such as F value and shutter speed, text including letters and numbers such as the number of shots and shooting date, lines such as a frame surrounding the text, camera shake prevention, flash on, etc. An icon for representing / off, a person mode, etc., and an object such as a pictograph are displayed so as to be superimposed on the three-dimensional display image. By confirming such an object, the photographer can recognize the shooting date and time, the number of shots, the shooting conditions at the time of shooting, and the like.

Here, when displaying such an object, a method of changing the stereoscopic effect of the object based on the usage frequency and importance of the object has been proposed (see Patent Document 1). According to the technique described in Patent Literature 1, the stereoscopic effect of an object can be easily changed according to its use frequency, importance, and the like.
JP 2005-49668 A

  Here, when displaying an object, the object must be made small so that the image is displayed as large as possible. However, if the object is small, the parallax between the plurality of images is large, and if the stereoscopic effect when three-dimensionally displayed is increased, it becomes difficult to confirm the contents of the object, and further, it becomes difficult to hold the stereoscopic effect of the image.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to make it easy to see an object displayed in a three-dimensionally displayed image.

A first three-dimensional display device according to the present invention includes a display unit that three-dimensionally displays a plurality of images acquired by shooting at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
When displaying an object overlaid on the three-dimensionally displayed image, it is determined whether or not the amount of parallax between the plurality of images is equal to or greater than a predetermined threshold value. And a display control means for displaying the object with the background superimposed on the three-dimensionally displayed image.

  In the first three-dimensional display device according to the present invention, the display control unit calculates a parallax amount for each region where the object is displayed on the three-dimensionally displayed image, and It may be a means for determining whether or not the amount of parallax is equal to or greater than the predetermined threshold value, and adding a background to the object only in a region where the determination is affirmative.

The 3D display device according to the present invention further comprises a switching means for switching the display mode of the display means to 3D display and 2D display,
The display control means may be means for calculating the parallax amount, making the determination, and adding a background to the object only when the display mode is switched to the three-dimensional display.

In this case, the display control means is a means for displaying a menu screen on the display means,
The switching means may be means for switching the display mode to the two-dimensional display when the menu screen is displayed.

  The menu screen is a screen displayed for setting functions of a 3D display device according to the present invention and a camera to which the 3D display device according to the present invention is applied, and characters representing various menus for setting the functions. It is a screen including

A second three-dimensional display device according to the present invention includes a display unit that three-dimensionally displays a plurality of images acquired by photographing at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
Switching means for switching the display mode of the display means between three-dimensional display and two-dimensional display;
When displaying an object overlaid on the three-dimensionally displayed image, a background is added to the object only when the display means is switched to the three-dimensional display, and the object with the background is added to the 3D display. It is characterized by comprising display control means for displaying in a superimposed manner on a three-dimensionally displayed image.

In the second three-dimensional display device according to the present invention, the display control means is a means for displaying a menu screen on the display means,
The switching means may be means for switching the display means to the two-dimensional display when the menu screen is displayed.

A first three-dimensional display method according to the present invention includes a display unit that three-dimensionally displays a plurality of images obtained by photographing at different positions;
A three-dimensional display method in a three-dimensional display device comprising a three-dimensional processing means for performing three-dimensional processing for three-dimensional display on the plurality of images,
When displaying an object overlaid on the three-dimensionally displayed image, it is determined whether or not the amount of parallax between the plurality of images is greater than or equal to a predetermined threshold value;
If the determination is affirmative, a background is given to the object,
The object provided with the background is displayed so as to be superimposed on the three-dimensionally displayed image.

A second three-dimensional display method according to the present invention includes a display unit that three-dimensionally displays a plurality of images acquired by photographing at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
A three-dimensional display method in a three-dimensional display device comprising switching means for switching a display mode of the display means to three-dimensional display and two-dimensional display,
When displaying an object overlaid on the three-dimensionally displayed image, a background is added to the object only when the display means is switched to the three-dimensional display,
The object provided with the background is displayed so as to be superimposed on the three-dimensionally displayed image.

  In addition, you may provide as a program for making a computer perform the 1st and 2nd three-dimensional display method by this invention.

  According to the first three-dimensional display device and method of the present invention, when an object is displayed on a three-dimensionally displayed image, it is determined whether or not the amount of parallax between the plurality of images is equal to or greater than a predetermined threshold value. If the determination is affirmative, a background is given to the object and the image is displayed overlaid on the three-dimensionally displayed image. For this reason, it is possible to make the object easy to see when the amount of parallax is large and the stereoscopic effect of the image displayed three-dimensionally is large, and as a result, the stereoscopic vision of the image displayed three-dimensionally is hindered because the object becomes difficult to see Can be prevented.

  In addition, when the amount of parallax is calculated for each region where an object is displayed on a three-dimensionally displayed image, and it is determined whether the amount of parallax is equal to or greater than a predetermined threshold value for each region. By adding a background to an object, it is possible to add a background only to an object that is displayed in an area with a large amount of parallax. It is possible to make it easier to see the object being used.

  Also, only when the display means is switched to the three-dimensional display, unnecessary processing is performed when performing the two-dimensional display by calculating and determining the amount of parallax and adding the background to the object. Can be prevented.

  Further, when displaying the menu screen, it is possible to make the menu screen easier to see by switching the display means to two-dimensional display.

  According to the second three-dimensional display device and method of the present invention, when an object is displayed on a three-dimensionally displayed image, a background is added to the object only when the display means is switched to the three-dimensional display. Then, the image is displayed so as to be superimposed on the three-dimensionally displayed image. For this reason, when three-dimensional display is performed, it is possible to make the object easy to see, and as a result, it is possible to prevent the stereoscopic view of the image displayed three-dimensionally from being obstructed by making the object difficult to see. In addition, unnecessary processing can be prevented when performing two-dimensional display.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a schematic block diagram showing an internal configuration of a compound eye camera to which a three-dimensional display device according to a first embodiment of the present invention is applied. As shown in FIG. 1, the compound-eye camera 1 according to the first embodiment includes two photographing units 21A and 21B, a photographing control unit 22, an image processing unit 23, a compression / decompression processing unit 24, a frame memory 25, and a media control unit 26. An internal memory 27 and a display control unit 28.

  FIG. 2 is a diagram illustrating the configuration of the photographing units 21A and 21B. As shown in FIG. 2, the photographing units 21A and 21B include lenses 10A and 10B, diaphragms 11A and 11B, shutters 12A and 12B, CCDs 13A and 13B, analog front ends (AFE) 14A and 14B, and A / D conversion units 15A, 15B is provided.

  The lenses 10 </ b> A and 10 </ b> B are configured by a plurality of functional lenses such as a focus lens for focusing on a subject and a zoom lens for realizing a zoom function, and focus data obtained by AF processing performed by the imaging control unit 22. Based on zoom data obtained by operating a zoom lever (not shown), the position is adjusted by a lens driving unit (not shown).

  The apertures 11A and 11B are adjusted in aperture diameter by an aperture drive unit (not shown) based on aperture value data obtained by AE processing performed by the imaging control unit 22.

  The shutters 12A and 12B are mechanical shutters, and are driven by a shutter driving unit (not shown) according to the shutter speed obtained by the AE process.

  The CCDs 13A and 13B have a photoelectric surface in which a large number of light receiving elements are two-dimensionally arranged, and subject light is imaged on the photoelectric surface and subjected to photoelectric conversion to obtain an analog imaging signal. In addition, color filters in which R, G, and B color filters are regularly arranged are arranged on the front surfaces of the CCDs 13A and 13B.

  The AFEs 14A and 14B perform processing for removing noise of the analog imaging signal and processing for adjusting the gain of the analog imaging signal (hereinafter referred to as analog processing) for the analog imaging signals output from the CCDs 13A and 13B.

  The A / D converters 15A and 15B convert the analog imaging signals subjected to analog processing by the AFEs 14A and 14B into digital signals. Note that an image represented by digital image data acquired by the photographing unit 21A is a first image G1, and an image represented by image data acquired by the photographing unit 21B is a second image G2.

  The imaging control unit 22 includes an AF processing unit and an AE processing unit (not shown). The AF processing unit determines the focus area and the focal positions of the lenses 10A and 10B based on the pre-images acquired by the shooting units 21A and 21B by half-pressing the release button included in the input / output unit 34, and the shooting is performed. Output to the sections 21A and 21B. The AE processing unit determines an aperture value and a shutter speed based on the pre-image, and outputs them to the photographing units 21A and 21B.

  Here, as a focus position detection method by AF processing, for example, a passive method that detects a focus position using a feature that the contrast of an image is high when a desired subject is in focus can be considered. . More specifically, the pre-image is divided into a plurality of AF areas, and an image in each AF area is subjected to a filtering process using a high-pass filter, and an AF evaluation value is calculated for each AF area. That is, the position corresponding to the AF area with the highest output value by the filter is detected as the in-focus position.

  In addition, the shooting control unit 22 instructs the shooting units 21A and 21B to perform main shooting for acquiring the main images of the first and second images G1 and G2 by fully pressing the release button. Before the release button is operated, the shooting control unit 22 displays a through image having a smaller number of pixels than the first and second images G1 and G2 for allowing the shooting unit 21A to check the shooting range. Then, an instruction to sequentially acquire at a predetermined time interval (for example, 1/30 second interval) is given.

  The image processing unit 23 adjusts white balance, gradation correction, sharpness correction, and color correction on the digital image data of the first and second images G1 and G2 acquired by the imaging units 21A and 21B. Etc. are applied. It should be noted that reference numerals G1 and G2 before processing are also used for the first and second images after processing in the image processing unit 23.

  The compression / decompression processing unit 24 is processed by the image processing unit 23, and a three-dimensional display image generated from the main images of the first and second images G1 and G2 for three-dimensional display as will be described later. Is compressed in a compression format such as JPEG, and a three-dimensional image file for three-dimensional display is generated. The three-dimensional image file includes image data of the first and second images G1 and G2 and image data of a three-dimensional display image. In addition, a tag in which incidental information such as shooting date and time is stored is assigned to the image file based on the Exif format or the like.

  The frame memory 25 is used when various processes including the process performed by the image processing unit 23 described above are performed on the image data representing the first and second images G1 and G2 acquired by the imaging units 21A and 21B. This is a working memory.

  The media control unit 26 accesses the recording medium 29 and controls writing and reading of a 3D image file or the like.

  The internal memory 27 stores various constants set in the compound eye camera 1, a program executed by the CPU 33, and the like.

  The display control unit 28 two-dimensionally displays the first and second images G1 and G2 stored in the frame memory 25 at the time of shooting on the monitor 20 or the first and second images recorded on the recording medium 29. The images G1 and G2 are displayed two-dimensionally on the monitor 20. In addition, the display control unit 28 displays the first and second images G1 and G2 that have been subjected to the three-dimensional processing as described later on the monitor 20 in a three-dimensional manner or the three-dimensional image recorded in the recording medium 29. It is also possible to display the file on the monitor 20 three-dimensionally. Note that switching between the two-dimensional display and the three-dimensional display may be performed automatically, or may be performed by an instruction from the photographer using the input / output unit 34 described later. Here, when the three-dimensional display is performed, the through images of the first and second images G1 and G2 are three-dimensionally displayed on the monitor 20 until the release button is pressed.

  When the display mode is switched to the three-dimensional display, both the first and second images G1 and G2 are used for display as described later, and when the display mode is switched to the two-dimensional display, the first and second images are used. One of the second images G1 and G2 is used for display. In the present embodiment, the first image G1 is used for two-dimensional display.

  In addition, when the image is displayed on the monitor 20 three-dimensionally or two-dimensionally, the display control unit 28 displays the object superimposed on the image. Here, the object includes shooting conditions such as F value and shutter speed, texts composed of letters and numbers such as the number of shots and shooting date, lines such as a frame surrounding the text, camera shake prevention, flash on / off, and person mode. Etc., icons and pictograms are used. The object data is stored in the internal memory 27.

  FIG. 3 is a diagram illustrating a state in which an object is displayed on the image. Here, a state where an object is displayed on one of the first and second images G1 and G2 is shown. As shown in FIG. 3, the image has a flash emission icon in the upper left corner, the number of shots taken so far in the upper right corner, the F value and shutter speed in the lower left corner, and characters representing the shooting date in the lower right corner. Overlaid on the image.

  The objects to be displayed are not limited to those shown in FIG. 3, and characters used for warning when AF processing cannot be performed, icons used for face detection, and camera shake prevention processing. Icons, icons for macro shooting, and the like can be used.

  Further, the compound eye camera 1 according to the present embodiment includes a three-dimensional processing unit 30. The three-dimensional processing unit 30 performs three-dimensional processing on the first and second images G1 and G2 in order to display the first and second images G1 and G2 on the monitor 20 in three dimensions. When an object is displayed on the first and second images G1 and G2, three-dimensional processing is performed on the first and second images G1 and G2 on which the object is displayed.

  Here, as the three-dimensional display in the present embodiment, any known method can be used. For example, the first and second images G1 and G2 are displayed side by side and stereoscopically viewed by the naked eye balance method, or a lenticular lens is attached to the monitor 20 and the images G1 and G2 are placed at predetermined positions on the display surface of the monitor 20. By displaying the lenticular method, it is possible to use a lenticular method in which the first and second images G1 and G2 are incident on the left and right eyes to realize three-dimensional display. Further, the optical path of the backlight of the monitor 20 is optically separated so as to correspond to the left and right eyes, and the first and second images G1 and G2 are separated on the display surface of the monitor 20 to the left and right of the backlight. By alternately displaying in accordance with the above, it is possible to use a scan backlight system that realizes three-dimensional display.

  The three-dimensional processing unit 30 performs three-dimensional processing corresponding to the three-dimensional display method on the first and second images G1 and G2. For example, when the three-dimensional display method is based on the naked eye balance method, three-dimensional processing is performed by generating a three-dimensional display image in which the first and second images G1 and G2 are arranged side by side. When the three-dimensional display method is the lenticular method, three-dimensional display images are generated by cutting the first and second images G1 and G2 into strips in the vertical direction and arranging them alternately. Process. When the three-dimensional display method is the scan backlight method, the first and second images G1 and G2 are alternately output to the monitor 20 in accordance with the separation of the backlight of the monitor 20 to the left and right 3 Perform dimension processing. In the following description, the method of arranging the first and second images G1 and G2 is referred to as a first method, and the other methods are referred to as a second method.

  The monitor 20 is processed according to the method of three-dimensional processing performed by the three-dimensional processing unit 30. For example, when the three-dimensional display method is the lenticular method, a lenticular lens is attached to the display surface of the monitor 20, and when the scan backlight method is used, an optical element for changing the light beam direction of the left and right images. Is attached to the display surface of the monitor 20.

  Here, in the case of performing three-dimensional display, the object is superimposed on the image displayed on the monitor 20, but as described above, since the object is displayed small in the corner of the image, the first and second images are particularly displayed. If the amount of parallax of G1 and G2 is large and the stereoscopic effect is large, the object becomes difficult to see.

  In the first embodiment, the display control unit 28 calculates the amount of parallax between the first and second images G1 and G2, compares the amount of parallax with a threshold value Th1, and the amount of parallax is equal to or greater than the threshold value Th1. In this case, a background is added to the object. Details of this process will be described later.

  CPU33 controls each part of compound eye camera 1 according to the signal from input-output part 34 containing a release button, a zoom lever, etc.

  The data bus 35 is connected to each part constituting the compound eye camera 1 and the CPU 33, and exchanges various data and various information in the compound eye camera 1.

  Next, processing performed in the first embodiment will be described. 4 and 5 are flowcharts showing the processing performed in the first embodiment. Here, processing in the case where the through images of the first and second images G1 and G2 are three-dimensionally displayed by the first method will be described. When the compound eye camera 1 is switched to the photographing mode or the power is turned on in the state of the photographing mode, the CPU 33 starts processing, and determines whether or not the display mode of the monitor 20 is switched to the three-dimensional display ( Step ST1). If step ST1 is affirmed, the display control unit 28 calculates the amount of parallax between the first and second images G1 and G2 acquired by the photographing units 21A and 21B (step ST2).

  FIG. 6 is a diagram for explaining the calculation of the amount of parallax. As shown in FIG. 6, the display control unit 28 cuts out a region A1 in a predetermined range with reference to the center pixel O1 of the first image G1, and performs template matching with the second image G2 using the region A1 as a template. Then, a region A2 corresponding to the region A1 is extracted on the second image G2. Then, the absolute value Δx of the difference in the number of pixels in the horizontal direction between the center pixel O2 of the second image G2 and the center pixel O2 ′ of the area A2 is calculated as the amount of parallax.

  Then, the display control unit 28 determines whether or not the parallax amount Δx is greater than or equal to the threshold value Th1 (step ST3). Here, as the threshold value Th1, a value of about 3% of the number of pixels in the horizontal direction of the first and second images G1 and G2 can be used. If step ST3 is affirmed, the display control unit 28 creates an object with a background to be displayed on the first and second images G1 and G2 (step ST4). On the other hand, if step ST3 is negative, the display control unit 28 creates an object without a background to be displayed over the first and second images G1 and G2 (step ST5). Next, the three-dimensional processing unit 30 generates a three-dimensional display image by performing a three-dimensional process of arranging the first and second images G1 and G2 (step ST6), and the display control unit 28 performs three-dimensional display. The created objects are superimposed on the first and second images G1 and G2 included in the image for use to create a 3D display image in which the objects are overlaid (create 3D display image with object, step ST7). The three-dimensional display image on which the objects are superimposed is three-dimensionally displayed on the monitor 20 (step ST8).

  FIG. 7 is a diagram showing a three-dimensional display image on which objects with a background are overlaid. As shown in FIG. 7, the first and second images G1 and G2 included in the three-dimensional display image each have an icon indicating flash emission in the upper left corner, and the number of shots taken so far in the upper right corner. The F value and the shutter speed are displayed in the lower left corner, and the characters representing the shooting date are displayed in a white background with a white background and are superimposed on the three-dimensional display image.

  FIG. 8 is a diagram showing a three-dimensional display image on which objects without a background are superimposed. As shown in FIG. 8, the first and second images G1 and G2 included in the three-dimensional display image each have an icon indicating flash emission in the upper left corner, and the number of shots taken so far in the upper right corner. The F-number and shutter speed are superimposed on the lower left corner, and characters representing the shooting date are superimposed on the three-dimensional display image in the lower right corner.

  Note that each object is superimposed on the first and second images G1 and G2 with a parallax corresponding to the parallax amount Δx. Therefore, when a three-dimensional display image on which the objects are superimposed is displayed three-dimensionally, along with the image Objects can also be viewed stereoscopically. On the other hand, the object may be superimposed on the first and second images G1 and G2 so as not to have the parallax amount Δx. In this case, only the image is stereoscopically viewed and the object is not stereoscopically viewed.

  Further, when the first and second images G1 and G2 are three-dimensionally processed by the second method, the object is overlaid on the generated three-dimensional display image as in FIGS. In this case, since the object cannot have parallax, the object is not stereoscopically viewed even if the three-dimensional display image on which the objects are superimposed is three-dimensionally displayed.

  Next, the CPU 33 determines whether or not an instruction to display the menu screen has been issued from the input / output unit 34 (step ST9). If step ST9 is affirmed, the display control unit 28 switches the display mode to two-dimensional display ( In step ST10), a menu screen is displayed over the first image G1 (step ST11). If step ST9 is negative, the process returns.

  FIG. 9 is a diagram showing a state in which the menu screen is displayed. As shown in FIG. 9, the monitor 20 displays a first image G1 in a two-dimensional manner and a menu screen M1 superimposed on the first image G1.

  Following step ST11, the CPU 33 starts monitoring whether or not an instruction to end the menu screen display has been issued from the input / output unit 34 (step ST12). If step ST12 is affirmed, the display control unit 28 displays the display. The mode is switched to 3D display (step ST13), and the process returns.

  If step ST1 is negative, the display control unit 28 creates an object without a background to be displayed on the first image G1 (step ST14). Further, the display control unit 28 creates a two-dimensional display image in which the created object is superimposed on the first image G1 (two-dimensional display image with object creation, step ST15). Then, the display control unit 28 two-dimensionally displays the two-dimensional display image with an object on the monitor 20 (step ST16), and returns.

  When the release button is fully pressed, the CPU 33 acquires the main images of the first and second images G1 and G2, and the three-dimensional processing unit 30 performs the three-dimensional processing from the first and second images G1 and G2. A display image is generated, the compression / expansion processing unit 24 generates a three-dimensional image file including the first and second images G1 and G2 and the image data of the three-dimensional display image, and the media control unit 26 performs three-dimensional display. Processing for recording the image file on the recording medium 29 is performed.

  As described above, in the first embodiment, when an object is superimposed on a three-dimensionally displayed image and the parallax amount Δx between the plurality of images is equal to or greater than the threshold Th1, a background is displayed on the object. Since the three-dimensional display is given to the object, the object can be easily seen even when the parallax amount Δx is large and the stereoscopic effect of the image displayed three-dimensionally is large, and the object is difficult to see and is displayed three-dimensionally. It is possible to prevent the stereoscopic view of the image from being hindered.

  Also, only when the display mode is switched to 3D display, unnecessary processing is performed when performing 2D display by calculating and determining the amount of parallax, and adding a background to the object. Can be prevented.

  When displaying the menu screen, the menu screen can be easily viewed by switching the display mode to the two-dimensional display.

  Next, a second embodiment of the present invention will be described. In the first embodiment, whether to add a background to the object is determined according to the parallax amount Δx calculated based on the region with the center of the first image G1 as a reference. In the embodiment, the first image G1 is divided into a plurality of regions, the amount of parallax is calculated for each divided region, and it is determined whether or not to add a background to the object to be displayed for each region. Is. Note that the configuration of the compound eye camera according to the second embodiment is the same as that of the compound eye camera according to the first embodiment, and thus detailed description thereof is omitted here.

  Next, processing performed in the second embodiment will be described. FIG. 10 is a flowchart showing processing performed in the second embodiment. Here, processing in the case where the through images of the first and second images G1 and G2 are three-dimensionally displayed by the first method will be described. In addition, it is assumed that the display mode is switched to three-dimensional display. First, the display control unit 28 calculates the amount of parallax for each region of the first and second images G1 and G2 acquired by the imaging units 21A and 21B (step ST21).

  FIG. 11 is a diagram for explaining the calculation of the amount of parallax for each region. As shown in FIG. 11, in the present embodiment, the first image G1 is divided into four regions B1 to B4, and each region is used as a template in the same manner as in the first embodiment. By performing the template matching, the parallax amounts Δx1 to Δx4 for all the regions B1 to B4 are calculated.

  Then, the display control unit 28 sets the determination target region as the first region (i = 1, step ST22), and determines whether or not the parallax amount Δxi of the determination target region is equal to or greater than the threshold value Th1. (Step ST23). If step ST23 is positive, the display control unit 28 creates an object with a background to be displayed in the determination target area (step S24). On the other hand, if step ST24 is negative, the display control unit 28 creates an object without a background to be displayed in the determination target area (step ST25). Next, it is determined whether or not the determination for all areas has been completed (step ST26). If step ST26 is negative, the determination target area is changed to the next area (i = i + 1, step ST27), Returning to step ST23, the processes after step ST23 are repeated.

  When step ST26 is affirmed, the display control unit 28 superimposes the created objects on the first and second images G1 and G2 included in the three-dimensional display image created by the three-dimensional process, and the object is displayed. A superimposed 3D display image is created (creating a 3D display image with an object, step ST28). In the following, since the same processing as that after step ST8 in the first embodiment is performed, description thereof is omitted.

  FIG. 12 shows a three-dimensional display image on which objects are superimposed. Here, it is assumed that the parallax amounts Δx1 and Δx3 of the regions B1 and B3 are equal to or greater than the threshold value Th1. As shown in FIG. 12, white characters with a background are displayed in the areas B1 and B3, and characters without a background are displayed in the areas B2 and B4.

  As described above, in the second embodiment, the amount of parallax is calculated for each region where the object is displayed, it is determined whether the amount of parallax is equal to or greater than Th1 for each region, and when the determination is affirmed, Since the background is added to the object, it is possible to add the background only to the object displayed in the region where the amount of parallax is large. The displayed object can be made easy to see.

  Next, a third embodiment of the present invention will be described. The third embodiment is different from the first embodiment in that, when the display mode is switched to three-dimensional display without calculating the amount of parallax, the object is displayed with a background. . The configuration of the compound eye camera according to the third embodiment is the same as the configuration of the compound eye camera according to the first embodiment, and thus detailed description thereof is omitted here.

  Next, processing performed in the third embodiment will be described. FIG. 13 is a flowchart showing processing performed in the third embodiment. Here, processing in the case where the through images of the first and second images are three-dimensionally displayed by the first method will be described. When the compound eye camera 1 is switched to the photographing mode or the power is turned on in the state of the photographing mode, the CPU 33 starts processing, and determines whether or not the display mode of the monitor 20 is switched to the three-dimensional display ( Step ST31). If step ST31 is affirmed, the display control unit 28 creates an object with a background to be displayed on the first and second images G1 and G2 (step ST32). Next, the three-dimensional processing unit 30 generates a three-dimensional display image by performing a three-dimensional process of arranging the first and second images G1 and G2 (step ST33), and the display control unit 28 performs three-dimensional display. The created objects are superimposed on the first and second images G1 and G2 included in the image for use to create a 3D display image in which the objects are overlaid (create 3D display image with object, step ST34). The three-dimensional display image on which the objects are superimposed is three-dimensionally displayed on the monitor 20 (step ST35).

  Next, the CPU 33 determines whether or not an instruction to display the menu screen has been issued from the input / output unit 34 (step ST36). When step ST36 is affirmed, the display control unit 28 switches the display mode to two-dimensional display ( Step ST37), a menu screen is displayed over the first image G1 (step ST38). If step ST36 is negative, the process returns.

  On the other hand, following step ST38, the CPU 33 starts monitoring whether or not an instruction to end the menu screen display has been issued from the input / output unit 34 (step ST39). When step ST39 is affirmed, the display control unit 28 The display mode is switched to 3D display (step ST40), and the process returns.

  If step ST31 is negative, the display control unit 28 creates an object without a background for the first image G1 (step ST41). Further, the display control unit 28 creates a two-dimensional display image in which the objects are superimposed on the first image G1 (step ST42). Then, the display control unit 28 two-dimensionally displays the two-dimensional display image on the monitor 20 (step ST43) and returns.

  As described above, in the third embodiment, the background is added to the object only when the display mode is switched to the three-dimensional display, so that the object is easy to see when the three-dimensional display is performed. In addition, it is possible to prevent the stereoscopic view of an image displayed three-dimensionally from being obstructed by making the object difficult to see. In addition, when performing two-dimensional display, it is possible to prevent unnecessary processing from being performed.

  In the above embodiment, when the display instruction of the menu screen is given, the display mode is switched to the two-dimensional display. However, the menu screen may be displayed with the three-dimensional display. In this case, the photographer can stereoscopically view the menu screen by displaying the menu screen three-dimensionally.

  In the first embodiment, the parallax amount Δx of the region with the center pixel of the first image G1 as a reference is calculated. For example, the sum of the first image G1 obtained by the AF process is calculated. The amount of parallax between the focus area and the area in the second image corresponding to the focus area may be calculated. When the compound eye camera 1 is provided with a function for detecting a specific subject such as a face, the amount of parallax in the detected subject area may be calculated.

  In the above-described embodiment, the case where the through images of the first and second images G1 and G2 before the actual photographing are displayed three-dimensionally has been described. However, the first and the first images immediately after the main photographing are described. Parallax also when displaying the object when displaying the two images G1 and G2 three-dimensionally and when displaying the first and second images G1 and G2 recorded on the recording medium 29 three-dimensionally for confirmation. The presence or absence of background on the object may be determined according to the amount. Note that when the first and second images G1 and G2 are recorded on the recording medium 29, the parallax amounts of the first and second images G1 and G2 may be recorded. In this case, when displaying the first and second images G1 and G2 recorded on the recording medium 29, the background addition to the object is performed using the recorded amount of parallax without calculating the amount of parallax. The presence or absence may be determined.

  In the above embodiment, the two-eye camera 1 is provided with the two photographing units 21A and 21B and performs the three-dimensional display using the two images G1 and G2. However, the three-or-more photographing units are provided. The present invention can also be applied to the case where three-dimensional display is performed using these images.

  In the above embodiment, the three-dimensional display device according to the present invention is applied to the compound eye camera 1, but a three-dimensional display device including the display control unit 28, the three-dimensional processing unit 30, and the monitor 20 is provided alone. You may make it do. In this case, a plurality of images acquired by photographing the same subject at a plurality of different positions are input to the 3D display device, and the amount of parallax between the plurality of images is the same as in the first to third embodiments. Is used to determine whether or not to give a background to the displayed object.

  Although the embodiment of the present invention has been described above, the computer is caused to function as a unit corresponding to the display control unit 28 and the three-dimensional processing unit 30, and the processes as shown in FIGS. The program to be executed is also one embodiment of the present invention. A computer-readable recording medium in which such a program is recorded is also one embodiment of the present invention.

1 is a schematic block diagram showing an internal configuration of a compound eye camera to which a three-dimensional display device according to a first embodiment of the present invention is applied. Diagram showing the configuration of the shooting unit The figure which shows the state where the object is displayed on the image The flowchart which shows the process performed in 1st Embodiment (the 1) The flowchart which shows the process performed in 1st Embodiment (the 2) The figure for demonstrating calculation of the amount of parallax The figure which shows the image for 3D display on which the object with a background was piled up The figure which shows the image for three-dimensional display on which the object without a background was piled up The figure which shows the state where the menu screen is displayed The flowchart which shows the process performed in 2nd Embodiment (the 1) The figure for demonstrating calculation of the amount of parallax for every area | region The figure which shows the image for 3D display on which the object was piled up The flowchart which shows the process performed in 3rd Embodiment (the 1)

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Compound eye camera 21A, 21B Image pick-up part 22 Image pick-up control part 30 3D processing part

Claims (9)

Display means for three-dimensionally displaying a plurality of images acquired by shooting at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
Switching means for switching the display mode of the display means between three-dimensional display and two-dimensional display;
Whether or not the amount of parallax between the plurality of images is equal to or greater than a predetermined threshold only when the display mode is switched to the three-dimensional display when displaying an object overlaid on the three-dimensionally displayed image Display control means for providing a background to the object when the determination is affirmative, and displaying the object with the background superimposed on the three-dimensionally displayed image. A three-dimensional display device.   The display control means calculates a parallax amount for each region where the object is displayed on the three-dimensionally displayed image, and determines whether the parallax amount is equal to or greater than the predetermined threshold value for each region. The three-dimensional display device according to claim 1, wherein the three-dimensional display device is a unit that gives a background to the object only for a region in which the determination is affirmed. The display control means is means for displaying a menu screen on the display means,
Said switching means, when the menu screen is displayed, the three-dimensional display apparatus according to claim 1, wherein it is a means for switching the display mode to the two-dimensional display. Display means for three-dimensionally displaying a plurality of images acquired by shooting at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
Switching means for switching the display mode of the display means between three-dimensional display and two-dimensional display;
When displaying an object on the three-dimensionally displayed image, only when the display means is switched to the three-dimensional display, a background is added to the object, and the object with the background is displayed in the three-dimensional display. A three-dimensional display device comprising display control means for displaying the image superimposed on the image. The display control means is means for displaying a menu screen on the display means,
5. The three-dimensional display device according to claim 4 , wherein the switching means is means for switching the display means to the two-dimensional display when the menu screen is displayed. Display means for three-dimensionally displaying a plurality of images acquired by shooting at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images ;
A three-dimensional display method in a three-dimensional display device comprising switching means for switching a display mode of the display means to three-dimensional display and two-dimensional display ,
Whether or not the amount of parallax between the plurality of images is equal to or greater than a predetermined threshold only when the display mode is switched to the three-dimensional display when displaying an object overlaid on the three-dimensionally displayed image Determine
If the determination is affirmative, a background is given to the object,
A three-dimensional display method, wherein the object to which the background is added is displayed so as to overlap the three-dimensionally displayed image. Display means for three-dimensionally displaying a plurality of images acquired by shooting at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
A three-dimensional display method in a three-dimensional display device comprising switching means for switching a display mode of the display means to three-dimensional display and two-dimensional display,
When displaying an object overlaid on the three-dimensionally displayed image, a background is added to the object only when the display means is switched to the three-dimensional display,
A three-dimensional display method, wherein the object to which the background is added is displayed so as to overlap the three-dimensionally displayed image. Display means for three-dimensionally displaying a plurality of images acquired by shooting at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images ;
A program for causing a computer to execute a 3D display method in a 3D display device comprising switching means for switching the display mode of the display means to 3D display and 2D display ,
Whether or not the amount of parallax between the plurality of images is equal to or greater than a predetermined threshold only when the display mode is switched to the three-dimensional display when displaying an object overlaid on the three-dimensionally displayed image A procedure for determining
A procedure for providing a background to the object when the determination is positive;
A program for causing a computer to execute a procedure for displaying an object to which the background is added in an overlapping manner on the three-dimensionally displayed image. Display means for three-dimensionally displaying a plurality of images acquired by shooting at different positions;
3D processing means for performing 3D processing for 3D display on the plurality of images;
A program for causing a computer to execute a 3D display method in a 3D display device comprising switching means for switching the display mode of the display means to 3D display and 2D display,
A procedure for providing a background to the object only when the display means is switched to the three-dimensional display when displaying the object overlaid on the three-dimensionally displayed image;
A program for causing a computer to execute a procedure for displaying an object to which the background is added in an overlapping manner on the three-dimensionally displayed image.

Images