JP2009047912A - Stereoscopic imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To take a stereoscopic image with composition and facial expression that reflect an intention of a photographer, by using an image, which is taken by an imaging means compatible with a dominant eye of the photographer, as a representative image. <P>SOLUTION: An apparatus detects a face of the photographer who looks in a finder as a detected object, by using two or more object detection sensors, which are horizontally spaced apart at the rear of an apparatus body, and determines the dominant eye of the photographer who looks in the finder on the basis of each detection output of the two or more object detection sensors. Thereby, the dominant eye of the photographer can automatically be determined without troubling the photographer. Preferably, a rear camera may be arranged at the rear of a camera body, and the eye looking at a monitor, i.e. the dominant eye may be determined on the basis of the image taken by the rear camera. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a stereoscopic image capturing apparatus, and more particularly to a stereoscopic image capturing apparatus capable of displaying in consideration of the dominant eye.

  As a method of confirming the composition of a normal liquid crystal display or TV screen and the expression of a subject from a stereoscopic image composed of a plurality of (for example, two) planar images taken with a compound eye camera, (1) two images A method of displaying them side by side and (2) a method of selecting and displaying one of two planar images are conceivable.

  However, when displaying by the method (1), the display area is doubled, which is complicated. Further, when displaying by the method (2), the expression and composition can be easily confirmed, but there is a problem of which of the two plane images should be displayed.

  As a technique for selecting a desired image from a plurality of images, Patent Document 1 discloses a technique for selecting one desired image as a representative image from a plurality of images based on the evaluation value of the image. .

  When a human perceives a solid, the target is visually recognized with the dominant eye, and additional information for the solid is obtained with the other eyes. The following technique is disclosed as using dominant eye information when performing stereoscopic viewing.

  In Patent Document 2, in a display device that is worn on the head and views a stereoscopic image, when the power supply voltage is lower than a reference value, the dominant eye is set based on the dominant eye information set by the dominant eye setting means. A technique for driving only the display unit is disclosed.

  Patent Document 3 discloses a technique for displaying a cursor or the like corresponding to acquired dominant eye information when an image is operated using a stereoscopic image display device and a cursor.

Patent Document 4 discloses a technique for automatically determining the dominant eye and outputting an image of the dominant eye to an external monitor or the like in a display device that is worn on the head and views a stereoscopic image.
JP 2007-25876 A JP-A-8-179275 JP 2004-362218 A JP 2007-34628 A

  However, in the technique described in Patent Document 1, a representative image is selected based on an evaluation value (image quality, image capturing condition, etc.) of a captured image, and the characteristics of the photographer such as dominant eyes are reflected. The selected representative image cannot be selected.

  The techniques described in Patent Documents 2 to 4 are techniques for displaying a stereoscopic image using dominant eye information, and do not use dominant eye information at the time of photographing.

  The present invention has been made in view of such circumstances, and an image captured by an imaging unit corresponding to a photographer's dominant eye is used as a representative image, so that a three-dimensional structure and expression reflecting the photographer's intention can be obtained. It is an object of the present invention to provide a stereoscopic image photographing apparatus capable of photographing an image.

  The stereoscopic image capturing apparatus according to claim 1 is a stereoscopic image capturing apparatus including a plurality of imaging units that capture subject images viewed from a plurality of viewpoints as a stereoscopic image, and is spaced apart from the back of the apparatus main body in the left-right direction. Two or more object detection sensors arranged, the object detection sensor for detecting the photographer's face looking through the finder as a detection object, and the detection outputs of the two or more object detection sensors A dominant eye judging means for judging a dominant eye of a photographer looking through the viewfinder.

  According to the three-dimensional image photographing device of claim 1, the photographer's face looking through the finder is detected as an object to be detected by the two or more object detection sensors disposed on the back surface of the device body so as to be separated in the left-right direction. Detection is performed, and the dominant eye of the photographer looking through the viewfinder is determined based on the detection output of each of the two or more object detection sensors. Thereby, it is possible to automatically determine the dominant eye of the photographer without bothering the photographer.

  The stereoscopic image capturing apparatus according to claim 2 is the stereoscopic image capturing apparatus according to claim 1, wherein the object detection sensor emits light having high directivity and the presence or absence of light reflected by the detected object, or reflection. It is a photoelectric sensor that outputs a signal corresponding to the amount of light to be emitted.

  The stereoscopic image capturing apparatus according to a third aspect is the stereoscopic image capturing apparatus according to the first or second aspect, wherein the sensor is provided in the vicinity of a finder provided in a substantial center of the back surface of the apparatus main body. And a second sensor provided at an end of the back surface of the apparatus main body.

  According to the three-dimensional image capturing apparatus of the third aspect, the first sensor provided in the vicinity of the finder provided in the approximate center of the back surface of the apparatus main body, and the first sensor provided at the end of the back surface of the apparatus main body. Based on the detection output of each of the two sensors, the dominant eye of the photographer looking through the viewfinder is determined. As a result, the photographer looking through the viewfinder can be reliably detected.

  The stereoscopic image capturing apparatus according to claim 4 is the stereoscopic image capturing apparatus according to claim 3, wherein the second sensor includes a left sensor provided at a left end of a back surface of the apparatus main body, and the apparatus main body. A right sensor provided at the right end of the back surface, and the dominant eye determination means has a right eye when a photographer is detected by the first sensor and the left sensor. If the photographer is detected by the first sensor and the right sensor, it is determined that the dominant eye of the photographer is the left eye.

  According to the stereoscopic image capturing apparatus of claim 4, the sensors are a first sensor provided in the vicinity of the optical viewfinder at a substantially central portion, a left sensor provided at the left end, and a right side provided at the right end. It consists of a sensor. When the photographer is detected by the first sensor and the left sensor, it is determined that the dominant eye of the operator is the right eye, and when the photographer is detected by the first sensor and the right sensor, the operation is performed. The person's dominant eye is determined to be the left eye. Thereby, it is possible to automatically determine the dominant eye of the photographer without bothering the photographer.

  The stereoscopic image capturing apparatus according to claim 5 is the stereoscopic image capturing apparatus according to any of claims 1 to 4, further comprising a dominant eye setting unit that sets a dominant eye of a photographer, wherein the dominant eye determining unit is When the photographer is not detected by one sensor, the dominant eye set by the dominant eye setting means is determined as the dominant eye.

  According to the stereoscopic image capturing device of claim 5, when the photographer is not detected by the first sensor, the dominant eye set by the dominant eye setting means for setting the dominant eye of the photographer is captured. It is judged that it is the dominant eye of the person. Thereby, even when the dominant eye cannot be automatically determined, the dominant eye can be taken into consideration.

  The stereoscopic image capturing apparatus according to claim 6 is the stereoscopic image capturing apparatus according to any one of claims 1 to 5, wherein the finder includes a right objective lens for a right eye provided on a front surface of the apparatus main body, and an apparatus. The left objective lens for the left eye provided on the front surface of the main body, one eyepiece for viewing the subject image through either the right objective lens or the left objective lens, and the dominant eye in the dominant eye determination means Switching means for switching whether to guide the light incident from the right objective lens to the eyepiece unit or to guide the light incident from the left objective lens to the eyepiece unit based on the determination result of the eyes; It is characterized by having.

  According to the stereoscopic image capturing apparatus of the sixth aspect, the optical path from the right objective lens for the right eye provided on the front surface of the apparatus main body to the eyepiece provided on the back surface of the apparatus main body, and the front surface of the apparatus main body. There are two optical paths from the left objective lens for the left eye to the eyepiece. These optical paths are switched based on the determination result of the photographer's dominant eye. Thereby, since it is possible to perform a photographing operation in consideration of the dominant eye, a stereoscopic image as intended by the photographer can be photographed.

  The stereoscopic image capturing apparatus according to claim 7 is a stereoscopic image capturing apparatus including a plurality of imaging units that capture subject images viewed from a plurality of viewpoints as a stereoscopic image, and a rear camera provided on a back surface of the apparatus main body. A face position detecting means for detecting a photographer's face position based on an image photographed by the rear camera, and a dominant hand of the operator is determined based on the face position detected by the face position detecting means. And a dominant eye judging means.

  According to the stereoscopic image capturing device of the seventh aspect, the photographer's face position is detected from the image photographed by the rear camera provided on the back surface of the apparatus body, and the operator's face position is detected based on the detected face position. Judge the dominant eye. Thereby, it is possible to automatically determine the dominant eye of the photographer without bothering the photographer.

  The stereoscopic image capturing apparatus according to claim 8 is the stereoscopic image capturing apparatus according to claim 7, wherein the rear camera is provided on a substantially central axis of display means provided on a back surface of the apparatus main body. Features.

  According to the stereoscopic image capturing apparatus of the eighth aspect, the rear camera is provided on the substantially central axis of the display means provided on the rear surface of the apparatus main body. Thus, by comparing the center of the captured image with the face position, the position where the photographer is looking at the display means can be known.

  The stereoscopic image capturing device according to claim 9 is the stereoscopic image capturing device according to claim 7 or 8, further comprising face detection means for detecting a photographer's face from an image captured by the rear camera, The position detection means determines the position of the photographer's face by comparing the center of the photographer's face detected by the face detection means with the center of the image photographed by the rear camera. And

  According to the stereoscopic image capturing apparatus of the ninth aspect, the dominant eye of the operator is determined by comparing the center of the detected face position with the center of the image captured by the rear camera. That is, if the detected face position is to the right of the center of the image, it can be determined that the photographer's dominant eye is the right eye, and if the detected face position is to the left of the image center, the photographer's dominant eye Can be determined to be the left eye. Thereby, the dominant eye of the photographer can be accurately determined.

  The stereoscopic image photographing device according to claim 10 is the stereoscopic image photographing device according to any one of claims 7 to 9, further comprising a dominant eye setting means for setting a dominant eye of the photographer, wherein the dominant eye determining means is If the position of the photographer's face cannot be determined by the face position detection means, the dominant eye set by the dominant eye setting means is determined as the dominant eye.

  According to the stereoscopic image capturing device of the tenth aspect, when the dominant eye cannot be determined based on the detected face position, the dominant eye set by the dominant eye setting unit that sets the dominant eye of the photographer. Judged as the photographer's dominant eye. Thereby, even when the dominant eye cannot be automatically determined, the dominant eye can be taken into consideration.

  The stereoscopic image capturing device according to claim 11 is the stereoscopic image capturing device according to any one of claims 1 to 10, further comprising a release button for performing a release operation, wherein the dominant eye determining unit is a half of the release button. It is characterized in that the dominant eye is determined when pressed.

  According to the three-dimensional image capturing apparatus of the eleventh aspect, the dominant eye is determined when the release button is half-pressed. Thereby, since the dominant eye is determined before the shooting operation, the shooting operation considering the dominant eye can be performed quickly.

  A stereoscopic image capturing apparatus according to a twelfth aspect is the stereoscopic image capturing apparatus according to any one of the first to eleventh aspects, wherein a display unit that displays a subject image and a dominant eye determined by the dominant eye determination unit. Based on the information, representative image selecting means for selecting a desired one subject image as a representative image from a plurality of subject images constituting the stereoscopic image, and the representative image selected by the representative image selecting means is displayed. Display control means for displaying on the means.

  According to the stereoscopic image capturing apparatus of the twelfth aspect, a desired one subject image is selected as a representative image from the stereoscopic image based on the dominant eye information, and the selected representative image is displayed on the display unit. As a result, it is possible to view the flat image closest to the stereoscopic image intended by the photographer. Further, at the time of shooting, a planar image closest to the stereoscopic image intended by the photographer can be displayed as a moving image or a live view image (through image).

  The stereoscopic image capturing apparatus according to a thirteenth aspect is the stereoscopic image capturing apparatus according to any one of the first to twelfth aspects, wherein the stereoscopic image captured by the plurality of imaging units and the dominant eye determining unit are determined. It is characterized by comprising a recording means for recording information on a recording medium in association with information on the dominant eye.

  According to the three-dimensional image photographing apparatus of the thirteenth aspect, the photographed three-dimensional image and the photographer's dominant eye information are associated and recorded on the recording medium. Accordingly, information about the dominant eye of the photographer can be used when viewing the captured stereoscopic image.

  A stereoscopic image capturing apparatus according to a fourteenth aspect is the stereoscopic image capturing apparatus according to the thirteenth aspect, wherein the representative image selecting unit is based on information on a dominant eye recorded on a recording medium in association with the stereoscopic image. A desired subject image is selected as a representative image from a plurality of subject images constituting the recorded stereoscopic image.

  According to the three-dimensional image capturing device of claim 14, based on the dominant eye information recorded on the recording medium in association with the three-dimensional image, a desired image is selected from a plurality of subject images constituting the recorded three-dimensional image. One subject image, that is, an image taken using the dominant eye is selected as the representative image. Thereby, even when viewing the recorded image, it is possible to reproduce the image in consideration of the dominant eye. In this case, the present invention can be implemented as a program that takes in a stereoscopic image in which dominant eye information is recorded and reproduces the image.

  According to the present invention, it is possible to capture a stereoscopic image with a composition and facial expression reflecting the photographer's intention by using the image captured by the imaging unit corresponding to the photographer's dominant eye as the representative image.

  The best mode for carrying out a stereoscopic image photographing apparatus according to the present invention will be described below in detail with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 is a front perspective view of a compound-eye digital camera 1 according to a first embodiment of a stereoscopic image photographing apparatus that automatically determines a photographer's dominant eye, and FIG. 2 is a rear perspective view of the compound-eye digital camera 1. It is.

  The compound-eye digital camera 1 is a compound-eye digital camera 1 having a plurality of imaging systems (two are illustrated in FIG. 1), and a stereoscopic image of the same subject viewed from a plurality of viewpoints (two viewpoints on the left and right are illustrated in FIG. 1). Can be taken.

  The camera body 12 of the compound-eye digital camera 1 is formed in a substantially rectangular parallelepiped box shape. As shown in FIG. 1, the camera body 12 mainly includes a right camera 10a, a left camera 10b, a right objective lens 61a, and a left objective. A lens 61b and the like are provided.

  A battery cover (not shown) is provided on the side surface of the camera body 12. Inside the battery cover, there are provided a battery storage chamber for storing the battery, a memory card slot for mounting the recording medium 144, and the like.

  As shown in FIG. 2, a mode dial 24, a release switch 26, a power button 28, and the like are provided on the upper surface of the camera body 12.

  On the back of the camera body 12, as shown in FIG. 2, the monitor 30, zoom button 38, macro button 40, BACK button 42, MENU / OK button 44, DISP button 46, cross button 48, slide switch 50, left sensor 51, a right side sensor 52, a finder sensor 53, an eyepiece lens 64, and the like.

  A tripod screw hole or the like (not shown) is provided on the bottom surface of the camera body 12.

  The right camera 10a for capturing an image for the right eye and the left camera 10b for capturing an image for the left eye are arranged side by side so that their lens optical axes are parallel or at a predetermined angle. When the power of the compound-eye digital camera 1 is turned on, subject light is incident on the right camera 10a and the left camera 10b by opening covers (not shown) respectively provided on the front surfaces of the right camera 10a and the left camera 10b.

  The monitor 30 is a liquid crystal display having a general aspect ratio of 4: 3 and capable of color display. The monitor 30 is used as an image display panel for displaying a photographed image in the reproduction mode, and is used as a photographer interface display panel when performing various setting operations. In the photographing mode, a through image is displayed as necessary, and is used as an electronic viewfinder for checking the angle of view.

  The mode dial 24 functions as switching means for switching between the reproduction mode and the photographing mode of the compound-eye digital camera 1, and is provided rotatably between the “reproduction position” and the “photographing position”. The compound-eye digital camera 1 is set to the playback mode when the mode dial 24 is positioned at the “playback position”, and is set to the shooting mode when it is positioned at the “shooting position”. The mode dial 24 is used to switch various modes (shooting mode, playback mode, erase mode, edit mode, etc.) and set shooting modes such as auto shooting and manual shooting. The mode dial 24 is rotatably provided below the release switch 26 on the upper surface of the camera body 12, and “2D still image position”, “2D moving image position”, “3D still image position” are not shown by a click mechanism (not shown). ”And“ 3D moving image position ”.

  The release switch 26 is constituted by a two-stage stroke type switch composed of so-called “half press” and “full press”. When the compound-eye digital camera 1 is taking a still image (for example, when the still image shooting mode is selected with the mode dial 24 or when the still image shooting mode is selected from the menu), the release switch 26 is pressed halfway to take a shooting preparation process, that is, AE. Each process (Automatic Exposure), AF (Auto Focus), and AWB (Automatic White Balance) is performed, and when fully pressed, an image is captured and recorded. Also, during movie shooting (for example, when the movie shooting mode is selected with the mode dial 24 or when the movie shooting mode is selected from the menu), when the release switch 26 is fully pressed, shooting of the movie is started, and when the shutter button is fully pressed again, shooting is performed. Exit. Depending on the setting, it is also possible to shoot a moving image while the release switch 26 is fully pressed, and to stop shooting when the full press is released. A shutter button dedicated to still image shooting and a shutter button dedicated to moving image shooting may be provided.

  The power button 28 functions as a power switch of the compound-eye digital camera 1, and when the power button 28 is pressed, the power is turned on / off.

  The zoom button 38 is used for a zoom operation of the right camera 10a and the left camera 10b, and includes a zoom tele button 34 for instructing zooming to the telephoto side and a zoom wide button 36 for instructing zooming to the wide angle side. Yes.

  The MENU / OK button 44 is used for calling up a menu screen (MENU function), as well as for confirming selection contents, executing instructions for processing (OK function), and assigned according to the setting state of the compound-eye digital camera 1. The function is switched. On the menu screen, for example, all adjustment items that the compound-eye digital camera 1 has such as image quality adjustment such as exposure value, hue, ISO sensitivity, number of recorded pixels, self-timer setting, photometry switching, and whether or not to use digital zoom Is set. The compound-eye digital camera 1 operates according to the conditions set on this menu screen.

  The DISP button 46 is used to input an instruction to switch the display contents of the monitor 30 and the BACK button 77 is used to input an instruction to cancel the input operation.

  The cross button 48 is a button for setting, selecting, or zooming various menus, and is provided so that it can be pressed in four directions, up, down, left, and right. The buttons in each direction correspond to the setting state of the camera. A function is assigned. For example, at the time of shooting, a function for switching on / off of the macro function is assigned to the left button, and a function for switching the strobe mode is assigned to the right button. In addition, a function for changing the brightness of the monitor 30 is assigned to the upper button, and a function for switching ON / OFF of the self-timer is assigned to the lower button. During playback, a frame advance function is assigned to the right button, and a frame return function is assigned to the left button. Also, a function for changing the brightness of the monitor 30 is assigned to the upper button, and a function for deleting the image being reproduced is assigned to the lower button. Further, at the time of various settings, a function for moving the cursor displayed on the monitor 30 in the direction of each button is assigned.

  The slide switch 50 is a switch for inputting information about the dominant eye of the operator. When the slide switch 50 is moved to the right, the dominant eye is set to the right eye, and when the slide switch 50 is moved to the left, the dominant eye is set to the left eye.

  The left sensor 51, the right sensor 52, and the finder sensor 53 emit light with high directivity from the light emitting element, the light is reflected by the detection object, and the presence or absence of the reflected light and the amount of the reflected light are received by the light receiving element. Is a reflective photoelectric sensor that detects a detection object by outputting a signal corresponding to the presence or absence of light and the amount of light. The left sensor 51 and the right sensor 52 are provided at both ends of the camera body 12. The left sensor 51 detects that the photographer's face is in front of the left sensor 51. Detect that the photographer's face is in front. The finder sensor 53 is provided in the vicinity of an eyepiece lens 64 to be described later, and detects that the photographer's face is present in front of the finder sensor 53, that is, that the photographer is looking into the eyepiece lens 64. That is, when it is detected by the left sensor 51 and the finder sensor 53 that the photographer has a face, it indicates that the photographer is looking into the eyepiece 64 with the right eye, and the right sensor 52 and the finder sensor 53 photograph the image. When it is detected that the person's face is present, this indicates that the photographer is looking into the eyepiece lens 64 with the right eye. The left sensor 51, the right sensor 52, and the finder sensor 53 are not limited to the reflective photoelectric sensors, and various types of photoelectric sensors can be used as long as the change in the amount of light can be detected by an object. In addition to the photoelectric sensor, various types of proximity sensors such as a sensor using ultrasonic waves can be used.

  Next, the optical viewfinder of the compound-eye digital camera 1 will be described. As shown in FIG. 3, the optical viewfinder includes a right objective lens 61a, a right prism 62a, a left objective lens 61b, a left prism 62b, a central prism 63, and an eyepiece lens 64. The left objective lens 61b and the left prism 62b are provided symmetrically about the optical axis A of the eyepiece lens 64 with respect to the right objective lens 61a and the right prism 62a. The left objective lens 61b and the left prism 62b have the same configuration as the right objective lens 61a and the right prism 62a, and thus description thereof is omitted.

  The right prism 62a is an optical element having a substantially triangular prism shape, and is provided on the back surface of the right objective lens 61a. The right prism 62a refracts the optical axis La of the right objective lens 61a at a substantially right angle and guides it to the optical axis L of the eyepiece lens 64.

  The eyepiece lens 64 is provided in the approximate center of the camera body 12, and a central prism 63 is provided on the front surface of the eyepiece lens 64.

  As shown in FIG. 4, the central prism 63 is a substantially triangular prism-shaped optical element, and is provided so as to be rotatable clockwise and counterclockwise about the optical axis L. By rotating the central prism 63, it is possible to switch between guiding the light guided by the right objective lens 61a to the eyepiece lens 64 and guiding the light guided by the left objective lens 61b to the eyepiece lens 64. .

  FIG. 4 illustrates a case where the central prism 63 is inclined from the upper left when viewed from the left. When the central prism 63 is rotated 90 ° counterclockwise from the state shown in FIG. 4, the state shown in FIG. 3 is obtained. This is a state in which the right objective lens 61a is selected, and the central prism 63 refracts the optical axis La of the right objective lens 61a refracted by the right prism 62a to the optical axis L. Thereby, when the photographer looks into the eyepiece lens 64, the light guided by the right objective lens 61a can be seen.

  Further, by rotating the central prism 63 from the state of FIG. 3 by 180 °, the right objective lens 61a is switched to the left objective lens 61b. When the left objective lens 61b is selected, the central prism 63 refracts the optical axis Lb of the left objective lens 61b refracted by the left prism 62b toward the optical axis L. Thereby, when the photographer looks into the eyepiece lens 64, the light guided by the left objective lens 61b can be seen.

  FIG. 5 is a block diagram showing an electrical configuration of the compound-eye digital camera 1. The compound-eye digital camera 1 can shoot single-viewpoint images (two-dimensional images) and multi-viewpoint images (three-dimensional images, stereoscopic images), and can record and reproduce moving images, still images, and audio. In addition, for both moving images and still images, not only single-view images but also multi-view images can be taken.

  The operations of the right camera 10a and the left camera 10b are controlled by the CPU 110. The right camera 10a and the left camera 10b basically operate in conjunction with each other, but can be individually operated.

  The right camera 10a mainly includes a first diaphragm 12a, a first focus lens group 13a, and a first image sensor 14a. The left camera 10b has the same configuration as that of the right camera 10a, and mainly includes a second diaphragm 12b, a second focus lens group 13b, and a second image sensor 14b.

  The first diaphragm 12 a and the second diaphragm 12 b are connected to the motor driver 122. The motor driver 122 controls the operations of the first diaphragm 12a and the second diaphragm 12b in accordance with commands from the CPU 110.

  The first focus lens group 13a and the second focus lens group 13b are connected to a motor driver 124. The motor driver 124 controls the operations of the first focus lens group 13a and the second focus lens group 13b, respectively, according to instructions from the CPU 110.

  The first image sensor 14a and the second image sensor 14b are CCD-type or CMOS-type image sensors, and are connected by the second diaphragm 12b and the second focus lens group 13b, such as the first diaphragm 12a and the first focus lens group 13a. The imaged subject light is received, and photoelectric charges corresponding to the amount of received light are accumulated in the light receiving element. A timing generator (TG) 130 is connected to the first image sensor 14a and the second image sensor 14b. The operation of the TG 130 is controlled by the CPU 110. Imaging signals output from the first image sensor 14a and the second image sensor 14b of the right camera 10a and the left camera 10b are input to A / D converters 134a and 134b, respectively. The photocharge accumulation / transfer operation of the first image sensor 14a is controlled by the TG 130, and the electronic shutter speed (photocharge accumulation time) is determined by a timing signal (clock pulse) input from the TG 130. The first image sensor 14a acquires an image signal for one screen every predetermined period in the photographing mode. When the half-pressed state of the release switch 26 is detected, the CPU 110 obtains distance measurement data from the first image sensor 14a. The CPU 110 adjusts the focus, aperture, and the like based on the obtained distance measurement data. Further, the CPU 110 adjusts the convergence angles of the right camera 10a and the left camera 10b through driving means (not shown) based on the obtained distance measurement data.

  The system bus includes CPU 110, SDRAM 114, VRAM 116, image input controller 136, image signal processing circuit 138, compression / decompression processing circuit 140, image file generation unit 142, media controller 146, video encoder 148, AE / AWB detection circuit 152, AF A detection circuit 154 and the like are connected.

  The CPU 110 functions as a control unit that performs overall control of the overall operation of the compound-eye digital camera 1 and also functions as a calculation unit that performs various calculation processes. The operation unit (mode dial 24, release switch 26, power button 28, zoom Each part of the compound-eye digital camera 1 is controlled according to a predetermined control program based on input from the button 38, the macro button 40, the BACK button 42, the MENU / OK button 44, the DISP button 46, the cross button 48, the slide switch 50, and the like.

  The SDRAM 114 stores firmware, which is a control program executed by the CPU 110, various data necessary for control, camera setting values, captured image data, and the like. As will be described later, the captured image data is normally recorded on the memory card. However, when the photographer selects it, the memory card is not loaded, or the memory card has insufficient capacity. Recorded in the SDRAM 114.

  The VRAM 116 is used as a work area for the CPU 110 and also used as a temporary storage area for image data.

  The analog signal processing units 132a and 132b respectively perform correlated double sampling processing on the image signals output from the first image sensor 14a and the second image sensor 14b (noise (particularly thermal noise) included in the output signal of the imaging device). In order to alleviate the above, etc., a process of obtaining accurate pixel data by taking the difference between the feedthrough component level and the pixel signal component level included in the output signal for each pixel of the image sensor is performed and amplified. Output.

  The A / D converters 134a and 134b convert input image data from analog to digital. Through the A / D converters 134a and 134b, the imaging signal of the first image sensor 14a is output as right-eye image data, and the imaging signal of the second image sensor 14b is output as left-eye image data.

  The image input controller 136 has a built-in line buffer of a predetermined capacity, accumulates an image signal for one image output from the A / D converter 134 in accordance with a command from the CPU 110, and records it in the VRAM 116.

  The image signal processing circuit 138 includes a synchronization circuit (a processing circuit that converts a color signal into a simultaneous expression by interpolating a spatial shift of the color signal associated with the color filter array of a single CCD), a white balance correction circuit, and a gamma correction. Including a circuit, a contour correction circuit, a luminance / color difference signal generation circuit, and the like, and according to a command from the CPU 110, required signal processing is performed on the right-eye image data and the left-eye image data input from the A / D converters 134a and 134b. The image data (YUV data) composed of the luminance data (Y data) and the color difference data (Cr, Cb data) is generated and output to the video encoder 148 for display. When used as an electronic viewfinder in the shooting mode, the generated image data is displayed as a live view image on the monitor 30 via the video encoder 148. Further, the image signal processing circuit 138 converts the YC signal of the right eye image data captured by the right camera 10a and the left eye image data captured by the left camera 10b into a predetermined format video signal (for example, NTSC format). Color composite video signal) and then synthesized with stereoscopic image data for stereoscopic display in an external stereoscopic image display device or the like.

  The compression / decompression processing circuit 140 performs compression processing in a predetermined format on the input image data in accordance with a command from the CPU 110 to generate compressed image data. Also, the compression / decompression processing circuit 140 applies JPEG for still images, MPEG2, MPEG4, H.264 for moving images to the image data for the right eye and the image data for the left eye stored in the VRAM 116. Compression processing is performed according to a predetermined compression format such as H.264. The compression / decompression processing circuit 140 stores the two-dimensional image data of the still image on the recording medium 144 as an image file of a predetermined format such as an Exif file (the image file will be described in detail later). The Exif file has an area for storing main image data and an area for storing reduced image (thumbnail image) data. A thumbnail image having a specified size (for example, 160 × 120 or 80 × 60 pixels) is generated from the main image data obtained by shooting through pixel thinning processing and other necessary data processing. The thumbnail image generated in this way is written in the Exif file together with the main image. Also, tag information such as shooting date / time, shooting conditions, and face detection information is attached to the Exif file.

  The image file generation unit 142 generates an image file of JPEG format image data generated by the compression / decompression processing circuit 140. Details of the image file will be described later.

  The recording medium 144 is an xD picture card (registered trademark) detachably attached to the compound-eye digital camera 1, a semiconductor memory card represented by smart media (registered trademark), a portable small hard disk, a magnetic disk, an optical disk, a magneto-optical disk, etc. Various recording media.

  The media controller 146 records each image data compressed by the compression / decompression processing circuit 140 on a recording medium 144 or other recording media connected via the media controller 146.

  The video encoder 148 outputs the RGB signal output from the image signal processing circuit 138 to the monitor 30.

  When the release switch 26 is half-pressed in the shooting standby state, the AE / AWB detection circuit 152 calculates a physical quantity necessary for AE control and AWB control from the input image signal in accordance with a command from the CPU 110. For example, as a physical quantity required for AE control, one screen is divided into a plurality of areas (for example, 16 × 16), and an integrated value of R, G, and B image signals is calculated for each divided area. The CPU 110 detects the brightness of the subject (subject brightness) based on the integrated value obtained from the AE / AWB detection circuit 152, and calculates an exposure value (shooting EV value) suitable for shooting. Then, an aperture value and a shutter speed are determined from the calculated photographing EV value and a predetermined program diagram. Further, as a physical quantity necessary for AWB control, one screen is divided into a plurality of areas (for example, 16 × 16), and an average integrated value for each color of R, G, and B image signals is calculated for each divided area. . The CPU 110 obtains the ratio of R / G and B / G for each divided area from the obtained R accumulated value, B accumulated value, and G accumulated value, and R of the obtained R / G and B / G values. The light source type is discriminated based on the distribution in the color space of / G and B / G. Then, according to the white balance adjustment value suitable for the determined light source type, for example, the value of each ratio is approximately 1 (that is, the RGB integration ratio is R: G: B≈1: 1: 1 in one screen). Then, a gain value (white balance correction value) for the R, G, and B signals of the white balance adjustment circuit is determined.

  When the release switch 26 is half-pressed in the shooting standby state, the AF detection circuit 154 calculates a physical quantity necessary for AF control from the input image signal in accordance with a command from the CPU 110. In the compound-eye digital camera 1 of the present embodiment, AF control is performed based on the contrast of the image obtained from the image sensor 128 (so-called contrast AF), and the AF detection circuit 154 indicates the sharpness of the image from the input image signal. A focus evaluation value is calculated. The CPU 110 detects a position where the focus evaluation value calculated by the AF detection circuit 154 is maximized, and moves the focus lens group to that position. That is, the focus lens group is moved from the closest distance to infinity in a predetermined step, the focus evaluation value is obtained at each position, and the position where the obtained focus evaluation value is the maximum is set as the in-focus position, and the focus lens group is at that position. Move.

  Further, the compound-eye digital camera 1 is provided with a power supply battery in a detachable manner. The power battery is composed of a rechargeable secondary battery such as a nickel cadmium battery, a nickel metal hydride battery, or a lithium ion battery. The power battery may be a single use primary battery such as a lithium battery or an alkaline battery. The power supply battery is electrically connected to each means of the compound-eye digital camera 1 by being loaded into a battery storage chamber (not shown).

  1 shows an example having two imaging systems (the right camera 10a and the left camera 10b), but there may be three or more imaging systems. Moreover, the arrangement of the imaging system may not be one horizontal row but may be two-dimensionally arranged. In addition, the compound-eye digital camera 1 of FIG. 1 can perform not only stereoscopic shooting but also shooting from multiple viewpoints and all directions.

  Each operation of photographing, recording, reproduction, and editing of the compound-eye digital camera 1 configured as described above will be described. The following processing is mainly performed by the CPU 110.

[Shooting and recording operations]
FIG. 6 is a flowchart showing a flow of a series of photographing processes for photographing two subject images as a stereoscopic image. When it is detected that the power button 28 of the compound-eye digital camera 1 has been turned on, the power in the camera is turned on, and the dominant eye information is set to the right eye, which is the initial value, and a shooting standby state is set in the shooting mode (step S10). ). The initial value of the dominant eye information is set to the right eye based on statistical information that there are many photographers (about 70%) whose right eye is the dominant eye. On the monitor 30, a live view image taken by the right camera 10a is displayed.

  It is determined whether or not the release switch 26 is half-pressed (step S12). If the release switch has not been pressed halfway (NO in step S12), it is determined whether an operation mode other than the photographing mode is selected as the operation mode of the compound-eye digital camera 1 (step S14). If an operation mode other than the shooting mode is selected as the operation mode of the compound-eye digital camera 1 (YES in step S14), the processing is terminated, and an operation mode other than the shooting mode is selected as the operation mode of the compound-eye digital camera 1. If not (NO in step S14), it is determined whether the power button 26 of the compound-eye digital camera 1 has been turned off (step S16). If the power button 26 of the compound-eye digital camera 1 is turned off (YES in step S16), the process is terminated, and if the power button 26 of the compound-eye digital camera 1 is not turned off (NO in step S16). In step S12, it is determined whether the release switch 26 is half-pressed again.

  If the release switch 26 is pressed halfway (YES in step S12), it is determined whether or not the photographer's face is detected by the finder sensor 53 (step S18). If it is detected by the finder sensor 53 that there is a photographer's face (YES in step S18), this means that the photographer is taking a picture using the finder. Display. Thereby, the power consumption of the compound-eye digital camera 1 can be reduced. Then, it progresses to the step (steps S22-S32) which determines a dominant eye. In general, it is better to use it when looking through camera viewfinders, monocular telescopes and microscopes, gun sights, plate holes, etc. That is, there is a characteristic that when the photographer looks into the optical viewfinder, the photographer looks in with the dominant eye. Therefore, in the step of determining the dominant eye (steps S22 to S32), the left sensor 51, the right sensor 52, and the finder sensor 53 are used to determine which eye is looking into the optical finder, and the dominant eye is determined. .

  First, it is determined whether or not the right sensor 52 and the finder sensor 53 detect the presence of the photographer's face (step S22). If it is detected by the right sensor 52 and the finder sensor 53 that there is a photographer's face (YES in step S22), as shown in FIG. 7, the photographer is looking into the eyepiece 64 with the left eye. Therefore, it is determined that the left eye is a dominant eye (step S24), and the central prism 63 is rotated so that the light guided by the left objective lens 61b is guided to the eyepiece lens 64, whereby the optical path of the optical viewfinder is changed to the left side. (Step S26).

  If the right sensor 52 and the finder sensor 53 do not detect that there is a photographer's face (NO in step S22), whether or not the left sensor 51 and the finder sensor 53 detect that there is a photographer's face. Is determined (step S28). When it is detected by the left sensor 51 and the finder sensor 53 that there is a photographer's face (YES in step S28), as shown in FIG. 8, the photographer is looking into the eyepiece 64 with the right eye. Therefore, it is determined that the right eye is a dominant eye (step S30), and the central prism 63 is rotated so that the light guided by the right objective lens 61a is guided to the eyepiece lens 64, so that the optical path of the optical finder is on the right side. (Step S32). As a result, it is possible to acquire information on the dominant eye by simply looking into the eyepiece lens 64 without having to be aware of the input of information on the dominant eye, and the subject light corresponding to the dominant eye can be obtained via the eyepiece lens 64. Can see.

  In the step of determining whether or not the photographer's face is detected by the finder sensor 53 (step S18), if the photographer's face is not detected by the finder sensor 53 (NO in step S18). In step S34, it is determined whether or not the operator's dominant eye information input by the slide switch 50 is the right eye. If the input dominant eye information is the right eye (YES in step S34), a live view image captured through the right camera 10a, which is the right eye imaging system, is displayed on the monitor 30 (step S36). . If the input information on the dominant eye is the left eye (NO in step S34), a live view image captured through the left camera 10b that is the imaging system for the left eye is displayed on the monitor 30 (step S38). .

  It is determined whether the release switch 26 has been fully pressed (step S40). If the release switch 26 has not been fully pressed (NO in step S40), a step (step S12) for determining again whether the release switch 26 has been pressed halfway is performed. If the release switch 26 is fully pressed (YES in step S40), an S2 ON signal is input to the CPU 110. In response to the S2ON signal, a stereoscopic image is captured (step S42) and the captured stereoscopic image is recorded as described below (step S44).

  First, the CPU 110 drives the first diaphragm 12a and the second diaphragm 12b via the motor driver 122 based on the aperture value determined based on the photometric value when the release switch 26 is half-pressed, and based on the photometric value. The charge accumulation time (so-called electronic shutter) in the first image sensor 14a and the second image sensor 14b is controlled so that the determined shutter speed is obtained.

  Further, the CPU 110 calculates an AF evaluation value and an AE evaluation value from each of the right eye image data and the left eye image data stored in the VRAM 116. The AF evaluation value is calculated by integrating high-frequency components of the luminance value for the entire area or predetermined area (for example, the central portion) of each image data, and represents the sharpness of the image. The high-frequency component of the luminance value is a sum of luminance differences (contrast) between adjacent pixels in a predetermined area. The AE evaluation value is calculated by integrating the luminance values over the entire area or a predetermined area (for example, the central portion) of each image data, and represents the brightness of the image. The AF evaluation value and the AE evaluation value are respectively used in an AF operation and an AE operation that are executed during an imaging preparation process described later.

  The CPU 110 controls the first focus lens 13a and the second focus lens 13b and moves them in predetermined directions while the CPU 110 calculates AF calculated from each of the right-eye image data and the left-eye image data obtained sequentially. An AF operation (contrast AF) is performed by obtaining the maximum evaluation value.

  The subject light enters the light receiving surface of the first image sensor 14a via the first zoom lens 11a, the first diaphragm 12a, and the first focus lens 13a. Further, the light enters the light receiving surface of the second image sensor 14b via the second zoom lens 11b, the second diaphragm 12b, and the second focus lens 13b.

  The light incident on the light receiving surfaces of the first image sensor 14a and the second image sensor 14b is converted into signal charges corresponding to the amount of incident light by the photodiodes arranged on the light receiving surfaces. The signal charges accumulated in each photodiode are read according to the timing signal applied from the TG 130, and are sequentially output from the first image sensor 14a and the second image sensor 14b as voltage signals (image signals), and the analog signal processing unit 132a. , 132b.

  The analog signal processing units 132a and 132b include a CDS circuit and an analog amplifier. The CDS circuit performs correlated double sampling processing on the CCD output signal based on the CDS pulse, and the analog amplifier is a gain for setting the photographing sensitivity applied from the CPU 110. To amplify the image signal output from the CDS circuit. In the A / D converters 134a and 134b, analog image signals are converted into digital image signals, respectively.

  The right-eye image data and the left-eye image data output from the A / D converters 134a and 134b are subjected to various image processing such as gradation conversion, white balance adjustment, and γ adjustment processing by the image signal processing circuit 138, respectively. The image data is once stored in the buffer memory 3 built in the image input controller 136.

  The R, G, and B image signals read from the buffer memory are converted into luminance signal Y and color difference signals Cr and Cb (YC signals) by the image signal processing circuit 138, and the Y signal is contour-enhanced by the contour adjusting means. It is processed. The YC signals processed by the image signal processing circuit 138 are each stored in a buffer memory. As a result, shooting is simultaneously performed by the two imaging systems of the right camera 10a and the left camera 10b, and two subject images, that is, stereoscopic images are captured.

  The YC signal stored in the buffer memory is compressed by the compression / decompression processing circuit 140 and recorded on the recording medium 144 via the media controller 146 as an image file of a predetermined format.

  Next, the image file will be described. FIG. 9 is a diagram schematically showing the data structure of an image file in which two images are connected to the same image file. As shown in FIG. 9, the image file includes a marker SOI (Start of Image) storage area indicating the head of the data of the right-eye image captured by the right camera 10a, a right-eye tag information storage area APP1, and a right-eye image file. Image data (JPEG data) storage area, marker EOI (End of Image) storage area indicating the end of right-eye image data, marker indicating the start of left-eye image data captured by the left camera 10b An SOI (Start of Image) storage area, a left eye tag information storage area APP1, a left eye image data (JPEG data) storage area, and a marker EOI (End of Image) indicating the end of the left eye image data Contains storage area.

  The right eye and left eye tag information storage area APP1 is compatible with the APP1 marker area, the length information area, the Exif identification information area, the Tiff header area, the IFD0 area, the Exif IFD area, and the DPS IFD area. It includes an IFD area, an IFD1 area (thumbnail IFD area), and a thumbnail image data area. The photographer's dominant eye information is recorded in at least one of the right-eye Exif IFD area, the right-eye compatible IFD area, the left-eye Exif IFD area, and the left-eye compatible IFD area.

In addition, as shown in FIG. 10, two images can be recorded in different image files. The right eye image file captured by the right camera 10a includes DSCF0001. An odd number such as JPG is given, and the image file of the image for the left eye photographed by the left camera 10b is DSCF0002. Even numbers such as JPG are attached and recorded in the same file in the recording medium 144. In this case, it is necessary to record information about the dominant eye of the photographer in each of the image file for the right eye and the image file for the left eye.
[Playback operation]
When the playback mode is selected as the mode of the compound-eye digital camera 1, the image of the last frame recorded on the recording medium 144 is selected, and the image file is read via the media controller 146 (step S50). Based on information on the dominant eye of the photographer recorded in the tag information storage area APP1 of the read image file, an image (image on the dominant eye side) captured and recorded by the imaging system corresponding to the dominant eye The compressed data is decompressed into an uncompressed YC signal via the compression / decompression processing circuit 140, held in a buffer memory or the like, and a subject image as shown in FIG. It is displayed (step S52).

  It is determined whether the reverse frame advance switch (left key of the cross key) has been pressed (step S54). If it is determined that the left key of the cross key has been pressed (YES in step S54), the frame is advanced in the reverse direction, and the image file having the next frame number next to the currently selected frame number is read from the recording medium 144. The dominant side image is reproduced on the monitor 30 in the same manner as described above (step S56). If it is determined that the left key of the cross key has not been pressed (NO in step S54), it is determined whether or not the forward frame advance switch (right key of the cross key) has been pressed (step S58). If it is determined that the right key of the cross key is pressed (YES in step S58), the frame is advanced in the forward direction, and the image file having the next frame number next to the currently selected frame number is read from the recording medium 144. The dominant side image is reproduced on the monitor 30 in the same manner as described above.

  It is determined whether an operation mode other than the playback mode has been selected as the operation mode of the compound-eye digital camera 1 (step S62). If a mode other than the playback mode is selected (YES in step S62), the playback mode is terminated. Examples of modes other than the playback mode include an erase mode and an edit mode. When the erasing mode is selected while the image is reproduced and displayed on the monitor 30, the image file of the image reproduced and displayed on the monitor 30 is erased from the recording medium 144. In addition, when the editing mode is selected while the image is reproduced and displayed on the monitor 30, the image displayed on the monitor 30 can be edited.

  If an operation mode other than the playback mode is not selected (NO in step S62), it is determined whether the power button 26 of the compound-eye digital camera 1 has been turned OFF (step S64). If the power button 26 of the compound-eye digital camera 1 is turned off (YES in step S64), the process is terminated, and if the power button 26 of the compound-eye digital camera 1 is not turned off (NO in step S64). In step S50, the last frame image recorded on the recording medium 144 is selected again.

  As described above, even when the monitor 30 can display only a two-dimensional image, by reproducing the image on the dominant eye side based on the dominant eye information, the closest to the stereoscopic image recognized by the photographer “ The “planar image of the photographer's dominant eye” can be reproduced on the monitor 30.

  In addition to the reproduction method shown in FIG. 12A (reproduction of a single image), the subject image on the dominant side may be displayed by the reproduction method (index display) as shown in FIG. it can. FIG. 12B shows an example of index display of four images. The dominant-side image of the currently selected frame number is displayed on the upper left, and the dominant-side image of the next smaller frame number is displayed on the upper right. The image on the dominant side with the third smallest frame number is displayed on the lower left, and the image on the dominant side with the fourth smallest frame number is displayed on the lower right.

[Display operation of selected image file]
A desired image recorded on the recording medium 144 is selected, and an image file of the selected image is read from the recording medium 144 (step S70). The image may be selected by opening a folder in which image files are recorded, or by selecting an index display. Information on the dominant eye of the photographer recorded in the tag information storage area APP1 of the read image file is referred to (step S72), and it is determined whether the information on the dominant eye of the photographer is the right eye ( Step S74).

  If the photographer's dominant eye information is the right eye (YES in step S74), the right-eye image captured by the right camera 10a is displayed on the monitor 30 via the video encoder 148 (step S76). If the dominant eye information is not the right eye (NO in step S74), the image for the left eye photographed by the left camera 10b is displayed on the monitor 30 via the video encoder 148 (step S78).

  In this way, by displaying the dominant eye side image based on the dominant eye information, the “planar image of the dominant eye side of the photographer” closest to the stereoscopic image recognized by the photographer is displayed on the monitor 30. can do.

  In this embodiment, the dominant eye information is acquired and the photographing operation is performed using the optical viewfinder. However, the present invention is not limited to the optical viewfinder but can be applied to an electronic viewfinder.

<Second Embodiment>
The first embodiment of the stereoscopic image capturing apparatus that automatically determines the dominant eye of the photographer uses an left eye sensor 51, a right sensor 52, and a viewfinder sensor 53 provided on the back surface of the camera body 12, and an eyepiece lens. The dominant eye is determined by detecting whether the user is peeping with the left eye or the right eye, but the method of determining the dominant eye is not limited to this.

  In the second embodiment of the stereoscopic image capturing apparatus that automatically determines the dominant eye of the photographer, the dominant eye of the photographer is determined using a camera provided on the back surface of the camera body 12. In addition, about the part same as 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  FIG. 14 is a front perspective view of a compound-eye digital camera 100 according to a second embodiment of a stereoscopic image photographing apparatus that automatically determines a photographer's dominant eye, and FIG. 15 is a rear perspective view of the compound-eye digital camera 100. It is. FIG. 16 is a block diagram showing an electrical configuration of the compound-eye digital camera 100. The compound-eye digital camera 100 is a compound-eye digital camera 100 having a plurality of imaging systems (two are illustrated in FIG. 14), and a stereoscopic image in which the same subject is viewed from a plurality of viewpoints (two viewpoints are illustrated in FIG. 14). Can be taken.

  The camera body 112 of the compound-eye digital camera 100 is formed in a substantially rectangular parallelepiped box shape. As shown in FIG. 14, a right camera 10a and a left camera 10b are mainly provided on the front surface.

  As shown in FIG. 15, a rear camera 10c, a monitor 30, a zoom button 38, a macro button 40, a BACK button 42, a MENU / OK button 44, a DISP button 46, and a cross button 48 are provided on the back of the camera body 112. It has been.

  The rear camera 10c is provided on a substantially central axis M of the monitor 30, and mainly includes a third diaphragm 12c, a third focus lens group 13c, and a third image sensor 14c. The third diaphragm 12 c is connected to the motor driver 122, and the third focus lens 13 c is connected to the motor driver 124. The subject light enters the light receiving surface of the third image sensor 14c via the third zoom lens 11c, the third diaphragm 12c, and the third focus lens 13c. The third image sensor 14c is composed of a color CCD provided with R, G, B color filters in a predetermined color filter array (for example, honeycomb array, Bayer array), and a light receiving surface of the third image sensor 14c. The light incident on the light is converted into signal charges of an amount corresponding to the amount of incident light by the photodiodes arranged on the light receiving surface. The signal charges accumulated in each photodiode are read according to the timing signal applied from the TG 130, sequentially output from the third image sensor 14c as a voltage signal (image signal), and input to the analog signal processing unit 132c.

  The analog signal processing unit 132c is for the purpose of reducing correlated double sampling processing (noise (particularly thermal noise) included in the output signal of the imaging device) for the image signal output from the third image sensor 14c. Then, a process of obtaining accurate pixel data by taking the difference between the feedthrough component level and the pixel signal component level included in the output signal for each pixel of the image pickup device) is amplified and output.

  The A / D converter 134c converts the input image data from analog to digital. The imaging signal of the third image sensor 14c is output as back image data through the A / D converter 134c.

  The system bus includes CPU 110, SDRAM 114, VRAM 116, image input controller 136, image signal processing circuit 138, compression / decompression processing circuit 140, image file generation unit 142, media controller 146, video encoder 148, AE / AWB detection circuit 152, AF A detection circuit 154, a face detection unit 160, a face position detection unit 162, and the like are connected.

  The face detection unit 160 extracts a face area in the image from the image data in accordance with a command from the CPU 110, and detects the position (for example, the center of gravity of the face area). In this face area extraction, for example, skin color data is extracted from an original image, and a cluster of photometric points determined to be in the skin color range is extracted as a face. In addition, as a method for extracting a face area from an image, a method for determining a face area by converting photometric data into hue and saturation, creating a two-dimensional histogram of the converted hue / saturation, and analyzing it. Or a method for extracting a face candidate region corresponding to the shape of a human face and determining the face region from the feature amount in the region, extracting a human face outline from an image, and determining a face region, There are known methods for extracting a human face by preparing a template having the shape of a human face, calculating the correlation between the template and an image, and using the correlation value as a face candidate region. Can be extracted.

  The face position detection unit 162 detects the position of the photographer's face center (for example, the center of gravity of the face area) in the image photographed by the rear camera 10c. For example, the position of the center of gravity of the face area detected by the face detection unit 160 is used as the center of the face, and it is detected whether the center of the face is on the right or left of the center of the image. Instead of using the center of gravity position of the face area detected by the face detection unit 160, the face position detection unit 162 may calculate the center of the face based on the face area detected by the face detection unit 160. Thereby, the positional relationship between the center of the face and the rear camera 10c is detected, and dominant eye information is acquired based on the detection result.

[Shooting and recording operations]
FIG. 17 is a flowchart showing a flow of a series of shooting processes for shooting two subject images as a stereoscopic image. When the power button 26 of the compound-eye digital camera 100 is turned on, the CPU 110 detects this, turns on the power in the camera, sets the dominant eye information to the right eye that is the initial value, and enters the shooting standby state in the shooting mode (step) S10). On the monitor 30, the subject light photographed by the right camera 10a is displayed as a live view image.

  It is determined whether or not the release switch 26 is half-pressed (step S12). If the release switch is not half-pressed (NO in step S12), it is determined whether or not an operation mode other than the photographing mode is selected as the operation mode of the compound-eye digital camera 100 (step S14). If an operation mode other than the shooting mode is selected as the operation mode of the compound-eye digital camera 100 (YES in step S14), the processing is terminated, and an operation mode other than the shooting mode is selected as the operation mode of the compound-eye digital camera 100. If not (NO in step S14), it is determined whether the power button 26 of the compound-eye digital camera 100 has been turned OFF (step S16). If the power button 26 of the compound-eye digital camera 100 is turned off (YES in step S16), the process is terminated, and if the power button 26 of the compound-eye digital camera 100 is not turned off (NO in step S16). In step S12, it is determined whether the release switch 26 is half-pressed again.

  If the release switch 26 is half-pressed (YES in step S12), the process proceeds to steps for determining the dominant eye (steps S80 to S90). In general, the eyes used for looking through the display screen, monocular telescope or microscope, gun sight, and the nodal hole of the lance are good-natured eyes. That is, when the photographer looks at the liquid crystal monitor, there is a characteristic that the photographer looks mainly at the dominant eye. Accordingly, in the step of determining the dominant eye (steps S80 to S90), it is determined which eye is mainly looking at the monitor 30 using the image taken by the rear camera 10c, and the dominant eye is determined. .

  The rear camera 10c is turned on and photographing is performed (step S80). In the face detection unit 160, face detection is performed from image data captured by the rear camera 10c (step S82), and it is determined whether or not a face is included in the image data (step S84). If the face is not included in the image data (NO in step S84), the step of determining the dominant eye (steps S80 to S90) is not performed, and the process advances to step S92 while maintaining the dominant eye information set in step 10. . When the image data includes a face (YES in step S84), the face position detection unit 162 determines whether the center of the face is on the right side of the captured image (step S86).

  When the face position is on the right side of the captured image (YES in step S86), as shown in FIG. 18, the face center is on the right side of the image center. Since the rear camera 10 c is on the approximate central axis M of the monitor 30, the center of the image indicates the approximate central axis M of the monitor 30. Therefore, when the face position is on the right side of the photographed image, as shown in FIG. 19, the face position of the operator is substantially on the center axis M, that is, on the left of the monitor 30. Therefore, since the operator looks at the monitor 30 with the right eye, the dominant eye of the operator is determined to be the right eye (step S88).

  When the face position is on the left side of the photographed image (NO in step S86), as shown in FIG. 20, the face center is on the left side of the image center. Therefore, when the face position is on the left side of the photographed image, as shown in FIG. 21, the face position of the operator is substantially on the central axis M, that is, on the right of the monitor 30. Therefore, since the operator looks at the monitor 30 with the left eye, the dominant eye of the operator is determined to be the left eye (step S90).

  This makes it possible for the photographer to obtain the dominant eye information simply by looking at the monitor 30 at the time of shooting without having to be aware of the input of the dominant eye information. You can see the subject light.

  When the steps for determining the dominant eye (steps S80 to S90) are completed, it is determined whether or not the operator's dominant eye information is the right eye (step S92). If the input dominant eye information is the right eye (YES in step S92), a live view image photographed via the right camera 10a that is the imaging system for the right eye is displayed on the monitor 30 (step S92). S94). If the input dominant eye information is the left eye (NO in step S92), a live view image captured through the left camera 10b, which is the imaging system for the left eye, is displayed on the monitor 30 (step S92). S96).

  It is determined whether the release switch 26 has been fully pressed (step S40). If the release switch 26 has not been fully pressed (NO in step S40), a step (step S12) for determining again whether the release switch 26 has been pressed halfway is performed. When the release switch 26 is fully pressed (YES in step S40), a stereoscopic image is captured (step S42), and a recording process of the captured stereoscopic image is performed (step S44).

  As a result, it is possible to input the dominant eye information only by performing the normal shooting operation of looking at the monitor 30 during shooting without being aware of the input of dominant eye information, and the stereoscopic image recognized by the photographer. Can be displayed on the monitor 30 as a live view image or a reproduced image at the time of shooting. The stereoscopic image capturing method, the image file recording mode, the playback operation, and the display operation of the selected image file are the same as those in the first embodiment, and thus description thereof is omitted.

  In the present embodiment, the case where the rear camera 10c, the right camera 10a, and the left camera 10b have the same configuration has been described as an example, but a pan-focus camera may be used as the rear camera 10c.

  In the first embodiment and the second embodiment, the compound-eye digital camera 1 that creates an image file in the image file generation unit 142 and performs a restoration process of the image file and a related image information restoration process in the CPU 110. However, the present invention is not limited to a compound-eye digital camera, and may be provided as a device such as a PC. The device is not limited to a device such as an imaging device, PC, or portable information terminal. You may provide as a program to apply.

1 is a front view of a compound-eye digital camera 1 to which the present invention is applied. 2 is a rear perspective view of the compound-eye digital camera 1. FIG. FIG. 2 is a perspective view and a rear view of the main part of the compound-eye digital camera 1. It is a general-view perspective view of a prism. 1 is a block diagram of a compound eye digital camera 1. FIG. 3 is a flowchart showing a flow of processing of photographing and recording operations of the compound-eye digital camera 1. It is a figure for demonstrating a photographer's eye position and the position of the eyepiece lens 64. FIG. It is a figure for demonstrating the position of a photographer's eye, and the position of 64 of an eyepiece. It is a figure which shows typically the data structure of an image file. It is a figure which shows typically another example of the data structure of an image file. 4 is a flowchart showing a flow of processing of a reproduction operation of the compound eye digital camera 1. It is an example of a display screen of the reproduction operation of the compound-eye digital camera 1 4 is a flowchart showing a flow of processing of a selection file display operation of the compound eye digital camera 1. 1 is a front view of a compound-eye digital camera 10 to which the present invention is applied. 2 is a rear perspective view of the compound-eye digital camera 100. FIG. 1 is a block diagram of a compound-eye digital camera 100. FIG. 3 is a flowchart showing a flow of processing of photographing and recording operations of the compound-eye digital camera 1. It is a figure for demonstrating the relationship between the image image | photographed with the back camera 10c, and the image | photographed face position. It is a figure for demonstrating the relationship between a photographer's eye position and the position of the monitor. It is a figure for demonstrating the relationship between the image image | photographed with the back camera 10c, and the image | photographed face position. It is a figure for demonstrating the relationship between a photographer's eye position and the position of the monitor.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,100: Compound-eye digital camera, 10a: Right camera, 10b: Left camera, 10c: Rear camera, 30: Monitor, 51: Left sensor, 52: Right sensor, 53: Finder sensor, 61a: Right objective lens, 61b: Left objective lens, 62a, 62b, 63: prism, 64: eyepiece, 110: CPU

Claims (14)

In a stereoscopic image capturing apparatus including a plurality of imaging means for capturing subject images viewed from a plurality of viewpoints as a stereoscopic image,
Two or more object detection sensors disposed on the back surface of the apparatus body so as to be separated from each other in the left-right direction, the object detection sensor detecting a photographer's face looking through the finder as a detection object;
A dominant eye determining means for determining a dominant eye of a photographer looking through a finder based on respective detection outputs of the two or more object detection sensors;
A three-dimensional image photographing apparatus comprising:   2. The photoelectric sensor according to claim 1, wherein the object detection sensor is a photoelectric sensor that emits light with high directivity and outputs a signal corresponding to the presence or absence of light reflected by the detection object or the amount of reflected light. The three-dimensional image photographing device described. The sensor is
A first sensor provided in the vicinity of a finder provided in the approximate center of the back of the apparatus body;
A second sensor provided at an end of the back surface of the apparatus body;
The stereoscopic image capturing apparatus according to claim 1, wherein the stereoscopic image capturing apparatus is configured by: The second sensor is composed of a left sensor provided at the left end of the back surface of the apparatus main body and a right sensor provided at the right end of the back surface of the apparatus body,
When the photographer is detected by the first sensor and the left sensor, the dominant eye determination unit determines that the photographer's dominant eye is a right eye, and the first sensor and the right sensor The stereoscopic image capturing apparatus according to claim 3, wherein when the photographer is detected, the dominant eye of the photographer is determined to be the left eye. With a dominant eye setting means to set the dominant eye of the photographer,
The said dominant eye judging means judges that the dominant eye set by the dominant eye setting means is a dominant eye when no photographer is detected by the first sensor. 4. The stereoscopic image capturing device according to claim 4. The finder
A right objective lens for the right eye provided on the front surface of the apparatus body,
A left objective lens for the left eye provided on the front surface of the apparatus body;
One eyepiece for viewing a subject image through either the right objective lens or the left objective lens;
Switching between whether light incident from the right objective lens is guided to the eyepiece unit or light incident from the left objective lens is guided to the eyepiece unit based on the result of the dominant eye determination by the dominant eye determination unit Switching means for performing
The three-dimensional image photographing device according to claim 1, further comprising: In a stereoscopic image capturing apparatus including a plurality of imaging means for capturing subject images viewed from a plurality of viewpoints as a stereoscopic image,
A rear camera provided on the back of the device body;
Face position detecting means for detecting the position of the photographer's face based on an image photographed by the rear camera;
Based on the position of the photographer's face detected by the face position detection means, the dominant eye determination means for determining the dominant eye of the photographer;
A three-dimensional image photographing apparatus comprising:   The stereoscopic image capturing apparatus according to claim 7, wherein the rear camera is provided on a substantially central axis of a display unit provided on a rear surface of the apparatus main body. Comprising face detection means for detecting a photographer's face from an image taken by the rear camera;
The face position detection means determines the position of the photographer's face by comparing the center of the photographer's face detected by the face detection means with the center of the image photographed by the rear camera. The three-dimensional image photographing device according to claim 7 or 8. With a dominant eye setting means to set the dominant eye of the photographer,
The dominant eye determining means determines that the dominant eye set by the dominant eye setting means is a dominant eye when the face position detecting means cannot determine the position of the photographer's face. The three-dimensional image photographing device according to any one of 7 to 9. It has a release button for release operation.
The stereoscopic image capturing apparatus according to claim 1, wherein the dominant eye determining unit determines a dominant eye when the release button is half-pressed. Display means for displaying a subject image;
Representative image selection means for selecting a desired one subject image as a representative image from a plurality of subject images constituting the stereoscopic image based on the dominant eye information determined by the dominant eye determination means;
Display control means for causing the display means to display the representative image selected by the representative image selection means;
The three-dimensional image photographing device according to claim 1, further comprising:   13. A recording unit that records a three-dimensional image captured by the plurality of imaging units and a dominant eye information determined by the dominant eye determination unit in association with each other on a recording medium. The three-dimensional image photographing device according to any one of the above.   The representative image selecting means is a desired one subject image out of a plurality of subject images constituting the recorded stereoscopic image based on the dominant eye information recorded on the recording medium in association with the stereoscopic image. The stereoscopic image capturing apparatus according to claim 13, wherein the three-dimensional image capturing apparatus is selected as a representative image.

Images