JP2011033990A - Compound eye photographing device and photographing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a compound eye photographing device for preventing photographing from failing because a user is located outside a range where a parallax image can be photographed, when the parallax image for stereoscopic display is photographed by using a self-timer function by the compound eye photographing device whose convergence angle is fixed; and to provide a photographing method. <P>SOLUTION: The compound eye photographing device 10 starts a timer to start the counting of time (step S22), when it is determined that the user is in a stereoscopic viewing possible range A1 where an object can be stereoscopically viewed (Yes in step S20), and photographs right and left parallax images by photographing parts 12-1 and 12-2 (step S24), when a previously set time (for instance, several seconds) elapses. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a compound eye photographing apparatus and a photographing method, and more particularly to a compound eye photographing apparatus and a photographing method for photographing an image for performing stereoscopic display.

  Patent Documents 1 to 3 disclose automating congestion control in a photographing apparatus that photographs right and left parallax images. In Patent Documents 1 to 3, the convergence distance is set to the detected subject distance only when the state where the absolute value of the difference between the detected subject distance and the previously updated subject distance is larger than a predetermined value continues for a predetermined time. It is disclosed.

Japanese Patent Laid-Open No. 2001-16618 JP 2001-16619 A JP 2001-16620 A

  When capturing left and right parallax images for performing stereoscopic display, if the subject is too close to the imaging device, the parallax shift increases and the stereoscopic display image (3D image) blurs. On the other hand, if the subject is too far away from the photographing device, the parallax shift is reduced and a phenomenon in which a stereoscopic effect cannot be obtained occurs.

  When shooting a parallax image using the self-timer function, the user, who is the subject, moves within the field of view of the shooting device after determining the angle of view and composition, so take a shot while checking the 3D image. I can't. For this reason, since it is difficult for the user to determine whether or not he / she is within a range in which a parallax image can be captured (a range in which the parallax shift is not too large and not too small), it is likely that shooting will fail.

  The inventions described in Patent Documents 1 to 3 cannot be applied to a compound eye photographing apparatus with a fixed convergence angle. Further, the inventions described in Patent Documents 1 to 3 are not made by paying attention to self-timer photographing. Furthermore, the inventions described in Patent Documents 1 to 3 perform the congestion control according to the result of monitoring the absolute value of the difference between the detected subject distance and the previously updated subject distance for a predetermined time, and the convergence angle is fixed. However, it does not solve the problem of preventing failure in taking a parallax image when self-timer shooting is performed after the angle of view and the composition are determined in the compound eye photographing device.

  The present invention has been made in view of such circumstances, and a parallax image can be taken when a parallax image for stereoscopic display is shot using a self-timer function by a compound eye photographing device with a fixed convergence angle. It is an object of the present invention to provide a compound eye photographing apparatus and a photographing method for preventing a user from being located outside the range and failing in photographing.

  In order to solve the above problems, a compound eye photographing apparatus according to a first aspect of the present invention includes first and second photographing units fixed to form a predetermined angle of convergence, and input of photographing instructions from a user. A shooting instruction unit for receiving a self-timer shooting setting, a timer shooting setting unit for receiving setting of self-timer shooting, and the shooting instruction unit receiving an input of the shooting instruction after the timer shooting setting unit has received the setting of the self-timer shooting. A first determination unit that detects the position of the user and determines whether the position of the user is within a stereoscopically viewable range where a stereoscopically viewable parallax image can be captured; and the position of the user A shooting control unit that performs shooting of the parallax image of the user by the first and second shooting units after a predetermined time has elapsed since the first determination unit determined that the range is within the stereoscopic viewable range; Preparation That.

  According to the first aspect, when the self-timer photographing is performed by the compound eye photographing device in which the convergence angles of the first and second imaging units are fixed, it is detected that the position of the user is within the stereoscopic view possible range. After that, since the timer is started to be counted, it is possible to prevent the shooting from failing because the user is positioned outside the range where the parallax image can be shot.

  In the compound eye photographing apparatus according to the second aspect of the present invention, in the first aspect, the first determination unit obtains the feature point of the user from the images photographed by the first and second photographing units. And detecting whether or not the position of the user is within the stereoscopic view possible range based on the amount of parallax deviation of the feature points.

  The compound-eye imaging device according to a third aspect of the present invention is the compound eye photographing apparatus according to the second aspect, further comprising a map in which the amount of parallax deviation of the feature points is recorded such that the position of the user is within the stereoscopic viewable range. The first determination unit is configured to determine whether the position of the user is within the stereoscopic view possible range by comparing the amount of parallax deviation of the feature points with the map. is there.

  According to the third aspect, in addition to the above-described effects, whether or not the user is in the stereoscopic view possible range is prepared in advance by providing a map that is a criterion for determining whether or not the user is in the stereoscopic view possible range. It becomes possible to shorten the processing time for judgment.

  In the compound eye imaging device according to the fourth aspect of the present invention, in the first to third aspects, the first determination unit determines that the position of the user is within the stereoscopic viewable range. A notification unit for notifying the user is further provided.

  According to the fourth aspect, the notification unit can notify the user whether the user's position is within the stereoscopic view possible range.

  According to a fifth aspect of the present invention, in the first to third aspects, the compound eye photographing apparatus extracts the user feature point from the user's parallax image, and the user's position is at the time of photographing the parallax image. A second determination unit that determines whether or not the range is within the stereoscopic view possible range; and the second determination unit that the position of the user is not within the stereoscopic view possible range when the parallax image is captured. A notifying unit for notifying the user, wherein the shooting control unit determines that the position of the user is not within the stereoscopic view possible range at the time of shooting the parallax image; After the first determination unit determines that the user's position is within the stereoscopic view possible range, the first and second imaging units re-shoot the parallax image of the user. Like It is.

  According to the fifth aspect, it is determined whether stereoscopic 3D display is possible based on the parallax image obtained by photographing the parallax image with the self-timer, and the user in front of the compound-eye imaging device receives the first The determination result by the two determination units can be notified.

  According to a sixth aspect of the present invention, in the fourth or fifth aspect, the notification unit is an auxiliary light emitting unit or a flash light emitting unit.

  According to a seventh aspect of the present invention, in the fourth to sixth aspects, the notification unit is an audio output unit.

  According to the sixth and seventh aspects, since the existing auxiliary light emitting unit, flash light emitting unit, or audio output unit is used for notification to the user, the manufacturing cost of the compound eye photographing device can be suppressed.

  A compound eye photographing apparatus according to an eighth aspect of the present invention further includes a changing unit that changes the predetermined time in the first to seventh aspects.

  According to the eighth aspect, since it is possible to freely set a predetermined time until the user or the like decides the posture at the time of shooting, shooting as intended by the user can be facilitated.

  According to a ninth aspect of the present invention, in the first to eighth aspects, the compound eye photographing apparatus further includes a feature point information recording unit that records the feature point information of the user, and the first determination unit includes: Based on the feature point information, it is determined whether or not the position of the user is within a stereoscopically viewable range where a stereoscopically viewable parallax image can be taken.

  According to the ninth aspect, in addition to the effects described above, the detection target can be narrowed down based on the user's feature point information recorded in advance, so that the time required for the user detection process can be shortened.

  The compound eye imaging device according to a tenth aspect of the present invention is the ninth aspect, wherein the feature point information recording unit records feature point information of a user of the compound eye imaging device and a person other than the user. The first determination unit determines whether the positions of the user and a person other than the user are within a stereoscopically viewable range where a stereoscopically viewable parallax image can be taken based on the feature point information. The photographing control unit is configured to perform the first and second after a lapse of a predetermined time after the first determination unit determines that the positions of the user and a person other than the user are within the stereoscopic view possible range. The photographing unit performs photographing of the user's parallax image.

  According to the tenth aspect, the self-timer shooting is started when all of the pre-registered persons (including the user) are within the stereoscopic viewable range. It is possible to prevent the shooting from being performed in a state where there is no person who has already finished. In addition, since the detection target can be narrowed down based on the feature point information recorded in advance, the time required for the subject detection process can be shortened.

  An imaging method according to an eleventh aspect of the present invention is an imaging method in which a parallax image of a user is captured by a compound-eye imaging device including first and second imaging means fixed so as to form a predetermined convergence angle. The user's position can be detected and the user's position can be stereoscopically captured when the compound eye photographing device accepts an input of a photographing instruction after accepting the self-timer photographing setting. A first determination step of determining whether or not the stereoscopic view is within a range within which stereoscopic viewing is possible; and after a predetermined time has elapsed since the determination that the user's position is within the stereoscopic view possible range, And a first shooting control step of shooting a parallax image of the user by the second shooting means.

  In the photographing method according to a twelfth aspect of the present invention, in the first determining step according to the eleventh aspect, the compound eye photographing apparatus is configured such that the user uses an image photographed by the first and second photographing means. These feature points are detected, and based on the amount of parallax deviation of the feature points, it is determined whether or not the position of the user is within the stereoscopic view possible range.

  In the photographing method according to a thirteenth aspect of the present invention, in the first determination step according to the twelfth aspect, the compound eye photographing device is characterized in that the position of the user is within the stereoscopic viewable range. It is determined whether or not the position of the user is within the stereoscopic view possible range by comparing a map in which the amount of disparity between points is recorded and the amount of disparity between the feature points.

  In the photographing method according to the fourteenth aspect of the present invention, in the eleventh to thirteenth aspects, the compound eye photographing apparatus determines that the position of the user is within the stereoscopic view possible range. A notification step of notifying the user is further provided.

  In the photographing method according to a fifteenth aspect of the present invention, in the eleventh to thirteenth aspects, the compound eye photographing device extracts the user feature point from the user's parallax image, and the parallax image is captured when the parallax image is captured. A second determination step of determining whether or not a user's position is within the stereoscopic viewable range; and the compound eye photographing device determines that the user's position was not within the stereoscopic viewable range when photographing the parallax image After the second determining step determines that the user's position is not within the stereoscopic view possible range when the compound eye imaging device captures the parallax image. After the predetermined time has elapsed since the first determination step that the position is within the stereoscopic view possible range, the parallax image of the user is again captured by the first and second imaging means. Further comprising a second imaging control step of rows.

  In the photographing method according to the sixteenth aspect of the present invention, in the first determining step of the eleventh to fifteenth aspects, the compound eye photographing device is based on the feature point information of the user recorded in advance. It is determined whether or not the position of the user is within a stereoscopic view possible range where a stereoscopically viewable parallax image can be taken.

  In the photographing method according to a seventeenth aspect of the present invention, in the first determination step of the sixteenth aspect, the compound eye photographing device is a user of the compound eye photographing device and a person other than the user who have been recorded in advance. Based on the feature point information, it is determined whether or not the positions of the user and a person other than the user are within a stereoscopic viewable range in which a stereoscopically viewable parallax image can be taken. The imaging apparatus captures a parallax image of the user by the first and second imaging units after a predetermined time has elapsed after determining that the positions of the user and a person other than the user are within the stereoscopic viewable range. Is to be executed.

  According to the present invention, when performing self-timer shooting with a compound eye imaging device in which the convergence angles of the first and second imaging units are fixed, after detecting that the position of the user is within the stereoscopic view possible range, Since the timer starts counting, it is possible to prevent a user from being located outside the range where the parallax image can be photographed and photographing failure.

1 is a block diagram showing the main configuration of a compound eye photographing apparatus according to a first embodiment of the present invention. The figure for demonstrating the method of carrying out the self-timer imaging | photography of the parallax image with the compound eye imaging device which concerns on this embodiment. 7 is a flowchart showing a self-timer photographing method for parallax images according to the first embodiment of the present invention. The figure for demonstrating the judgment method of a user's position The figure which shows the post view display of a compound eye imaging device 7 is a flowchart showing a self-timer photographing method for parallax images according to the second embodiment of the present invention. Map showing correspondence between stereoscopic view possible range A1 and parallax deviation amount The block diagram which shows the main structures of the compound eye imaging device which concerns on the 3rd Embodiment of this invention. 7 is a flowchart showing a self-timer photographing method for parallax images according to a third embodiment of the present invention. 8 is a flowchart showing a self-timer photographing method for parallax images according to a fourth embodiment of the present invention. Flowchart illustrating a self-timer photographing method for parallax images according to a fifth embodiment of the present invention. The block diagram which shows the main structures of the compound eye imaging device which concerns on the 6th Embodiment of this invention. The flowchart which shows the self-timer imaging method of the parallax image which concerns on the 6th Embodiment of this invention. The block diagram which shows the main structures of the compound eye imaging device which concerns on the 7th Embodiment of this invention. The flowchart which shows the self-timer imaging method of the parallax image which concerns on the 7th Embodiment of this invention. The flowchart which shows the self-timer imaging method of the parallax image which concerns on the 8th Embodiment of this invention. The flowchart which shows the self-timer imaging method of the parallax image which concerns on the 9th Embodiment of this invention. Flowchart showing registration process of user feature point information The flowchart which shows the self-timer imaging method of the parallax image which concerns on the 10th Embodiment of this invention. The flowchart which shows the self-timer imaging method of the parallax image which concerns on the 11th Embodiment of this invention.

  Preferred embodiments of a compound eye photographing apparatus and photographing method according to the present invention will be described below with reference to the accompanying drawings.

[First Embodiment]
First, the configuration of the compound eye photographing apparatus according to the present embodiment will be described with reference to the block diagram of FIG.

  As shown in FIG. 1, the compound eye photographing apparatus 10 includes two photographing units 12-1 and 12-2. Two or more photographing units 12 may be provided.

  The compound eye photographing apparatus 10 combines two pieces of image data photographed by the photographing units 12-1 and 12-2. For example, the compound eye photographing apparatus 10 generates and displays an image for stereoscopic display by combining two pieces of parallax image data photographed by the photographing units 12-1 and 12-2. The compound eye photographing apparatus 10 stores the parallax image data in one recording image file. In addition, the compound eye photographing apparatus 10 joins a plurality of frames of image data obtained during bracket photographing, moving image photographing and continuous photographing and stores them in one recording image file.

As a format for recording an image of a plurality of frames, for example, “multi-picture format” is known, but is not limited thereto. (The same applies to the following examples)
The signal processing IC (Integrated Circuit) includes a CPU (Central Processing Unit) 14 and is a means for comprehensively controlling the operation of the entire compound eye photographing apparatus 10 in accordance with a predetermined control program based on an input from the operation unit 16.

  The signal processing IC includes a ROM (Read Only Memory), an EPROM (Erasable Programmable ROM), and a work memory (RAM (Random Access Memory)). The ROM stores a control program executed by the CPU 14 and various data necessary for control. In the EPROM, various setting information relating to the operation of the compound eye photographing apparatus 10 such as user setting information is stored. As the EEPROM, a non-volatile memory whose stored contents are not erased even when the power is turned off is used. The work memory includes a calculation work area for the CPU 14 and a temporary storage area for image data. Usually, a dynamic RAM, which is a volatile memory, is used in terms of cost.

  The operation unit 16 is an operation means for a user to perform various operation inputs, and includes a power switch for switching power on and off, a mode dial for switching the operation mode of the compound eye photographing apparatus 10, a release switch, and a zoom. Includes buttons.

  The mode dial is an operation means for performing an operation mode switching input of the compound eye photographing apparatus 10, and a 2D mode for capturing a two-dimensional image (still image, moving image) according to the set position of the mode dial, and a stereoscopic The operation mode is switched between a 3D mode for capturing a visual image (still image, moving image) and a reproduction mode for reproducing an image.

  The release switch is composed of a two-stage stroke type switch composed of so-called “half-press” and “full-press”. When the release switch is pressed halfway (S1 ON) in the still image shooting mode, shooting preparation processing (for example, automatic exposure adjustment processing (AE (Automatic Exposure)), automatic focusing processing (AF (Auto Focus)) ), Automatic white balance adjustment processing (AWB (Automatic White Balance))) is performed. When the release switch is fully pressed (S2 is on), still image shooting / recording processing is performed. In the mode for shooting a moving image, the shooting of the moving image starts when the release switch is fully pressed, and the shooting of the moving image ends when the release switch is fully pressed again. A release switch for still image shooting and a release switch for moving image shooting may be provided separately.

  The zoom button is an operation means for performing zooming operations of the photographing units 12-1 and 12-2, and includes a zoom tele button for instructing zooming to the telephoto side, and a zoom wide button for instructing zooming to the wide angle side. It has.

  The display unit 18 is a display device including a color liquid crystal panel (LCD (Liquid Crystal Display)), for example. The display unit 18 functions as a display unit that displays a captured image, and also functions as a user interface when performing settings related to various functions of the compound-eye imaging device 10. The display unit 18 functions as an electronic viewfinder that displays a live view image for confirming the angle of view in the shooting mode.

  The display unit 18 has a function of displaying a stereoscopic (3D) image that can be stereoscopically viewed by the user and the observer in the 3D mode. As a 3D image display method, for example, a light direction control system is employed. In the light direction control system, the image data for the left eye is displayed on the LCD, and the backlight panel irradiates the LCD with illumination light having directivity so as to reach the left eye of the user. A process of displaying image data for eyes on the LCD and irradiating the LCD with illumination light having directivity so as to reach the right eye of the user through the backlight panel (for example, at intervals of 1/60 seconds) )repeat. Accordingly, the left-eye image and the right-eye image having parallax with each other can be observed alternately by the left and right eyes of the user, so that the user can observe a stereoscopic image. There are many methods for displaying a stereoscopic image, and any of them may be used.

  The recording unit 20 records captured image files and various data. The recording unit 20 may be a detachable recording medium such as an SD memory card (registered trademark) or an xD picture card (registered trademark), or may be a memory built in the main body of the compound eye photographing apparatus 10. However, when using the memory built in the main body of the compound eye photographing apparatus 10, it is necessary to use a non-volatile memory so that the image is not erased even when the power of the camera main body is turned off.

  Next, the photographing function of the compound eye photographing apparatus 10 will be described. In FIG. 1, the imaging units 12-1 and 12-2 are distinguished from each other by reference numerals 1 and 2, but the functions of the respective units are substantially the same. 2 will be omitted as appropriate.

  Each photographing unit 12 includes a photographing lens (photographing lens) 22 including a focus lens 24, a zoom lens 26, a diaphragm 28 and a mechanical shutter 30. In the present embodiment, the convergence angle θ of the photographing lenses 22-1 and 22-2 is fixed.

  The focus lens 24 and the zoom lens 26 move back and forth along the optical axis of each photographing unit 12. The CPU 14 controls the operation of the focus actuator provided in the optical system driving unit 32 to adjust the position of the focus lens 24 and perform focusing. Further, the CPU 14 controls the operation of the zoom actuator provided in the optical system driving unit 32 to adjust the position of the zoom lens 26 to perform zooming. The CPU 14 controls the amount of light incident on the image sensor 34 by adjusting the aperture (aperture value) of the diaphragm 28 by controlling the driving of the diaphragm actuator provided in the optical system driving unit 32.

  The mechanical shutter 30 is closed when data is read from the image sensor 34. As a result, light incident on the image sensor 34 is shielded during data reading.

  In the 3D mode, the CPU 14 takes the photographing lenses 22-1 and 22-1 (that is, the focus lenses 24-1 and 24-2, zoom lenses 26-1 and 26-2, and the like) of the photographing units 12-1 and 12-2. The diaphragms 28-1 and 28-2) are driven in synchronization. That is, in the 3D mode, the photographing units 12-1 and 12-2 are always set to the same focal length (zoom magnification), and the diaphragm is adjusted so that the same incident light amount (aperture value) is always obtained. Further, in the 3D mode, focus adjustment is performed so that the same subject is always in focus.

  The image sensor 34 is, for example, a color CCD (Charge Coupled Device) solid-state image sensor. The image sensor 34-1 and the image sensor 34-2 may have the same size and saturation characteristics, or may be different from each other. As the image sensor 34, an image sensor other than a CCD, such as a complementary metal oxide semiconductor (CMOS) image sensor, can also be used.

  A large number of photodiodes are two-dimensionally arranged on the light receiving surface of the image sensor 34. In each photodiode, color filters of a predetermined color (for example, three primary colors of red (R), green (G), and blue (B)) are arranged in a predetermined arrangement. Note that the color of the color filter is not limited to the three primary colors of R, G, and B. For example, a complementary color system color filter may be used. When subject light is imaged on the light receiving surface of the image sensor 34 via the imaging unit 12, the subject light is converted into signal charges corresponding to the amount of incident light by the photodiode. The image sensor 34 has an electronic shutter function, and the CPU 14 controls the exposure time (shutter speed) by controlling the charge accumulation time in the photodiode. The signal charge accumulated in each photodiode is based on a drive pulse given from a timing generator (TG) 36 in accordance with a command from the CPU 14 and is used as an image signal (R, G, B signal) corresponding to the charge amount. Are read sequentially. The image signal read from the image sensor 34 is input to the analog signal processing unit 40 through the amplifier 38.

  The analog signal processing unit 40 includes a correlated double sampling (CDS (Correlated Double Sampling)) circuit for removing reset noise (low frequency) included in the R, G, and B signals output from the image sensor 34, R, It includes an AGC (Automatic Gain Control) circuit for amplifying the G and B signals and controlling them to a certain level, and an A / D converter for converting analog signals into digital signals. Analog R, G, B signals output from the image sensor 34 are subjected to correlated double sampling processing and amplified by the analog signal processing unit 40. The amplification gains of the R, G, and B signals in the analog signal processing unit 40 correspond to shooting sensitivity (ISO sensitivity). The CPU 14 sets the photographing sensitivity by adjusting the amplification gain in accordance with the brightness of the subject. Note that, when images are taken using two imaging elements having the same sensitivity (3D mode), the gains are the same as [1] system analog signal processing unit 40-1 and [2] system analog signal processing unit 40-2. Is set to the same value.

  The gain-adjusted analog R, G, B signals are converted into digital R, G, B signals by an A / D converter and then input to the signal processing IC 14 via a buffer memory.

  The digital R, G, and B signals generated as described above are subjected to predetermined processing (for example, by interpolating a spatial shift of the color signal accompanying the color filter array of the single-plate image sensor by a signal processing IC. R, G, and B color signal processing), white balance adjustment processing, gradation conversion (gamma correction) processing, and contour correction processing are performed to obtain a luminance signal (Y signal) and a color difference signal (Cr, Cb signal). That is, it is converted into a Y / C signal.

  When a live view image (through image) that is an image for confirming the angle of view when shooting a still image or a moving image is displayed on the display unit 18, the image signal accumulated in the image sensor 34 is thinned out at predetermined time intervals. Read out. The read image signal is subjected to predetermined processing by a signal processing IC and converted into a Y / C signal. The Y / C signal is converted into a signal suitable for display on the display unit 18 (for example, R, G, B signal), and then output to the display unit 18 frame by frame. As a result, a moving image for checking the angle of view (through image) is displayed on the display unit 18. In the 2D mode, an image signal for a through image is read from only one photographing unit 12. On the other hand, in the 3D mode, image signals for through images are read from both the left and right imaging units 12-1 and 12-2, and a 3D through image (moving image) is displayed using both images. .

  In the 3D mode, the through image can be displayed in 2D by setting. In this case, a through image created using an image obtained from one of the left and right imaging units 12-1 and 12-2 is displayed. When performing subject detection (face detection) in the 3D mode, depending on whether or not the subject is within the stereoscopic view possible range, a figure (for example, face detection) attached to the subject detected from the 2D through image The color of the frame may be changed.

  Next, image capturing and recording processing will be described. In the 2D mode, a recording image is shot by a predetermined one shooting unit (for example, 12-1). Note that the characteristics of the imaging units 12-1 and 12-2 (imaging lens 22, imaging element 34, etc.) are different from each other so that the user can select which imaging unit to use in the 2D mode. Good.

  In the 2D mode, an image photographed by the photographing unit 12-1 is compressed by the signal processing IC. The compressed image data is recorded in the recording unit 20 as an image file in a predetermined format. For example, JPEG (Joint Photographic Experts Group) for still images, MPEG2 or MPEG4 for moving images, and H.264. It is recorded as a compressed image file conforming to a standard such as H.264. However, the compression method is not limited to these.

  In the 3D mode, images are captured in synchronization by the imaging units 12-1 and 12-2. In the 3D mode, AF processing and AE processing are performed based on the image signal acquired by one of the imaging units 12-1 and 12-2. In the 3D mode, the two viewpoint images photographed by the photographing units 12-1 and 12-2 are respectively compressed, stored in one file, and recorded in the recording unit 20. The file stores subject distance information, the distance between the photographing lenses of the photographing unit 12, and information on the convergence angle together with the compressed image data of the two viewpoints.

  In the playback mode, the last image file (last recorded image file) recorded in the recording unit 20 is read out and decompressed into an uncompressed Y / C signal by the signal processing IC. The uncompressed Y / C signal is converted into R, G, and B signals and then output to the display unit 18. As a result, the image file recorded in the recording unit 20 is displayed on the display unit 18.

  At the time of reproduction of an image shot in 3D mode, 3D display and 2D display can be selected by setting. When performing subject detection (face detection) from an image, a figure (for example, face detection) attached to the subject detected from the 2D display according to whether or not the subject is within the stereoscopic view possible range at the time of shooting. The color of the frame may be changed.

[Self-timer shooting]
Next, processing of the compound eye photographing apparatus 10 at the time of self-timer photographing will be described.

  FIG. 2 is a diagram for explaining a method for performing self-timer photographing of a parallax image by the compound eye photographing apparatus according to the present embodiment.

As shown in FIG. 2, the convergence angle θ of the compound eye photographing device 10 is fixed, and the optical axes (L1 and L2 respectively) of the left and right photographing lenses 22-1 and 22-2 are in front of the compound eye photographing device 10. Crossing at cross point Pc. When the distance (stereo base) between the left and right photographing lenses 22-1 and 22-2 is X (mm) and the distance between the cross point Pc and the compound eye photographing device 10 is Y (mm), the convergence angle θ is θ = Tan ⁻¹ (X / 2Y).

  The cross point Pc is an optimal subject position for stereoscopically viewing the subject (capturing a stereoscopically viewable parallax image). The stereoscopic view possible range A1 is a distance range to a subject that can stereoscopically view the subject. In FIG. 2, the stereoscopic view possible range A1 is a range of a distance W1 from the cross point Pc toward the compound eye photographing apparatus 10 and a distance W2 from the cross point Pc to the side away from the compound eye photographing apparatus 10.

  The stereoscopic view possible range A1 is determined based on the stereo base X, the width of the effective area of the imaging elements 34-1 and 34-2, the focal length of the photographing lenses 22-1 and 22-2, and the allowable parallax amount.

  A point closest to the compound eye imaging device 10 in the stereoscopic view possible range A1 is a near point Pn, and a point farthest from the compound eye imaging device 10 is a far point Pf. When φ = 90 ° −θ, the parallax deviation amount at the near point Pn is δ1 (°), and the parallax deviation amount at the far point Pf is δ2 (°), the distance Yn between the near point Pn and the left lens 22-2 (= Y−W1), the distance Yf (= Y + W2) between the far point Pf and the left lens 22-2 is expressed by the following equations (1) and (2), respectively.

Yn = X / 2 × tan (φ−δ1) (1)
Yf = X / 2 × tan (φ + δ2) (2)
The stereoscopic view possible range A1 is, for example, a range of δ1 ≦ 30 ° and δ2 ≦ 7 ° to 8 ° (range A). In a recent survey, the stereoscopic viewable range A1 is preferably a range of δ1 ≦ 3.34 ° and δ2 ≦ 3.05 ° (range B), more preferably δ1 ≦ 1.84 °, δ2 ≦ 2. The range of 04 ° (range C) is said.

  In FIG. 2, in order to simplify the calculation, the cross point Pc is formed by setting an angle to both the left and right photographing lenses 22-1 and 22-2. Of course it is good.

  In addition, when the compound eye imaging device 10 detects that the user has entered and exited each of the ranges A, B, and C, the user may be notified of that fact.

  FIG. 3 is a flowchart showing a self-timer photographing method for parallax images according to the first embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is powered on (step S10), the compound eye photographing apparatus 10 is activated in the 3D mode. The compound-eye imaging device 10 captures a parallax image by each of the imaging units 12-1 and 12-2, and displays a 3D live view image (through image) based on the parallax image on the display unit 18 (step S12). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S14) and it is detected that the release switch is pressed (fully pressed) (step S16), the compound eye photographing apparatus 10 detects the position of the user (subject). Is started (step S18). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic view possible range A1 (step S20). Note that, when activated in the 3D mode, the self-timer mode may be set as a default.

  FIG. 4 is a diagram for explaining a method for determining the position of the user.

The compound eye photographing apparatus 10 detects a user from left and right parallax images (left image IMG _L and right image IMG _R ). Here, the detection of the user is performed by, for example, face detection processing. As a face detection processing method, for example, there is a method in which a pixel having a color close to a color designated in advance as a skin color is extracted from an original image, and the extracted region is detected as a face region. In this face detection processing method, for example, a skin color range on a color space is determined from skin color information sampled in advance on a color space for distinguishing the skin color from other colors. For example, the compound eye photographing device 10 calculates an evaluation value (face-likeness degree) of the face-likeness based on the degree of the skin color or the like for each skin-color region detected from the image. Then, the compound eye photographing apparatus 10 determines that the skin color area having the faceness degree equal to or greater than a predetermined value is a face area. In addition, as a method of ear detection processing, for example, a region (eye region) including two black colors arranged on the left and right is detected from the skin color regions detected by the face detection processing, and thus the detected eye Some detect the vicinity of the edge of the skin color area as an ear area with reference to the position of the area.

Next, the compound eye imaging device 10 detects the feature points (P _L and P _R ) of the user (face) in the left image IMG _L and the right image IMG _R , respectively, and uses the left image IMG _L and the right image IMG _R. the shift amount between the feature points P _L and P _R when the superimposed measuring. Then, the compound eye photographing apparatus 10 has an absolute value of the shift amount (when there are a plurality of feature points, a total value, an average value, or a maximum value of the absolute values of the shift amounts between corresponding feature points) is equal to or less than a predetermined value. If, or left image IMG _L, the right image IMG centerline of _R (respectively _L L, _{L R)} and the feature point _P L, the total value of the absolute value of the distance between the _{P R,} the average value or the maximum value is predetermined If the value is less than or equal to the value, it is determined that the user's position is within the stereoscopic view possible range A1.

When the compound eye photographing apparatus 10 determines that the user is within the stereoscopic viewable range A1 (Yes in Step S20), the compound eye photographing apparatus 10 starts a timer and starts counting time (Step S22). When a preset time (for example, several seconds) elapses, the left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S24). The compound eye photographing apparatus 10 stores the parallax images IMG _L and IMG _R in a file of a predetermined format, and records the file in the recording unit 20 (step S26). As shown in FIG. 5, the compound eye photographing apparatus 10 displays a stereoscopic image for confirmation of photographing based on the parallax image on the display unit 18 for a predetermined time (postview display) (step S <b> 28).

  According to the present embodiment, when self-timer photographing is performed by a compound eye photographing device with a fixed convergence angle θ, the timer count is started after detecting that the user is within the stereoscopic viewable range A1. As a result, it is possible to prevent the user from being located outside the range where the parallax image can be photographed and photographing failure.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. In the following description, the description of the same configuration as in the first embodiment is omitted.

  In this embodiment, the relationship between the stereoscopic viewable range A1 and the amount of parallax deviation is recorded in advance as a map, and based on this map, it is determined whether or not the user is within the stereoscopic viewable range A1. It is.

  FIG. 6 is a flowchart illustrating a self-timer photographing method for parallax images according to the second embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is turned on (step S30), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing device 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays a stereoscopic live view image (through image) based on the parallax images on the display unit 18 (step S32). ).

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S34) and it is detected that the release switch is pressed (fully pressed) (step S36), the compound eye photographing apparatus 10 detects the position of the user (subject). Is started (step S38). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic viewable range A1 (step S40).

  FIG. 7 is a map showing the correspondence between the stereoscopic viewable range A1 and the amount of parallax deviation.

  As illustrated in FIG. 7, the map M1 stores a disparity amount (angle) and a value indicating whether or not a stereoscopic view possible range is associated with each other. The map M1 is stored in the ROM or EPROM of the signal processing IC. The reference address indicates the data storage position in the ROM or EPROM.

Similarly to the above-described embodiment, the compound-eye imaging device 10 performs face detection processing on the left image IMG _L and the right image IMG _R , and detects the detected feature points (respectively P _L and P _R ) of the user (face). To do. The compound eye photographing apparatus 10 measures the deviation amount between the feature points _{P L} and _{P R} when the overlapped and left images IMG _L and the right image IMG _R. The compound eye photographing apparatus 10 determines whether or not the position of the user is within the stereoscopic viewable range A1 based on the absolute value of the shift amount and the map M1.

Next, when the compound-eye imaging device 10 determines that the user is within the stereoscopic viewable range A1 (Yes in Step S40), it starts a timer and starts counting time according to the following algorithm (Step S42). When a preset time (for example, several seconds) elapses, the left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S44). The compound eye imaging device 10 stores the parallax images IMG _L and IMG _R in a file of a predetermined format, and records the file in the recording unit 20 (step S46). Further, the compound eye photographing apparatus 10 displays a stereoscopic image for confirmation of photographing based on the parallax image on the display unit 18 for a predetermined time (postview display) (step S48).
[algorithm]
IF ((deviation amount) ≥ min or (deviation amount) ≤ MAX)
{Start timer}
else
According to the present embodiment, when self-timer photographing is performed by a compound eye photographing device with a fixed convergence angle θ, the timer count is started after detecting that the user is within the stereoscopic viewable range A1. As a result, it is possible to prevent the user from being located outside the range where the parallax image can be photographed and photographing failure. Further, by storing in advance a map M1 that is a criterion for determining whether or not the user is within the stereoscopic viewable range A1, the processing time for determining whether or not the user is within the stereoscopic viewable range A1 is shortened. It becomes possible.

[Third Embodiment]
Next, a third embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  FIG. 8 is a block diagram showing a main configuration of a compound eye photographing apparatus according to the third embodiment of the present invention.

  As shown in FIG. 8, the compound eye photographing apparatus 10 according to the present embodiment includes a light emitting unit 50. The light emitting unit 50 is, for example, a light emitting unit including a light emitting diode (LED), and is provided on the front surface of the compound eye photographing apparatus 10 (the surface on which the photographing lens 22 is provided). The light emitting unit 50 irradiates the subject with light at the time of autofocus, and performs AF detection with high accuracy.

  In the present embodiment, the light emitting unit 50 is used to notify the user whether or not it is within the stereoscopic view possible range A1.

  FIG. 9 is a flowchart showing a self-timer photographing method for parallax images according to the third embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is turned on (step S50), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing device 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S52). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S54) and it is detected that the release switch is pressed (fully pressed) (step S56), the compound eye photographing apparatus 10 ends step S64 described later. The light emitting unit 50 is caused to emit light until it does (step S58), and detection of the position of the user (subject) is started (step S60). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic view possible range A1 (step S62). Note that the determination process in step S62 is the same as in the first and second embodiments.

Next, when the compound eye photographing apparatus 10 determines that the user is within the stereoscopic viewable range A1 (Yes in Step S62), the light emitting unit 50 is blinked (Step S64), and the user's position is within the stereoscopic viewable range A1. In addition, the user is notified (step S66), and the timer is started to start counting time (step S68). When a preset time (for example, several seconds) elapses, the left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S70). The compound eye imaging device 10 stores the parallax images IMG _L and IMG _R in a file of a predetermined format, and records the file in the recording unit 20 (step S72). Further, the compound eye photographing apparatus 10 displays a stereoscopic image for confirmation of photographing based on the parallax image on the display unit 18 for a predetermined time (postview display) (step S74).

  According to this embodiment, when a parallax image is captured by the self-timer, the light emitting unit 50 can notify the user whether or not the user's position is within the stereoscopic viewable range A1. In addition, since the existing AF auxiliary light emitting unit 50 is used for notification to the user, the manufacturing cost of the compound eye photographing apparatus 10 can be reduced.

  In this embodiment, the light emitting unit 50 is caused to emit light when the release switch is pressed, and the light emitting unit 50 is blinked when the user enters the stereoscopic viewable range A1. It is not limited to the above. The light emission color, the light emission amount, the blinking time interval, and a combination thereof may indicate that the user has entered the stereoscopic switchable range A1 by pressing the release switch.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

In the present embodiment, based on the parallax images IMG _L and IMG _R taken by the self-timer, it is determined whether stereoscopic 3D display is possible, and the above determination result is sent to the user in front of the compound-eye imaging device 10. Is re-photographed if necessary.

  FIG. 10 is a flowchart showing a self-timer photographing method for parallax images according to the fourth embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is turned on (step S80), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing apparatus 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S82). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S84) and it is detected that the release switch is pressed (fully pressed) (step S86), the compound eye photographing apparatus 10 causes the light emitting unit 50 to emit light. At the same time (step S88), detection of the position of the user (subject) is started (step S90). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic viewable range A1 (step S92). The determination process in step S92 is the same as that in the above embodiment.

  Next, when the compound eye photographing apparatus 10 determines that the user is within the stereoscopic viewable range A1 (Yes in Step S92), the light emitting unit 50 is blinked (Step S94), and the user's position is within the stereoscopic viewable range A1. In addition, the user is notified (step S96), and the timer is started to start counting time (step S98). When a preset time (for example, several seconds) elapses, the left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S100).

Next, the compound eye photographing apparatus 10 measures the movement of the user at the time of photographing from the parallax images IMG _L and IMG _R photographed in Step S100 (Step S102). The compound eye photographing apparatus 10 extracts the feature point of the subject from the parallax images IMG _L and IMG _R, and detects the amount of parallax deviation based on the position of the feature point in the same manner as in step S92 (step S106). Then, the compound eye photographing device 10 determines whether or not stereoscopic 3D display based on the parallax images IMG _L and IMG _R is possible, that is, the stereoscopic movement range when the user moves when shooting the parallax images IMG _L and IMG _R. Judgment is made as to whether or not A1 has exited (step S108).

Further, the compound eye photographing apparatus 10 displays a stereoscopic image for photographing confirmation based on the parallax images IMG _L and IMG _R on the display unit 18 for a predetermined time (post view display) (step S104).

Next, the compound eye photographing apparatus 10 can perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that the image has not come out (Yes in step S108), the parallax images IMG _L and IMG _R are stored in a file of a predetermined format, and the file is recorded in the recording unit 20 (step S110).

On the other hand, the compound eye photographing apparatus 10 cannot perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that the light has exited (No in step S108), the flashing light emitting unit 50 is caused to emit light (step S112), and the user is notified of the shooting failure (step S114). Then, the process returns to step S92, and the parallax image is captured again (steps S92 to S114).

  According to the present embodiment, it is determined whether stereoscopic 3D display is possible based on a parallax image obtained by capturing a parallax image with a self-timer, and the above determination result is sent to a user in front of the compound-eye imaging device 10. Can be notified. In addition, since the existing AF auxiliary light emitting unit 50 is used for notification to the user, the manufacturing cost of the compound eye photographing apparatus 10 can be reduced.

  In the present embodiment, the light emitting unit 50 is caused to emit light when the release switch is pressed, the light emitting unit 50 is blinked when the user enters the stereoscopic viewable range A1, and the light emitting unit 50 is turned on when photographing fails. Although it is made to light up again, the light emission method is not limited to the above. The light emission color, the light emission amount, the blinking time interval, and a combination thereof may indicate that the user has entered the stereoscopic switchable range A1 by pressing the release switch.

[Fifth Embodiment]
Next, a fifth embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  FIG. 11 is a flowchart showing a self-timer photographing method for parallax images according to the fifth embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is powered on (step S120), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing device 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S122). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S124) and it is detected that the release switch is pressed (fully pressed) (step S126), the compound eye photographing apparatus 10 causes the light emitting unit 50 to emit light. At the same time (step S128), detection of the position of the user (subject) is started (step S130). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic viewable range A1 (step S132). The determination process in step S132 is the same as that in the above embodiment.

  Next, when the compound-eye imaging device 10 determines that the user is within the stereoscopic viewable range A1 (Yes in step S132), the emission color of the light emitting unit 50 is changed (transitioned) (step S134), and the position of the user Is in the stereoscopic view possible range A1 (step S136), and the timer is started to start counting time (step S138). Then, when a preset time (for example, several seconds) elapses, left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S140).

Next, the compound eye photographing apparatus 10 measures the movement of the user at the time of photographing from the parallax images IMG _L and IMG _R photographed in Step S140 (Step S142). The compound-eye imaging device 10 extracts feature points of the subject from the parallax images IMG _L and IMG _R, and detects the amount of parallax deviation based on the position of the feature points in the same manner as in step S132 (step S146). Then, the compound eye photographing device 10 determines whether or not stereoscopic 3D display based on the parallax images IMG _L and IMG _R is possible, that is, the stereoscopic movement range when the user moves when shooting the parallax images IMG _L and IMG _R. Judgment is made as to whether or not A1 has been exited (step S148).

Further, the compound eye photographing apparatus 10 displays a 3D image for photographing confirmation based on the parallax images IMG _L and IMG _R on the display unit 18 for a predetermined time (post-view display) (step S144).

Next, the compound eye photographing apparatus 10 can perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that it has not come out (Yes in step S148), the parallax images IMG _L and IMG _R are stored in a file of a predetermined format, and the file is recorded in the recording unit 20 (step S150).

On the other hand, the compound eye photographing apparatus 10 cannot perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that the light has come out (No in step S148), the light emission color of the light emitting unit 50 is returned to the light emission color in step S128 (step S152), and the user is notified of the shooting failure (step S154). Then, the process returns to step S92, and the parallax image is captured again (steps S132 to S154).

  According to the present embodiment, it is determined whether stereoscopic 3D display is possible based on a parallax image obtained by capturing a parallax image with a self-timer, and the above determination result is sent to a user in front of the compound-eye imaging device 10. Can be notified. In addition, since the existing AF auxiliary light emitting unit 50 is used for notification to the user, the manufacturing cost of the compound eye photographing apparatus 10 can be reduced.

[Sixth Embodiment]
Next, a sixth embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  FIG. 12 is a block diagram showing the main configuration of a compound eye photographing apparatus according to the sixth embodiment of the present invention.

  As shown in FIG. 12, the compound eye photographing apparatus 10 according to the present embodiment includes a flash light emitting unit 60. The flash light emitting unit 60 is, for example, a light emitting unit including a light emitting diode (LED), and is provided on the front surface of the compound eye photographing apparatus 10 (the surface on which the photographing lens 22 is provided). The flash light emitting unit 60 is for irradiating the subject with light at the time of shooting according to the result of AE or the setting of the user.

In the present embodiment, 3D display capable of stereoscopic viewing can be performed using the flash light emitting unit 60 based on whether or not it is within the stereoscopic viewable range A1 and the parallax images IMG _L and IMG _R taken by the self-timer. This is to notify the user of the determination result.

  FIG. 13 is a flowchart showing a self-timer photographing method for parallax images according to the sixth embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is powered on (step S160), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing device 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S162). .

  Next, the compound eye photographing apparatus 10 is set to the self-timer mode (step S164), and when it is detected that the release switch is pressed (full depression) (step S166), the compound eye photographing apparatus 10 detects the position of the user (subject). Is started (step S168). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic viewable range A1 (step S170). The determination process in step S170 is the same as that in the above embodiment.

  Next, when the compound eye photographing apparatus 10 determines that the user is within the stereoscopic viewable range A1 (Yes in Step S170), the flash light emitting unit 60 is pre-flashed and then blinked (Step S172), and the position of the user Is in the stereoscopic viewable range A1 (step S174), and a timer is started to start counting time (step S176). When a preset time (for example, several seconds) elapses, the left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S178).

Next, the compound eye photographing apparatus 10 measures the movement of the user at the time of photographing from the parallax images IMG _L and IMG _R photographed in Step S178 (Step S180). The compound eye photographing apparatus 10 extracts the feature point of the subject from the parallax images IMG _L and IMG _R, and detects the amount of parallax deviation based on the position of the feature point in the same manner as in step S170 (step S184). Then, the compound eye photographing device 10 determines whether or not stereoscopic 3D display based on the parallax images IMG _L and IMG _R is possible, that is, the stereoscopic movement range when the user moves when shooting the parallax images IMG _L and IMG _R. Judgment is made as to whether or not A1 has exited (step S186).

Further, the compound eye photographing apparatus 10 displays a 3D image for photographing confirmation based on the parallax images IMG _L and IMG _R on the display unit 18 for a predetermined time (post view display) (step S182).

Next, the compound eye photographing apparatus 10 can perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that the image has not come out (Yes in step S186), the parallax images IMG _L and IMG _R are stored in a file of a predetermined format, and the file is recorded in the recording unit 20 (step S188).

On the other hand, the compound eye photographing apparatus 10 cannot perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that it has come out (No in step S186), the flash light emitting unit 60 is re-emitted (step S190), and the user is notified of the shooting failure (step S192). Then, the process returns to step S170, and the parallax image is captured again (steps S170 to S192).

  According to the present embodiment, it is determined whether stereoscopic 3D display is possible based on a parallax image obtained by capturing a parallax image with a self-timer, and the above determination result is sent to a user in front of the compound-eye imaging device 10. Can be notified. Moreover, since the existing flash light emitting unit 60 is used for notification to the user, the manufacturing cost of the compound eye photographing apparatus 10 can be suppressed.

[Seventh Embodiment]
Next, a seventh embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  FIG. 14 is a block diagram showing the main configuration of a compound eye photographing apparatus according to the seventh embodiment of the present invention.

  As shown in FIG. 14, the compound eye photographing apparatus 10 according to the present embodiment includes a speaker 70. The speaker 70 is for playing back sound (so-called voice memo or the like) recorded via a microphone (not shown).

In this embodiment, it is possible to perform stereoscopic 3D display using the speaker 70 based on whether or not it is within the stereoscopic viewable range A1 and the parallax images IMG _L and IMG _R taken by the self-timer. The determination result is notified to the user.

  FIG. 15 is a flowchart showing a self-timer photographing method for parallax images according to the seventh embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is turned on (step S200), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing apparatus 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays a 3D live view image (through image) based on the parallax images on the display unit 18 (step S202). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S204) and it is detected that the release switch is pressed (fully pressed) (step S206), the compound eye photographing apparatus 10 detects the position of the user (subject). Is started (step S208). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic view possible range A1 (step S210). The determination process in step S210 is the same as that in the above embodiment.

  Next, when the compound-eye imaging device 10 determines that the user is within the stereoscopic viewable range A1 (Yes in step S210), it outputs a sound from the speaker 70 that it has entered the stereoscopic viewable range A1 (step S212). The user is notified that the position of the user is within the stereoscopic viewable range A1 (step S214), and the timer is started to start counting time (step S216). Then, when a preset time (for example, several seconds) elapses, left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S218).

Next, the compound eye photographing apparatus 10 measures the movement of the user at the time of photographing from the parallax images IMG _L and IMG _R photographed in Step S218 (Step S220). The compound-eye imaging device 10 extracts feature points of the subject from the parallax images IMG _L and IMG _R, and detects the amount of parallax deviation based on the position of the feature points in the same manner as in step S210 (step S224). Then, the compound eye photographing device 10 determines whether or not stereoscopic 3D display based on the parallax images IMG _L and IMG _R is possible, that is, the stereoscopic movement range when the user moves when shooting the parallax images IMG _L and IMG _R. Judgment is made as to whether or not it has exited from A1 (step S226).

Further, the compound eye photographing apparatus 10 displays a 3D image for photographing confirmation based on the parallax images IMG _L and IMG _R on the display unit 18 for a predetermined time (postview display) (step S222).

Next, the compound eye photographing apparatus 10 can perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that the image has not come out (Yes in step S226), the parallax images IMG _L and IMG _R are stored in a file of a predetermined format, and the file is recorded in the recording unit 20 (step S228).

On the other hand, the compound eye photographing apparatus 10 cannot perform stereoscopic 3D display based on the parallax images IMG _L and IMG _R , that is, the stereoscopic view possible range A1 when the user moves when photographing the parallax images IMG _L and IMG _R. If it is determined that the image has been taken out (No in step S226), the speaker 70 outputs a sound that the shooting of the stereoscopically viewable parallax image has failed (step S230), and notifies the user of the shooting failure (step S232). . And it returns to step S210 and imaging | photography of a parallax image is performed again (step S210 to S232).

  According to the present embodiment, it is determined whether stereoscopic 3D display is possible based on a parallax image obtained by capturing a parallax image with a self-timer, and the above determination result is sent to a user in front of the compound-eye imaging device 10. Can be notified. Further, since the existing speaker 70 is used for notification to the user, the manufacturing cost of the compound eye photographing apparatus 10 can be suppressed.

[Eighth Embodiment]
Next, an eighth embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  In the third embodiment, the user can manually adjust the self-timer time in the third embodiment.

  FIG. 16 is a flowchart showing a self-timer photographing method for parallax images according to the eighth embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is powered on (step S240), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing apparatus 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S242). .

  Next, when the compound-eye imaging device 10 is set to the self-timer mode (step S244), the timer time (from detecting that the user has entered the stereoscopic viewable range A1 in step S262 to executing the imaging) (Time)) setting screen (GUI) is displayed on the display unit 18, and a timer time setting input is received (step S246). Hereinafter, the processing of steps S248 to S266 is the same as that of steps S56 to S74 of FIG.

  According to the present embodiment, since it is possible to freely set the time until the user or the like decides the posture at the time of shooting, shooting as intended by the user can be facilitated.

[Ninth Embodiment]
Next, a ninth embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  FIG. 17 is a flowchart showing a self-timer photographing method for parallax images according to the ninth embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is turned on (step S270), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing apparatus 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S272). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S274) and it is detected that the release switch is pressed (full depression) (step S276), the compound eye photographing apparatus 10 detects the position of the user (subject). Is started (step S278). Then, the compound eye photographing apparatus 10 determines whether or not the user is within the stereoscopic view possible range A1 (step S280). The determination process in step S280 is the same as that in the above embodiment.

  Next, when the compound-eye imaging device 10 determines that the user is within the stereoscopic viewable range A1 (Yes in step S280), the compound-eye imaging device 10 determines whether there is a subject other than the user in the stereoscopic viewable range A1 (step S282). In step S282, for example, the compound eye photographing apparatus 10 performs face detection processing on the through image in step S272, and after the release switch is pressed, a new detection is made in the through image (the face before the release switch is pressed). Is detected), the face is determined to be a user.

  When the compound eye photographing apparatus 10 determines that there is a subject other than the user within the stereoscopic view possible range A1 (Yes in step S282), the compound eye photographing device 10 performs photographing control according to the subject other than the user and the user (step S284). In step S284, for example, when the compound-eye imaging device 10 determines that all or a predetermined ratio or more of the detected subjects (including the user) are within the stereoscopic viewable range A1, the process proceeds to step S288 and starts the timer. To do. In addition, the compound eye photographing apparatus 10 selects a main subject from the detected subjects (including the user), and performs AE control, AF control, and AWB control according to the main subject. Here, the main subject may be the user himself / herself, or may be determined based on at least one of the size of the face region, the distance from the compound-eye imaging device 10, and the degree of facialness. For example, the subject with the largest face area, the shortest distance from the compound-eye imaging device 10, or the highest faceness degree is selected as the main subject.

  On the other hand, when the compound eye photographing apparatus 10 determines that there is no subject other than the user in the stereoscopic view possible range A1 (No in step S282), it determines that the subject is only the user and performs photographing control according to the user ( Step S286). That is, the compound eye photographing apparatus 10 performs AE control, AF control, and AWB control according to the user.

  Next, the compound eye photographing apparatus 10 starts a timer and starts counting time (step S288). Then, when a preset time (for example, several seconds) elapses, the left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S290).

Next, the compound eye imaging device 10 stores the parallax images IMG _L and IMG _R in a file of a predetermined format, and records the file in the recording unit 20 (step S292). Further, the compound eye photographing apparatus 10 displays a 3D image for photographing confirmation based on the parallax images IMG _L and IMG _R on the display unit 18 for a predetermined time (post-view display) (step S294).

  According to the present embodiment, even when another person is already in the stereoscopic viewable range A1 when the user presses the release switch, the self-timer after the user enters the stereoscopic viewable range A1. Since the photographing can be started, it is possible to prevent the photographing from being performed in the state where there is no user within the stereoscopic view possible range A1.

[Tenth embodiment]
Next, a tenth embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  In the present embodiment, feature point information of a user's image is registered in advance in the compound eye photographing apparatus 10, and the user is detected based on the feature point information.

  FIG. 18 is a flowchart showing a registration process of user feature point information.

  First, when the compound eye photographing apparatus 10 is turned on (step S300), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye imaging device 10 captures the parallax images by the imaging units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S302). .

  Next, in response to the release switch being pressed (fully pressed), the compound eye imaging device 10 captures an image of a person (user) (step S304). Then, the compound eye photographing apparatus 10 performs face detection processing on the photographed person image to extract feature points (step S306), and stores feature point information indicating the coordinates and positional relationship of the feature points in a storage unit such as an EPROM. Store (step S308).

  FIG. 19 is a flowchart showing a self-timer photographing method for parallax images according to the tenth embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is turned on (step S310), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing apparatus 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays a 3D live view image (through image) based on the parallax images on the display unit 18 (step S312). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S314) and it is detected that the release switch is pressed (full depression) (step S316), the compound eye photographing apparatus 10 The detection of the position of the person included in is started (step S318).

  Next, the compound eye photographing apparatus 10 extracts the feature point of the person detected from the through image, compares the feature point of the person with the feature point information registered in advance, and the detected person has registered the feature point It is determined whether the person is a person (step S320). When the compound eye imaging apparatus 10 determines that the detected person is a person whose feature points have been registered (Yes in step S320), the compound eye imaging apparatus 10 determines whether the user is within the stereoscopic view possible range A1 (step S322). In step S322, the compound eye photographing apparatus 10 determines whether the user is within the stereoscopic view possible range A1 based on the amount of parallax shift of the user's feature point detected from the through image and the map M1 of FIG. Note that the determination in step S322 may be the same as that in the first embodiment, for example.

Next, when the compound eye photographing apparatus 10 determines that the user is within the stereoscopic viewable range A1 (Yes in step S322), the timer is started according to the algorithm described in the second embodiment, and the time is counted. Start (step S324). Then, when a preset time (for example, several seconds) has elapsed, the left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S326). The compound eye photographing apparatus 10 stores the parallax images IMG _L and IMG _R in a file of a predetermined format, and records the file in the recording unit 20 (step S328). Further, the compound eye photographing apparatus 10 displays a 3D image for photographing confirmation based on the parallax image on the display unit 18 for a predetermined time (post-view display) (step S330).

  According to the present embodiment, since the self-timer shooting is started when a pre-registered subject (person, user) enters the stereoscopic viewable range A1, there is no user in the stereoscopic viewable range A1. Can prevent shooting. Further, since the detection target can be narrowed down by the feature point information, the time required for the subject (person, user) detection process can be shortened.

[Eleventh embodiment]
Next, an eleventh embodiment of the present invention will be described. In the following description, the description of the same configuration as the above embodiment is omitted.

  In this embodiment, the feature point information is registered for both the user and a person who can be a subject other than the user, and the subject (person) other than the user and the user is within the stereoscopic viewable range A1 based on the feature point information. Judgment is made whether or not.

  FIG. 20 is a flowchart showing a self-timer photographing method for parallax images according to the eleventh embodiment of the present invention.

  First, when the compound eye photographing apparatus 10 is powered on (step S340), the compound eye photographing apparatus 10 is activated in the 3D mode. Then, the compound eye photographing device 10 photographs the parallax images by the photographing units 12-1 and 12-2, and displays the 3D live view image (through image) based on the parallax images on the display unit 18 (step S342). .

  Next, when the compound eye photographing apparatus 10 is set to the self-timer mode (step S344) and it is detected that the release switch is pressed (full depression) (step S346), the compound eye photographing apparatus 10 The detection of the position of the person included in is started (step S348).

  Next, the compound eye photographing device 10 extracts the feature points of the person detected from the through image, compares the feature points of the person with the feature point information registered in advance, and the person who has registered the feature point information It is determined whether it is within the stereoscopic view possible range A1 (step S350). When the compound eye photographing apparatus 10 determines that the person whose feature point information has been registered is in the stereoscopic viewable range A1 (Yes in step S350), the compound eye imaging apparatus 10 determines whether the user is in the stereoscopic viewable range A1 (step S350). S352). In addition, the determination process of step S350 and S352 is the same as that of said embodiment.

Next, when the compound eye photographing apparatus 10 determines that the user is within the stereoscopic viewable range A1 (Yes in step S352), the compound eye photographing apparatus 10 starts a timer and starts counting time (step S354). Then, when a preset time (for example, several seconds) elapses, left and right parallax images are captured by the imaging units 12-1 and 12-2 (step S356). The compound eye imaging device 10 stores the parallax images IMG _L and IMG _R in a file of a predetermined format, and records the file in the recording unit 20 (step S358). Further, the compound eye photographing apparatus 10 displays a 3D image for confirmation of photographing based on the parallax image on the display unit 18 for a predetermined time (post-view display) (step S360).

  According to the present embodiment, the self-timer shooting is started when all of the pre-registered persons (persons who can be subjects other than the user) are within the stereoscopic viewable range A1, so that the stereoscopic viewable range is reached. It is possible to prevent photographing in a state where there is no user or registered person in A1. Further, since the detection target can be narrowed down by the feature point information, the time required for the subject detection process can be shortened.

  DESCRIPTION OF SYMBOLS 10 ... Compound eye camera, 12 ... Shooting part, 14 ... CPU, 16 ... Operation part, 18 ... Display part, 20 ... Recording part, 22 ... Shooting lens, 24 ... Focus lens, 26 ... Zoom lens, 28 ... Aperture, 30 ... Mechanical shutter 32 ... Optical system drive unit 34 ... Image sensor 36 ... Timing generator 38 ... Amplifier 40 ... Analog signal processing unit 50 ... Light emission unit 60 ... Flash light emission unit 70 ... Speaker

Claims (17)

First and second imaging units fixed to form a predetermined convergence angle;
A shooting instruction unit for receiving an input of a shooting instruction from a user;
A timer shooting setting unit for accepting settings for self-timer shooting;
After the timer shooting setting unit receives the setting of the self-timer shooting, when the shooting instruction unit receives an input of the shooting instruction, the user's position is detected and the user's position can be stereoscopically viewed. A first determination unit that determines whether or not a parallax image is within a stereoscopic view possible range;
After the first determination unit determines that the user's position is within the stereoscopic view possible range, the parallax image of the user is shot by the first and second shooting units. A shooting control unit;
A compound eye photographing apparatus.   The first determination unit detects a feature point of the user from the images photographed by the first and second photographing units, and the position of the user is determined based on the amount of parallax deviation of the feature point. The compound-eye imaging device according to claim 1, wherein it is determined whether or not the range is within a viewable range. A map in which the amount of parallax deviation of the feature points is recorded so that the position of the user is within the stereoscopic view possible range;
The compound eye according to claim 2, wherein the first determination unit determines whether or not the position of the user is within the stereoscopic viewable range by comparing a parallax shift amount of the feature point with the map. Shooting device.   The compound eye photography according to any one of claims 1 to 3, further comprising a notification unit that notifies the user that the first determination unit has determined that the position of the user is within the stereoscopic viewable range. apparatus. A second determination unit that extracts a feature point of the user from the parallax image of the user and determines whether or not the position of the user is within the stereoscopic view possible range when the parallax image is captured;
A notification unit that notifies the user that the second determination unit has determined that the position of the user is not within the stereoscopic viewable range when the parallax image is captured;
The shooting control unit determines that the position of the user is within the stereoscopic viewable range after the second determination unit determines that the position of the user is not within the stereoscopic viewable range when shooting the parallax image. 4. The parallax image of the user is re-executed by the first and second imaging units after a lapse of a predetermined time from the determination by the first determination unit. 5. Compound eye photography device.   The compound eye photographing apparatus according to claim 4 or 5, wherein the notification unit is an auxiliary light emitting unit or a flash light emitting unit.   The compound eye photographing apparatus according to claim 4, wherein the notification unit is an audio output unit.   The compound eye photographing apparatus according to claim 1, further comprising a changing unit that changes the predetermined time. A feature point information recording unit for recording the feature point information of the user;
The first determination unit according to claim 1, wherein the first determination unit determines whether the position of the user is within a stereoscopic view possible range where a stereoscopically viewable parallax image can be taken based on the feature point information. The compound-eye imaging device of any one of Claims. The feature point information recording unit records feature point information of a user other than the user and the user of the compound eye photographing device,
The first determination unit determines, based on the feature point information, whether the positions of the user and a person other than the user are within a stereoscopically viewable range where a stereoscopically viewable parallax image can be taken,
The imaging control unit is configured to perform the first and second imaging after a lapse of a predetermined time after the first determination unit determines that the positions of the user and a person other than the user are within the stereoscopic viewable range. The compound eye imaging device according to claim 9, wherein a parallax image of the user is executed by a unit. A photographing method for photographing a user's parallax image with a compound eye photographing device provided with first and second photographing means fixed so as to form a predetermined convergence angle,
When the compound eye photographing device accepts a setting for self-timer photographing and then accepts an input of a photographing instruction, the user's position is detected, and a stereoscopic view capable of photographing a parallax image in which the user's position is stereoscopically viewable A first determination step of determining whether or not it is within a possible range;
A first that the compound-eye imaging device captures a parallax image of the user by the first and second imaging means after a predetermined time has elapsed since the position of the user is determined to be within the stereoscopic viewable range. Shooting control process of
A photographing method comprising:   In the first determination step, the compound eye photographing device detects the user feature point from the images photographed by the first and second photographing means, and based on the amount of parallax deviation of the feature point, The imaging method according to claim 11, wherein it is determined whether or not a user's position is within the stereoscopic view possible range.   In the first determination step, the compound eye photographing device includes a map in which a parallax shift amount of the feature point is recorded so that the position of the user is within the stereoscopic view possible range, and a parallax shift amount of the feature point. The imaging method according to claim 12, wherein it is determined whether or not the position of the user is within the stereoscopic view possible range by comparing.   The imaging method according to claim 11, further comprising a notifying step in which the compound eye imaging device notifies the user that the position of the user is determined to be within the stereoscopic view possible range. A second determination step in which the compound eye imaging device extracts the user feature points from the parallax image of the user, and determines whether or not the position of the user is within the stereoscopic viewable range at the time of shooting the parallax image;
A notifying step for notifying the user that the compound eye photographing device has determined that the position of the user is not within the stereoscopic view possible range when photographing the parallax image;
After the second determining step determines that the user's position is not within the stereoscopic viewable range when the compound eye photographing device captures the parallax image, the user's position is within the stereoscopic viewable range. A second shooting control step of performing again shooting of the parallax image of the user by the first and second shooting means after a lapse of a predetermined time from the determination of the first determination step;
The imaging method according to claim 11, further comprising:   In the first determination step, the compound eye photographing device is within a stereoscopic viewable range in which a parallax image in which the user's position is stereoscopically viewable can be taken based on the user's feature point information recorded in advance. The imaging method according to claim 11, wherein it is determined whether or not there is any. In the first determination step, the compound eye photographing apparatus determines the positions of the user and the person other than the user based on the feature point information of the user of the compound eye photographing apparatus and the person other than the user recorded in advance. Determine whether the stereoscopic viewable parallax image is within the stereoscopic viewable range,
In the photographing control step, the compound eye photographing device is configured such that the first and second photographing units are provided after a predetermined time has elapsed since the positions of the user and a person other than the user are determined to be within the stereoscopic view possible range. The imaging method according to claim 16, wherein imaging of the parallax image of the user is executed by the following.

Images