JP2011209634A - Compound eye imaging apparatus and effective sound control method and program for compound eye imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly discriminate the parallax of a compound eye imaging apparatus by using not only visual sense but also hearing sense.SOLUTION: A compound eye camera 1 includes photographic units 21A and 21B imaging one and the same object from a plurality of visual points, to generate a plurality of visual point images; a three-dimensional processing unit 30 for adjusting the parallaxes of the plurality of visual point images and generating a stereoscopic viewing image, on the basis of the plurality of visual point images whose parallaxes are adjusted; a monitor 7 for displaying the generated stereoscopic viewing image; stereo speakers 33 for independently outputting effective sounds, respectively; and a CPU 35 for controlling the effective sounds output from the stereo speakers 33 on the basis of the adjusted parallaxes.

Description

  The present invention relates to a compound eye imaging apparatus, a sound effect control method for a compound eye imaging apparatus, and a program.

  Conventionally, a compound-eye imaging device that includes a plurality of imaging units and generates a stereoscopic image has been proposed. The compound-eye imaging device generates a stereoscopic image based on a plurality of viewpoint images respectively generated by a plurality of imaging units, and displays the stereoscopic image on a stereoscopic display monitor.

  The stereoscopic effect of the stereoscopic image captured by such a compound-eye imaging device depends on the distance between the user's eyes and the distance from the stereoscopic display monitor to the user. For this reason, there is a problem that individual differences are large in the stereoscopic function of the compound-eye imaging device.

  Therefore, in the compound-eye imaging device, the parallax of the plurality of viewpoint images can be adjusted according to the user's operation, thereby adjusting the stereoscopic effect of the stereoscopic image. However, it is difficult for the user to sensuously grasp the parallax adjustment amount only with the stereoscopic display monitor.

  Here, there is disclosed a camera capable of confirming a shooting mode by generating a sound of a tone corresponding to a mode when the mode is selected by a mode dial even when looking through the viewfinder (Patent Document 1). reference). Thereby, even when the user is looking through the viewfinder, the user can confirm the mode selected by the mode dial by listening to the sound.

  In addition, a digital camera that can easily determine a set mode and can easily change the mode is disclosed (Patent Document 2). The digital camera of Patent Document 2 displays information for specifying a mode on a display unit in a form that is easy to see for a certain period of time when the power is turned on or when the mode setting is changed.

JP 2006-154051 A JP 2005-117519 A

  However, even if the techniques described in Patent Documents 1 and 2 are used, the user can confirm each mode visually or visually, but what is the parallax of the compound-eye imaging device (increase or decrease). There is a problem that cannot be grasped). In addition, the user can check the parallax on the monitor of the compound eye imaging apparatus, but since the parallax cannot be confirmed except by vision, there is a problem that the parallax cannot be determined appropriately.

  The present invention has been proposed in view of such circumstances, and a compound-eye imaging device capable of appropriately discriminating parallax of a compound-eye imaging device using not only vision but also hearing, and sound effect control of a compound-eye imaging device An object is to provide a method and a program.

  The compound eye imaging device according to claim 1 is an imaging unit that generates a plurality of viewpoint images by imaging the same subject from a plurality of viewpoints, and a parallax between the plurality of viewpoint images generated by the imaging unit. Generated by the parallax adjusting means for adjusting, the stereoscopic image generating means for generating a stereoscopic image for stereoscopic viewing based on a plurality of viewpoint images whose parallax has been adjusted by the parallax adjusting means, and the stereoscopic image generating means From the pair of sound effect output means based on the parallax adjusted by the parallax adjusted by the display means for displaying the stereoscopic image, the pair of sound effect output means for outputting the sound effects independently, and the parallax adjustment means Sound effect control means for controlling the output sound effects.

  According to a second aspect of the present invention, in the compound eye imaging device according to the first aspect of the present invention, the compound eye imaging apparatus further includes a reception unit that receives an instruction operation for increasing or decreasing parallax, and the parallax adjustment unit performs the instruction operation received by the reception unit. The parallax is adjusted accordingly.

  According to a third aspect of the present invention, in the compound-eye imaging apparatus according to the second aspect, the sound effect control means is output from the pair of sound effect output means as the parallax adjusted by the parallax adjustment means increases. Increase or decrease the phase difference between sound effects.

  According to a fourth aspect of the present invention, in the compound-eye imaging apparatus according to the second aspect, the sound effect control means is output from the pair of sound effect output means as the parallax adjusted by the parallax adjustment means increases. Increase or decrease the volume of the sound effect.

  According to a fifth aspect of the present invention, in the compound-eye imaging apparatus according to the second aspect, the sound effect control means is output from the pair of sound effect output means as the parallax adjusted by the parallax adjustment means increases. Increase or decrease the pitch of the sound effect.

  According to a sixth aspect of the present invention, in the compound-eye imaging device according to any one of the first to fifth aspects, the vibration generating means that generates vibration and the parallax adjusted by the parallax adjusting means Vibration control means for controlling at least one of the intensity of vibration generated by the vibration generation means and the length of vibration.

  According to a seventh aspect of the present invention, in the compound eye imaging device according to the sixth aspect of the invention, the vibration control unit increases the vibration generated by the vibration generation unit as the parallax adjusted by the parallax adjustment unit increases. Weakly control.

  According to an eighth aspect of the present invention, in the compound-eye imaging device according to the sixth aspect, the vibration control means increases the time of vibration generated by the vibration generation means as the parallax adjusted by the parallax adjustment means increases. Control longer or shorter.

  The invention according to claim 9 is the compound-eye imaging device according to claim 1, wherein the parallax adjustment unit automatically adjusts the parallax of the plurality of viewpoint images so that the parallax according to the distance to the subject is obtained. The sound effect control means increases or decreases the phase difference between the sound effects respectively output from the pair of sound effect output means based on the parallax automatically adjusted by the parallax adjustment means.

  According to a tenth aspect of the present invention, in the compound eye imaging device according to the ninth aspect, the sound effect control means outputs a comparative sound effect corresponding to a case where an automatic parallax adjustment value is obtained to the pair of sound effect output means. Let

  In addition, this invention is realizable as a sound effect control method and program of a compound eye imaging device.

  According to the present invention, a plurality of viewpoint images are generated by capturing the same subject from a plurality of viewpoints, the parallax of the generated plurality of viewpoint images is adjusted, and based on the plurality of viewpoint images whose parallax has been adjusted. The stereoscopic image is generated, the generated stereoscopic image is displayed, and the sound effect output from each of the pair of sound effect output units is controlled based on the adjusted parallax. Not only the effect but also the auditory effect can be used to inform the user of the parallax being adjusted.

1 is a front perspective view of a compound eye camera according to an embodiment of the present invention. It is a back side perspective view of a compound eye camera. It is a schematic block diagram which shows the internal structure of a compound eye camera. It is a figure which shows the structure of an imaging | photography part. It is a figure which shows the file format of the image file for stereoscopic vision. It is a figure which shows the structure of a monitor. It is a figure which shows the structure of a lenticular sheet. It is a figure for demonstrating the three-dimensional process with respect to the 1st and 2nd image. It is a flowchart which shows a parallax adjustment routine. It is a figure which shows the change pattern of the phase difference of a stereo speaker with respect to parallax adjustment amount. It is a figure which shows the change pattern of the pitch of a stereo speaker with respect to parallax adjustment amount. It is a figure which shows the change pattern of the intensity | strength of the vibration with respect to parallax adjustment amount. It is a figure which shows the change pattern of the length of the vibration with respect to parallax adjustment amount. It is a flowchart which shows an automatic parallax adjustment routine. It is a figure which shows the change pattern of the phase of the pseudo surround with respect to the parallax at the time of automatic parallax adjustment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a front perspective view of a compound eye camera 1 according to an embodiment of the present invention, and FIG. 2 is a rear perspective view.

  A release button 2, a power button 3, and a zoom lever 4 are provided on the compound eye camera 1. In front of the compound-eye camera 1, the flash 5 and the lenses of the two photographing units 21A and 21B are disposed. A liquid crystal monitor (hereinafter simply referred to as “monitor”) 7 for performing various displays and various operation buttons 8 are disposed on the back of the compound-eye camera 1. Furthermore, as shown in FIG. 2, a parallax adjustment button 9 for adjusting the parallax according to the user's preference is provided on the back of the compound eye camera 1.

  FIG. 3 is a schematic block diagram showing the internal configuration of the compound eye camera 1. The compound eye camera 1 includes two photographing units 21A and 21B, a photographing control unit 22, an image processing unit 23, a compression / decompression processing unit 24, a frame memory 25, a media control unit 26, an internal memory 27, and a display control unit 28. . Note that the photographing units 21A and 21B are arranged so as to have a predetermined baseline length with a convergence angle at which the subject is viewed. Information on the convergence angle and the baseline length is stored in the internal memory 27.

  FIG. 4 is a diagram illustrating the configuration of the imaging units 21A and 21B. As shown in FIG. 4, the imaging units 21A and 21B include lenses 10A and 10B, apertures 11A and 11B, shutters 12A and 12B, image sensors 13A and 13B, analog front ends (AFE) 14A and 14B, and an A / D conversion unit 15A. , 15B.

  The lenses 10A and 10B have a plurality of functional lenses such as a focus lens for focusing on a subject and a zoom lens for realizing a zoom function. The positions of the lenses 10A and 10B are not determined based on the focusing data obtained by the AF processing unit 22a of the imaging control unit 22 and the zoom data obtained when the zoom lever 4 shown in FIGS. 1 and 2 is operated. It is adjusted by the lens driving unit shown in the figure.

  The apertures 11A and 11B are adjusted in aperture diameter by an unillustrated aperture driving unit based on aperture value data obtained by the AE processing unit 22b of the imaging control unit 22.

  The shutters 12A and 12B are mechanical shutters, and are driven by a shutter driving unit (not shown) according to the shutter speed obtained by the AE processing unit 22b.

  The imaging elements 13A and 13B have a photoelectric surface in which a large number of light receiving elements are two-dimensionally arranged, and subject light is imaged on the photoelectric surface and subjected to photoelectric conversion to obtain an analog photographing signal. In addition, color filters in which R, G, and B color filters are regularly arranged are disposed on the front surfaces of the image sensors 13A and 13B.

  The AFEs 14A and 14B remove noise from the analog shooting signal and adjust the gain of the analog shooting signal (hereinafter referred to as “analog processing”) for the analog shooting signals output from the image sensors 13A and 13B. Apply.

  The A / D converters 15A and 15B convert the analog photographing signals subjected to the analog processing by the AFEs 14A and 14B into digital signals. Note that an image represented by digital image data acquired by the photographing unit 21A is a first image G1, and an image represented by image data acquired by the photographing unit 21B is a second image G2.

  The imaging control unit 22 includes the AF processing unit 22a and the AE processing unit 22b as described above. When the release button 2 is pressed halfway, the AF processing unit 22a acquires distance measurement information from the distance measurement sensor, determines the focal positions of the lenses 10A and 10B, and outputs them to the photographing units 21A and 21B. The AE processing unit 22b determines an aperture value and a shutter speed based on the pre-image, and outputs them to the photographing units 21A and 21B.

  Note that the focus position detection method by the AF processing unit 22a is not limited to the active method using the distance measurement information, and a passive method that detects the in-focus position using the contrast of the image may be used.

  In a state where the release button 2 is not operated, the shooting control unit 22 displays a through image having a smaller number of pixels than the main images of the first and second images G1 and G2 for confirming the shooting range at a predetermined time interval ( For example, the photographing units 21A and 21B are controlled so as to be sequentially generated at an interval of 1/30 seconds. Then, when the release button 2 is fully pressed, the shooting control unit 22 causes the shooting units 21A and 21B to generate the main images of the first and second images G1 and G2 so as to start the main shooting. Control.

  The image processing unit 23 performs image processing such as white balance adjustment, gradation correction, sharpness correction, and color correction on the digital image data of the first and second images G1 and G2 acquired by the imaging units 21A and 21B. Apply processing.

  The compression / decompression processing unit 24 performs compression processing on the image data representing the main images of the first and second images G1 and G2 processed by the image processing unit 23, for example, in a compression format such as JPEG. Then, the stereoscopic image file F0 is generated. The stereoscopic image file F0 includes image data of the first and second images G1 and G2, and additional information such as a base line length, a convergence angle, and a shooting date and time based on the Exif format, And viewpoint information representing the viewpoint position.

  FIG. 5 is a diagram illustrating a file format of a stereoscopic image file. The stereoscopic image file F0 includes supplementary information H1 of the first image G1, viewpoint information S1 of the first image G1, image data of the first image G1, supplementary information H2 of the second image G2, and second information. The viewpoint information S2 of the second image G2 and the image data of the second image G2 are stored. Although not shown, information indicating the start position and end position of data is included before and after the supplementary information, viewpoint information, and image data for the first and second images G1 and G2.

  The incidental information H1 and H2 includes information on the shooting dates, baseline lengths, and convergence angles of the first and second images G1 and G2. The supplementary information H1 and H2 includes thumbnail images of the first and second images G1 and G2. As the viewpoint information, for example, the viewpoint position number assigned in order from the left photographing unit can be used.

  The frame memory 25 is used when performing various processes including the processes performed by the image processing unit 23 described above on the image data representing the first and second images G1 and G2 acquired by the photographing units 21A and 21B. This is a working memory.

  The media control unit 26 accesses the recording medium 29 to control writing and reading of image files and the like.

  The internal memory 27 stores various constants set in the compound-eye camera 1, programs executed by the CPU 35, and the like.

  The display control unit 28 causes the monitor 7 to display the stereoscopic image GR recorded in the frame memory 25 or the recording medium 29 when stereoscopically viewing.

  FIG. 6 is an exploded perspective view showing the configuration of the monitor 7. As shown in FIG. 6, the monitor 7 is configured by laminating a backlight unit 40 that emits light by an LED and a liquid crystal panel 41 for performing various displays, and attaching a lenticular sheet 42 to the surface of the liquid crystal panel 41. .

  FIG. 7 is a diagram showing the configuration of the lenticular sheet. As shown in FIG. 7, the lenticular sheet 42 is configured by arranging a plurality of cylindrical lenses 43 in parallel in a direction along the base line.

  The compound eye camera 1 includes a three-dimensional processing unit 30, a wide stereo circuit 31, an audio processing circuit 32, a pair of stereo speakers 33, a motor driver circuit 36, and a motor 37.

  The three-dimensional processing unit 30 performs a three-dimensional process on the first and second images G1 and G2 in order to stereoscopically display the first and second images G1 and G2 on the monitor 7, thereby providing a stereoscopic image. Generate a GR.

  FIG. 8 is a diagram for explaining a three-dimensional process for the first and second images G1 and G2. As shown in FIG. 8, the three-dimensional processing unit 30 cuts each of the first and second images G1 and G2 into a strip shape in a direction perpendicular to the base line, and positions each of the cylindrical lenses 43 on the lenticular sheet 42. A three-dimensional process is performed so that the first and second images G1 and G2 cut into strips corresponding to are alternately arranged to generate a stereoscopic image GR. The image pairs of the first and second images G1 and G2 constituting the stereoscopic image GR are respectively arranged corresponding to one cylindrical lens.

  The three-dimensional processing unit 30 automatically adjusts the parallax between the first and second images G1 and G2 based on distance measurement information (distance to the subject) used in the AF processing unit 22a (automatic parallax). Adjustment). Hereinafter, the parallax obtained by the automatic parallax adjustment is referred to as “automatic parallax adjustment value”.

  Here, the parallax is a shift in pixel position in the horizontal direction of the subject included in both the first and second images G1 and G2, that is, the direction along the base line, of the first and second images G1 and G2. Say quantity. Although the automatic parallax adjustment value is determined according to the distance to the subject, the stereoscopic effect of the subject included in the stereoscopic image GR can be made appropriate for each user by adjusting the parallax.

  For example, after the automatic parallax adjustment, the three-dimensional processing unit 30 adjusts the parallax between the first and second images G1 and G2 according to the parallax adjustment amount instructed by the parallax adjustment button 9 via the CPU 35. You can also. Note that the parallax adjustment amount refers to the amount of increase or decrease in parallax when the automatic parallax adjustment value is used as a reference.

  In addition, the three-dimensional processing unit 30 may adjust the parallax between the first and second images G1 and G2 obtained by the photographing units 21A and 21B in real time, or may be recorded in advance on the recording medium 29. The parallax between the first and second images G1 and G2 may be adjusted.

  The wide stereo circuit 31 generates a signal for generating pseudo surround (wide stereo) from the stereo speaker 33. The audio processing circuit 32 performs predetermined processing on the signal from the wide stereo circuit 31 and generates a pseudo surround from the stereo speaker 33. The stereo speaker 33 is composed of a pair of speakers, one speaker being installed on the right side of the compound eye camera 1 main body and the other on the left side of the compound eye camera 1 main body.

  The motor driver circuit 36 drives the motor 37 according to the control of the CPU 35. Here, a weight is biased and attached to the shaft tip of the motor 37, and vibration occurs when the motor 37 rotates. The intensity of vibration (rotation speed of the motor 37) and the length of vibration (rotation time of the motor 37) are controlled by the CPU 35 via the motor driver circuit 36.

[Pseudo-surround phase difference control]
In the compound eye camera 1 configured as described above, the parallax between the first and second images G1 and G2 is automatically adjusted, and the stereoscopic image GR is displayed on the monitor 7. However, the stereoscopic effect felt by each user from the stereoscopic image GR is greatly different. Therefore, when the user operates the parallax adjustment button 9, the following parallax adjustment routine is executed. The program for the parallax adjustment routine is stored in the internal memory 27 in advance. FIG. 9 is a flowchart showing a parallax adjustment routine.

  In step 100, the CPU 35 determines whether or not the parallax adjustment button 9 has been operated, and proceeds to step 102 when determining that the parallax adjustment button 9 has been operated.

  In step 102, the CPU 35 determines whether or not the stereoscopic effect is emphasized. If the stereoscopic effect is emphasized, the process proceeds to step 104. If not, the process proceeds to step 106. Here, when an instruction to increase the parallax adjustment amount is instructed by operating the parallax adjustment button 9, it is determined that the stereoscopic effect is enhanced, and when a decrease in the parallax adjustment amount is instructed, it is determined that the stereoscopic effect is not enhanced.

  In step 104, the CPU 35 controls the wide stereo circuit 31 so as to generate a sound effect signal in which the pseudo-surround phase difference is expanded by one step. Therefore, the sound effect signal generated by the wide stereo circuit 31 is supplied to the sound processing circuit 32, and the pseudo surround sound effect having a wide phase difference is output through the stereo speaker 33. Then, the process proceeds to Step 108.

  On the other hand, in step 106, the CPU 35 controls the wide stereo circuit 31 so as to generate a sound effect signal in which the pseudo-surround phase difference is narrowed by one step. For this reason, the sound effect signal generated by the wide stereo circuit 31 is supplied to the sound processing circuit 32, and the pseudo surround sound effect with a narrow phase difference is output via the stereo speaker 33. Then, the process proceeds to step 108.

  In step 108, the CPU 35 determines whether or not the parallax adjustment by the parallax adjustment button 9 has been completed. If it has been completed, the routine is terminated. If not, the process returns to step 102.

  FIG. 10 is a diagram illustrating a change pattern of the phase difference of the sound effect output from the stereo speaker 33 with respect to the parallax adjustment amount. This change pattern is an exponential curve in which the change in phase difference is small when the absolute value of the parallax adjustment amount is small, but the change in phase difference is large when the absolute value of the parallax adjustment amount is large. Note that the axis near the center of the horizontal axis in the figure is the automatic parallax adjustment value.

  As a result, while the parallax adjustment button 9 is instructed to increase the parallax adjustment amount, steps 102, 104, and 108 are repeatedly executed, and the phase difference of the pseudo surround increases. Further, while the parallax adjustment button 9 is instructed to reduce the parallax adjustment amount, steps 102, 106, and 108 are repeatedly executed, and the pseudo-surround phase difference is narrowed.

  As a result, the user can recognize the change in the phase difference of the pseudo surround while looking at the monitor 7 by using the stereo sound effect of the sound effect, and therefore appropriately determine how much the parallax adjustment amount is. Can do. In addition, since the phase difference with respect to the parallax adjustment amount does not change linearly but exponentially, even when the parallax adjustment amount is excessively large, the user can easily grasp that and the parallax adjustment is too strong. Or it can perceive too weak.

  For example, when the stereoscopic effect is emphasized, the pseudo-surround phase difference may be reduced, while when the stereoscopic effect is not emphasized, the pseudo-surround phase difference may be increased. Further, the phase difference with respect to the parallax adjustment amount may change linearly.

[Pseudo Surround Volume Control]
Further, the CPU 35 may control the wide stereo circuit 31 to change the volume of the sound effect instead of changing the phase difference of the pseudo surround as described above.

  For example, in step 104 shown in FIG. 9, the CPU 35 may control the wide stereo circuit 31 so as to generate a sound effect signal in which the pseudo surround sound volume is increased by one step. In step 106, the CPU 35 may control the wide stereo circuit 31 so as to generate a sound effect signal in which the pseudo surround sound volume is reduced by one step. In this case, the change pattern of the volume with respect to the parallax adjustment amount may use the same curve as in FIG. 10, and in this case, the volume may be used instead of the phase difference. Note that at the position of the automatic parallax adjustment value, an intermediate volume is obtained.

  Thereby, the user can recognize the change in the volume of the pseudo surround while looking at the monitor 7, and can appropriately determine how much the parallax adjustment amount is. Further, since the pitches of the left and right sound effects are shifted except for the automatic parallax adjustment value, the user can perceive that the parallax is too strong or too weak.

  Note that the present invention is not limited to the above-described example. For example, when emphasizing the stereoscopic effect, the volume of the pseudo surround sound may be reduced. On the other hand, when enhancing the stereoscopic effect, the sound volume of the pseudo surround sound may be increased. Further, the volume with respect to the parallax adjustment amount may change linearly.

[Pseudo surround pitch adjustment]
The CPU 35 may control the wide stereo circuit 31 to change the pitch of the sound effect instead of changing the phase difference or volume of the pseudo surround as described above.

  For example, in step 104 shown in FIG. 9, the CPU 35 may control the wide stereo circuit 31 so as to generate a sound effect signal in which the pseudo-surround pitch is increased by one step. In step 106, the CPU 35 may control the wide stereo circuit 31 so as to generate a sound effect signal in which the pseudo surround pitch is lowered by one step.

  FIG. 11 is a diagram illustrating a pitch change pattern with respect to the parallax adjustment amount. As shown in the figure, as the parallax adjustment amount increases, the right (R) and left (L) pitches of the stereo speaker 33 both increase (upward to the right), and the pitches coincide with each other with the automatic parallax adjustment value. However, when the parallax is smaller than the automatic parallax adjustment value, the right (R) pitch is higher, and when the parallax is larger than the automatic parallax adjustment value, the left (L) pitch is higher.

  Thus, the user can recognize the change in the pitch of the pseudo surround while looking at the monitor 7, and can appropriately determine how much the parallax adjustment amount is. However, the pitch change pattern is not limited to the pattern shown in FIG. For example, as the parallax increases, the right (R) and left (L) pitches of the stereo speaker 33 may be lowered (lower right), or the right (R) and left (L) slopes are switched. Also good.

[Adjustment of vibration intensity and length]
Further, the CPU 35 may control the vibration with respect to the parallax operation amount as follows by controlling the motor 37 at the same time as controlling the sound effect of the pseudo surround. FIG. 12 is a diagram illustrating the intensity of vibration with respect to the amount of parallax operation. According to the figure, the intensity of vibration increases linearly as the parallax adjustment amount increases. FIG. 13 is a diagram illustrating the vibration length with respect to the parallax operation amount. According to the figure, the length of the vibration decreases linearly as the parallax adjustment amount increases.

  Then, in the case of emphasizing the stereoscopic effect (when the amount of parallax operation increases), the CPU 35 increases the rotation speed of the motor 37 and extends the rotation time of the motor 37 via the motor driver circuit 36. Thereby, the vibration which arises in the compound eye camera 1 becomes strong, and vibration time becomes long.

  In addition, when the stereoscopic effect is not emphasized (when the amount of parallax operation is reduced), the CPU 35 decreases the rotation speed of the motor 37 and shortens the rotation time of the motor 37 via the motor driver circuit 36. Thereby, the vibration which arises in the compound eye camera 1 becomes weak, and vibration time becomes short. Note that the control target of the CPU 35 may be one of vibration intensity and length.

  As a result, the user can recognize the parallax adjustment amount by the strength and length of vibration. In addition, since the intensity and length of vibration transmitted to the hand changes, it is possible to make the user perceive that the parallax is too strong or too weak.

[Automatic parallax adjustment]
In automatic parallax adjustment, distance measurement information when performing autofocus in a half-pressed state is used, but the next automatic parallax adjustment routine may be executed using the distance measurement information. FIG. 14 is a flowchart showing an automatic parallax adjustment routine.

  In step 110, the CPU 35 controls the wide stereo circuit 31 so as to generate a signal for sounding the comparative long sound in pseudo-surround. The comparative long sound is a long sound whose pseudo-surround has a predetermined phase difference and has the same tone color and pitch, for example, a long sound of “pea”. Note that the phase difference of the pseudo-surround of the comparative long sound is the same as the phase difference of the sound effect when the in-focus position is detected (when the automatic adjustment parallax value is detected). Then, when a comparative long sound of “pea” sounds from the stereo speaker 33, the process proceeds to step 112.

  In step 112, the CPU 35 causes the AF processing unit 22a to execute autofocus processing and performs automatic parallax adjustment for automatically adjusting the parallax of the first and second images G1 and G2 based on distance measurement information in three dimensions. The processing is executed by the processing unit 30, and the process proceeds to step 114.

  In step 114, the CPU 35 controls the wide stereo circuit 31 so as to generate a focus sound effect signal by pseudo surround. Specifically, the CPU 35 controls the phase difference of the pseudo surround according to the change of the parallax during the automatic parallax adjustment. Here, a short focusing effect sound is generated, and when the in-focus position is detected, the focusing effect sound beeps with a comparative long sound. Then, this routine ends.

  FIG. 15 is a diagram illustrating a pseudo-surround phase difference with respect to parallax during automatic parallax adjustment. In this manner, during automatic parallax adjustment (AF processing), as the parallax increases, the pseudo-surround phase difference also increases linearly, and when the in-focus position is found, it beeps. Therefore, the user can perceive the automatic adjustment amount at the time of automatic parallax adjustment by the acoustic effect. The pseudo-surround phase control can be similarly applied not only during automatic parallax adjustment but also during manual parallax adjustment.

  In addition, this invention is not limited to embodiment mentioned above, It can apply also to what was changed in the design within the range of the matter described in the claim.

  For example, in each of the above-described embodiments, the three-dimensional processing unit 30 has adjusted the parallax between the first and second images G1 and G2, but the drive mechanism (not shown) has a distance (baseline length) or congestion between the imaging units 21A and 21B. The parallax may be adjusted by adjusting at least one of the corners.

7 Monitor 9 Parallax adjustment buttons 21A and 21B Imaging unit 22 Imaging control unit 22a AF processing unit 22b AE processing unit 30 Three-dimensional processing unit 31 Wide stereo circuit 32 Audio processing circuit 33 Stereo speaker 35 CPU
36 Motor driver circuit 37 Motor

Claims (12)

Imaging means for generating a plurality of viewpoint images by imaging the same subject from a plurality of viewpoints;
Parallax adjusting means for adjusting parallax of a plurality of viewpoint images generated by the imaging means;
Stereoscopic image generation means for generating a stereoscopic image for stereoscopic viewing based on a plurality of viewpoint images whose parallax has been adjusted by the parallax adjustment means;
Display means for displaying a stereoscopic image generated by the stereoscopic image generation means;
A pair of sound effect output means for outputting sound effects independently,
Sound effect control means for controlling the sound effects respectively output from the pair of sound effect output means based on the parallax adjusted by the parallax adjustment means;
A compound eye imaging device. A receiving unit that receives an instruction to increase or decrease the parallax;
The compound eye imaging apparatus according to claim 1, wherein the parallax adjusting unit adjusts the parallax according to an instruction operation received by the receiving unit. The compound eye imaging according to claim 2, wherein the sound effect control means increases or decreases a phase difference between sound effects respectively output from the pair of sound effect output means as the parallax adjusted by the parallax adjustment means increases. apparatus. The compound-eye imaging device according to claim 2, wherein the sound effect control means increases or decreases the volume of the sound effect output from the pair of sound effect output means as the parallax adjusted by the parallax adjustment means increases. . The compound-eye imaging apparatus according to claim 2, wherein the sound effect control means increases or decreases the pitch of the sound effects respectively output from the pair of sound effect output means as the parallax adjusted by the parallax adjustment means increases. . Vibration generating means for generating vibration;
Vibration control means for controlling at least one of the strength of vibration generated by the vibration generating means and the length of vibration based on the parallax adjusted by the parallax adjusting means;
The compound eye imaging device according to any one of claims 1 to 5, further comprising: The compound eye imaging apparatus according to claim 6, wherein the vibration control unit controls the vibration generated by the vibration generation unit to be stronger or weaker as the parallax adjusted by the parallax adjustment unit becomes larger. The compound eye imaging apparatus according to claim 6, wherein the vibration control unit controls the vibration time generated by the vibration generation unit to be longer or shorter as the parallax adjusted by the parallax adjustment unit becomes larger. The parallax adjusting means automatically adjusts the parallax of the plurality of viewpoint images so that the parallax according to the distance to the subject is obtained.
The compound eye imaging according to claim 1, wherein the sound effect control means increases or decreases a phase difference between sound effects respectively output from the pair of sound effect output means based on the parallax that is automatically adjusted by the parallax adjustment means. apparatus. The compound-eye imaging device according to claim 9, wherein the sound effect control unit causes the pair of sound effect output units to output a comparative sound effect corresponding to a case where an automatic parallax adjustment value is obtained. Generate multiple viewpoint images by capturing the same subject from multiple viewpoints,
Adjusting the parallax of the generated viewpoint images,
Generating a stereoscopic image based on a plurality of viewpoint images with the parallax adjusted;
Displaying the generated stereoscopic image;
A sound effect control method for a compound eye imaging apparatus, wherein sound effects respectively output from a pair of sound effect output means are controlled based on the adjusted parallax. Computer
Parallax adjusting means for adjusting parallax of a plurality of viewpoint images generated by an imaging means that images the same subject from a plurality of viewpoints;
Stereoscopic image generation means for generating a stereoscopic image based on a plurality of viewpoint images whose parallax has been adjusted by the parallax adjustment means;
Display control means for controlling the display means to display the stereoscopic image generated by the stereoscopic image generation means; and
Based on the parallax adjusted by the parallax adjusting means, sound effect control means for controlling the sound effects respectively output from the pair of sound effect output means;
The sound effect control program of the imaging apparatus for functioning as

Images