JP5087027B2 - Compound eye imaging device - Google Patents

Description

  The present invention relates to a compound eye imaging device, and more particularly to a compound eye imaging device capable of photographing at an arbitrary timing.

  In Patent Document 1, two imaging devices are connected, one of which functions as a master and the other as a slave. There has been proposed an imaging apparatus capable of interlocking a plurality of imaging apparatuses by transferring captured image data with an identification number to a master memory after image capturing and storing them collectively.

  In Patent Document 2, a plurality of cameras are connected in cascade, one master camera is set, and another camera (slave camera) is operated in synchronization with the master camera, or any slave camera is selected from the master camera An imaging apparatus that can be operated automatically has been proposed.

JP 2005-148090 A JP 2005-39409 A

  However, in the imaging devices described in Patent Document 1 and Patent Document 2, the slave camera operates after receiving a shutter synchronization signal from the master camera. Therefore, a delay corresponding to “receive and operate” occurs in the slave camera, and it is not possible to match the exposure start and end timings of the master camera and the slave camera.

  Further, in the photographing operation using the mechanical shutter, a time difference (hereinafter referred to as mechanical delay) from when the drive signal is input to when the mechanical shutter operates is generated. Since the mechanical error of the mechanical shutter is different for each imaging device, even in the imaging devices described in Patent Literature 1 and Patent Literature 2, even if the drive is completely synchronized, the timing of the end of exposure due to the difference in mechanical delay is determined. Cannot match.

  For this reason, for example, when shooting a fast-moving subject, even if the parallax or the like is optimally adjusted, it can be normally viewed as a stereoscopic image because the position of the shot subject varies from camera to camera. There is a problem that you can not.

  Also, for subjects that are relatively stationary or when the exposure time is long, it is not so important to match the timing of the start and end of exposure, because the battery voltage drop due to simultaneous mechanical shutter operation, noise superposition due to voltage fluctuations In order to avoid the influence of the above, control for intentionally shifting the mechanical shutter drive pulse should be performed. However, Patent Document 1 and Patent Document 2 do not describe control for avoiding mechanical shutter drive pulse duplication.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a compound eye imaging apparatus capable of controlling exposure of the left and right imaging systems at an arbitrary timing.

In order to achieve the above object, an invention according to one aspect of the present invention provides an image sensor that converts incident light into a charge corresponding to the amount of light and accumulates it as a signal charge, and a mechanical incident light path to the image sensor. A plurality of image pickup means each comprising a mechanical shutter that can be shielded and opened, and provided for each of the image pickup devices, and controls a start point of charge accumulation in the image pickup device based on an input charge discharge pulse. A plurality of electronic shutter means for starting exposure and mechanical shutter driving means provided for each of the mechanical shutters for driving the mechanical shutter, and closing the mechanical shutter on the basis of a shutter closing operation signal inputted thereto for exposure. The plurality of mechanical shutter driving means to be terminated and the charge to the plurality of electronic shutter means at arbitrary timings, respectively. Out output and the electronic shutter control means capable of pulses, a mechanical shutter control means capable of outputting of the shutter closing operation signal at an arbitrary timing respectively for the plurality of mechanical shutter driving means, the mechanical shutter control unit shutter closing operation A storage unit that stores, for each mechanical shutter, a mechanical delay that is a time difference from when a signal is output until the corresponding mechanical shutter is closed, and the electronic shutter control unit starts exposure of the plurality of image sensors simultaneously. In this way, each charge discharge pulse is output at the same timing, and the mechanical shutter control means outputs each shutter closing operation signal at an earlier timing by a mechanical delay for each mechanical shutter so that exposure with the plurality of imaging elements is simultaneously completed. Is output to the corresponding mechanical shutter means .

According to one aspect of the present invention , since the charge discharge pulse can be output to each of the plurality of image sensors at an arbitrary timing, exposure of the plurality of image sensors can be started at an arbitrary timing. In addition, by closing each of the plurality of mechanical shutters at an arbitrary timing, the exposure of the plurality of imaging elements can be ended at an arbitrary timing. Thereby, the imaging start timings and imaging end timings of the plurality of imaging units can be matched, and the mechanical shutter drive timings can be prevented from overlapping.

Further , according to one aspect of the present invention, by outputting each charge discharge pulse at the same timing, exposure of a plurality of image sensors is started simultaneously, and each shutter is closed at an earlier timing by the mechanical delay for each mechanical shutter. By outputting the operation signal to the corresponding mechanical shutter means, the plurality of mechanical shutters are closed at the same time, and the exposure of the plurality of image sensors is simultaneously ended. Thereby, the imaging start timing and the imaging end timing of the plurality of image sensors can be completely matched.

The invention according to another aspect of the present invention includes an image sensor that converts incident light into electric charge corresponding to the amount of light and accumulates it as signal charge, and a mechanical shutter that can mechanically shield and open the incident optical path to the image sensor. And a plurality of image pickup means each configured as described above, and exposure is started by controlling the start point of charge accumulation in the image pickup device based on charge discharge pulses respectively input to the image pickup device. A plurality of electronic shutter means and a mechanical shutter driving means provided for each of the mechanical shutters for driving the mechanical shutter, and a plurality of mechanical shutter driving means for closing the mechanical shutter and ending the exposure based on the input shutter closing operation signals. The charge discharge pulse can be output to the plurality of electronic shutter means at an arbitrary timing. A sub shutter control means and a mechanical shutter control means capable of outputting the shutter closing operation signal at an arbitrary timing to each of the plurality of mechanical shutter driving means, and the electronic shutter control means The charge discharge pulses are output at different timings so that the exposure start points of the plurality of image sensors deviate by a predetermined time longer than an output time, and the mechanical shutter control means is configured to output the plurality of image sensors for the predetermined time. Each shutter closing operation signal is output at a different timing so that the end point of the exposure is shifted.

According to another aspect of the present invention, the start times of exposure of the plurality of image sensors are shifted by a predetermined time (a time longer than the output time of the shutter closing operation signal) by outputting each charge discharge pulse at different timings, By outputting the shutter closing operation signals at different timings, the end points of exposure of the plurality of image sensors are shifted by a predetermined time. Thereby, it is possible to avoid the influence of noise superimposition due to the battery voltage drop and voltage fluctuation caused by the simultaneous operation of the mechanical shutter.

The invention according to another aspect of the present invention includes a storage unit that stores, for each mechanical shutter, a mechanical delay that is a time difference from when the mechanical shutter control unit outputs a shutter closing operation signal to when the corresponding mechanical shutter closes. The mechanical shutter control means outputs each shutter closing operation signal to the corresponding mechanical shutter means at an earlier timing by the mechanical delay of each mechanical shutter so that the charge accumulation times in the plurality of imaging devices are the same. And

According to another aspect of the present invention, the start times of exposure of the plurality of image sensors are shifted by a predetermined time (a time longer than the output time of the shutter closing operation signal) by outputting each charge discharge pulse at different timings, After the exposure time has elapsed from the start of exposure of each image sensor, each shutter closing operation signal is output to the corresponding mechanical shutter means at an earlier timing by the mechanical delay for each mechanical shutter. Thereby, the exposure time of each image pick-up element can be made to correspond completely.

In the invention according to another aspect of the present invention, the mechanical shutter control unit outputs each charge discharge pulse at the same timing so that the plurality of image sensors start exposure at the same time, and the plurality of image sensors finish the exposure at the same time. As described above, the mechanical shutter control means outputs the shutter closing operation signals to the corresponding mechanical shutter means, or the exposure of the plurality of image sensors is performed for a predetermined time longer than the output time of the shutter closing operation signals. The electronic shutter control means outputs the charge discharge pulses at different timings so that the start time points are shifted, and the mechanical shutter control means closes the shutters so that the exposure end points of the plurality of image sensors are shifted by the predetermined time. The electronic shutter control means and the mechanical shutter are in a second drive mode that outputs operation signals at different timings. Characterized by comprising a control means for controlling the control means.

According to another aspect of the present invention, a first drive mode in which exposure disclosure of a plurality of image sensors and exposure end are simultaneously performed (drive timings of a plurality of mechanical shutters overlap), or exposure of a plurality of image sensors for a predetermined time. The plurality of image pickup means are driven in the second drive mode in which the end point of is shifted (the drive timings of the plurality of mechanical shutters do not overlap). In the second drive mode in which the drive timings of the plurality of mechanical shutters do not overlap, it is possible to avoid the influence of noise superimposition due to battery voltage drop and voltage fluctuation caused by the simultaneous operation of the mechanical shutter.

The invention according to another aspect of the present invention is directed to an extraction unit that extracts a motion of a subject from a plurality of images taken at different times by at least one of the plurality of imaging units, and a subject extracted by the extraction unit. First determination means for determining whether or not the movement of the subject is faster than a predetermined speed based on the movement, and the control means causes the movement of the subject to be faster than the predetermined speed by the first determination means. If not, the electronic shutter unit and the mechanical shutter driving unit are driven in the second driving mode.

According to another aspect of the present invention, the first shooting mode and the second drive mode are switched based on the movement of the subject extracted from the plurality of images, and it is determined that the movement of the subject is faster than a predetermined speed. If not, the second drive mode is used for driving. As a result, when the movement of the subject is small and there is no problem even if the exposure timing is shifted, the influence of noise superposition due to the battery voltage drop and voltage fluctuation caused by the simultaneous operation of the mechanical shutter can be avoided by shifting the exposure timing. In addition, in the case of a high-speed subject, it is possible to automatically perform switching without giving the user priority to the simultaneity between the imaging means, and otherwise to give priority to noise and power.

The invention according to another aspect of the present invention is characterized in that the plurality of images are live view images.

The invention according to another aspect of the present invention is calculated by a metering unit for metering subject luminance, a calculation unit for calculating a shutter speed so as to obtain an appropriate exposure according to the metered subject luminance, and the calculation unit. Second determining means for determining whether or not the shutter speed is faster than a predetermined threshold value, and the control means is not judged by the second determining means that the shutter speed is faster than the predetermined threshold value. Is characterized in that the electronic shutter means and the mechanical shutter drive means are driven in the second drive mode.

According to another aspect of the present invention, the first photographing mode and the second drive mode are switched based on the shutter speed, and when it is not determined that the shutter speed is faster than a predetermined threshold, the second Drive in the drive mode. Thereby, if the shutter speed is sufficiently long and there is no problem even if the exposure timing is shifted, the influence of noise superposition due to the battery voltage drop and voltage fluctuation caused by the simultaneous operation of the mechanical shutter can be avoided by shifting the exposure timing. In particular, the noise reduction effect is high when the exposure time is long, that is, the subject is likely to have high sensitivity. In addition, when the exposure time is long, priority is given to the synchronism between the imaging means (the shooting start timing and the shooting end timing are substantially the same), and if not, the user switches the priority to give priority to noise and power. It can be done automatically without doing it.

The invention according to another aspect of the present invention is directed to a battery that supplies power to the compound eye imaging device, a detection unit that detects a remaining amount of the battery, and a remaining amount detected by the detection unit includes a plurality of the mechanical shutters. And a third determining unit that determines whether or not the values are operable at the same time, and the control unit determines that the third determining unit cannot simultaneously drive the plurality of mechanical shutters. The electronic shutter unit and the mechanical shutter driving unit are driven in the second driving mode.

According to another aspect of the present invention, when the first photographing mode and the second driving mode are switched based on the remaining battery level and it is determined that the remaining battery level is such that the plurality of mechanical shutters cannot be driven simultaneously, Drive in the second drive mode. Thereby, when the battery remaining amount is low and the simultaneous operation of the mechanical shutter is not possible, the influence of noise superposition due to the battery voltage drop and voltage fluctuation can be avoided by shifting the exposure timing. You can also use the battery to the limit. Also, when the remaining battery level is sufficient, priority is given to simultaneity between the imaging means (shooting start timing and shooting end timing should be substantially the same), otherwise noise and power are given priority. It can be done automatically without the user.

  According to the present invention, the left and right imaging systems can be subjected to exposure control at an arbitrary timing.

1 is a front view of a compound-eye digital camera 1 according to a first embodiment of the present invention. 2 is a rear view of the compound-eye digital camera 1. FIG. 2 is a block diagram illustrating an internal configuration of the compound-eye digital camera 1. FIG. It is a figure explaining a mechanical delay. 3 is a flowchart showing a flow of processing for storing a mechanical delay parameter of the compound-eye digital camera 1 in a ROM 102. 6 is a timing chart showing pulse application timings of the right imaging system 11 and the left imaging system 12 when the exposure times of the right imaging system 11 and the left imaging system 12 of the compound-eye digital camera 1 are matched. It is a block diagram which shows the internal structure of the compound-eye digital camera 2 which concerns on the 2nd Embodiment of this invention. In the compound eye digital camera 2, a flowchart showing a flow of processing for switching between applying the mechanical shutter drive pulses of the right imaging system 11 and the left imaging system 12 substantially simultaneously or intentionally shifted according to the movement of the subject. is there. 4 is a timing chart showing pulse application timings when photographing in the complete synchronization mode in the compound-eye digital camera 2. 5 is a timing chart showing pulse application timings when photographing is performed in the exposure time shifting mode in the compound-eye digital camera 2. 6 is a flowchart showing a flow of processing in the compound-eye digital camera 2 for switching between applying the mechanical shutter drive pulses of the right imaging system 11 and the left imaging system 12 substantially simultaneously or intentionally shifted in accordance with the shutter speed. . In the compound-eye digital camera 2, a flowchart showing a flow of processing for switching between applying the mechanical shutter drive pulses of the right imaging system 11 and the left imaging system 12 substantially simultaneously or intentionally shifted in accordance with the remaining battery level. is there.

  The best mode for carrying out a compound eye imaging apparatus according to the present invention will be described below in detail with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 is a diagram of the compound-eye digital camera 1 viewed from the front, and FIG. 2 is a diagram of the compound-eye digital camera 1 viewed from the back. The compound-eye digital camera 1 is a compound-eye digital camera 1 having a plurality of imaging systems (two are illustrated in FIG. 1), and a stereoscopic image of the same subject viewed from a plurality of viewpoints (two viewpoints on the left and right are illustrated in FIG. 1). Can be taken. The compound-eye digital camera 1 can shoot not only a stereoscopic image but also a single viewpoint image (two-dimensional image), and can record and reproduce moving images, still images, and audio.

  The camera body 10 of the compound-eye digital camera 1 is formed in a substantially rectangular parallelepiped box shape, and as shown in FIG. 1, a right imaging system 11, a left imaging system 12, a flash 13 and the like are mainly provided on the front surface. It has been. A release switch 20 and the like are provided on the upper surface of the camera body 10.

  On the other hand, on the back of the camera body 10, as shown in FIG. 2, a monitor 14, a zoom button 21, a playback button 22, a function button 23, a cross button 24, a MENU / OK button 25, a DISP button 26, a BACK button 27, etc. Is provided.

  The right imaging system 11 that captures an image for the right eye and the left imaging system 12 that captures an image for the left eye include a collapsible zoom lens, and the lens optical axes are parallel to each other or have a predetermined angle. Are arranged side by side. When the compound-eye digital camera 1 is turned on, a cover (not shown) disposed on the front surfaces of the right imaging system 11 and the left imaging system 12 is opened, so that subject light is emitted to the right imaging system 11 and the left imaging system 12. Incident.

  The flash 13 is composed of a xenon tube, and emits light as necessary when photographing a dark subject or when backlit.

  The monitor 14 is a parallax barrier type or lenticular lens type 3D monitor having a general aspect ratio of 4: 3 and capable of color display, and serves as a photographer interface display panel when performing various setting operations. It is used as an electronic viewfinder at the time of image shooting, and three-dimensional display of image data obtained by shooting is performed at the time of image reproduction. The configuration of the monitor 14 is not necessarily limited to a parallax method using a slit array sheet or a lenticular method using a lenticular lens sheet. An integral photography method using a microlens array sheet, a holography method using an interference phenomenon, or the like. May be adopted.

  The release switch 20 is constituted by a two-stage stroke type switch composed of so-called “half-press” and “full-press”. When the compound-eye digital camera 1 shoots a still image (for example, when a still image shooting mode is selected from the menu), when the release switch 20 is pressed halfway, a shooting preparation process is performed, that is, AE (Automatic Exposure), AF (Auto Focus). : Automatic focusing) and AWB (Automatic White Balance) processing, and when fully pressed, image capturing / recording processing is performed. Also, during movie shooting (for example, when a movie shooting mode is selected from the menu), when the release switch 20 is fully pressed, shooting of the movie is started, and when it is fully pressed again, shooting is terminated. Depending on the setting, it is also possible to shoot a moving image while the release switch 20 is fully pressed, and to stop shooting when the full press is released. A shutter button dedicated to still image shooting and a shutter button dedicated to moving image shooting may be provided.

  The zoom button 21 is used for a zoom operation of the right imaging system 11 and the left imaging system 12, and includes a zoom tele button 21T for instructing zooming to the telephoto side and a zoom wide button 21W for instructing zooming to the wide angle side. Has been.

  The playback button 22 is used for an instruction to switch to the playback mode. That is, the digital camera 1 is switched to the playback mode when the playback button 22 is pressed during shooting. When the playback button 22 is pressed while the power is off, the digital camera 1 is activated in the playback mode.

  The function button 23 is used to call up various setting screens for shooting and playback functions. That is, when this function button 23 is pressed during shooting, a setting screen for image size (number of recorded pixels), sensitivity, etc. is displayed on the monitor 14, and when this function button 23 is pressed during playback, the image is erased on the monitor 14. A print reservation (DPOF) setting screen is displayed.

  The cross button 24 is a button for setting, selecting, or zooming various menus, and is provided so that it can be pressed in four directions, up, down, left, and right. The buttons in each direction correspond to the setting state of the camera. A function is assigned. For example, at the time of shooting, a function for switching on / off of the macro function is assigned to the left button, and a function for switching the strobe mode is assigned to the right button. In addition, a function for changing the brightness of the monitor 14 is assigned to the upper button, and a function for switching ON / OFF of the self-timer is assigned to the lower button. During playback, a frame advance function is assigned to the right button, and a frame return function is assigned to the left button. Also, a function for changing the brightness of the monitor 14 is assigned to the upper button, and a function for deleting the image being reproduced is assigned to the lower button. Further, at the time of various settings, a function for moving the cursor displayed on the monitor 14 in the direction of each button is assigned.

  The MENU / OK button 25 is used for calling up a menu screen (MENU function), as well as for confirming selection contents, executing instructions for processing (OK function), and assigned according to the setting state of the compound-eye digital camera 1. The function is switched. On the menu screen, for example, all adjustment items that the compound-eye digital camera 1 has such as image quality adjustment such as exposure value, hue, ISO sensitivity, number of recorded pixels, self-timer setting, photometry switching, and whether or not to use digital zoom Is set. The compound-eye digital camera 1 operates according to the conditions set on this menu screen.

  The DISP button 26 functions as a button for instructing display switching of the monitor 14, and when the DISP button 26 is pressed during photographing, the display of the monitor 14 is switched from ON to framing guide display to OFF. Further, when the DISP button 26 is pressed during reproduction, normal reproduction → character reproduction without character display → multi reproduction is switched.

  The BACK button 27 functions as a button for instructing to cancel the input operation or return to the previous operation state.

  FIG. 3 is a block diagram showing the internal configuration of the compound-eye digital camera 1. The compound-eye digital camera 1 mainly includes a CPU 100, an operation unit (cross button 24, MENU / OK button 25, release switch 20, etc.) 101, ROM 102, DRAM 103, AE / AWB detection circuit 104, AF detection circuit 105, clock generator 106, Power supply unit 107, lens groups 111 and 121, image sensors 112 and 122, CDS / AMP / AD converters 113 and 123, lens drive units 114 and 124, image sensor drive units 115 and 125, timing generator (TG) 130, image Input controller 131, image signal processing unit 132, stereoscopic image signal processing unit 133, compression / decompression processing unit 134, video encoder 135, media recording control unit 136, recording medium 137, stereo microphone amplifier 138, sound input processing unit 139, sound output Processing unit 1 0 to consist of.

  The CPU 100 comprehensively controls the overall operation of the compound-eye digital camera 1. The CPU 100 includes a memory area for storing various control programs and setting information. The CPU 100 controls the operations of the right imaging system 11 and the left imaging system 12. The right imaging system 11 and the left imaging system 12 basically operate in conjunction with each other, but can be operated individually.

  The ROM 102 stores firmware, which is a control program executed by the CPU 100, various data necessary for control, camera setting values, captured image data, and the like. The ROM 102 stores mechanical delay parameters (described later) of the right mechanical shutter 111d and the left mechanical shutter 121d.

  The DRAM 103 is used as a work area for the CPU 100 and also as a temporary storage area for image data.

  The AE / AWB detection circuit 104 calculates a physical quantity necessary for AE control and AWB control from the input image signal in accordance with a command from the CPU 100. For example, as a physical quantity required for AE control, one screen is divided into a plurality of areas (for example, 16 × 16), and an integrated value of R, G, and B image signals is calculated for each divided area. The CPU 100 detects the brightness of the subject (subject brightness) based on the integrated value obtained from the AE / AWB detection circuit 104, and calculates an exposure value (shooting EV value) suitable for shooting. Then, an aperture value and a shutter speed are determined from the calculated shooting EV value and a predetermined program diagram. Further, as a physical quantity necessary for AWB control, one screen is divided into a plurality of areas (for example, 16 × 16), and an average integrated value for each color of R, G, and B image signals is calculated for each divided area. . The CPU 100 obtains the ratio of R / G and B / G for each divided area from the obtained R accumulated value, B accumulated value, and G accumulated value, and R of the obtained R / G and B / G values. The light source type is discriminated based on the distribution in the color space of / G and B / G. Then, according to the white balance adjustment value suitable for the determined light source type, for example, the value of each ratio is approximately 1 (that is, the RGB integration ratio is R: G: B≈1: 1: 1 in one screen). Then, a gain value (white balance correction value) for the R, G, and B signals of the white balance adjustment circuit is determined.

  The AF detection circuit 105 calculates a physical quantity necessary for AF control from the input image signal in accordance with a command from the CPU 100. The AF detection circuit 105 performs AF control based on the right imaging system AF control circuit that performs AF control based on the image signal input from the right imaging system 11 and the image signal input from the left and left imaging systems 12. The left imaging system AF control circuit. In the digital camera 1 of the present embodiment, AF control is performed based on the contrast of the images obtained from the image sensors 112 and 122 (so-called contrast AF), and the AF detection circuit 105 determines the sharpness of the image from the input image signal. The focus evaluation value shown is calculated. The CPU 100 detects a position where the focus evaluation value calculated by the AF detection circuit 105 is maximized, and moves the focus lens group to that position. That is, the focus lens group is moved from the closest distance to infinity in a predetermined step, the focus evaluation value is obtained at each position, and the position where the obtained focus evaluation value is the maximum is set as the in-focus position, and the focus lens group is at that position. Move.

  The clock generator 106 includes a resonance circuit and an amplifier, and supplies a timing signal to each component including the CPU 100. Thereby, operation | movement of each component is synchronized.

  The power supply unit 107 mainly includes a battery and a power supply control circuit. The power control circuit supplies power only from the battery to the CPU 100 when the digital camera 1 is not turned on in order to suppress the power consumption of the battery, and from the battery when the digital camera 1 is turned on. Control is performed so that power is supplied to each block.

  The lens group 111, the image sensor 112, the CDS / AMP / AD conversion unit 113, the lens driving unit 114, and the image sensor driving unit 115 constitute the right imaging system 11, and the lens group 121, the image sensor 122, and CDS / AMP / AD conversion. The unit 123, the lens driving unit 124, and the image sensor driving unit 125 constitute the left imaging system 12. Since the right imaging system 11 and the left imaging system 12 have the same configuration, only the right imaging system 11 will be described below, and the description of the left imaging system 12 will be omitted.

  The lens group 111 includes a zoom lens 111a, a diaphragm 111b, a focus lens 111c, and a mechanical shutter 111d arranged along the lens optical axis.

  When the zoom lens 111a is driven by the zoom motor of the lens driving unit 114, the zoom lens 111a moves back and forth on the optical axis to change the focal length.

  When the focus lens 111c is driven by the focus motor of the lens driving unit 114, the focus lens 111c moves back and forth on the optical axis to change the focal position.

  The diaphragm 111b is driven by the iris motor of the lens driving unit 114, thereby changing the opening amount thereof and adjusting the amount of light incident on the image sensor 112.

  The mechanical shutter 111d opens and closes when driven by the shutter motor of the lens driving unit 114, and performs exposure / shading to the image sensor 112.

  The image sensor 112 is a CCD type or CMOS type image sensor, receives subject light imaged by a zoom lens, a diaphragm, and a focus lens, and accumulates photocharges corresponding to the amount of received light in the light receiving element. In the photocharge accumulation / transfer operations of the image sensors 112 and 122, the electronic shutter speed (photocharge accumulation time) is determined based on the charge discharge pulses input from the image sensor drive units 115 and 125, respectively.

  That is, when a charge discharge pulse is input to the image sensors 112 and 122, charges are discharged without being stored in the image sensors 112 and 122. On the other hand, when no charge discharge pulse is input to the image sensors 112 and 122, charges are not discharged, and charge accumulation, that is, exposure is started in the image sensors 112 and 122. The imaging signals acquired by the imaging elements 112 and 122 are output to the CDS / AMP / AD conversion unit 113 based on the driving pulse given from the imaging element driving unit 115.

  The CDS / AMP / AD conversion unit 113 is for the purpose of reducing correlated double sampling processing (noise (particularly thermal noise) included in the output signal of the image sensor) and the like for the image signal output from the image sensor 112. , Processing to obtain accurate pixel data by taking the difference between the feed-through component level and the pixel signal component level included in the output signal for each pixel of the image sensor, and amplifying the analog signals of R, G, and B The image signal is generated. Then, R, G, and B analog image signals are converted into digital image signals.

  The TG 130 mainly includes a right imaging system shutter signal generation unit 130a, a left imaging system shutter signal generation unit 130b, a right imaging system imaging signal generation unit 130c, and a left imaging system imaging signal generation unit 130d.

  The right imaging system shutter signal generation unit 130a outputs a mechanical shutter driving pulse (referred to as a driving pulse for closing the mechanical shutter) to the shutter motor of the lens driving unit 114, and the left imaging system shutter signal generation unit 130b outputs the mechanical shutter driving pulse. Output to the shutter motor of the lens driving unit 124. A control line for outputting a mechanical shutter drive pulse from the right imaging system shutter signal generation unit 130a to the lens driving unit 114 is separate from a control line for outputting a mechanical shutter driving pulse from the left imaging system shutter signal generation unit 130b to the lens driving unit 124. is there. Therefore, the mechanical shutter 111d and the mechanical shutter 121d can be operated substantially simultaneously or at different timings.

  The right imaging system imaging signal generation unit 130 c outputs a clock and a synchronization signal to the imaging device 112 to the imaging device driving unit 115. The left imaging system imaging signal generation unit 130d outputs a clock and a synchronization signal to the imaging device 122 to the imaging device driving unit 125. A control line that outputs a clock and a synchronization signal from the right imaging system imaging signal generation unit 130c and a control line that outputs a clock and a synchronization signal from the left imaging system imaging signal generation unit 130d to the imaging device driving unit 125. Is different. Therefore, exposure control of the image sensor 112 and the image sensor 122 can be performed at arbitrary timings, respectively.

  The image input controller 131 has a built-in line buffer with a predetermined capacity, accumulates an image signal for one image output from the CDS / AMP / AD converter 113 in accordance with a command from the CPU 100, and records it in the DRAM 103. .

  The image signal processing unit 132 is a synchronization circuit (a processing circuit that converts a color signal into a simultaneous expression by interpolating a spatial shift of the color signal associated with a color filter array of a single CCD), a white balance correction circuit, and a gamma correction. Circuit, contour correction circuit, luminance / color difference signal generation circuit, etc., and according to a command from the CPU 100, the input image signal is subjected to necessary signal processing to obtain luminance data (Y data) and color difference data (Cr, Cb data). ) Is generated.

  The stereoscopic image signal processing unit 133 combines the two image data obtained by the right imaging system 11 and the left imaging system 12 to generate stereoscopic image data.

  The compression / decompression processing unit 134 performs compression processing in a predetermined format on the input image data in accordance with a command from the CPU 100 to generate compressed image data. Further, in accordance with a command from the CPU 100, the input compressed image data is subjected to a decompression process in a predetermined format to generate non-compressed image data.

  The video encoder 135 controls display on the monitor 14. That is, the image signal stored in the recording medium 137 or the like is converted into a video signal (for example, an NTSC signal, a PAL signal, or a SCAM signal) for display on the monitor 14 and output to the monitor 14. Are output to the monitor 14.

  The media recording control unit 136 records each image data compressed by the compression / decompression processing unit 134 on the recording medium 137.

  The recording medium 137 includes an xD picture card (registered trademark) detachably attached to the compound-eye digital camera 1, a semiconductor memory card represented by smart media (registered trademark), a portable small hard disk, a magnetic disk, an optical disk, a magneto-optical disk, etc. Various recording media.

  The sound input processing unit 139 receives an audio signal input to the stereo microphone 16 and amplified by the stereo microphone amplifier 138, and performs an encoding process on the audio signal.

  The sound output processing unit 140 performs output signal generation processing for the speaker 15.

  The operation of the compound eye digital camera 1 configured as described above will be described. First, in manufacturing the compound-eye digital camera 1 according to the present invention (for example, an inspection process), in order to make the exposure time of the right imaging system 11 and the exposure time of the left imaging system 12 coincide with each other, the mechanical delay parameter of each imaging system is set. Save in the ROM 102.

  First, the relationship between mechanical delay and exposure time will be described. As shown in FIG. 4, the exposure time of the image sensor 112 of the right imaging system 11 is such that the output of the charge discharge pulse from the image sensor drive unit 115 stops and the charge discharge pulse is no longer input to the image sensor 112. Is defined as the time from when the electronic shutter is opened until the image sensor 112 is shielded by the mechanical shutter 111d being closed by driving the shutter motor of the lens driving unit 114 by the mechanical shutter driving pulse output from the lens driving unit 114. The The exposure time of the image sensor 122 of the left image pickup system 12 is such that the output of the charge discharge pulse from the image sensor drive unit 125 stops and the charge discharge pulse is not input to the image sensor 122, so that the electronic shutter of the image sensor 122 is opened. After that, the time from when the shutter motor of the lens driving unit 124 is driven by the mechanical shutter driving pulse output from the lens driving unit 124 and the mechanical shutter 121d is closed to shield the image sensor 122 by the mechanical shutter 121d is defined.

  As shown in FIG. 4, there is a time difference between the mechanical shutter driving pulse being applied to the shutter motor of the lens driving unit 114 to the actual closing of the mechanical shutter 111d, and the mechanical shutter driving pulse is applied to the shutter motor of the lens driving unit 124. There is also a time difference from when the mechanical shutter 121d is actually closed. This is a mechanical delay. This mechanical delay is caused by mechanical elements such as shutter motor torque, mechanical shutter size, and weight being different for each imaging system.

  Therefore, although the electronic shutter end, that is, the exposure start timing can be synchronized by the photographing synchronization signal, the mechanical delay is different in each imaging system, and therefore the timing at which the mechanical shutter closes (exposure end timing) cannot be synchronized even if the mechanical shutter drive pulse is synchronized. As a result, the exposure time of each imaging system is different. Further, in the case of a moving subject (for example, a subject that moves within the angle of view by 1 to 3% or more during the photographing shutter speed) due to different exposure times, the position of the photographed subject However, the right imaging system 11 and the left imaging system 12 are different.

  Therefore, in order to make the exposure times of all the imaging systems the same, it is necessary to grasp the mechanical delay for each imaging system.

  Next, a method for storing the mechanical delay parameter in the ROM 102 will be described with reference to FIG. The following processing is mainly performed by the CPU 100.

  First, the CPU 100 calculates a theoretical exposure time in which the mechanical shutter is not used for the right imaging system 11 (step S10). The theoretical exposure time can be calculated as the difference between the time when the electronic shutter opening timing signal is applied (substantially coincident with the time when the electronic shutter of the image sensor 112 is opened) and the time when the mechanical shutter driving pulse is applied.

  The CPU 100 sends the electronic shutter opening timing signal and the mechanical shutter drive pulse to the right side of the image sensor driving unit 115 and the right side at the same timing as step S10 via the right imaging system shutter signal generation unit 130a and the right imaging system imaging signal generation unit 130c. Applied to the shutter motor of the mechanical shutter 111d, the actual exposure time is actually measured (step S11).

  The CPU 100 calculates the difference between the theoretical exposure time calculated in step S10 and the actual exposure time actually measured in step S11 as a mechanical delay amount (step S12), and calculates the value calculated in step S12 as The mechanical delay parameter of the right mechanical shutter 111d is stored in the ROM 102 (step S13).

  Next, as in step S10, the CPU 100 calculates a theoretical exposure time for which the mechanical shutter is not used for the left imaging system 12 (step S14).

  The CPU 100 sends the electronic shutter opening timing signal and the mechanical shutter driving pulse to the left side of the imaging element driving unit 125 and the left side at the same timing as step S14 via the left imaging system shutter signal generation unit 130b and the left imaging system imaging signal generation unit 130d, respectively. It is applied to the shutter motor of the mechanical shutter 121d and the actual exposure time is measured (step S15).

  The CPU 100 calculates the difference between the theoretical exposure time calculated in step S14 and the actual exposure time actually measured in step S15 as a mechanical delay (step S16), and sets the value calculated in step S12 to the left The mechanical delay parameter of the mechanical shutter 121d is stored in the ROM 102 (step S17).

  As described above, when the compound-eye digital camera 1 is manufactured, that is, before the shipment, the mechanical delay parameter is measured and stored for each imaging system, so that the exposure when the user takes an image after the compound-eye digital camera 1 is shipped. The time can be adjusted.

  Next, photographing and recording operations will be described. When the power button is pressed and the compound-eye digital camera 1 is turned on, the compound-eye digital camera 1 is activated under the photographing mode and driven in the monocular mode or the compound-eye mode.

  When the monocular mode is set, the right imaging system 11 or the left imaging system 12 (the left imaging system 12 in the present embodiment) is selected. Then, shooting for the live view image is started by the imaging element 122. That is, images are continuously picked up by the image pickup element 122, and the image signals are continuously processed to generate image data for a live view image. The generated image data is sequentially converted into a signal format for display and output to the monitor 14.

  When the compound eye mode is set, shooting for the live view image is started by the image sensor 112 and the image sensor 122. That is, images are continuously picked up by the image pickup device 112 and the image pickup device 122, and the image signals are continuously processed to generate image data for a live view image. The generated image data is sequentially converted into a signal format for display and output to the monitor 14 respectively.

  The user adjusts the angle of view by operating the zoom button 21 while viewing the live view image displayed on the monitor 14.

  It is determined whether the shutter button is half-pressed, that is, whether the S1 ON signal is input to the CPU 100. When the S1ON signal is input, shooting preparation processing, that is, AE, AF, and AWB processes are executed in response to the S1ON signal.

  It is determined whether the shutter button is fully pressed, that is, whether the S2 ON signal is input to the CPU 100. When the S2ON signal is input, the following photographing process and recording process are executed in response to the S2ON signal.

  First, the image sensor 112 and the image sensor 122 are exposed with the aperture value and shutter speed (exposure time) obtained by the AE process, and a recording image is captured.

  In the present embodiment, taking into account the mechanical delay of the right imaging system 11 and the left imaging system 12 and the difference between them, the imaging start timing and the imaging end timing of the right imaging system 11 and the left imaging system 12 are matched. FIG. 6 is a timing chart showing pulse application timings of the right imaging system 11 and the left imaging system 12 when the exposure times of the right imaging system 11 and the left imaging system 12 are matched.

  The right imaging system imaging signal generation unit 130c and the left imaging system imaging signal generation unit 130d simultaneously output drive signals to the imaging element driving unit 115 and the imaging element driving unit 125 in accordance with instructions from the CPU 100, and the imaging element driving unit 115 and imaging The element driver 125 simultaneously stops the output of the charge discharge pulse. Thereby, the electronic shutter of the image sensor 112 and the electronic shutter of the image sensor 122 are simultaneously opened, and the exposure of the image sensor 112 and the exposure of the image sensor 122 are started substantially simultaneously.

  The CPU 100 refers to the mechanical delay parameter of the right mechanical shutter 111d and the mechanical delay parameter of the left mechanical shutter 121d stored in the ROM 112, and is calculated by the AE / AWB detection circuit 104 for each image sensor at the time of S1 ON from the exposure start time. A command is issued to the right imaging system shutter signal generation unit 130a and the left imaging system shutter signal generation unit 130b so that the mechanical shutter drive pulse is output earlier by the mechanical delay parameter of the corresponding mechanical shutter from the time when the exposure time has elapsed. .

  In other words, the right imaging shutter signal generation unit 130a has the right mechanical shutter 111d at a time earlier by the mechanical delay parameter of the right mechanical shutter 111d than when the exposure time has elapsed since the imaging device driving unit 115 stopped outputting the charge discharge pulse. The mechanical shutter drive pulse is output to Also, the left imaging shutter signal generator 130b generates the left mechanical shutter 121d at a time earlier by the mechanical delay parameter of the left mechanical shutter 121d than the time when the exposure time has elapsed since the imaging device driving unit 125 stopped outputting the charge discharge pulse. The mechanical shutter drive pulse is output to

  As a result, as shown in FIG. 6, first, a mechanical shutter drive pulse is output to the shutter motor for the right mechanical shutter 111d with a large mechanical delay, and the time lapse of the difference between the mechanical delay of the right mechanical shutter 111d and the mechanical delay of the left mechanical shutter 121d. Thereafter, a mechanical shutter drive pulse is output to the shutter motor for the left mechanical shutter 121d having a small mechanical delay.

  The right mechanical shutter 111d is closed after the mechanical delay of the right mechanical shutter 111d has elapsed since the mechanical shutter driving pulse is applied to the shutter motor, and the left mechanical shutter 121d is closed after the mechanical delay of the left mechanical shutter 121d has been applied since the mechanical shutter driving pulse was applied to the shutter motor. close up. Thereby, the right mechanical shutter 111d and the left mechanical shutter 121d are closed substantially simultaneously.

  Thereby, the imaging start timing and the imaging end timing of the right imaging system 11 and the left imaging system 12 can be completely matched. For this reason, the right imaging system 11 and the left imaging system 12 can have the same exposure and subject position.

  The image sensor 112 and the image sensor 122 thus exposed output the recording image signals accumulated by the exposure to the CDS / AMP / AD converters 113 and 123, respectively. The CDS / AMP / AD converters 113 and 123 perform predetermined signal processing on the input image signal to generate two pieces of image data (YUV data) composed of luminance data and color difference data.

  The two image data generated by the CDS / AMP / AD conversion units 113 and 123 are temporarily stored in the DRAM 103 and then added to the media recording control unit 136. The media recording control unit 136 performs a predetermined compression process on the input two pieces of image data, and generates two pieces of compressed image data.

  The two pieces of compressed image data are stored in the memory unit 104 and recorded on the recording medium 137 via the media recording control unit 136 as a still image file (for example, Exif) in a predetermined format.

  When the mode of the compound-eye digital camera 1 is set to the playback mode, the CPU 100 outputs a command to the media recording control unit 136 and causes the recording medium 137 to read the last recorded image file.

  The compressed image data of the read image file is added to the compression / decompression circuit 148, decompressed to a non-compressed luminance / color difference signal, converted into a stereoscopic image by the stereoscopic image signal processing unit 133, and then the video encoder 135 is used. To the monitor 14. As a result, the image recorded on the recording medium 137 is reproduced and displayed on the monitor 14 (reproduction of one image).

  The frame advance of the image is performed by operating the left and right keys of the cross button 24. When the right key of the cross button 24 is pressed, the next image file is read from the recording medium 137 and reproduced and displayed on the monitor 14. When the left key of the cross button is pressed, the previous image file is read from the recording medium 137 and reproduced and displayed on the monitor 14.

  While confirming the image reproduced and displayed on the monitor 14, the image recorded on the recording medium 137 can be erased as necessary. The image is erased by pressing the MENU / OK button 25 while the image is reproduced and displayed on the monitor 14.

  According to this embodiment, after purchasing a compound-eye digital camera, the user does not perform adjustments or complicated operations, i.e., without being aware of mechanical delays, the right imaging system, the left imaging system, the imaging start timing, and the imaging end timing. It is possible to take a stereoscopic image with high coincidence that perfectly matches.

  In the present embodiment, the mechanical delay parameter of the right mechanical shutter 111d and the mechanical delay parameter of the left mechanical shutter 121d are stored in the ROM 112, but the method of storing the mechanical delay parameter is not limited to this. For example, the difference between the mechanical delay parameter of the right mechanical shutter 111d and the mechanical delay parameter of the left mechanical shutter 121d may be stored. In this case, after starting exposure at the same time, the CPU 100 outputs a drive pulse to a mechanical shutter having a large mechanical delay (a mechanical shutter in which the difference is stored), and after the stored difference time has elapsed, the mechanical delay is output. Control may be performed so that a drive pulse is output to a mechanical shutter having a small (a mechanical shutter in which no difference is stored). As a result, the exposure time calculated at S1 ON and the actual exposure time are different from each other by the mechanical delay of the mechanical shutter having a small mechanical delay, but the exposure times of the two imaging systems can be matched.

  In this embodiment, the electronic shutter is synchronized and the mechanical shutter drive pulse is shifted so that the photographing start timing and the photographing end timing coincide with each other, and the right imaging system 11 and the left imaging system 12 adjust the exposure and the position of the subject. However, as a modification of this embodiment, the mechanical shutter drive pulse may be output substantially simultaneously by shifting the drive pulse of the electronic shutter. As a result, since the photographing start timing and the photographing end timing are shifted, the positions of the subjects are not equal, but the exposure times can be matched and the exposures can be equalized.

<Second Embodiment>
In the second embodiment, control for intentionally shifting the mechanical shutter drive pulse is performed in order to avoid the influence of noise superimposition due to the battery voltage drop and voltage fluctuation caused by the simultaneous operation of the mechanical shutter. Hereinafter, the compound-eye digital camera 2 of the second embodiment will be described. In addition, about the part same as 1st Embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  The ROM 108 stores firmware, which is a control program executed by the CPU 100, various data necessary for control, camera setting values, captured image data, and the like. The ROM 108 records various threshold values for determining whether or not to execute control for intentionally shifting the mechanical shutter drive pulse.

  The power supply unit 109 mainly includes a battery, a power supply control circuit, and a battery remaining amount detection unit 109a (not shown). The power control circuit supplies power only from the battery to the CPU 100 when the digital camera 1 is not turned on in order to suppress the power consumption of the battery, and from the battery when the digital camera 1 is turned on. Control is performed so that power is supplied to each block.

  The battery remaining amount detection unit 109a is an analog digital circuit that measures the terminal voltage of the battery as a battery remaining amount index. In the standby state, the measured terminal voltage is corrected in consideration of the voltage drop due to the internal resistance of the compound-eye digital camera 2, and the corrected voltage is used as the remaining battery index. The remaining battery level detection unit 109a converts the measured or calculated voltage into a digital signal and outputs the digital signal to the CPU 100. Note that a circuit for measuring the remaining battery capacity itself may be used as the remaining battery capacity detection unit 109a.

  The operation of the compound-eye digital camera 2 configured as described above will be described. Since the reproduction process is the same as that in the first embodiment, a description thereof will be omitted.

  When the power button is pressed and the compound-eye digital camera 1 is turned on, the compound-eye digital camera 1 is activated under the photographing mode and driven in the monocular mode or the compound-eye mode.

  When the monocular mode is set, the right imaging system 11 or the left imaging system 12 (the left imaging system 12 in the present embodiment) is selected. Then, shooting for the live view image is started by the imaging element 122. That is, images are continuously picked up by the image pickup element 122, and the image signals are continuously processed to generate image data for a live view image. The generated image data is sequentially converted into a signal format for display and output to the monitor 14.

  When the compound eye mode is set, shooting for the live view image is started by the image sensor 122 and the image sensor 122. That is, images are continuously picked up by the image pickup device 112 and the image pickup device 122, and the image signals are continuously processed to generate image data for a live view image. The generated image data is sequentially converted into a signal format for display and output to the monitor 14 respectively.

  The user adjusts the angle of view by operating the zoom button 21 while viewing the live view image displayed on the monitor 14.

  It is determined whether the shutter button is half-pressed, that is, whether the S1 ON signal is input to the CPU 100. When the S1ON signal is input, shooting preparation processing, that is, AE, AF, and AWB processes are executed in response to the S1ON signal.

  It is determined whether the shutter button is fully pressed, that is, whether the S2 ON signal is input to the CPU 100. When the S2ON signal is input, the following photographing process and recording process are executed in response to the S2ON signal.

  First, the image sensor 112 and the image sensor 122 are exposed with the aperture value and shutter speed (exposure time) obtained by the AE process, and a recording image is captured. In the present embodiment, at the time of shooting, switching between applying the mechanical shutter drive pulses of the right imaging system 11 and the left imaging system 12 at substantially the same time or intentionally shifting is performed according to the state of the subject and the battery voltage. There is a feature.

(1) When switching according to the movement of the subject In the case of a relatively stationary subject, it is not so important that the right imaging system 11 and the left imaging system 12 capture images substantially simultaneously, and mechanical shutter simultaneous operation The effects of noise superimposition due to battery voltage drop and voltage fluctuations due to the battery should be avoided.

  FIG. 8 is a flowchart showing a flow of processing for switching between applying the mechanical shutter drive pulses of the right imaging system 11 and the left imaging system 12 substantially simultaneously or intentionally shifted in accordance with the movement of the subject.

  The CPU 100 acquires two consecutive frames of image data from the image sensor 112 or the image sensor 122, and detects a motion vector in a certain area of the frame (for example, near the center) (step S20). As a motion vector detection method, a representative point matching method, a block matching method, or the like can be used. Two frames of image data may be newly acquired when S2 is ON, may be acquired during S1 processing, or image data for a live view image may be used. When using image data for a live view image, the image data for the live view image may be stored in the DRAM 103 or the like, and may be used. The motion vector may be used. The two frames of image data may or may not be continuous.

  The CPU 100 determines whether or not the motion vector detected in step S20 is smaller than a predetermined threshold (step S21).

  If the motion vector detected in step S20 is larger than a predetermined threshold (YES in step S21), if the subject moves greatly (for example, the subject moves within the angle of view by 1 to 3% or more during the shooting shutter speed period). If the shooting start timing and shooting end timing differ between the right imaging system 11 and the left imaging system 12, the position of the subject shot by the right imaging system 11 and the left imaging system 12 are shot. Since the position of the subject is different, shooting is performed in the complete synchronization mode (step S22). FIG. 9 is a timing chart showing the timing of pulse application in the complete synchronization mode.

  The CPU 100 issues a command to the right imaging system imaging signal generation unit 130c and the left imaging system imaging signal generation unit 130d, and the right imaging system imaging signal generation unit 130c and the left imaging system imaging signal generation unit 130d include the imaging element driving unit 115 and A drive signal is simultaneously output to the image sensor drive unit 125. As a result, the image sensor drive unit 115 and the image sensor drive unit 125 simultaneously stop the charge discharging pulse, the electronic shutter of the image sensor 112 and the electronic shutter of the image sensor 122 are opened simultaneously, and the exposure of the image sensor 112 and the image sensor 122 are detected. The exposure starts at substantially the same time.

  After the exposure time calculated by AE elapses, the CPU 100 issues a command to the right imaging system shutter signal generation unit 130a and the left imaging system shutter signal generation unit 130b, and generates the right imaging system shutter signal generation unit 130a and the left imaging system shutter signal. The unit 130b simultaneously outputs mechanical shutter drive pulses to the shutter motor of the right mechanical shutter 111d and the shutter motor of the left mechanical shutter 121d. As a result, the right mechanical shutter 111d and the left mechanical shutter 121d are simultaneously closed, and the exposure of the image sensor 112 and the exposure of the image sensor 122 are ended almost simultaneously.

  If the motion vector detected in step S20 is not greater than the predetermined threshold (NO in step S21), this is a case of a relatively stationary subject, and shooting is started by the right imaging system 11 and the left imaging system 12. Since the influence of the difference in timing and photographing end timing is small, photographing is performed in the exposure time shifting mode in which the mechanical shutter driving pulse is intentionally shifted (step S23). FIG. 10 is a timing chart showing the timing of pulse application in the exposure time shifting mode.

  First, the CPU 100 issues a command to the right imaging system imaging signal generation unit 130 c, and the right imaging system imaging signal generation unit 130 c outputs a drive signal to the imaging element driving unit 115. Thereby, the image sensor driving unit 115 stops the charge discharging pulse, the electronic shutter of the image sensor 112 is opened, and the exposure of the image sensor 112 is started.

  After a predetermined time (exposure shifting time), the CPU 100 issues a command to the left imaging system imaging signal generation unit 130d, and the left imaging system imaging signal generation unit 130d outputs a drive signal to the imaging element driving unit 125. Thereby, the image sensor driving unit 125 stops the charge discharging pulse, the electronic shutter of the image sensor 122 is opened, and the exposure of the image sensor 122 is started.

  The CPU 100 issues a command to the right imaging system shutter signal generation unit 130a, and the right imaging system shutter signal generation unit 130a outputs S1 ON after the right imaging system imaging signal generation unit 130c outputs a drive signal to the imaging element driving unit 115. Sometimes, a mechanical shutter drive pulse is output to the shutter motor of the right mechanical shutter 111d so that the right mechanical shutter 111d is closed after the exposure time calculated by the AE / AWB detection circuit 104 has elapsed. As a result, the image sensor 112 is exposed at the shutter speed calculated by the AE / AWB detection circuit 104.

  The CPU 100 issues a command to the left imaging system shutter signal generation unit 130b, and the left imaging system shutter signal generation unit 130b performs S1ON after the left imaging system imaging signal generation unit 130d outputs a driving signal to the imaging element driving unit 125. A mechanical shutter drive pulse is output to the shutter motor of the left mechanical shutter 121d so that the left mechanical shutter 121d is closed after the exposure time calculated by the AE / AWB detection circuit 104 has elapsed. As a result, the image sensor 121 is exposed at the shutter speed calculated by the AE / AWB detection circuit 104 with a shift from the exposure time of the image sensor 112 by a predetermined time (exposure shift time).

  In the present embodiment, the right mechanical shutter 111d and the left mechanical shutter 121d are prevented from operating simultaneously by making the exposure shift time longer than the output time of the mechanical shutter drive pulse.

  The simultaneous operation of the mechanical shutter increases the peak power, which is not preferable from the viewpoint of the load on the power source and noise caused by the power source. Therefore, if the movement of the subject is small and there is no problem even if the exposure timing is shifted, the exposure time shifting mode can be set to avoid the influence of the battery voltage drop and noise superposition due to the voltage fluctuation caused by the simultaneous operation of the mechanical shutter.

  Further, in the case of a high-speed subject, the user performs switching such that priority is given to the synchronism between the imaging means (shooting start timing and shooting end timing are substantially the same), and otherwise noise and power are given priority. Without being able to do it automatically.

(2) When switching according to the result of AE processing (shutter speed) When the exposure time (shutter speed) is long, the shooting start timing and the shooting end timing of the right imaging system 11 and the left imaging system 12 are different. Even if the exposure time is different, the difference between the position of the subject photographed by the right imaging system 11 and the position of the subject photographed by the left imaging system 12 is not noticeable, and the influence is small. Accordingly, it is not so important that the right imaging system 11 and the left imaging system 12 coincide with the shooting start timing and the shooting end timing, and the influence of noise superimposition due to the battery voltage drop and voltage fluctuation caused by the simultaneous operation of the mechanical shutter should be avoided. is there.

  FIG. 11 is a flowchart showing a flow of processing for switching whether to apply the mechanical shutter drive pulses of the right imaging system 11 and the left imaging system 12 substantially simultaneously or intentionally shifted according to the shutter speed.

  The CPU 100 determines whether or not the shutter speed calculated by the AE / AWB detection circuit 104 when S1 is ON is shorter than a predetermined threshold (step S24).

  If the shutter speed calculated by the AE / AWB detection circuit 104 when S1 is ON is shorter than a predetermined threshold (for example, 1 millisecond) (YES in step S24), shooting is performed in the complete synchronization mode shown in FIG. 9 (step S22). .

  If the shutter speed calculated by the AE / AWB detection circuit 104 when S1 is ON is not shorter than the predetermined threshold (NO in step S24), shooting is performed in the exposure time shifting mode shown in FIG. 10 (step S23).

  Thereby, if the shutter speed is sufficiently long and there is no problem even if the exposure timing is shifted, the influence of noise superposition due to the battery voltage drop and voltage fluctuation caused by the simultaneous operation of the mechanical shutter can be avoided by shifting the exposure timing. In particular, the noise reduction effect is high when the exposure time is long, that is, the subject is likely to have high sensitivity.

  In addition, when the exposure time is long, priority is given to the synchronism between the imaging means (the shooting start timing and the shooting end timing are substantially the same), and if not, the user switches the priority to give priority to noise and power. It can be done automatically without doing it.

(3) When switching according to the remaining battery level When the right mechanical shutter 111d and the left mechanical shutter 121d are driven substantially simultaneously, as shown in FIG. 9, only one right mechanical shutter 111d and left mechanical shutter 121d are driven (FIG. 9). 10), the power consumption by the mechanical shutter driving is doubled, and the fluctuation range (voltage drop) of the battery voltage is doubled or more.

  Therefore, when the right mechanical shutter 111d and the left mechanical shutter 121d are driven substantially simultaneously when the remaining battery level is low (for example, when a lithium ion battery is used as the battery, the voltage is about 3.3V), There is a possibility that the operation of the digital camera 2 may be hindered. Such a defect appears remarkably at low temperatures.

  Therefore, when the remaining battery level is low, the influence caused by the simultaneous operation of the mechanical shutter should be avoided.

  FIG. 12 is a flowchart showing a flow of processing for switching whether to apply the mechanical shutter drive pulses of the right imaging system 11 and the left imaging system 12 substantially simultaneously or intentionally shifted in accordance with the remaining battery level.

  The CPU 100 acquires the voltage output from the battery remaining amount detection unit 109a (step S25), and determines whether or not the voltage acquired in step S25 is higher than a predetermined threshold (step S26).

  If the voltage acquired in step S25 is higher than the predetermined threshold value (YES in step S26), it is a case where the simultaneous mechanical shutter operation is possible, and thus photographing is performed in the complete synchronization mode shown in FIG. 9 (step S22).

  If the voltage acquired in step S25 is not higher than the predetermined threshold value (NO in step S26), it is a case where the simultaneous operation of the mechanical shutter is not possible, and thus shooting is performed in the exposure time shift mode shown in FIG. 10 (step S23). .

  Thereby, when the battery remaining amount is low and the simultaneous operation of the mechanical shutter is not possible, the influence of noise superposition due to the battery voltage drop and voltage fluctuation can be avoided by shifting the exposure timing. You can also use the battery to the limit.

  Also, when the remaining battery level is sufficient, priority is given to simultaneity between the imaging means (shooting start timing and shooting end timing should be substantially the same), otherwise noise and power are given priority. It can be done automatically without the user.

  The image sensor 112 and the image sensor 122 exposed as described in (1) to (3) output the recording image signals accumulated by exposure to the CDS / AMP / AD converters 113 and 123, respectively. The CDS / AMP / AD converters 113 and 123 perform predetermined signal processing on the input image signal to generate image data (YUV data) including luminance data and color difference data.

  The image data generated by the CDS / AMP / AD conversion units 113 and 123 is temporarily stored in the DRAM 103 and then added to the media recording control unit 136. The media recording control unit 136 performs predetermined compression processing on the input image data to generate compressed image data.

  The compressed image data is stored in the memory unit, and is recorded on the recording medium 137 via the media recording control unit 136 as a still image file (for example, Exif) in a predetermined format.

  According to the present embodiment, it is possible to automatically select the complete synchronization mode and the exposure time shifting mode in accordance with the operation status of the compound-eye digital camera, the subject status, the battery status, and the like. As a result, it is possible to appropriately determine the shooting situation and, if possible, perform a shooting operation in which the influence of noise superposition due to battery voltage drop and voltage fluctuation is reduced.

  In the present embodiment, when switching between the complete synchronization mode and the exposure time shifting mode, only one of (1) to (3) may be used, or a plurality of methods may be combined. You may make it use.

  In the present embodiment, it has been described that there is no mechanical delay. However, in the case of the complete synchronization mode, the right imaging system 11 and the left imaging system 12 are used by using the method described in the first embodiment. The shooting start timing and the shooting end timing may be matched.

  The application of the present invention is not limited to two compound-eye digital cameras, and the present invention is applied to various imaging devices such as digital cameras and video cameras having two or more imaging systems, mobile phones, and the like. Can do. It can also be provided as a program applied to a compound-eye digital camera or the like.

  1, 2: Compound eye digital camera, 11: Right imaging system, 12: Left imaging system, 100: CPU, 101: Operation unit, 102: ROM, 103: DRAM, 104: AE / AWB detection circuit, 105: AF detection circuit , 106: clock generator, 107: power supply unit, 111, 121: lens group, 111a, 121a: zoom lens, 111b, 121b: aperture, 111c, 121c: focus lens, 111d, 121d: mechanical shutter, 112, 122: imaging device 113, 123: CDS / AMP / AD conversion unit, 114, 124: lens driving unit, 115, 125: image sensor driving unit, 130: timing generator (TG), 131: image input controller, 132: image signal processing unit 133: Stereo image signal processing unit 134: Compression / decompression processing unit 135 Video encoder, 136: Media recording control unit, 137: recording medium 138: Stereo microphone amplifier, 139: sound input unit, 140: sound output processing unit

Claims (8)

A plurality of image pickup means each constituted by an image pickup element that converts incident light into a charge corresponding to the amount of light and accumulates it as a signal charge, and a mechanical shutter that can mechanically shield and open the incident light path to the image pickup element When,
A plurality of electronic shutter means that are provided for each of the image sensors and that start exposure by controlling the start point of charge accumulation in the image sensor based on the respective charge discharge pulses;
Mechanical shutter driving means for driving the mechanical shutter provided for each mechanical shutter, and a plurality of mechanical shutter driving means for closing the mechanical shutter on the basis of input shutter closing operation signals and ending the exposure;
Electronic shutter control means capable of outputting the charge discharge pulse at an arbitrary timing for each of the plurality of electronic shutter means;
Mechanical shutter control means capable of outputting the shutter closing operation signal at an arbitrary timing for each of the plurality of mechanical shutter driving means;
Storage means for storing, for each mechanical shutter, a mechanical delay that is a time difference from when the mechanical shutter control means outputs a shutter closing operation signal to when the corresponding mechanical shutter is closed;
The electronic shutter control means outputs each charge discharge pulse at the same timing so that the plurality of image sensors start exposure at the same time,
The mechanical shutter control means outputs each shutter closing operation signal to the corresponding mechanical shutter means at an earlier timing by the mechanical delay of each mechanical shutter so that exposure with the plurality of image pickup devices is completed simultaneously. Compound eye imaging device. A plurality of image pickup means each constituted by an image pickup element that converts incident light into a charge corresponding to the amount of light and accumulates it as a signal charge, and a mechanical shutter that can mechanically shield and open the incident light path to the image pickup element When,
A plurality of electronic shutter means that are provided for each of the image sensors and that start exposure by controlling the start point of charge accumulation in the image sensor based on the respective charge discharge pulses;
Mechanical shutter driving means for driving the mechanical shutter provided for each mechanical shutter, and a plurality of mechanical shutter driving means for closing the mechanical shutter on the basis of input shutter closing operation signals and ending the exposure;
Electronic shutter control means capable of outputting the charge discharge pulse at an arbitrary timing for each of the plurality of electronic shutter means;
Mechanical shutter control means capable of outputting the shutter closing operation signal at an arbitrary timing with respect to the plurality of mechanical shutter driving means,
The electronic shutter control means outputs the charge discharge pulses at different timings so that the exposure start points of the plurality of image pickup devices are shifted by a predetermined time longer than the output time of the shutter closing operation signal.
The compound-eye imaging device, wherein the mechanical shutter control means outputs each shutter closing operation signal at different timings so that exposure end points of the plurality of imaging elements are shifted by the predetermined time . Storage means for storing, for each mechanical shutter, a mechanical delay that is a time difference from when the mechanical shutter control means outputs a shutter closing operation signal until the corresponding mechanical shutter closes;
The mechanical shutter control means outputs each shutter closing operation signal to the corresponding mechanical shutter means at an earlier timing by the mechanical delay of each mechanical shutter so that the charge accumulation times in the plurality of imaging devices are the same. The compound eye imaging device according to claim 2 . The mechanical shutter control means outputs each charge discharge pulse at the same timing so that the plurality of image sensors start exposure simultaneously, and the mechanical shutter control means closes the shutter so that the plurality of image sensors finish exposure simultaneously. The electronic shutter control means that the first drive mode for outputting the operation signal to the corresponding mechanical shutter means or the start time of exposure of the plurality of image sensors is shifted by a predetermined time longer than the output time of the shutter closing operation signal. Outputs the respective charge discharge pulses at different timings, and the mechanical shutter control means outputs the respective shutter closing operation signals at different timings so that the exposure end points of the plurality of image pickup devices are shifted by the predetermined time. Control means for controlling the electronic shutter control means and the mechanical shutter control means in a drive mode; Compound-eye imaging device according to any one of claims 1 to 3, characterized in that there was e. Extraction means for extracting movement of a subject from a plurality of images taken at different times by at least one of the plurality of imaging means;
First determination means for determining whether the movement of the subject is faster than a predetermined speed based on the movement of the subject extracted by the extraction means,
The control means drives the electronic shutter means and the mechanical shutter drive means in the second drive mode when the first determination means does not determine that the movement of the subject is faster than a predetermined speed. The compound-eye imaging device according to claim 4 . The compound-eye imaging apparatus according to claim 5 , wherein the plurality of images are live view images. Metering means for metering subject brightness;
Calculating means for calculating a shutter speed so as to obtain an appropriate exposure according to the measured subject brightness;
Second judging means for judging whether or not the shutter speed calculated by the calculating means is faster than a predetermined threshold,
The control means drives the electronic shutter means and the mechanical shutter drive means in the second drive mode when the second determination means does not determine that the shutter speed is faster than a predetermined threshold. The compound-eye imaging device according to claim 4, 5, or 6 . A battery for supplying power to the compound eye imaging device;
Detecting means for detecting the remaining amount of the battery;
Third determination means for determining whether or not the remaining amount detected by the detection means is a value capable of operating the plurality of mechanical shutters simultaneously,
The control means drives the electronic shutter means and the mechanical shutter drive means in the second drive mode when the third judgment means judges that the plurality of mechanical shutters cannot be driven simultaneously. A compound eye imaging device according to claim 4 .

Images