JP2010230879A - Double eye camera device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make a double eye camera device, which includes a plurality of photographic optical systems and a plurality of imaging devices one-to-one corresponding to the respective photographic optical systems, small in size and low in cost. <P>SOLUTION: The double eye camera device includes a main lens 1 and two sub lenses 2 and 3, wherein a CCD 11 corresponding to the main lens 1 is mounted on a front surface of a CCD substrate 4, and CCDs 12 and 13 corresponding to the sub lenses 2 and 3 are mounted on a back surface of the CCD substrate 4. The sub lens 2 is configured to form a subject image on a light receiving surface of the CCD 12 through two total reflection mirrors 7a and 7b, and the sub lens 3 is configured to form a subject image on a light receiving surface of the CCD 13 through two total reflection mirrors 8a and 8b. The CCD substrate 4 and a main substrate 5 on which a control block is mounted are electrically connected by means of a single connection cable 6. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a compound-eye camera device, and more particularly to a compound-eye camera device having a plurality of photographing optical systems and a plurality of image pickup elements corresponding to the photographing optical systems one-to-one.

  Conventionally, a first imaging unit including a main lens and a first imaging element, and a second imaging unit including a sub-lens and a second imaging element having a smaller number of effective pixels than the first imaging element, There has been proposed a twin-lens camera characterized by obtaining depth information of an image of a first imaging unit by referring to an image captured by two imaging units (Patent Document 1).

  In addition, a first image pickup unit including a main lens and a first image pickup device, a first image pickup device including second and third image pickup elements having a smaller number of effective pixels than the first and second sub lenses and the first image pickup device. A three-lens camera comprising: 2 and a third imaging unit, wherein depth information of the image of the first imaging unit is obtained by referring to images captured by the second and third imaging units Has been proposed (Patent Document 2).

  In addition, an imaging apparatus has been proposed in which light incident from two optical paths (two eyes) is imaged on one imaging element in a time-sharing manner using a mirror and a shutter to obtain a stereo image. (Patent Document 3).

JP 2000-102040 A JP 2000-1112019 A JP-A-11-285026

  However, in the twin-lens or trinocular camera described in Patent Documents 1 and 2, a plurality of image sensors are independently arranged in parallel in the camera body, and the apparatus is not downsized. In addition, there are a plurality of substrates on which a plurality of image sensors are respectively mounted, and there are a plurality of connection cables between these substrates and the main substrate, so that the device is not reduced in price and size.

  On the other hand, the twin-lens camera described in Patent Document 3 takes time to obtain a set of stereo images because light incident from two optical paths is switched in a time-sharing manner to form an image on one image sensor. There's a problem.

  The present invention has been made in view of such circumstances, and in a compound eye camera device having a plurality of photographing optical systems and a plurality of image pickup elements corresponding to the respective photographing optical systems, the size and cost of the device are reduced. It is an object of the present invention to provide a compound eye camera device that can be realized.

  In order to achieve the above object, a compound eye camera device according to claim 1 is provided with a plurality of imaging optical systems, a plurality of imaging elements corresponding to the plurality of imaging optical systems, and the plurality of imaging elements. A single imaging device substrate, wherein the imaging device substrate on which the imaging devices are respectively mounted on both surfaces of the imaging device substrate, and all or a part of the optical paths of the plurality of imaging optical systems are bent to form a subject image And an optical member that forms an image on a corresponding image sensor.

  According to the first aspect of the present invention, since the image pickup device substrate on which the plurality of image pickup devices are mounted is made one and the image pickup device is mounted on both surfaces of the image pickup device substrate, the image pickup device substrate for the plurality of image pickup devices is provided. Can be made smaller than before, and the apparatus can be miniaturized.

  According to a second aspect of the present invention, the compound-eye camera device according to the first aspect includes a main board on which a control block that processes output signals output from the plurality of imaging elements is mounted, the imaging element board and the main board The substrate is connected by a single cable or a single connector. As a result, the connection between the imaging element substrate and the main substrate can be simplified, and the cost of the apparatus can be reduced.

  According to a third aspect of the present invention, in the compound eye camera device according to the first or second aspect, the plurality of imaging devices include different types of imaging devices having at least one of the number of pixels, the size of the light receiving surface, and the sensitivity. It is characterized by that.

  4. The compound-eye camera device according to claim 1, wherein the imaging element substrate is disposed so as to be orthogonal to an optical axis of the plurality of photographing optical systems, and the plurality of imaging devices. The element is mounted separately on the front surface and the back surface of the imaging device substrate, and the optical member is a corresponding imaging optical so that a subject image is formed on the imaging device mounted on the back surface of the imaging device substrate. It is characterized by bending the optical path of the system.

  According to a fifth aspect of the present invention, in the compound eye camera device according to the fourth aspect, the image pickup device mounted on the surface of the image pickup device substrate has a light receiving surface smaller than the image pickup device mounted on the back surface of the image pickup device substrate. It is characterized by that. As a result, the imaging optical system that forms an image on the imaging element on the back surface of the imaging element substrate has a larger image circle than the imaging optical system that forms an image on the imaging element on the front surface (that is, the optical path length until imaging is large). A long one) can be used, which is suitable for the arrangement of the image sensor.

  According to a sixth aspect of the present invention, the compound-eye camera device according to the third aspect has a plurality of photographing modes for acquiring one image or a plurality of images by using any one or a plurality of the image pickup devices simultaneously. A mode selection unit for selecting a desired shooting mode from the plurality of shooting modes, and driving any one or more of the plurality of imaging elements according to the shooting mode selected by the mode selection unit. And a control means for processing an image acquired from the driven imaging device. As a result, various types of imaging can be performed in accordance with a plurality of imaging modes, and higher functionality and added value can be improved.

  According to a seventh aspect of the present invention, in the compound eye camera device according to the sixth aspect, the plurality of image pickup devices include different types of image pickup devices having the same number of pixels and different sensitivities.

  The compound-eye camera device according to claim 7, wherein the plurality of photographing modes include a first photographing mode for acquiring a plurality of images for high-sensitivity and high dynamic range three-dimensional display, A second shooting mode for acquiring a plurality of images for three-dimensional display with high sensitivity and low dynamic range; a third shooting mode for acquiring a plurality of images for low-sensitivity and high dynamic range three-dimensional display; 2 of 4th imaging | photography modes which acquire the single image for two-dimensional display of a high dynamic range, and the 5th imaging | photography mode which acquires the single image for two-dimensional display of a high sensitivity and low dynamic range It is characterized by including the above photographing modes.

  According to a ninth aspect of the present invention, in the compound-eye camera device according to the sixth aspect, the plurality of photographing optical systems and the plurality of imaging elements are respectively three photographing optical systems and imaging elements.

  10. The compound-eye camera device according to claim 9, wherein the plurality of photographing modes are a first photographing mode for acquiring three images for three-dimensional display, and two images for three-dimensional display. It is characterized in that it includes two or more shooting modes of a second shooting mode for acquiring the first image and a third shooting mode for acquiring one image for two-dimensional display.

  According to the present invention, since the image pickup device substrate on which a plurality of image pickup devices are mounted is formed on one sheet and the image pickup devices are mounted on both surfaces of the image pickup device substrate, the image pickup device substrate for the plurality of image pickup devices is more than conventional. Therefore, the apparatus can be reduced in size.

FIG. 1 is a schematic diagram showing a configuration of a compound eye camera apparatus according to a first embodiment of the present invention. FIG. 2 is a main part configuration diagram of a compound eye camera device according to a second embodiment of the present invention. FIG. 3 is a block diagram showing the main part of a compound eye camera device according to the third embodiment of the present invention. FIG. 4 is a block diagram of a compound eye camera device according to a fourth embodiment of the present invention. FIG. 5 is a flowchart showing the processing contents in each photographing mode by the compound eye camera apparatus of the fourth embodiment of the present invention. FIG. 6 is a block diagram of a compound eye camera apparatus according to a fifth embodiment of the present invention. FIG. 7 is a flowchart showing the processing contents in each photographing mode by the compound eye camera device of the fifth embodiment of the present invention. FIG. 8 is a schematic diagram showing the configuration of a compound eye camera apparatus according to the sixth embodiment of the present invention. FIG. 9 is a schematic view showing a configuration of a conventional compound eye camera apparatus.

  Embodiments of a compound eye camera device according to the present invention will be described below with reference to the accompanying drawings.

[First Embodiment]
FIG. 1 is a schematic diagram showing a configuration of a compound eye camera apparatus according to a first embodiment of the present invention.

  As shown in FIG. 1, this compound-eye camera device is a trinocular compound-eye camera device having a main lens 1 and two sub-lenses 2 and 3, and an imaging element (hereinafter referred to as a CCD (Charge Coupled Device)). A CCD substrate 4 on which “CCD” is mounted is disposed in the camera body so as to be orthogonal to the optical axes (optical paths L1, L2, L3) of the main lens 1 and the sub lenses 2, 3.

  Three CCDs 11, 12, and 13 corresponding to the main lens 1 and the sub-lenses 2 and 3 are mounted on the single CCD substrate 4. The CCD 11 is mounted on the surface of the CCD substrate 4 (on the front side of the camera). The CCDs 12 and 13 are mounted on the back surface of the CCD substrate 4.

  The main lens 1 is configured to form a subject image on the light receiving surface of the CCD 11, and the sub lens 2 can form a subject image on the light receiving surface of the CCD 12 via the two total reflection mirrors 7 a and 7 b. The sub lens 3 is configured so that a subject image can be formed on the light receiving surface of the CCD 13 via the two total reflection mirrors 8a and 8b.

  A main board 5 on which a control block for processing a CCD output signal and the like is mounted is disposed in the camera body. The CCD board 4 and the main board 5 are connected to a single connection cable 6 (flexible cable). (Including the wiring board).

  FIG. 9 is a schematic diagram showing an example of a conventional trinocular compound eye camera device. In addition, the same code | symbol is attached | subjected to the part which is common in the compound eye camera apparatus of 1st Embodiment shown in FIG. 1, and the detailed description is abbreviate | omitted.

  As shown in FIG. 9, in the conventional trinocular compound camera device, three CCD substrates 4a, 4b, and 4c on which CCDs 11, 12, and 13 are mounted are arranged in parallel, and the CCD substrates 4a, 4b, and 4c are arranged in parallel. And the main board 5 are electrically connected by connection cables 6a, 6b and 6c, respectively.

  The compound eye camera device according to the first embodiment of the present invention can have the CCD substrates 4 of the three CCDs 11, 12, and 13 as one sheet, and uses both surfaces of the CCD substrate 4 as mounting surfaces. Compared with the three CCD substrates 4a, 4b and 4c of the conventional compound eye camera device shown, the CCD substrate 4 can be made compact, and the device can be miniaturized.

  In addition, the connection between the CCD substrate 4 and the main substrate 5 can be made with a single connection cable 6, and the connection is simplified compared to the conventional connection with three connection cables 6a, 6b, 6c. The cost of the apparatus can be reduced.

  In FIG. 1, the optical paths L1, L2, and L3 of the main lens 1 and the sub lenses 2 and 3 are shown in parallel. However, the main lens 1 and the sub lenses 2 and 3 have an optical path L1 at a predetermined distance. , L2 and L3 are arranged so as to intersect (have a convergence angle). Thereby, the same subject can be photographed from different viewpoint positions, and three images for three-dimensional display can be acquired.

  Further, instead of the total reflection mirrors 7a and 7b and the total reflection mirrors 8a and 8b, other optical members such as a total reflection prism may be used. Furthermore, in order to correct the difference in optical path length between the optical path L and the optical paths L2 and L3, a relay lens or the like may be disposed in the optical paths L2 and L3 as necessary.

[Second Embodiment]
FIG. 2 is a main part configuration diagram of a compound eye camera device according to a second embodiment of the present invention. In addition, the same code | symbol is attached | subjected to the part which is common in the compound eye camera apparatus of 1st Embodiment shown in FIG. 1, and the detailed description is abbreviate | omitted.

  The compound eye camera device of the second embodiment shown in FIG. 2 includes a low-sensitivity CCD 21 having 12 million (12M) pixels and high-sensitivity CCDs 22 and 23 having 12M pixels. The CCD 21 has a low PD (photodiode) size due to low sensitivity, and the CCDs 22 and 23 have a large PD size due to high sensitivity. Further, since the number of pixels is the same 12M, the CCDs 22 and 23 have a larger shape than the CCD 21 (the size of the light receiving surface increases).

  As described above, the CCDs 22 and 23 have a larger light receiving surface than the CCD 21, and accordingly, the sub lenses 2 and 3 have a larger image circle than the main lens 1. That is, when the main lens 1 and the sub lenses 2 and 3 perform shooting at the same angle of view, the sub lenses 2 and 3 having a longer focal length than the main lens 1 are applied.

  Since the sub lenses 2 and 3 are to form an image on the CCDs 22 and 23 on the back surface of the CCD substrate 4 by bending the optical path via the total reflection mirrors 7a and 7b and the total reflection mirrors 8a and 8b. Since the optical path length is longer than that, the difference in optical path length can be accommodated by changing the size of the CCD 21 and the CCDs 22 and 23 as described above.

  Further, the optical path length can be adjusted by moving the total reflection mirrors 7a and 7b and the total reflection mirrors 8a and 8b in the direction of the arrow in FIG.

[Third Embodiment]
FIG. 3 is a block diagram showing the main part of a compound eye camera device according to the third embodiment of the present invention. In addition, the same code | symbol is attached | subjected to the part which is common in the compound eye camera apparatus of 1st Embodiment shown in FIG. 1, and the detailed description is abbreviate | omitted.

  The compound-eye camera device of the third embodiment shown in FIG. 3 includes a CCD 31 with 6M pixels, and CCDs 32 and 33 with 12M pixels having the same PD size as the CCD 31. The CCDs 32 and 33 have the same PD dimensions as the CCD 31 and a large number of pixels, and therefore have a larger shape than the CCD 31 (the size of the light receiving surface increases).

  Accordingly, the main lens 1 and the sub lenses 2 and 3 of the compound eye camera device of the third embodiment are the same as the main lens 1 and the sub lenses 2 and 3 of the compound eye camera device of the second embodiment shown in FIG. Can be applied.

[Fourth Embodiment]
FIG. 4 is a block diagram of a compound eye camera device according to a fourth embodiment of the present invention.

  The compound eye camera apparatus shown in FIG. 4 has the CCDs 21, 22, 23, etc. of the second embodiment shown in FIG. 2, and the two-dimensional images, three-dimensional images, etc. acquired by photographing are stored in the memory card 42, etc. It is a compound eye digital camera that records on a recording medium.

  The operation unit 44 includes known switches such as a shutter button, a power switch, a shooting mode selection dial, a shooting / playback mode selection switch, a back switch, a menu / OK switch, and a multifunction cross key.

  The shutter button is composed of a two-stage stroke type switch composed of so-called “half press” and “full press”. In the shooting mode, when the shutter button is half-pressed, shooting preparation processing (ie, AE (Automatic Exposure), AF (Auto Focus)) is performed, and when the shutter button is fully pressed, Image capturing / recording processing is performed.

  By rotating the photographing mode selection dial, the high sensitivity / high dynamic range (DR) three-dimensional photographing mode, the high sensitivity three-dimensional photographing mode, the high DR three-dimensional photographing mode, the high DR two-dimensional photographing mode, and the two-dimensional A shooting mode such as a shooting mode can be set. Details of these shooting modes will be described later.

  A liquid crystal display (LCD) 46 can display a moving image (through image) based on various display image signals input via an LCD driver 48 and can be used as an electronic viewfinder, and also takes a pre-recorded image. (Preview image), a reproduced image read from the memory card 42 loaded in the compound-eye camera device, and the like can be displayed. Further, the LCD 46 displays various menus for manually setting the number of frames that can be shot and the number of playback frames, white balance when setting manually, the number of pixels, compression rate, sharpness, and the like. Displayed in response to key operations.

  A central processing unit (CPU) 50 performs overall control of each circuit in the compound-eye camera device based on an input from the operation unit 44, as will be described later. Further, the CPU 50 exchanges necessary data with the ROM 52 and the RAM 54. The ROM 52 stores various parameters and data related to camera control such as a camera control program and CCD defect information. The RAM 54 includes a calculation work area for the CPU 50, a temporary storage area for image data, and a temporary storage area for image data for display.

  First, when the power switch of the operation unit 44 is operated, the CPU 50 detects this and turns on the power supply in the camera. When the shooting mode is selected by the shooting / playback mode selection switch, the shooting standby state is set.

  The imaging sequence changes according to the imaging mode set with the imaging mode selection dial. Here, a case where three images are captured will be described.

  When the shutter button is pressed in the photographing standby state, the CPU 50 detects this and controls the main lens 1 and the sub lenses 2 and 3 via the lens driving unit 56 (focus control and exposure control), respectively. Light is imaged on the light receiving surfaces of the CCDs 21, 22, and 23.

  Each CCD 21, 22, 23 converts the image light imaged on the light receiving surface into an amount of electric charge corresponding to the amount of light. The charges accumulated in this way are read out to the vertical transfer paths of the CCDs 21, 22 and 23 by a read pulse applied from the CCD drive unit 58, and are used as voltage signals corresponding to the charge amount by the vertical transfer pulse and the horizontal transfer pulse. Read sequentially. The CCDs 21, 22, and 23 have a so-called electronic shutter function that can sweep out charges accumulated by a shutter gate pulse applied from the CCD drive unit 58, thereby controlling the charge accumulation time (shutter speed). ing.

  The voltage signals output from the CCDs 21, 22, and 23 are applied to the analog processing circuits 60 a to 60 c on the main substrate 5 connected from the CCD substrate 4 via the connection cable 6. The analog processing circuits 60a to 60c include a correlated double sampling circuit (CDS circuit) and an amplifier, and the voltage signals output from the CCDs 21, 22, and 23 are correlated with each other by the analog processing circuits 60a to 60c. Are applied to the A / D converters 62a to 62c as R, G, and B signals for each pixel. Each of the A / D converters 62a to 62c converts analog R, G, and B signals that are sequentially added to R, G, and B signals, respectively. In this way, the R, G, B signals of the three images photographed simultaneously by the three CCDs 21, 22, 23 are temporarily stored in the RAM 54.

  The image processing circuit 64 reads out three pieces of image data, performs white balance adjustment by applying a digital gain corresponding to the type of light source, and performs gamma (gradation characteristic) processing and sharpness processing to perform R, G, B A signal is generated, and further YC signal processing is performed to generate a luminance signal Y and chroma signals Cr and Cb (YC signal), and the YC signal is stored in the RAM 24 again. When creating high DR image data, a process of combining low-sensitivity image data and high-sensitivity image data is performed.

  The YC signal stored in the RAM 54 as described above is supplied to the compression / decompression processing circuit 59, where it is compressed according to a predetermined compression format (for example, JPEG method). The compressed image data is filed, for example, in an Exif format image file in the 2D shooting mode, and an image file in which a plurality of images are associated is created in the 3D shooting mode. The data is recorded on the memory card 42 via the read / write circuit 60.

  The corresponding point detection circuit 66 is used when creating high DR image data from low sensitivity image data and high sensitivity image data.

  That is, the corresponding point detection circuit 66 detects a plurality of sets of corresponding points whose features substantially match between a plurality of images simultaneously captured by the CCDs 21, 22, and 23. Various methods have been proposed for detecting corresponding points by the corresponding point detection circuit 66. For example, conventional techniques such as a block matching method, a KLT method (Tomasi & Kanade, 1991, Detection and Tracking of Point Features), and a SIFT (Scale Invariant Feature Transform) can be used.

  The geometric deformation circuit 68 corrects a field angle shift caused by parallax between the two image data by geometrically deforming one of the low-sensitivity image data and the high-sensitivity image data. A geometric deformation parameter for geometrically deforming any one of the target images is obtained from a plurality of detected pairs of corresponding points, and the target image is geometrically deformed based on the geometric deformation parameters. Thereby, high-sensitivity image data without parallax is created for low-sensitivity image data, or low-sensitivity image data without parallax is created for high-sensitivity image data. As the geometric deformation parameter, a projective transformation parameter when performing the projective transformation, a Helmart transformation parameter when performing the Helmart transformation, and the like can be considered.

  The image processing circuit 64 converts the low-sensitivity image data and the high-sensitivity image data that have no parallax into each other, by geometrically deforming one of the low-sensitivity image data and the high-sensitivity image data by the geometric deformation circuit 68. Based on this, high DR image data is created.

  As a method for creating high-sensitivity and high-DR image data based on low-sensitivity image data having a wide DR and high-sensitivity image data having a narrow DR, a method of performing addition processing after gradation conversion of both image data A known method such as JP-A-2006-135684 can be used.

  On the other hand, when the playback mode is selected by the shooting / playback mode selection switch, the image file of the last frame recorded on the memory card 12 is read through the read / write circuit 60. The compressed data of the read image file is expanded to an uncompressed YC signal via the compression / expansion circuit 59.

  The decompressed YC signal is held in the RAM 54, converted into an LCD display signal via the LCD driver 48, and output to the LCD 46. As a result, the last frame image recorded on the memory card 42 is displayed on the LCD 46.

  Thereafter, when the forward frame advance switch (right key of the cross key) is pressed, the frame is advanced in the forward direction, and when the reverse frame advance switch (left key of the cross key) is pressed, the frame is advanced in the reverse direction. Then, the frame-positioned image file at the frame position is read from the memory card 42, and the frame image is reproduced on the LCD 46 in the same manner as described above. When the frame of the last frame is displayed and the frame is advanced in the forward direction, the first frame image file recorded on the memory card 42 is read and the first frame image is displayed on the LCD 46. To be played.

  Further, when the LCD 46 is adapted for three-dimensional display (for example, a so-called lenticular lens having a semi-cylindrical lens group is arranged on the surface and displays a plurality of images in different directions), 3 A plurality of images (parallax images) read from the memory card 42 are displayed in the three-dimensional image playback mode, and the user can view stereoscopically.

  Next, an imaging sequence by the compound eye camera device of the fourth embodiment having the above configuration will be described.

  FIG. 5 is a flowchart showing the processing contents in each photographing mode by the compound eye camera apparatus of the fourth embodiment of the present invention.

  In FIG. 5, when shooting is performed by fully pressing the shutter button, a high sensitivity / high DR 3D shooting mode, a high sensitivity 3D shooting mode, a high DR 3D shooting mode are performed in steps S10, S12, S14, and S16. It is determined which of the five shooting modes of the high DR two-dimensional shooting mode and the two-dimensional shooting mode is set.

  If it is determined in step S10 that the high sensitivity / high DR three-dimensional imaging mode is set, the CCDs 21, 22, and 23 are driven, and each CCD output is A / D converted to obtain three images (steps). S18).

  Subsequently, high sensitivity / high DR three-dimensional image processing is performed based on the acquired three images (step S20).

  In this high sensitivity / high DR three-dimensional image processing, three high sensitivity / high DR images each having a parallax are created. If the images acquired from the CCDs 21, 22, and 23 are images A, B, and C, respectively, the image A is a low-sensitivity image with a wide DR, and the images B and C are high-sensitivity images with a narrow DR. It is.

  Based on the images A and B, the image B is geometrically deformed so that the image B matches the image A, and an image B ′ having no parallax with respect to the image A is created. The image B 'is created by the corresponding point detection circuit 66 and the geometric deformation circuit 68 as described above. Then, a high sensitivity / high DR image with an expanded dynamic range is created by synthesizing the high DR image A and the high sensitivity image B ′.

  Further, the image A is geometrically deformed based on the images A and B so that the image A matches the image B, and an image A ′ having no parallax with respect to the image B is created. Then, the high-sensitivity / high-DR image is created by synthesizing the high-DR image A ′ and the high-sensitivity image B.

  Similarly, the image A is geometrically deformed based on the images A and C so that the image A matches the image C, and an image A ′ having no parallax with respect to the image C is created. Then, the high-sensitivity / high-DR image is created by synthesizing the high-DR image A ′ and the high-sensitivity image C.

  In this way, three high sensitivity / high DR images with parallax for three-dimensional display are created.

  On the other hand, if it is determined in step S12 that the high-sensitivity three-dimensional imaging mode is set, the CCDs 22 and 23 are driven, and each CCD output is A / D converted to obtain two images (step S22). .

  Subsequently, high-sensitivity three-dimensional image processing is performed based on the two acquired images (step S24). Here, image processing such as white balance adjustment, gamma processing, sharpness processing, and YC signal processing is performed on each of the two images.

  If it is determined in step S14 that the high DR three-dimensional imaging mode has been set, the CCDs 21 and 22 are driven, and each CCD output is A / D converted to obtain two images (step S26).

  Subsequently, high DR three-dimensional image processing is performed based on the two acquired images (step S28). In the high DR three-dimensional image processing, dynamic range expansion image processing is performed by performing processing similar to the processing in step S20, and two high-sensitivity / high DR images with parallax are generated.

  If it is determined in step S16 that the high DR two-dimensional imaging mode is set, the CCDs 21 and 22 are driven, and each CCD output is A / D converted to obtain two images (step S30).

  Subsequently, high DR two-dimensional image processing is performed based on the two acquired images (step S32). In this high DR two-dimensional image processing, the same processing as in step S20 is performed to perform dynamic range expansion image processing to create one high sensitivity / high DR image.

  On the other hand, if it is determined in step S16 that the high DR two-dimensional imaging mode is not set (in the case of “No”), the remaining two imaging modes are determined as the normal two-dimensional imaging mode, and the process proceeds to step S34. Transition. In step S34, the CCD 22 or 23 is driven, and the CCD output is A / D converted to obtain one image.

  Subsequently, two-dimensional image processing is performed based on the acquired one image (step S36). Here, image processing such as white balance adjustment, gamma processing, sharpness processing, and YC signal processing is performed on one high-sensitivity image.

  In step S38, a set shooting mode is selected from the five shooting modes of the high sensitivity / high DR 3D shooting mode, high sensitivity 3D shooting mode, high DR 3D shooting mode, high DR 2D shooting mode, and 2D shooting mode. Based on the above, the image (main image) created in step S14, S20, S26, S32, or S34 is compressed. The compressed main image is recorded on the memory card 42 (step S40).

  In this way, depending on the shooting mode set by the user, a plurality of CCDs having different sensitivities of the low-sensitivity CCD 21 and the high-sensitivity CCDs 22 and 22 are photographed in a single, all, or exclusively usable imaging sequence. Therefore, it is possible to provide a compound eye camera device with high functionality and added value.

[Fifth Embodiment]
FIG. 6 is a block diagram of a compound eye camera apparatus according to a fifth embodiment of the present invention.

  The compound-eye camera device shown in FIG. 6 has the CCDs 31, 32, 33, etc. of the third embodiment shown in FIG. 3, and the two-dimensional images, three-dimensional images, etc. acquired by photographing are stored in the memory card 42, etc. It is a compound eye digital camera that records on a recording medium.

  In FIG. 6, the same reference numerals are given to portions common to the block diagram of the compound eye camera device of the fourth embodiment shown in FIG. 4, and detailed description thereof is omitted.

  The compound eye camera device of the fifth embodiment shown in FIG. 6 is mainly different from the compound eye camera of the fourth embodiment shown in FIG. 4 in the CCDs 31, 32, and 33, and the corresponding point detection circuit 66 and the geometric deformation circuit 68. Is not provided.

  As described in the third embodiment shown in FIG. 3, the CCD 31 and the CCDs 32 and 33 have the same PD size (the same sensitivity), different numbers of pixels, and the CCD 31 has 6M pixels. Reference numeral 33 denotes 12M pixels.

  In addition, the shooting mode selection dial of the operation unit 44 ′ selects shooting modes such as a three-viewpoint three-dimensional shooting mode, a high-resolution three-dimensional shooting mode, a low-resolution three-dimensional shooting mode, a high-resolution two-dimensional shooting mode, and a two-dimensional shooting mode. It can be set.

  FIG. 7 is a flowchart showing the processing contents in each photographing mode by the compound eye camera device of the fifth embodiment of the present invention.

  In FIG. 7, when shooting is performed by fully pressing the shutter button, a three-viewpoint three-dimensional shooting mode, a high-resolution three-dimensional shooting mode, a low-resolution three-dimensional shooting mode, and a high resolution are performed in steps S50, S52, S54, and S56. It is determined which one of the two-dimensional imaging mode and the two-dimensional imaging mode is set.

  If it is determined in step S50 that the three-viewpoint three-dimensional imaging mode is set, the CCDs 31, 32, and 33 are driven, and each CCD output is A / D converted to obtain three images (step S58). .

  Subsequently, a three-viewpoint three-dimensional image process is performed based on the acquired three images (step S60).

  In this three-viewpoint three-dimensional image processing, three images for three-dimensional display each having a parallax are created. Note that the image acquired from the CCD 31 has 6M pixels, the images acquired from the CCDs 32 and 33 have 12M pixels, and the resolutions are different. When matching to a low resolution, a 12M pixel image acquired from the CCDs 32 and 33 is thinned out and interpolated to obtain a 6M pixel image. On the other hand, when matching to a high resolution, it is conceivable to geometrically deform the image of the CCD 32 or the CCD 33 so that the image of the CCD 32 or the CCD 33 coincides with the image of the CCD 31 (so that the image has no parallax). This geometric deformation can be performed by using the corresponding point detection circuit 66 and the geometric deformation circuit 68 shown in FIG.

  On the other hand, if it is determined in step S52 that the high-resolution three-dimensional imaging mode is set, the CCDs 32 and 33 are driven, and each CCD output is A / D converted to obtain two images (step S62). .

  Subsequently, high resolution three-dimensional image processing is performed based on the two acquired images (step S64). Here, image processing such as white balance adjustment, gamma processing, sharpness processing, and YC signal processing is performed for each of the two images.

  If it is determined in step S54 that the low-resolution three-dimensional imaging mode is set, the CCDs 31 and 32 are driven, and each CCD output is A / D converted to obtain two images (step S66). .

  Subsequently, low resolution three-dimensional image processing is performed based on the two acquired images (step S68). In this low-resolution three-dimensional image processing, thinning processing and interpolation processing are performed so that a 12M pixel image acquired from the CCD 32 becomes a 6M pixel image.

  The two images for three-dimensional display created in step S64 and the two images for three-dimensional display created in step S64 are images having different baseline lengths and convergence angles with respect to the two images. Thus, a three-dimensional image with a different stereoscopic effect is obtained during three-dimensional display.

  If it is determined in step S16 that the high-resolution two-dimensional imaging mode is set, the CCD 32 or 33 is driven, and the CCD output is A / D converted to obtain one image (step S70).

  Subsequently, high-resolution two-dimensional image processing is performed based on the acquired single image (step S72). In the high-resolution two-dimensional image processing, image processing such as white balance adjustment, gamma processing, sharpness processing, and YC signal processing is performed as in the processing in step S64.

  On the other hand, if it is determined in step S56 that the high resolution two-dimensional shooting mode is not set (in the case of “No”), the remaining shooting mode (low resolution) is determined as the two-dimensional shooting mode, The process proceeds to step S74. In step S74, the CCD 31 is driven, and the CCD output is A / D converted to obtain one image.

  Subsequently, two-dimensional image processing is performed based on the acquired single image (step S76). Here, image processing such as white balance adjustment, gamma processing, sharpness processing, and YC signal processing is performed on one low-resolution image.

  In step S78, a set shooting mode is selected from the five shooting modes of the three-viewpoint three-dimensional shooting mode, the high-resolution three-dimensional shooting mode, the low-resolution three-dimensional shooting mode, the high-resolution two-dimensional shooting mode, and the two-dimensional shooting mode. The image (main image) created in step S60, S64, S68, S72, or S76 is compressed based on the above. The compressed main image is recorded on the memory card 42 (step S80).

  As described above, according to the shooting mode set by the user, it is possible to perform shooting in an imaging sequence in which the three CCDs 31, 32, and 33 can be used singly, all, or exclusively. A compound eye camera device can be provided.

  In the fifth embodiment, the CCD 31 and the CCDs 32 and 33 have the same PD size but different numbers of pixels. However, the CCD 31 having the same number of pixels (12M pixels) as the CCDs 32 and 33 is used. The same processing as described above is possible.

In addition, when all the CCDs have high pixels (high resolution) with the same PD dimensions (same sensitivity characteristics),
(1) CCD unit price increases.

  (2) The CCD becomes larger.

  (3) Image processing takes time.

  However, if a low-resolution CCD is included when there are a plurality of CCDs as in the fifth embodiment, the above-mentioned disadvantages can be reduced, but the same image as when all the CCDs have high pixels is used. Can also get.

[Sixth Embodiment]
FIG. 8 is a main part configuration diagram of a compound eye camera device according to a sixth embodiment of the present invention.

  The compound-eye camera device of the sixth embodiment shown in FIG. 8 is a two-lens compound-eye camera device having two lenses 1-1 and 1-2, and the CCD substrate 40 is light of the lenses 1-1 and 1-2. It arrange | positions in a camera main body so that it may become parallel to an axis | shaft (optical path L1, L2, L3).

  Two CCDs 41-1 and 41-2 corresponding to the lenses 1-1 and 1-2 on a one-to-one basis are mounted on one CCD substrate 40. The CCD 41-1 is one of the CCD substrates 40. The CCD 41-2 is mounted on the other surface of the CCD substrate 40.

  The lenses 1-1 and 1-2 are configured to form a subject image on the light receiving surfaces of the CCDs 41-1 and 41-2 via total reflection mirrors 7-1 and 7-2, respectively.

  A main board 5 on which a control block for processing a CCD output signal and the like is mounted is disposed in the camera body. The CCD board 4 and the main board 5 are electrically connected by a single connector 43. It is connected to the.

  In the compound eye camera device of the sixth embodiment of the present invention, the CCD substrate 40 of the two CCDs 41-1 and 41-2 can be integrated into one sheet, and both surfaces of the CCD substrate 40 are used as mounting surfaces. The substrate 40 can be made compact, and the apparatus can be miniaturized.

  In addition, the CCD substrate 40 and the main substrate 5 can be connected by the single connector 43, the connection can be simplified, and the cost of the apparatus can be reduced.

  In FIG. 8, the optical paths L1 and L2 of the lenses 1-1 and 1-2 are shown in parallel, but the lenses 1-1 and 1-2 are optical paths L1, L2, and L3 at a predetermined distance. Are arranged so as to intersect (with a convergence angle). Thereby, the same subject can be photographed from different viewpoint positions, and two images for three-dimensional display can be acquired.

[Others]
In the embodiment shown in FIG. 4, the analog processing circuits 60a to 60c and the A / D converters 62a to 62c are provided on the main substrate 5 side, but the analog processing circuits 60a to 60c or A on the CCD substrate 4 side. / D converters 62a to 62c may be provided.

  In this embodiment, a two-eye and three-eye compound camera device has been described. However, the present invention can also be applied to a compound eye camera device having four or more eyes.

  Moreover, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present invention.

  DESCRIPTION OF SYMBOLS 1 ... Main lens, 1-1, 1-2 ... Lens, 2, 3 ... Sub lens, 4, 40 ... CCD board, 5 ... Main board, 6 ... Connection cable, 7a, 7b, 7-1, 7-2 8a, 8b ... Total reflection mirrors 11, 12, 13, 21, 22, 23, 31, 32, 33, 41-1, 41-2 ... Imaging devices (CCD), 42 ... Memory cards, 43 ... Connectors, 44 ... operation unit, 50 ... central processing unit (CPU), 64, 64 '... image processing circuit, 66 ... corresponding point detection circuit, 68 ... geometric deformation circuit

Claims (10)

A plurality of photographing optical systems;
A plurality of imaging elements corresponding one-to-one with the plurality of imaging optical systems;
A single image pickup device substrate on which the plurality of image pickup devices are mounted, wherein the image pickup device is mounted on both sides of the image pickup device substrate; and
An optical member that bends all or part of the optical paths of the plurality of photographing optical systems and forms a subject image on a corresponding imaging device;
A compound eye camera device comprising: A main board on which a control block for processing output signals output from the plurality of image sensors is mounted;
The compound-eye camera device according to claim 1, wherein the imaging element substrate and the main substrate are connected by a single cable or a single connector.   3. The compound eye camera device according to claim 1, wherein the plurality of image pickup devices include different types of image pickup devices that differ in at least one of the number of pixels, the size of the light receiving surface, and the sensitivity. The imaging element substrate is disposed so as to be orthogonal to the optical axes of the plurality of imaging optical systems,
The plurality of image sensors are separately mounted on the front surface and the back surface of the image sensor substrate,
The optical member bends an optical path of a corresponding photographing optical system so that a subject image is formed on an image sensor mounted on a back surface of the image sensor substrate. A compound eye camera device according to 1.   The compound-eye camera device according to claim 4, wherein the image sensor mounted on the front surface of the image sensor substrate has a smaller light receiving surface than the image sensor mounted on the back surface of the image sensor substrate. A mode for selecting a desired shooting mode from the plurality of shooting modes, having a plurality of shooting modes for acquiring one image or a plurality of images by using any one or a plurality of the image pickup devices at the same time A selection means;
Control means for driving any one or more of the plurality of image sensors in accordance with the imaging mode selected by the mode selection means, and processing an image acquired from the driven image sensor;
The compound eye camera apparatus according to claim 3, further comprising:   The compound-eye camera device according to claim 6, wherein each of the plurality of image pickup devices includes different types of image pickup devices having the same number of pixels and different sensitivities.   The plurality of shooting modes are a first shooting mode for acquiring a plurality of images for three-dimensional display with high sensitivity and high dynamic range, and a plurality of images for three-dimensional display with high sensitivity and low dynamic range. A third shooting mode for acquiring a plurality of images for three-dimensional display with two shooting modes, low sensitivity and high dynamic range, and a fourth for acquiring a single image for two-dimensional display with low sensitivity and high dynamic range. 8. The compound eye according to claim 7, comprising two or more shooting modes of the fifth shooting mode for acquiring a single image for two-dimensional display with high sensitivity and low dynamic range. Camera device.   The compound eye camera device according to claim 6, wherein the plurality of imaging optical systems and the plurality of imaging elements are respectively three imaging optical systems and imaging elements.   The plurality of shooting modes are a first shooting mode for acquiring three images for three-dimensional display, a second shooting mode for acquiring two images for three-dimensional display, and a single image for two-dimensional display. The compound-eye camera device according to claim 9, comprising two or more shooting modes out of the third shooting modes for acquiring the image of the above.

Images