JP2015029214A - Compound-eye imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a compound-eye imaging device which comprises plural optical systems different in focal distance, and allows checking the effect of variation in focal distance in advance of imaging, when imaging by an intra-exposure zooming imaging mode.SOLUTION: A compound-eye imaging device comprises: compound-eye imaging means which simultaneously captures optical images of plural focal distances; display means for displaying photographic images captured when imaging; an optical member for capturing the optical images photographed at plural focal distances; control means for controlling the compound-eye imaging device; and configuration means capable of configuring the compound-eye imaging device to the intra-exposure zooming imaging mode. When the device is configured to the intra-exposure zooming imaging mode, the control means displays at least one simulation image of intra-exposure zooming imaging obtained by combining the optical images of plural focal distances, on the display means.

Description

  The present invention relates to an imaging apparatus represented by a digital camera, and more particularly to an imaging apparatus having a plurality of optical systems having different focal lengths.

  Conventionally, an imaging device such as a video camera or a digital camera is required to be thin and have a high zoom ratio. In a conventional general imaging system, an optical system is configured by combining a plurality of optical lenses in order to suppress the occurrence of aberrations in the optical system and satisfy desired optical performance. In order to reduce the size of such an optical system, it is conceivable to reduce the image size and the aperture of the optical system. However, it is difficult to reduce the image size while maintaining the resolution.

  On the other hand, a compound eye imaging device that realizes a compact optical system by dividing the optical system into a plurality of parts has been proposed. A plurality of lens units with different angles of view are prepared, and an image sensor is provided for each lens unit so that a plurality of angles of view can be photographed. Each lens unit has a smaller diameter and a shorter focal length, and an optical system. A configuration for reducing the size is known.

  However, in the compound-eye imaging device, it becomes clear how to display the imaging conditions on the rear liquid crystal when imaging using various imaging techniques performed by a conventional monocular imaging device. Not.

  One of the special imaging techniques that has been performed is zoom between exposures. The zoom between exposures is zooming between the time when the shutter is opened and the time when the shutter is closed.

  As an example of displaying photographing information or the like on a rear liquid crystal or the like when performing zooming between exposures with a conventional monocular imaging device, there is, for example, Patent Document 1.

  In Patent Document 1, after shifting to the during-exposure zoom shooting mode, a simulation image of the during-exposure zoom shooting corresponding to the shooting pattern selected by the operator is generated and displayed. It is disclosed to perform zooming shooting between exposures with a selected shooting pattern after storing distance information.

JP 2010-045586 A

  However, in Patent Document 1, since the image obtained by the zoom between exposures is a specification that can be confirmed for the first time after the actual photographing, it is not possible to confirm whether or not it matches the photographer's image. Inconvenient for.

  Accordingly, an object of the present invention is to provide a compound eye imaging apparatus capable of confirming the effect of a change in focal length before photographing.

Compound eye imaging means for simultaneously capturing optical images of a plurality of focal lengths;
Display means for displaying a captured image at the time of imaging;
An optical member for capturing an optical image photographed at the plurality of focal lengths;
Control means for controlling the compound-eye imaging device;
A setting unit capable of setting the compound-eye imaging apparatus to a zoom exposure mode during exposure;
When set to the during-exposure zoom photographing mode, the control means displays at least one simulation image of the during-exposure zoom photography combining the optical images of the plurality of focal lengths on the display means.

  According to the present invention, it is possible to provide a compound eye imaging apparatus capable of confirming the effect of a change in focal length before photographing when the between-exposure zoom photographing mode is set.

Block diagram of compound eye imaging device of the present invention The perspective view of the imaging unit of the compound eye imaging device of the present invention Front view of the imaging unit shown in FIG. Rear view of compound eye imaging apparatus 1 Examples of images taken by each imaging optical system The figure which shows the example of a display of the display part 70 at the time of imaging | photography. The figure which shows the example of a display of the display part 70 at the time of imaging | photography mode between exposures Operation flow diagram at the time of photographing in the first embodiment of the present invention Operation flow diagram at the time of photographing in the second embodiment of the present invention The figure which shows the relationship between the focal distance and the imaging | photography possible range of a person's face in 2nd Example of this invention. The figure which shows the modification of the 2nd Example of this invention

  Hereinafter, the present invention will be described in detail with reference to the drawings.

[Example 1]
Hereinafter, the compound eye imaging device of the present invention will be described with reference to FIGS.

  FIG. 1 is a block diagram of the compound-eye imaging device 1 according to the first embodiment, FIG. 2 is a perspective view of the imaging unit 100 of the compound-eye imaging device 1, and FIG. 3 is a front view of the imaging unit 100.

  A camera system including the compound-eye imaging device 1 and the lens 102 includes an imaging system, an image processing system, a recording / reproducing system, and a control system. The imaging system includes a photographing optical system 101 and an imaging element 210, and the image processing system includes an image processing unit 150. The recording / reproducing system includes a memory 197 and a display unit 70, and the control system includes a CPU 30, a lens CPU 103, a zoom lens driving unit 111 that is a lens driving unit, and a focus group driving unit 121.

  FIG. 4 is a rear view of the camera system.

  The compound-eye imaging device 1 includes an imaging unit 100, an A / D converter 10, an image processing unit 20, a CPU 30, an imaging control unit (imaging control means) 40, an information input unit 50, an image recording medium 60, a display unit 70, and distance information. A calculation unit 80 is included. The compound-eye imaging device 1 may be a lens-integrated imaging device as shown in FIG. 1, a lens device having an imaging optical system (imaging optical system), and a lens device that is detachably mounted and has an imaging element. You may comprise from an imaging device main body.

  As shown in FIGS. 1 to 3, the imaging unit 100 includes eight imaging optical systems (imaging optical systems) 110a, 110b, 120a, 120b, 130a, 130b, 140a, and 140b, each of which forms an optical image of an object. And a plurality of imaging elements 210a and 210e respectively corresponding to one of the plurality of imaging optical systems. FIG. 1 is a cross-sectional view including the optical axes of the imaging optical systems 110a and 140a of the imaging unit 100.

  Each imaging optical system corresponds to the optical member of the present invention. Each imaging optical system includes a focus group unit 105F and a rear group unit 105R. As shown in FIG. 1, the focus group unit 105F is integrally held by a folder 300 so as to move by the same amount during focusing, and the focus group drive unit 121 using an ultrasonic motor or a stepping motor as a drive source moves the optical axis direction. Can be driven. The focus group voltage driver 123 generates a voltage for driving and controlling the focus group driving unit 121.

  The focus position detection unit 122 is a focus encoder that detects the position of the focus group unit 105F along the optical axis I. The focus position detection unit 122 outputs a pulse signal corresponding to the subject distance value to the imaging control unit 40.

  The imaging control unit 40 controls the focus group driving unit 121, and the focus group unit 105F is driven to a position on the optical axis I at which the subject distance is detected by the operation of the release switch 191 of the user's compound eye imaging device 1, for example. This is the part that performs tracking control.

  Further, the imaging control unit 40 takes in a pulse signal output from the focus position detection unit 122. The imaging control unit 40 calculates a drive signal based on the position (target position) on the optical axis I that is the subject distance, the current position information of the focus group unit 105F, and the like, and this digital drive signal is sent to the focus group voltage driver 123. Output.

  The focus group voltage driver 123 is a driver unit that supplies power to the focus group drive unit 121 in accordance with an input drive signal (drive voltage). The focus group voltage driver 123 switches the drive signal, applies a voltage to the focus group drive unit 121, and drives the focus group drive unit 121.

  The rear group unit 105R is integrally held by the folder 310, and is fixed at the time of focusing.

  Also, other members such as a diaphragm (not shown) are included in each imaging optical system. The plurality of image sensors 210 a to 210 f are integrally held to constitute the image sensor unit 200. Therefore, the imaging element unit 200 corresponds to the compound eye imaging means of the present invention.

  The imaging element 210a corresponds to the imaging optical system 110a, the imaging element 210b corresponds to the imaging optical system 120a, the imaging element 210c corresponds to the imaging optical system 110b, and the imaging element 210d corresponds to the imaging optical system 120b. To do. The imaging element 210e corresponds to the imaging optical system 140a, the imaging element 210f corresponds to the imaging optical system 130a, the imaging element 210g corresponds to the imaging optical system 140b, and the imaging element 210h corresponds to the imaging optical system 130b. To do.

  The image sensors 210a to 210f are specifically CMOS process compatible sensors (hereinafter abbreviated as CMOS sensors) which are one of the amplification type solid-state image sensors. One of the features of the CMOS sensor is that the MOS transistors in the area sensor and the peripheral circuits such as the imaging device drive circuit, AD converter circuit, and image processing circuit can be formed in the same process. It can be greatly reduced.

  As shown in FIG. 3, the optical axes of the eight imaging optical systems 110a, 120a, 130a, 140a, 110b, 120b, 130b, and 140b are arranged to be substantially parallel.

  Further, the two imaging optical systems a and b having the same reference numerals have the same focal length, and in this embodiment, four sets of imaging optical systems having different focal lengths are provided.

  The imaging optical systems 110a and 110b are a pair of wide-angle imaging optical systems having the shortest focal length among the eight imaging optical systems.

  The imaging optical systems 120a and 120b are a pair of imaging optical systems having a longer focal length than the imaging optical systems 110a and 110b.

  The imaging optical systems 130a and 130b are a pair of imaging optical systems having a longer focal length than the imaging optical systems 120a and 120b.

  The imaging optical systems 140a and 140b are a pair of imaging optical systems having a longer focal length than the imaging optical systems 130a and 130b.

  In FIG. 3, the focal lengths of the imaging optical systems 110a and 110b are 35 mm, the focal lengths of the imaging optical systems 120a and 120a are 75 mm, the focal lengths of the imaging optical systems 130a and 130b are 150 mm, and the imaging optical system. The focal lengths of 140a and 140b are set to 300 mm.

  FIG. 5 shows captured images 1110a, 1120a, 1130a, 1140a corresponding to the imaging optical systems 110a, 120a, 130a, 140a.

  As shown in FIG. 5, the captured image 1110a corresponding to the imaging optical system 110a is the widest subject space, and the captured images 1120a, 1130a, and 1140a corresponding to the imaging optical systems 120a, 130a, and 140a have a focal length. Accordingly, the subject space to be imaged is narrowed.

  Referring back to FIG. 1, the imaging optical systems 110a and 140a constitute a compound eye, and the imaging elements 210a and 210e convert the optical images that have reached the imaging element surface via the imaging optical systems 110a and 140a, respectively, into electrical signals (analogues). Signal).

  The A / D converter 10 converts the analog signals output from the image sensors 210 a to 210 h into digital signals and supplies them to the image processing unit 20.

  The image processing unit 20 performs predetermined pixel interpolation processing, color conversion processing, and the like on each image data from the A / D converter 10, and predetermined calculation processing is performed using each captured image data. . The result processed by the image processing unit 20 is transmitted to the CPU 30.

  The image processing unit 20 includes a super-resolution processing unit (super-resolution processing unit) 21, an image synthesis unit (image synthesis unit) 22, a blur addition unit 23, and a subject removal unit 24.

  The super-resolution processing unit 21 performs high-resolution processing of an image using a plurality of images to be described later. The image composition unit 22 generates one composite image having different image characteristics from a plurality of images, and performs processing such as lowering the noise level and creating a high dynamic range image, for example.

  The image characteristic is any one of an image dynamic range, resolution, blur amount, angle of view, and removal rate of a photographed subject.

  The blur adding unit 23 adds blur to an image based on distance information obtained by a distance information acquisition method described later.

  For example, the subject removing unit 24 obtains an image in which the background other than the main subject that is designated as unnecessary by the photographer is removed based on the distance information. The CPU 30 is a central processing unit that performs various controls of the entire compound-eye imaging apparatus 1 and controls the imaging control unit 40 based on the supplied data.

  Further, the information of the release switch 191 is input to the CPU 30, and it can be detected that the release switch 191 is half-pressed or fully pressed. Thereby, driving of the image sensor 210, operation of the image processing unit 150, compression processing of the memory 197, and the like are controlled. Further, the state of each segment of the information display device that displays information on a liquid crystal monitor or the like is controlled by a display unit 70 described later. Therefore, the CPU 30 corresponds to the control means of the present invention.

  In addition to the control of the amount of movement of the focus group 105F, the imaging control unit 40 is not shown depending on the numerical values of the imaging conditions such as the aperture value and shutter speed of each imaging optical system input from the CPU 30. Necessary images are acquired by controlling the aperture and controlling the image sensor.

  Each focus group satisfies the optical conditional expression for making the same amount of focusing movement in a plurality of imaging optical systems having different focal lengths, but differs from the gist of the present invention. Omitted.

  Therefore, by photographing at the position of the focus group unit 105F controlled by the imaging control unit 40, a plurality of in-focus images having the same angle of view as different subject space ranges (field angles) are acquired by one control.

  The image recording medium 60 stores a plurality of still images and moving images, and also stores a file header when an image file is configured.

  The display unit 70 is attached to the back surface of the compound eye imaging device 1 so that the user can directly observe the display of the image displayed on the display unit 70, the imaging condition setting state of the compound eye imaging device 1, or errors. It has become. Therefore, the display unit 70 corresponds to the display unit of the present invention.

  If the display unit 70 is composed of an organic EL spatial modulation element, a liquid crystal spatial modulation element, a spatial modulation element using fine particle electrophoresis, etc., the power consumption can be reduced and the display unit 70 can be made thin. . Thereby, power saving and size reduction of the compound eye imaging device 1 can be achieved.

  Further, by directly operating the surface of the display unit 70, the setting of the photographing conditions displayed on the display unit 70 can be changed, the display of errors and the like can be deleted, and further, as described later, zoom between exposures can be performed. A configuration in which a shooting pattern can be set is also possible.

  The distance information calculation unit (distance information calculation unit) 80 includes a reference image selection unit 81, a corresponding point extraction unit 82, and a parallax amount calculation unit 83.

  The reference image selection unit 81 selects a reference image from a plurality of parallax images formed by each imaging optical system. The corresponding point extraction unit 82 extracts corresponding pixels in the parallax image. The parallax amount calculation unit 83 calculates the parallax amount of all the extracted corresponding points, and the distance information calculation unit 80 calculates subject distance information in the image from the calculated parallax amount.

  As described above, the release switch 191 detects a half-press operation of the release button (not shown) (ON of SW1), starts a series of shooting preparation operations (photometry operation, focus adjustment operation, etc.), and fully presses the release button. This switch detects an operation (ON of SW2) and starts a photographing operation (recording of image data read from the image sensor 210 on a recording medium).

  A selection switch 192 that can be operated in an arbitrary direction is used to select an item of a well-known shooting menu (not shown) or to select a pattern for zooming between exposures as will be described later. .

  Reference numeral 193 denotes a determination switch, which is used when a known shooting menu (not shown) is determined or when the user determines a pattern for zooming between exposures as will be described later. Reference numeral 195 denotes a main switch for starting the compound eye imaging apparatus 1. Reference numeral 196 denotes a mode switch for setting a photographing mode of the compound-eye imaging apparatus 1, and a “inter-exposure zoom photographing mode” described later can be set. Therefore, the mode switch 196 corresponds to the setting unit of the present invention.

  A memory 197 includes a processing circuit necessary for recording in addition to an actual storage unit. The memory unit generates and stores an image to be output to the display unit 70 while outputting to the recording unit. In addition, the memory 197 compresses images, moving images, sounds, and the like using a predetermined method.

  FIG. 6 is a diagram illustrating a state of a subject image displayed on the display unit 70 during so-called live view shooting. FIG. 6 shows a case where a subject image captured by the imaging optical system 120a having a focal length of 75 mm is shot in live view.

  6, the display unit 70 includes a photographic area (view angle) indicating a subject image 310 captured by the imaging optical system 120a and a range (angle of view) in which each imaging optical system 110a to 140b can perform zooming during exposure. 6, a shootable area 71 that can be zoomed during exposure with the imaging optical system 130a having a focal length of 150 mm and a shootable area 72 that can be zoomed during exposure with the imaging optical system 140a having a focal length of 300 mm are displayed. Display area 70a and shooting information 70b such as shooting conditions (shutter speed, aperture value, ISO sensitivity, etc.) and battery remaining amount display are displayed.

  As shown in FIG. 2, since the image pickup devices 210a to 210h are arranged in the image pickup device 200, the shooting angle of view of each of the imaging optical systems 110a to 140a is slightly in accordance with the arrangement of the image pickup devices 210a to 210h. Sneak away. Therefore, by displaying the deviation of the shooting angle of view of each of the imaging optical systems 110a to 140a in the display area 70a together with the subject image 310, the shooting angle of view of each of the imaging optical systems 110a to 140a (for example, the shootable area 71) is displayed to the user. ) Can be recognized at the time of shooting.

  Therefore, since the user can recognize the shooting angle of view of each of the imaging optical systems 110a to 140a at the time of shooting, the user can check the shooting angle of view that can be taken during the exposure zoom, so that the convenience for the user is improved. .

  Even during normal shooting other than the below-exposure zoom shooting mode, which will be described later, the shooting angle of view of each of the imaging optical systems 110a to 140a is displayed together with the subject image 310 in the display area 70a, thereby improving user convenience. Needless to say.

  FIG. 7 shows an example displayed on the display unit 70 when the compound eye imaging apparatus 1 is set to the “exposure zoom shooting mode” described later. In FIG. 7, preview images 310, 320, and 330 are displayed on the display unit 70 when zooming between exposures obtained by a combination of the imaging optical systems 110 a to 140 a is performed. Note that the preview images 310, 320, and 330 correspond to the simulation image of the present invention.

  The preview image 310 is an image of a zoom image between exposures obtained when zooming to 300 mm, which is the focal length of the imaging optical system 140a, during exposure at the time of photographing with the imaging optical system 110a having a focal length of 35 mm. Yes. That is, it can be said that the preview image 310 is an image obtained by combining a plurality of optical images obtained by the imaging optical system 110a and the imaging optical system 140a.

  Similarly, the preview image 320 is an image of an inter-exposure zoom image obtained when zooming to 150 mm, which is the focal length of the imaging optical system 130a, during exposure at the time of shooting with the imaging optical system 110a having a focal length of 35 mm. It has become. That is, it can be said that the preview image 320 is an image obtained by combining a plurality of optical images obtained by the imaging optical system 110a and the imaging optical system 130a.

  Further, among the preview images 330, the preview image 331 is an exposure obtained when zooming to 75 mm, which is the focal length of the imaging optical system 120a, during exposure at the time of photographing with the imaging optical system 110a having a focal length of 35 mm. It is a zoom image. That is, it can be said that the preview image 331 is an image obtained by combining a plurality of optical images obtained by the imaging optical system 110a and the imaging optical system 120a.

  The preview image 332 is an image of a zoom image between exposures obtained when zooming to 300 mm, which is the focal length of the imaging optical system 140a, during exposure at the time of shooting with the imaging optical system 130a having a focal length of 150 mm. It has become. That is, it can be said that the preview image 332 is an image obtained by combining a plurality of optical images obtained by the imaging optical system 130a and the imaging optical system 140a.

  That is, the preview image 310 is a combination having the largest change in focal length during zooming during exposure.

  On the other hand, the preview image 330 (preview images 331 and 332) is a combination having the smallest change in focal length during zooming during exposure. In addition, the preview image 320 has an intermediate focal length change between the preview images 310 and 330 during zooming between exposures.

  Therefore, it can be said that the preview images 310, 320, and 330 are preview images of inter-exposure zoom photography that combine optical images having a plurality of focal lengths. On each preview image 310, 320, 330, the magnitude of the change in focal length of each preview image, that is, the magnitude of the effect of zoom between exposures is displayed.

  As shown in FIG. 7, the preview image 310 has the largest change in the focal length during zooming between exposures as described above, and therefore the effect of zooming between exposures is great. Is displayed.

  Similarly, since the effect of zooming between exposures is intermediate on the preview image 320, an index 73b of “in effect” is displayed, and the effect of zooming between exposures is displayed on the preview image 330. Since it is small, an index 73c “small effect” is displayed. Further, the change in the focal length of each preview image is displayed below each preview image 310, 320, 330.

  As described above, since the change in the focal length at the time of zoom shooting during exposure is 35 mm to 300 mm, the preview image 310 displays the focal length change display 74a of “35-300”.

  Similarly, the preview image 320 displays the focal length change display 74b of “35-150” because the focal length change during the zooming between exposures is 35 mm to 150 mm as described above.

  Similarly, the preview image 331 displays the focal length change display 74c of “35-75” because the change in focal length at the time of zoom exposure during exposure is 35 mm to 75 mm as described above.

  Similarly, the preview image 332 displays the focal length change display 74d of “150-300” because the focal length change during the exposure zoom shooting is 150 mm to 300 mm as described above. That is, the focal length change displays 74a, 74b, and 74c correspond to focal length information at the time of zoom exposure during exposure according to the present invention.

  In this way, the effect of zoom between exposures and the change in focal length at the time of zooming between exposures are displayed along with the preview image. Whether or not the zoom effect can be obtained can be confirmed before photographing together with the during-exposure zoom image, which is convenient. A method for combining the preview images 310, 320, and 330 will be described later.

  In the compound eye imaging apparatus 1 of the present invention, the user can select the preview images 310 to 330, and the user can select the desired preview images 310 to 330 before performing the shooting operation in the during-exposure zoom shooting mode. By selecting one of the images, any one of the selected preview images 310 to 330 can be obtained when the user shoots.

  Therefore, since the user can confirm the effect of the change in focal length before photographing the zoom during exposure, the convenience of the user is improved by the present invention.

  FIG. 8 is a flowchart for explaining the operation when photographing with the compound-eye imaging device 1 of the present invention. Hereinafter, the operation of the compound-eye imaging device 1 will be described using this.

  In step (hereinafter referred to as S) 1010, the CPU 30 determines whether or not the main switch 195 is ON. If the main switch 195 remains OFF, the compound eye imaging device 1 remains in the sleep state, and if the main switch 195 is ON, the process proceeds to S1020.

  In S1020, the CPU 30 determines whether or not the compound-eye imaging device 1 is in the “inter-exposure zoom shooting mode”. As a result, when the “inter-exposure zoom shooting mode” is set (if Yes), the process proceeds to S1030.

  If the “inter-exposure zoom shooting mode” is not set (in the case of No), shooting is performed using any one of the imaging optical systems 110a, 120a, 130a, and 140a, and the process proceeds to S1400. . Note that the operation flow of the compound-eye imaging device 1 in S1400 is different from the gist of the present invention, and the details thereof are omitted.

  In S1030, the display unit 70 is displayed to prompt the user to press the release switch 191 halfway and turn on the SW1. This is performed in order to acquire a preview image of the after-exposure zoom shooting described later.

  In S1040, the CPU 30 determines whether the user has performed the half-pressing operation of the release switch 191 to turn on the SW1. If SW1 is turned on (Yes), the process proceeds to S1050.

  In S1050, the distance to the subject is calculated by measuring the subject from the image information acquired by the image sensor 210 and operating the parallax amount calculation unit 83 described above. Alternatively, the compound-eye imaging device 1 may include a photometry unit and a distance measurement unit (not shown), and the photometry and the range measurement may be performed by operating the photometry unit and the range measurement unit.

  In S1060, the imaging control unit 40 receives the calculation result of S1050 from the CPU 30, and then the focus group unit 105F is driven by the focus group driving unit 121 so that the subject obtained in S1050 is in a focused state. Move 105F.

  In S1070, the CPU 30 acquires the image focused on the subject in S1060, and based on the image, synthesizes an inter-exposure zoom photographed image obtained by a combination of the imaging optical systems 110a to 140a included in the compound-eye imaging device 1. .

  Specifically, as described above, the preview images 310, 320, and 330 are synthesized. More specifically, in each of the preview images 310, 320, and 330, which are optical images photographed at a plurality of focal lengths, a so-called short focal length image among two combined focal length images is so-called. Pseudo zoom image processing is performed to create a predetermined number of images that are enlarged step by step up to the image size of the longer focal length. Thereafter, the contrast of these images is adjusted, the overlapping portion is processed, the bright spots and contours of the subject are radially extended, and the like are combined (see FIG. 7).

  In S1080, the preview images 310, 320, and 330 of the during-exposure zoom photographed image generated in S1070 are displayed on the display unit 70 as preview images before photographing.

  Note that the preview image 310 has the largest change in zoom magnification (for example, the focal length changes from 35 mm to 300 mm), and the preview image 320 has the largest change in zoom magnification next to the preview image 310 (for example, The example in which the focal length changes from 35 mm to 150 mm) is an example in which the preview image 330 has the smallest change in zoom magnification (for example, the focal length ranges from 35 mm to 75 mm) in the combination of the imaging optical systems included in the compound-eye imaging device 1. , And an example of changing from 150 mm to 300 mm).

  In step S1090, the display unit 70 is displayed to prompt the user to select a preview image close to the zoom exposure during exposure desired by the user. In S1100, the CPU 30 determines whether the user has selected any of the preview images 310, 320, 331, and 332.

  Specifically, the selection switch 192 is operated to select one of the preview images 310, 320, 331, and 332, and then the determination switch 193 is operated to determine whether or not the preview image for the during-exposure zoom shooting has been determined. The CPU 30 makes a determination. If Yes, the process proceeds to S1110.

  When a preview image can be selected / determined by directly operating the surface of the display unit 70, a desired preview image is determined by directly selecting one of the preview images 310, 320, 331, 332. The structure which can do is also good.

  In S1110, the CPU 30 stores a combination of focal lengths according to the preview image selected / determined by the user in S1100 in a storage unit (not shown) included in the CPU 30 itself. For example, if the CPU 30 determines in S1100 that the user has selected / determined the preview image 320, in S1110, the CPU 30 stores 35mm and 150mm, which are combinations of focal lengths of the preview image 320.

  In S1120, the CPU 30 determines whether the release switch 191 has been fully depressed (whether SW2 is turned on). If Yes, the process proceeds to S1130. In S1130, a known shooting operation is performed. In S1140, the CPU 30 selects a subject image formed on the image sensor 210 corresponding to the imaging optical system having the focal length stored by the CPU 30 in S1110.

  Specifically, as described in S1110, when the CPU 30 determines in S1100 that the user has selected / determined the preview image 320, in S1140, the combination of the focal lengths of the preview image 320 is obtained. The CPU 30 stores the subject image of the imaging element 210a corresponding to the imaging optical system 110a having a focal length of 35 mm and the subject image of the imaging element 210f corresponding to the imaging optical system 130a having a focal length of 150 mm. .

  In S1150, the two subject images selected in S1140 are each processed by the image processing unit 20 through a known image processing technique, and then the two processed images are used to synthesize an image that has been zoomed between exposures.

  Specifically, as in S1070, among the two focal length images to be combined, based on the shorter focal length image, the change in the focal length and the bright spots and contours of the shorter focal length are radiated. It is synthesized by stretching (see FIG. 7). In step S1160, the inter-exposure zoom image combined in step S1150 is displayed on the display unit 70.

  In S <b> 1170, a message is displayed on the display unit 70 to confirm to the user whether or not the during-exposure zoom image displayed on the display unit 70 in S <b> 1160 may be recorded. Specifically, for example, a message for confirming the user's intention of “Is this image OK?” And a decision message of “Yes / No” are simultaneously displayed on the display unit 70.

  In S1180, the CPU 30 determines whether it is possible to record the during-exposure zoom image displayed on the display unit 70 in S1160. Specifically, for example, the user selects the “Yes / No” decision message “Yes / No” displayed in S1170 using the selection switch 192 and the decision switch 193, and determines whether the decision has been made. CPU30 performs.

  Moreover, the structure which selects and determines either "Yes / No" of the decision message of "Yes / No" by directly operating the surface of the display part 70 may be sufficient. If No in S1180, the process proceeds to S1300. On the other hand, if Yes in S1180, the process proceeds to S1190. In S <b> 1190, the during-exposure zoom image synthesized in S <b> 1150 is recorded in the memory 197 or the image recording medium 50. In S1200, the CPU 30 determines whether or not the during-exposure zoom shooting mode is continued, that is, whether or not SW2 is OFF. If the full pressing operation of the release switch 191 is continued, that is, if SW2 is ON (Yes), the process returns to S1030 and a series of sequences is repeated. If No, the process proceeds to S1210.

  In S1210, the CPU 30 determines whether or not the main switch 195 is turned off. In the case of No, the process returns to S1010 to perform a series of shooting operations. In the case of Yes in S1210, the shooting operation is terminated.

  By the way, in the case of No in S1180, the process proceeds to S1300. In step S1300, the user confirms the display in step S1160, and changes to the inter-exposure zoom shooting with a combination of focal lengths different from the focal length change of the inter-exposure zoom shooting selected by the user in step S1100. Based on the photographed subject image, the combined between-exposure zoom photographed images including all focal length combinations including the change in the focal length selected in S1100 are synthesized. In S1310, the image of the zoom exposure during exposure combined in S1300 is displayed on the display unit 70 in the same manner as the preview images 310, 320, 331, and 332.

  In S1320, a display for prompting the user to select which of the exposure zoom shooting images is displayed on the display unit 70 in S1310 is displayed on the display unit 70. In S1330, the CPU 30 determines whether or not the user has selected an image for zoom shooting during exposure. Specifically, as in S1100, the selection switch 192 and the determination switch 193 are operated, and the CPU 30 determines which image during zooming during exposure is selected by the user. If Yes, the process proceeds to S1190.

  As described above, the user confirms the effect of the change in focal length before photographing by confirming the preview images 310, 320, and 330 at the time of zooming between exposures displayed on the display unit 70 before photographing. Things are possible. In other words, a compound eye imaging device that simultaneously captures optical images of a plurality of focal lengths, and can be used to confirm the effect of changing the focal length before photographing when set to the between-exposure zoom photographing mode. I can do it.

[Example 2]
The second embodiment of the present invention will be described below with reference to FIGS. FIG. 9 is an operation flowchart of the second embodiment of the present invention. The difference from the operation flow diagram of the first embodiment described above is that an operation flow related to “face detection” is inserted between S1060 and S1070 in FIG.

  Hereinafter, in the second embodiment, a description will be given of differences in the preview image displayed on the display unit 70 in accordance with the result of face detection described later.

  In the operation flow diagram of FIG. 9, S2010 to S2060 are the same as S1010 to S1060 of the first embodiment, and thus description thereof is omitted. In S2070, in S2060, the image focused on the subject in the image sensor 210a is analyzed, and the CPU 30 confirms whether or not there is a face as a subject in the image. As the face detection technique, for example, a known face detection technique using image processing such as hue detection or edge detection is used. That is, based on the image focused on the subject in the image sensor 210a, the above-described face detection processing is performed on the image data to detect the face area of the person and the positions of the eyes and mouth. Therefore, the CPU 30 corresponds to the face detection means of the present invention.

  Further, the reason for analyzing the image of the subject imaged on the image sensor 210a and confirming the presence or absence of a face region (hereinafter referred to as a face) as the subject is as follows. Since the imaging element 210a forms an image on the imaging optical system 110a having the shortest focal length among the imaging optical systems of the compound-eye imaging device 1, all subjects that can be photographed by the compound-eye imaging device 1 are all within the captured image. It will be in. Therefore, it is optimal to check whether or not there is a face as a subject in the image using a photographed image of the subject imaged on the image sensor 210a.

  In S2080, the CPU 30 confirms the result confirmed in S2070 and determines whether or not there is a face as a subject. As a result, if there is no face as the subject, that is, if No, the process proceeds to S2100, and the same processing as in the first embodiment is performed. As a result, preview images 310, 320, and 330 are displayed on the display unit 70 as shown in FIG.

  On the other hand, if there is a face as a subject in S2080, that is, if Yes, the flow proceeds to S2090.

  In S2090, a focal length that is inappropriate as a source image when combining an image obtained by zooming between exposures from the size of the subject's face in the image formed on the image sensor 210a via the imaging optical system 110a. Perform the operation. Inappropriate here means that a part of the face of the subject is missing in the original image.

  This will be specifically described with reference to FIG. In FIG. 10, FIG. 10A is a diagram showing the relationship between the shootable range 75 imaged on the image sensor 210a and the subject 350 when the subject 350 (person) is photographed by the imaging optical system 110a. 10 (b) is a diagram showing the relationship between the shootable range 75 imaged on the image sensor 210b and the subject 350 when the subject 350 is photographed by the imaging optical system 120a, and FIG. FIG. 6 is a diagram illustrating a relationship between a photographic range and a subject 350 that is imaged on an image sensor 210f when the subject 350 is photographed with an optical system 130a.

  As shown in FIG. 10A, when photographing with the imaging optical system 110a having a focal length of 35 mm, the subject 350 includes the upper body including the face in the photographing range 75, and FIG. As shown in FIG. 10B, when photographing with the imaging optical system 120a having a focal length of 75 mm as shown in FIG. 10B, the face of the subject 350 is included in the last photographing possible range 75. FIG. As shown in the figure, when photographing with the imaging optical system 130 a having a focal length of 150 mm, a part of the face of the subject 75 (in this case, the mouth) is not included in the shootable range 75.

  Therefore, in S2090, the focal length of 150 mm which is the focal length of the imaging optical system 130a and the focal length of 300 mm which is the focal length of the imaging optical system 140a are combined into the original image when the images obtained by the zooming during exposure are combined. Is calculated as an inappropriate focal length.

  In step S2100, if the process passes through step S2090, the image at the time of zoom shooting during exposure is synthesized based on the image captured by the imaging optical system having the focal length excluding the inappropriate focal length obtained in step S2080. According to the above, the combination of the imaging optical systems 110a to 140a based on the image taken by the imaging optical system 110a having a focal length of 35 mm and the image taken by the imaging optical system 120a having a focal length of 75 mm. The inter-exposure zoom photographed image obtained in the above is synthesized. That is, in the second embodiment, the preview image 332 described in the first embodiment is not displayed.

  In S2100, when the process directly proceeds from S2080 to S2100, as described above, the same processing as S1070 is performed, so that preview image 310, 320, 330 is displayed. Since S2110 to S2240 are the same as S1080 to S1210, S2300 to S2330 are the same as S1300 to S1330, and S2400 is the same as S1400, the description thereof is omitted.

  With the above configuration, when a person is included in the subject, a preview image based on an image captured at a focal length that causes a part of the person's face to be missing is not displayed. There is no need to zoom. Therefore, the convenience is improved for the user.

  That is, here, the control means recognizes the subject by the image recognition technique, changes the combination of the optical images having a plurality of focal lengths according to the type, and displays the simulation image of the inter-exposure zoom shooting. Accordingly, the display image may be changed depending on an object that moves at a high speed other than the face of a person or a subject with a large aspect ratio.

  As described above, it is a compound eye imaging apparatus that simultaneously captures optical images of a plurality of focal lengths, and the effect of changing the focal length can be confirmed before photographing when the inter-exposure zoom photographing mode is set. A compound eye imaging apparatus is provided.

[Modification of Example 2]
Hereinafter, a modification of the second embodiment of the present invention will be described with reference to FIG. FIG. 11 is obtained by changing the following operation flow according to the face detection determination result in S2080 in the operation flow shown in FIG. In addition, the same code | symbol is attached | subjected to the thing similar to a 2nd Example, and the description is abbreviate | omitted.

  Hereinafter, in the modified example of the second embodiment, the point that the preview image displayed on the display unit 70 differs according to the result of face detection described later will be described. In S2080, the CPU 30 confirms the result confirmed in S2070 and determines whether or not there is a face as a subject. As a result, if the subject does not have a face, that is, if No, the process proceeds to S2510, and if the subject has a face, that is, if Yes, the process proceeds to S2090.

  Since S2090 is the same as that of the second embodiment, its description is omitted. In S2510, based on the analysis result in S2070, since it is determined in S2080 that the image focused on the subject in the image sensor 210a does not have a human face, the CPU 30 determines that the user is shooting a landscape. Therefore, the CPU 30 uses an image with a focal length suitable for landscape photography as a source of zoom exposure during exposure. In other words, the CPU 30 sets an image captured by the imaging optical system 110a having the widest angle and the focal length of 35 mm among the imaging optical systems included in the compound-eye imaging device 1 as an original image for zooming during exposure.

  In S2100, when passing through S2510, an image captured by the imaging optical system 110a set in S2510 is used as an original image, and an inter-exposure zoom captured image obtained by a combination of the imaging optical systems 110a to 140a is synthesized. The process proceeds to S2110. In S2110, the preview images 310, 320, and 330 (only 331) of the during-exposure zoom photographed image generated in S2100 are displayed on the display unit 70 as a preview image before photographing.

  On the other hand, if the process has proceeded to S2100 via S2090, as in the second embodiment, based on the image taken with the imaging optical system having the focal length excluding the inappropriate focal length obtained in S2080, The images obtained during zooming during exposure are combined, and the process proceeds to S2110. In this case, the processing at 2110 is the same as that of the second embodiment, and the description thereof is omitted. Since S2120 and subsequent steps are the same as in the second embodiment, description thereof is omitted.

  With the above configuration, when a person is included in the subject, a preview image based on an image taken at a focal length at which part of the person's face is missing is not displayed. There is no need to shoot. Therefore, the convenience is improved for the user.

  In addition, when the subject does not include a person, a preview image of zoom shooting during exposure is displayed with the captured image of the focal length having the widest angle as the original image in the imaging optical system of the compound eye imaging apparatus 1. Therefore, since it is possible to perform zooming during exposure without cutting out the scenery to be photographed, the convenience for the user is further improved. That is, it can be said that the convenience for the user is improved by changing the combination of the preview images of the during-exposure zoom shooting according to the subject.

  As described above, it is a compound eye imaging apparatus that simultaneously captures optical images of a plurality of focal lengths, and the effect of changing the focal length can be confirmed before photographing when the inter-exposure zoom photographing mode is set. A compound eye imaging apparatus is provided.

1: Compound eye imaging device 30: CPU
70: Display units 110a and 110b: Imaging optical systems 120a and 120b (having the shortest focal length): Imaging optical systems 130a and 130b (with a longer focal length than imaging optical systems 110a and 110b) Imaging optical systems 140a and 140b: (Long focal length compared to imaging optical systems 130a and 130b) Imaging optical system 192: Selection switch 193: Determination switch 210a to 210h: image sensors 310, 320, 330: preview images

Claims (6)

  Control in a compound eye imaging apparatus that includes an optical member having a plurality of focal lengths, an imaging unit that captures an optical image that has passed through each optical member, and a display unit that displays a plurality of images captured by the imaging unit. And a setting unit that can be set to the between-exposure zoom shooting mode, and when set to the between-exposure zoom shooting mode, the control unit creates the between-exposure zoom shooting that combines the plurality of images. A compound eye imaging apparatus characterized in that at least one simulation image is displayed on the display means.   2. The compound eye imaging apparatus according to claim 1, wherein the control unit causes the display unit to display focal length information at the time of zoom shooting during exposure together with a simulation image of zoom shooting during exposure.   The control means changes the combination of the optical images of the plurality of focal lengths depending on the subject, and displays at least one simulation image of the during-exposure zoom photographing on the display means. The compound eye imaging device according to claim 1.   Face detection processing is performed for image data on which a person may be captured to detect the face area of the person and the positions of the eyes and mouth, and the face detection means is the face area of the person When detecting, the control means changes the combination of the optical images of the plurality of focal lengths, and displays at least one simulation image of the during-exposure zoom photographing on the display means. The compound eye imaging device according to claim 3.   When the face detection unit does not detect a human face area, the zoom between the exposures is performed based on the optical image having the focal length closest to the wide angle among the optical images having the focal lengths. 4. The compound eye imaging apparatus according to claim 3, wherein a simulation image is displayed on the display means. 2. The compound-eye imaging apparatus according to claim 1, wherein among the photographing field angles of the optical images having the plurality of focal lengths, the photographing means of the optical images having different focal lengths are simultaneously displayed on the display unit. .