JP5216640B2 - Imaging apparatus and method - Google Patents

Description

  The present invention relates to an imaging apparatus capable of acquiring images from multiple viewpoints.

  In Patent Document 1, image data obtained through a zoom-driven main lens system is reduced, and image data in a state equivalent to image data obtained through a sub-lens system is generated. Next, the image data and the image data obtained through the sub lens system are compared by pattern matching, and image data corresponding to the image data obtained through the main lens system is obtained through the sub lens system. The image data is cut out from the obtained image data and recorded in the recording unit.

In Patent Document 2, a correction value detection device is connected to an image correction device when the optical position of the CCD camera is initially adjusted, or when it is deviated from the initial adjustment due to secular change. A conversion value of affine transformation corresponding to the angular difference, rotation shift, and translation shift is calculated, and the image correction apparatus is set. Then, the image captured by the CCD camera is affine transformed by the image correction device, and the optical position of each CCD camera is equivalently precisely adjusted and output to the stereo image processing device.
Japanese Patent Laying-Open No. 2005-210217 JP-A-10-307352

  Patent Documents 1 and 2 disclose that a method of adjusting or correcting an error in the optical axes and angle of view of the left and right optical systems of a stereo camera is performed by image processing without mechanical adjustment. However, in the method of cutting out the common range of the left and right images, it is necessary to process the left and right images, and camera control is complicated. In addition, a method is disclosed in which the angle of view of one optical system is made wider than the other and cut out in accordance with the narrower angle of view and enlargement processing (electronic zoom) is performed. When the zoom lens becomes large, it is necessary to increase the electronic zoom magnification, and there is a problem that the image quality of one of the images is degraded.

  SUMMARY OF THE INVENTION An object of the present invention is to obtain a stereo image by suppressing an image quality deterioration during zooming by a simple method when adjusting errors of optical axes and field angles of a plurality of optical systems of a multi-viewpoint imaging apparatus.

  An image pickup apparatus according to the present invention outputs a plurality of images by photoelectrically converting a subject image formed through each of a desired reference optical system and one or a plurality of adjustment target optical systems other than the reference optical system using an image pickup device. The zoom lens position of the adjustment target optical system so that the imaging range of the imaging device via the imaging unit and the adjustment target optical system of the imaging unit includes the imaging range of the imaging device via the reference optical system of the imaging unit From the image obtained by the image sensor via the optical system to be adjusted, to a region corresponding to the imaging range of the image sensor via the reference optical system. And a cutout unit that cuts out the included partial image.

  The control unit sets a zoom lens position of the adjustment target optical system according to an optical error with respect to the reference optical system at each zoom stage of the adjustment target optical system.

  A diaphragm mechanism is provided for changing the aperture values of the adjustment target optical system and the reference optical system, and the control unit adjusts the position of the adjustment target optical system according to the zoom lens position of the adjustment target optical system and the reference optical system and the aperture value of the reference optical system. Set the aperture value.

  The control unit sets the aperture value of the adjustment target optical system so that the depth of field of the adjustment target optical system is substantially equal to the depth of field of the reference optical system.

  The control unit sets the imaging sensitivity of the imaging element so that the shutter speed of the adjustment target optical system is substantially equal to the shutter speed of the reference optical system.

  The control unit cuts out the partial image when receiving an instruction to output a stereoscopic image, and converts the stereoscopic image into a predetermined image based on the partial image cut out by the cut-out unit and the image obtained by the imaging element via the reference optical system. A stereoscopic image output unit for outputting to a display screen or a print medium is provided.

  A storage unit that stores the position information of the region in association with the image obtained by the imaging device via the adjustment target optical system, and the clipping unit stores the partial image according to the position information of the region stored in the storage unit; cut.

  A selection unit configured to receive selection of a desired reference optical system from among a plurality of optical systems of the imaging unit;

  A flat image output unit is provided that outputs a flat image to a predetermined display screen or print medium based on an image output from the image sensor via the reference optical system or the adjustment target optical system.

  An imaging method according to the present invention outputs a plurality of images by photoelectrically converting a subject image formed through each of a desired reference optical system and each of one or a plurality of adjustment target optical systems other than the reference optical system using an imaging device. And adjusting the zoom lens position of the adjustment target optical system so that the shooting range of the image pickup element via the adjustment target optical system includes the shooting range of the image pickup element via the reference optical system. A step of setting to a wider angle side than the position, and a step of cutting out a partial image included in an area corresponding to the imaging range of the image sensor via the reference optical system from an image obtained by the image sensor via the adjustment target optical system And execute.

  Since the image captured by the first optical system is left as it is, only the image captured by the second optical system is cut out and rotated, so that the processing of the imaging apparatus is simple. In addition, since only the image of the second optical system is interpolated and the difference in the angle of view between the first and second optical systems is minimized, image quality deterioration due to the interpolation enlargement processing of the captured image by the second optical system is reduced. It can be kept small.

<First Embodiment>
FIG. 1 shows the electrical configuration of the camera 1. The first imaging unit 2a includes a first zoom lens 11, a first diaphragm 12, a first focus lens 13, and a first image sensor 14 arranged along the lens optical axis L1. A lens motor 15 is connected to the first zoom lens 11, an iris motor 16 is connected to the first diaphragm 12, a lens motor 17 is connected to the first focus lens 13, and a timing generator (TG) is connected to the first image sensor 14. ) 18 is connected. The operations of the motors 15 to 17 and the TG 18 are controlled by the CPU 19, and the motor driver 29 instructs the actual driving start and end of the motors 15 to 17 according to the control of the CPU 19.

  The lens motor 15 moves the first zoom lens 11 along the lens optical axis L1 to the TELE side (feeding side) or the WIDE side (retracting side) in accordance with the zoom operation from the operation unit 9, and the zoom magnification is increased. Change. The iris motor 16 performs exposure adjustment by changing the aperture value (aperture value) of the first diaphragm 12 to limit the light beam during AE (Auto Exposure) operation. The lens motor 17 changes the in-focus position by moving the first focus lens 13 along the lens optical axis L1 to the NEAR side (feeding side) or the INF side (retracting side) during AF (Auto Focus) operation. Make adjustments.

  The first image sensor 14 is composed of a solid-state imaging device such as a CCD or a CMOS, receives the subject light imaged by the first zoom lens 11, the first diaphragm 12, and the first focus lens 13, and serves as a light receiving device. Accumulate photoelectric charge according to the amount of light received. The photocharge accumulation / transfer operation of the first image sensor 14 is controlled by the TG 18, and the electronic shutter speed (photocharge accumulation time) is determined by a timing signal (clock pulse) input from the TG 18. In the shooting mode, the first image sensor 14 acquires image signals for one screen every predetermined period and sequentially inputs them to the imaging circuit 28a.

  The second imaging unit 2b has the same configuration as the first imaging unit 2a. The second zoom lens 20 to which the lens motor 24 is connected, the second diaphragm 21 to which the iris motor 25 is connected, and the lens motor 26 are connected. The second focus lens 22 and a second image sensor 23 to which a timing generator (TG) 27 is connected. The operations of the motors 24 to 26 and the TG 27 are controlled by the CPU 19. The first imaging unit 2a and the second imaging unit 2b basically operate in conjunction with each other, but can also be operated individually. Incidentally, as the first and second image sensors 14 and 23, CCD type or CMOS type image sensors are used.

  The imaging signals output from the first and second image sensors 14 and 23 are input to correlated double sampling circuits (CDS) included in the imaging circuits 28a and 28b (collectively expressed as the imaging circuit 28), respectively. The CDS inputs R, G, B image data accurately corresponding to the accumulated charge amount of each light receiving element of the first and second image sensors 14, 23 to an amplifier (AMP) included in the imaging circuit 28. The AMP amplifies the input image data and inputs it to an A / D converter included in the imaging circuit 28. The A / D converter converts input image data from analog to digital. Through the CDS, AMP, and A / D converter included in the imaging circuit 28, the imaging signal of the first image sensor 14 is the first image data (image data for the left eye), and the imaging signal of the second image sensor 23 is the second. Output as image data (image data for the right eye).

  The image signal processing circuit 31 performs various image processing such as gradation conversion, white balance correction, and γ correction processing on the first and second image data input from the A / D converter. The frame memory 32 temporarily stores the first and second image data subjected to various image processing by the image signal processing circuit 31.

  The evaluation value calculation circuit 33 calculates an AF evaluation value and an AE evaluation value from each of the first and second image data stored in the frame memory 32. The AF evaluation value is calculated by integrating high-frequency components of the luminance value for the entire region or predetermined region (for example, the central portion) of each image data, and represents the sharpness of the image. The high-frequency component of the luminance value is a sum of luminance differences (contrast) between adjacent pixels in a predetermined area. Further, the AE evaluation value is calculated by integrating the luminance values over the entire area or a predetermined area (for example, the central portion) of each image data, and represents the brightness of the image. The AF evaluation value and the AE evaluation value are used in a known AF operation (automatic focus control) and AE operation (automatic exposure control), respectively.

  The stereoscopic image processing circuit 34 combines the first and second image data stored in the frame memory 32 with stereoscopic image data for the display unit 10 to perform stereoscopic display. When the display unit 10 is used as an electronic viewfinder in the shooting mode, the stereoscopic image data synthesized by the stereoscopic image processing circuit 34 is displayed on the display unit 10 as a through image via the display control unit 35.

  The compression / decompression processing circuit 36 performs compression processing on the first and second image data stored in the frame memory 32 in a compression format such as the JPEG method. The memory control unit 37 records each image data compressed by the compression / decompression processing circuit 36 on a recording medium 38 such as a memory card.

  When the first and second image data recorded on the recording medium 38 in this way are reproduced and displayed on the display unit 10, each image data on the recording medium 38 is read out by the memory control unit 37, and is compressed and expanded. The decompression process is performed by 36, converted into stereoscopic image data by the stereoscopic image processing circuit 34, and then displayed as a reproduced image on the display unit 10 via the display control unit 35.

  Although the detailed structure of the display unit 10 is not illustrated, the display unit 10 includes a parallax barrier display layer on the surface thereof. The display unit 10 generates a parallax barrier having a pattern in which light transmitting portions and light shielding portions are alternately arranged at a predetermined pitch on the parallax barrier display layer when performing stereoscopic display, and an image under the parallax barrier. By displaying strip-shaped image fragments showing left and right images alternately on the display surface, pseudo stereoscopic viewing is possible. Note that the planar images obtained from the first imaging unit 2a and the second imaging unit 2b are reconstructed into strip-shaped image fragments, and these are not arranged alternately, and the first imaging unit 2a or the second imaging unit 2b If only the right or left image obtained from one side is reconstructed into strip-shaped image fragments and these are alternately arranged, the viewer's right eye and left eye can see the same planar image.

  The CPU 19 comprehensively controls the overall operation of the stereoscopic camera 1. In addition to the shutter button 5 and the operation unit 9 described above, an EEPROM 39 that is a nonvolatile memory is connected to the CPU 19. The EEPROM 39 stores various control programs and setting information. The CPU 19 executes various processes based on this program and setting information.

  The shutter button 5 has a two-stage push switch structure. When the shutter button 5 is lightly pressed (half-pressed) during the shooting mode, the CPU 19 starts an AF operation and an AE operation, and shooting preparation processing is performed. In this state, when the shutter button 5 is further pressed (fully pressed), the CPU 19 starts photographing processing, and the first and second image data for one screen are transferred from the frame memory 32 to the recording medium 38 and recorded. Is done.

  In the AF operation, the CPU 19 controls the lens motors 17 and 26 to move the first and second focus lenses 13 and 22 in predetermined directions, respectively, and evaluates each of the first and second image data obtained sequentially. This is done by obtaining the maximum AF evaluation value calculated by the calculation circuit 33. In the AE operation, after the AF operation is completed, the CPU 19 controls the iris motors 18 and 27 and the TGs 18 and 27 based on the AE evaluation value calculated by the evaluation value calculation circuit 33, and the first and second apertures 12 and 21 are controlled. The aperture value (aperture value) and the electronic shutter speeds of the first and second image sensors 14 and 23 are set according to a program diagram stored in the EEPROM 39 in advance.

  FIG. 2 is a flowchart of an adjustment process in which the CPU 19 controls the execution. A program that causes the CPU 19 to execute this processing is stored in the EEPROM 39.

  In S1, an optical error (optical axis deviation, imaging) between the reference optical system (for example, the first imaging unit 2a) and the optical system (for example, the second imaging unit 2b) that requires adjustment of the optical deviation with respect to the reference optical system. Surface tilt error, zoom magnification error, etc.) are measured over the entire zoom range of the zoom lenses 11 and 20 of both optical systems. Which of the first imaging unit 2a and the second imaging unit 2b is used as the reference optical system is arbitrary. As illustrated in FIG. 3, the optical axis error usually varies depending on the zoom position due to a mechanical error of the lens barrel. In addition, the ratio of the error to the shooting angle of view becomes larger on the telephoto (tele) side having the same optical axis angle of view. On the other hand, as illustrated in FIG. 4, the tilt of the screen is dominated by the mounting error of the image sensor and does not vary depending on the zoom position.

  In S2, based on the measurement result, the second corresponding to each zoom level of the zoom lens 11 so as to include the shooting range of the first imaging unit 2a in each zoom level of the zoom lens 11 of the first image capturing unit 2a. The zoom position of the zoom lens 20 of the imaging unit 2b is determined.

In particular,
δan: field angle shift due to the optical axis difference between the first and second optical systems in the zoom stage Zn δbn: field angle shift due to the tilt difference between the first and second optical systems in the zoom stage Zn The zoom position Z′n of the second optical system corresponding to the zoom position Zn of the optical system of
Angle of view of Z′n ≧ Zn + δan + δbn
To be determined. Therefore, the zoom position Z′n of the second optical system is on the wide angle side with respect to the zoom position Zn of the first optical system.

  Then, the lens motor 24 is driven, and the second zoom lens 20 is moved to the zoom position of the second imaging unit 2b corresponding to the desired zoom position of the first imaging unit 2a set by the operation unit 9.

  FIG. 5 shows the zoom position Z of the second optical system (the second zoom lens 20 of the second imaging unit 2b) corresponding to the zoom position Zn of the first optical system (the first zoom lens 11 of the first imaging unit 2a). 'n is schematically shown. As described above, Z′n is on the wide-angle side (the one with a wider field of view) than Zn.

  Note that S1 (optical error measurement) and S2 (zoom position setting) are performed in advance in the manufacturing stage of the camera 1, and the zoom position setting value is stored in the EEPROM 39 of the camera 1. At the time of photographing after S3, the zoom positions of the first and second optical systems are set according to the input of the zoom lever of the operation unit 9 and the zoom position setting value of the EEPROM 39.

  In S3, in response to pressing of the shutter button 5, imaging is performed at a zoom position set for each optical system to obtain image data. Then, a range corresponding to the imaging range of the first imaging unit 2a is cut out from the image captured by the second imaging unit 2b in which the zoom position on the wide-angle side with respect to the first imaging unit 2a is set. When cutting out, the cut-out range is rotated to correct the angle-of-view shift due to the tilt difference. FIG. 6 shows an example of the cutout range. Among these, FIG. 6A shows the cutout range I1-2 at the tele end of the first imaging unit 2a corresponding to the captured image I1-1 of the second imaging unit 2b, and FIG. 6B shows the second imaging unit 2b. The cutout range I2-2 in the zoom intermediate range of the first imaging unit 2a corresponding to the captured image I2-1, FIG. 6C shows the first imaging unit 2a corresponding to the captured image I2-1 of the second imaging unit 2b. An example of the cutout range I2-2 at the wide end is shown.

  Although not shown in FIG. 6, the positional relationship of the cutout range in the captured image of the second imaging unit 2b can vary depending on the zoom position. For example, depending on the characteristics of the optical error, the upper left corner and the upper right corner of the cutout range may be in contact with the outer edge of the captured image of the second imaging unit 2b in the zoom middle range, and the lower right corner of the cutout range is always set regardless of the zoom position. The lower left corner does not touch the outer edge of the captured image of the second imaging unit 2b.

  In S4, interpolation processing is performed on the clipped image so that the size of the clipped image is the same as the size of the captured image data by the first imaging unit 2a. The method of interpolation is arbitrary, and for example, interpolation by normal peripheral pixels of defective pixels can be mentioned.

  In S5, the stereoscopic image processing circuit 34 is instructed to generate a stereo image from the image data of the first imaging unit 2a and the image data that has undergone the interpolation processing in S4.

  According to the above processing, the image captured by the first optical system (first imaging unit 2a) remains unchanged, and only the image captured by the second optical system (second imaging unit 2b) is cut out and rotated. The camera process is simple. In addition, since only the image of the second optical system is interpolated and the difference in the angle of view between the first and second optical systems is minimized, image quality deterioration due to the interpolation enlargement processing of the captured image by the second optical system is reduced. It can be kept small.

  As illustrated in FIG. 7, in the conventional technique, since the imaging range of the first optical system and the imaging range of the second optical system are simply overlapped and cut out, the cutting range becomes small and the size of the stereoscopic image also increases. However, in the present invention, since a portion corresponding to the imaging range of the first optical system is cut out from the captured image by the second optical system on the wide angle side, a larger cutting range can be secured as compared with the conventional technique.

Second Embodiment
FIG. 8 is a flowchart of the adjustment process according to the second embodiment. A program that causes the CPU 19 to execute this processing is stored in the EEPROM 39.

  In S <b> 11, the zoom level of the first imaging unit 2 a is set according to the input of the zoom button of the operation unit 9.

  In S12, the aperture value of the first aperture 12 of the first optical system (first imaging unit 2a) is set according to the photometric result of the through image (automatic exposure control: AE). The set F value of the first aperture stop 12 is Fa.

  In S13, the zoom position (focal point) of the corresponding second zoom lens 20 of the second imaging unit 2b so as to include the imaging range in the zoom stage of the first zoom lens 11 of the first imaging unit 2a set in S11. Determine the distance. This process is the same as in the first embodiment.

In S14, the F value of the second optical system that makes the depths of field of the first and second optical systems substantially equal is determined. When the focal length of the first optical system (first imaging unit 2a) is fa, the F value is Fa, the focal length of the second optical system (second imaging unit 2b) is fb, and the F value is Fb, Since the depth of field is approximately inversely proportional to the square of the focal length and approximately proportional to the F value, in order to make the depth of field of the first and second optical systems substantially equal,
Fa / (fa) ² = Fb / (fb) ²
Therefore, Fb = Fa × (fb / fa) ² is determined. That is, when the second optical system is set on the wide-angle side as compared with the first optical system, the focal length is short and the depth of field becomes deep, but this is offset by reducing the F value.

  In S15, it is determined whether or not the determined F value (Fb) is larger than the open F value (F value when the second diaphragm 21 is fully opened). If Yes, S16 is No. In this case, the process proceeds to S17.

  In S16, when the aperture of the second imaging unit 2b takes a stepwise value, the aperture stage closest to the determined F value is selected.

  In S17, the aperture of the second imaging unit 2b is set to the full F value.

In addition, when the apertures (F values) of the first and second optical systems are set differently as described above, it is preferable to adjust the sensitivity in order to make the shutter speed uniform. When the Av value of the first image sensor 14 of the first imaging unit 2a is Aa, the Sv value is Sa, the Av value of the second image sensor 23 of the second imaging unit 2b is Ab, and the Sv value is Sb,
Aa-Sa = Ab-Sb
Sa and Sb are set so as to satisfy

FIG. 9 shows an example of setting the shutter speed. For example, when fa = 100 mm, fb = 70 mm, and Fa = F8,
Fb = 8 × (70/100) ^ 2 = 3.91≈4 (F4).

At this time, since Aa = 6 and Ab = 4, when ISO sensitivity Sa = 7 (ISO400) of the first image sensor 14 of the first imaging unit 2a,
Sb = Ab + Sa−Aa = 4 + 7−6 = 5 (ISO 100)
That is, in this case, if the second image sensor 23 of the second imaging unit 2b is set to ISO100, the shutter speeds of the first imaging unit 2a and the second imaging unit 2b can be set to the same value.

  As described above, since the depth of field of each optical system can be made uniform, an image photographed by each optical system has the same blur condition according to the subject distance, and a stereo image without a sense of incongruity can be obtained.

  In addition, since the shutter speeds of the optical systems can be made uniform, even when subject blurring occurs, the images of the optical systems have the same blurring condition, and a stereo image without a sense of incongruity can be obtained.

<Other embodiments>
In the first and second embodiments, when an instruction for displaying the image captured by the first imaging unit 2a or the second imaging unit 2b as a planar image is input from the operation unit 9 on the display unit 10, the CPU 19 cuts out. When an image (original image) that has not been displayed is displayed on the display unit 10 and an instruction to display a stereo image is input from the operation unit 9, the CPU 19 creates a cut-out image and creates the three-dimensional image as described above. An image may be displayed on the display unit 10.

  Further, instead of actually cutting out the image of the first image pickup unit 2a or the second image pickup unit 2b, the CPU 19 records information indicating the cutout range in association with the image and displays the information when the stereo image is displayed. It may actually be cut out with reference to. Information indicating the cutout range may be stored as a header, a tag, and meta information of a file storing the image.

  If only the actually cut-out image is recorded on the recording medium 38, the capacity can be saved. However, if information indicating the cut-out range is recorded without cutting out the image, the degree of freedom in image editing is increased, and interpolation processing is performed. High-quality original images that have not been processed can be appropriately processed and used.

  In addition, the display unit 10 can be replaced with a printed matter that allows a viewer to view a planar or stereoscopic image. A three-dimensional printed material and a method for producing the three-dimensional printed material can be realized by a known method such as lenticular printing.

  Furthermore, it may be possible to arbitrarily set which of the first imaging unit 2a and the second imaging unit 2b the reference optical system is selected from the operation unit 9, or any one optical system is selected by default. May be. For example, when the user selects an optical system corresponding to his / her effect as the reference optical system and receives an instruction from the operation unit 9 to display the image of the reference optical system in a plane, a high-quality plane that is not subjected to interpolation processing. The image can be viewed from the viewpoint of the effective side. The present invention can also be applied to a camera having three or more optical systems. If at least one reference optical system is determined, the cutout range of other optical systems can be determined in accordance with the reference optical system. Good.

Camera block diagram Flow chart of adjustment processing according to the first embodiment Diagram showing an example of optical axis misalignment Diagram showing an example of the slope difference Diagram illustrating zoom position correspondence Diagram illustrating the cutout range Diagram comparing the clipping range of the prior art and the clipping range of the present invention Flowchart of adjustment processing according to the second embodiment Diagram showing setting example of imaging sensitivity

2a: first imaging unit, 2b: second imaging unit, 11: first zoom lens, 20: second zoom lens, 19: CPU

Claims (8)

An imaging unit that photoelectrically converts an object image formed through each of a desired reference optical system and one or a plurality of adjustment target optical systems other than the reference optical system, and outputs a plurality of images;
The zoom lens position of the adjustment target optical system so that the imaging range of the imaging element via the adjustment target optical system of the imaging unit includes the imaging range of the imaging element via the reference optical system of the imaging unit A control unit for setting the zoom lens position on the wide-angle side from the zoom lens position of the reference optical system;
A cutout unit that cuts out a partial image included in a region corresponding to the imaging range of the image pickup device via the reference optical system from an image obtained by the image pickup device via the adjustment target optical system;
An aperture mechanism for changing aperture values of the adjustment target optical system and the reference optical system;
Equipped with a,
The control unit sets the aperture value of the adjustment target optical system according to the zoom lens positions of the adjustment target optical system and the reference optical system and the aperture value of the reference optical system, and the target of the adjustment target optical system. An imaging apparatus that sets an aperture value of the optical system to be adjusted so that a depth of field is substantially equal to a depth of field of the reference optical system .   The imaging apparatus according to claim 1, wherein the control unit sets a zoom lens position of the adjustment target optical system according to an optical error with respect to the reference optical system at each zoom stage of the adjustment target optical system. Wherein the control unit, the imaging apparatus according to claim 1 or 2 shutter speed of the adjustment target optical system to set the imaging sensitivity of the imaging element so as to be substantially equal to the shutter speed of the reference optical system. The control unit cuts out the partial image when receiving an instruction to output a stereoscopic image,
The stereo image output part which outputs a stereo image to a predetermined | prescribed display screen or a printing medium based on the partial image which the said clipping part cut out, and the image which the said image pick-up element acquired via the said reference | standard optical system is provided. The imaging device according to any one of to 3 . A storage unit that stores the positional information of the region in association with an image obtained by the imaging element via the adjustment target optical system;
The cutting unit includes an imaging device according to any one of claims 1-4 for cutting the partial image according to the position information of the region stored in the storage unit. The imaging apparatus according to any one of claims 1 to 5, comprising a selection unit for receiving selection of a desired reference optical system from among a plurality of optical systems of the imaging unit. Claim 1-6 comprising a planar image output unit for outputting a planar image on a predetermined display screen or print medium based on the image the reference optical system or the image pickup element via the adjustment target optical system has an output The imaging device described in 1. The imaging device
Outputting a plurality of images by photoelectrically converting a subject image formed through each of a desired reference optical system and one or a plurality of adjustment target optical systems other than the reference optical system with an imaging device;
The zoom lens position of the adjustment target optical system is adjusted so that the shooting range of the image pickup element via the adjustment target optical system includes the shooting range of the image pickup element via the reference optical system. A step for setting the wide-angle side of the zoom lens position;
Cutting out a partial image included in a region corresponding to the imaging range of the imaging element via the reference optical system from an image obtained by the imaging element via the adjustment target optical system;
Changing aperture values of the optical system to be adjusted and the reference optical system;
The aperture value of the adjustment target optical system is set according to the zoom lens position of the adjustment target optical system and the reference optical system and the aperture value of the reference optical system, and the depth of field of the adjustment target optical system is Setting the aperture value of the optical system to be adjusted to be substantially equal to the depth of field of the reference optical system;
An imaging method for executing.

Images