JP2014204299A - Imaging apparatus and method for controlling the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus for changing parallax information in accordance with a resolution of a captured image.SOLUTION: An image sensor 505 of an imaging apparatus comprises pixel units each of which includes a plurality of photoelectric conversion sections which generate image signals by photoelectrically converting beams which have passed divided different regions of an exit pupil of an imaging optical system with respect to one micro-lens. The imaging apparatus: sets a resolution of the image signals which are outputted by the image sensor; detects an amount of parallax of right-eye image data and left-eye image data which are generated on the basis of the image signals outputted by the image sensor; and edits the detected amount of parallax in accordance with the set resolution.

Description

  The present invention relates to an imaging apparatus and a method for controlling the imaging apparatus.

  In recent years, the spread of stereoscopic video related devices such as a three-dimensional (3D) cinema and a 3D display has been rapidly increasing. Although stereoscopic video shooting has been conventionally performed with a film-type camera or the like, an original image for generating a stereoscopic video is being shot with a digital camera or a digital video camera along with the spread of digital imaging devices. ing.

  As a mechanism for a user to view a stereoscopic video, data of a right-eye image and a left-eye image that have a parallax in the left-right direction so as to correspond to an image of an object viewed with the left eye and an image viewed with the right eye are Prepared. A user can view each image stereoscopically by looking at the right eye and the left eye. As such a method, there is a method of dividing an image to be viewed by parallax, such as a parallax barrier method or a lenticular method. There is also known a method of presenting different videos for the left and right eyes of the user through filters having different characteristics on the left and right.

  On the other hand, Patent Documents 1 and 2 disclose a method for simultaneously capturing images from different viewpoints as a method for capturing an image that can be viewed as a stereoscopic video. Patent Document 1 discloses a solid-state imaging device in which a plurality of microlenses are formed, and one or more pairs of photodiodes are arranged in proximity to each of the microlenses. A first image signal is obtained from the output of one of the photodiode pairs, and a second image signal is obtained from the output of the other photodiode. By using the first and second image signals as the left-eye image and the right-eye image, respectively, the user can view the stereoscopic video.

  Patent Document 2 discloses an output parallax map having an output element having an output value corresponding to a shift to be applied to each pixel of the first image. A second image can be generated based on the output parallax map and the first image.

  When a captured stereo image is displayed on a display device, the stereoscopic effect obtained differs depending on the size of the display of the display device and the position of the viewer. The amount of parallax stored in the parallax map is a value representing a stereoscopic effect, but if the amount of parallax and the display size of the display device do not match, the display device will not display a stereo image. It becomes a natural three-dimensional effect. For example, the stereoscopic effect may not be obtained, or the stereoscopic effect may be excessive and cause eye fatigue. Patent Document 3 discloses a system that reproduces an image whose parallax has been changed by a parallax changing device that changes the parallax of a stereo image on a stereo display device.

JP-A-58-24105 Special table 2008-518317 JP 2010-045584 A

  The system disclosed in Patent Literature 3 displays a stereo image obtained by converting the parallax amount based on the display size of the stereo display device acquired from the information acquisition unit. However, this system can correct the parallax according to the size of the display during playback, but does not consider the correction according to the resolution of the captured image. The three-dimensional effect is impaired. Further, in this system, when a captured image is displayed at the same pixel magnification on the output display, a stereo image having an appropriate stereoscopic effect cannot be provided.

  An object of the present invention is to provide an imaging apparatus that changes parallax information according to the resolution of a captured image.

  An imaging apparatus according to an embodiment of the present invention includes a plurality of photoelectric conversion units that generate an image signal by photoelectrically converting a light beam that has passed through different regions of an exit pupil of an imaging optical system with respect to one microlens. An image sensor including a pixel unit, setting means for setting a resolution of an image signal output from the image sensor, and left-eye image data and right-eye image data generated based on the image signal output from the image sensor. Detection means for detecting the amount of parallax, and editing means for editing the detected amount of parallax according to the resolution set by the setting means.

  According to the imaging apparatus of the present invention, it is possible to provide a stereo image having an appropriate stereoscopic effect according to the resolution.

It is a figure showing roughly the example of composition of the image sensor which an imaging device applies. It is a figure which shows the structural example of the pixel of an image pick-up element. It is the conceptual diagram showing a mode that the light beam which came out of the exit pupil of the imaging lens injects into an image pick-up element. It is a figure which shows the structural example of the imaging device of this embodiment. It is a figure which shows an example of the production | generation process of the parallax map in this embodiment. It is an example of the file structure of the image data which an imaging device produces | generates. It is a figure explaining the example of editing of the amount of parallax. It is a figure explaining the example of editing of the amount of parallax. It is a flowchart explaining the production | generation process of a parallax map. It is a flowchart explaining the example of the expansion process of the amount of parallax. It is a figure which shows the example of the parallax map at the time of the parallax expansion process according to the resolution being performed. It is a flowchart explaining the production | generation process of a parallax map. It is a flowchart explaining the example of the expansion process of the amount of parallax. It is a figure which shows an example of a parallax expansion table.

  FIG. 1 is a diagram schematically illustrating a configuration example of an imaging element applied by the imaging apparatus of the present embodiment. The image sensor 100 includes a pixel array 101, a vertical selection circuit 102 that selects a row in the pixel array 101, and a horizontal selection circuit 104 that selects a column in the pixel array 101. The readout circuit 103 reads out the signal of the pixel selected by the vertical selection circuit 102 among the pixels in the pixel array 101. The reading circuit 103 includes a memory for storing signals, a gain amplifier, an AD converter, and the like for each column.

  The serial interface (SI) unit 105 determines an operation mode of each circuit according to an instruction from an external circuit (for example, the system control unit 509 or the timing generation unit 507 in FIG. 4). The vertical selection circuit 102 sequentially selects a plurality of rows in the pixel array 101 and extracts pixel signals to the readout circuit 103. The horizontal selection circuit 104 sequentially selects a plurality of pixel signals read by the reading circuit 103 for each column. In addition to the components shown in FIG. 1, the image sensor 100 includes, for example, a timing generator that provides a timing signal to the vertical selection circuit 102, the horizontal selection circuit 104, the readout circuit 103, a control circuit, and the like. These detailed explanations are omitted.

  FIG. 2 is a diagram illustrating a configuration example of pixels of the image sensor 100. FIG. 2A schematically shows the configuration of one pixel. FIG. 2B shows the arrangement of the pixel array 101. A pixel 201 illustrated in FIG. 2A includes a microlens 202 as an optical element and a plurality of photodiodes (hereinafter abbreviated as PD) as light receiving elements.

  FIG. 2A illustrates an example in which two pixels, the left PD 203 and the right PD 204, are provided in one pixel, but three or more (for example, four or nine) PDs may be used. The PD 203 photoelectrically converts the received light beam and outputs a left-eye image. The PD 204 photoelectrically converts the received light beam and outputs a right-eye image. The pixel 201 includes, for example, a pixel amplification amplifier that extracts a PD signal to the reading circuit 103, a row selection switch, a PD signal reset switch, and the like in addition to the illustrated components.

  In order to provide a two-dimensional image, the pixel array 101 is arranged in a two-dimensional array like a large number of pixels 301 to 304 shown in FIG. The PDs 301L, 302L, 303L, and 304L correspond to the PD 203 in FIG. PDs 301R, 302R, 303R, and 304R correspond to the PD 204 in FIG. That is, the imaging apparatus according to the present embodiment includes a plurality of first photoelectric conversion units (PD 203) that output a left-eye image and a second photoelectric conversion unit (PD 204) that outputs a right-eye image. An imaging device including a pixel portion is provided.

  Next, light reception of the imaging element 100 having the pixel configuration illustrated in FIG. FIG. 3 is a conceptual diagram illustrating a state in which a light beam emitted from the exit pupil of the photographing lens enters the image sensor 100.

  The pixel array 101 includes a microlens 202, a color filter 403, and PDs 404 and 405. PD 404 and PD 405 correspond to PD 203 and PD 204 in FIG.

  In FIG. 3, the center of the light beam emitted from the exit pupil 406 of the photographing lens with respect to the microlens 202 is an optical axis 409. The light emitted from the exit pupil 406 enters the image sensor 100 with the optical axis 409 as the center. Partial areas 407 and 408 are areas of the exit pupil 406 of the photographing lens. Light rays 410 and 411 are the outermost light rays of the light passing through the partial region 407. Light rays 412 and 413 are the outermost light rays of the light passing through the partial region 408.

  Out of the light beams emitted from the exit pupil 406, with the optical axis 409 as a boundary line, the upper light beam enters the PD 405, and the lower light beam enters the PD 404. That is, the PD 404 and the PD 405 each receive light beams from different regions obtained by dividing the exit pupil of the photographing optical system. In this way, each light receiving element detects light in a different region at the exit pupil, and therefore, in a situation where light is taken from a point light source, photographed images having different shapes can be obtained. .

  FIG. 4 is a diagram illustrating a configuration example of the imaging apparatus according to the present embodiment. With reference to FIG. 4, an application example of the image sensor 100 shown in FIG. 1 to a digital camera which is an image pickup apparatus will be described. Note that the control method of the present embodiment is realized by the function of the processing unit included in the imaging apparatus shown in FIG. The lens unit 501 constituting the imaging optical system forms an image of light from the subject on the imaging element 505. The imaging element 505 corresponds to the imaging element 100 illustrated in FIG. 1 and has a pixel configuration illustrated in FIG.

  The lens driving device 502 performs zoom control, focus control, aperture control, and the like. The mechanical shutter 503 is controlled by a shutter driving device 504. The image sensor 505 converts the subject image formed by the lens unit 501 into an image signal. The imaging signal processing circuit 506 performs various processes and corrections on the image signal output from the imaging element 505. The timing generator 507 outputs a timing signal necessary for the image sensor 505 and the image signal processing circuit 506.

  A system control unit 509 performs various calculations and controls the entire imaging apparatus. A function of the system control unit 509 is realized by a CPU (Central Processing Unit) (not shown) executing a program. As an operation specific to the present embodiment, the system control unit 509 sets the resolution of the image signal output by the image sensor 505. Further, the system control unit 509 generates a left-eye image and a right-eye image for three-dimensional display based on the synthesized image generated by the image synthesis circuit 513 and the parallax map generated by the parallax map generation circuit 514. . A parallax map is generated by the parallax map generation circuit 514, and the obtained parallax map is stored in the memory unit 508.

  The parallax map generation circuit 514 calculates a parallax amount using the left-eye image and the right-eye image, corrects the parallax range specified by the system control unit 509, and generates a parallax map. The system control unit 509 generates image data for three-dimensional display based on the parallax map, and reproduces it through display means (not shown), thereby allowing the user to view a stereoscopic image. For example, the system control unit 509 transmits and displays image data for three-dimensional display on a stereo display device connected to the imaging device. Note that the system control unit 509 can also realize phase difference AF by detecting a phase difference based on the left-eye image and the right-eye image.

  The memory unit 508 includes a memory that temporarily stores image data. A storage medium control interface unit (hereinafter abbreviated as I / F unit) 510 is provided for recording image data (image file) or the like on the recording medium 511 or reading image data from the recording medium 511. The recording medium 511 that can be attached to and detached from the imaging apparatus is a semiconductor memory or the like. The external I / F unit 512 transmits / receives data to / from an external device.

  The imaging signal processing circuit 506 performs image processing by distributing imaging data output from the imaging element 505 into a left-eye image and a right-eye image. The memory unit 508 functions as a storage unit that stores output data of the imaging signal processing circuit 506, a composite image generated by the image composition circuit 513, and a parallax map generated by the parallax map generation circuit 514.

  The image composition circuit 513 generates composite image data based on the left-eye image data and the right-eye image data. Specifically, the image synthesis circuit 513 synthesizes the left-eye image and the right-eye image by performing an averaging process on the left-eye image and the right-eye image for each pixel to generate a synthesized image. Thereby, even if the left eye image and the right eye image based on the image signal read from the image sensor 505 are photographed with different shapes, the shape of the subject is interpolated by the processing by the image composition circuit 513 and correct. Shape image data is generated. Note that the image composition circuit 513 may acquire only necessary PD signals and generate a composite image.

  For example, among the image signals output from the PDs 301L to 304R in FIG. 2B, the image composition circuit 513 generates a left-eye image from the image signals output from the PDs 301L, 302L, 303L, and 304L. The image composition circuit 513 generates a right eye image from the image signals output from the PDs 301R, 302R, 303R, and 304R. Further, the image composition circuit 513 adds the output of PD301L and the output of PD301R, adds the output of PD302L and the output of PD302R, adds the output of PD303L and the output of PD303R, and outputs the output of PD304L and the output of PD304R. Add the output. Thereby, a composite image is generated.

  The photometric device 515 measures the brightness of the subject. The compression / decompression circuit 520 compresses the stored image data by a predetermined image compression method (for example, adaptive discrete cosine transform (ADCT) or the like), and writes the compressed image data in the memory unit 508. The compression / decompression circuit 520 decompresses the image data read from the memory 508 and writes the decompressed image data to the memory unit 508.

  FIG. 5 is a diagram illustrating an example of a disparity map generation process according to the present embodiment. Reference numeral 601 in FIG. 5A indicates a composition obtained by photographing a subject. Reference numerals 602, 603, and 604 denote subjects. In the composition shown in FIG. 5A, the subjects 602, 603, and 604 are arranged in this order from the top. In addition, the subject is arranged side by side in the depth direction as shown in FIG. Reference numeral 604 is the closest subject, and reference numeral 602 is the farthest subject.

  FIG. 5B shows a stereo image obtained by photographing the composition shown in FIG. An image 605 is a left-eye image, and an image 606 is a right-eye image. In the left-eye image 605, subjects 602, 603, and 604 are shown as 607L, 608L, and 609L, respectively. In the right-eye image 606, subjects 602, 603, and 604 are shown as 607R, 608R, and 609R, respectively.

  There is a positional shift between the subject in the left-eye image 605 and the subject in the right-eye image 606. In the present embodiment, the amount of positional deviation is defined as the amount of parallax. First, the parallax map generation circuit 514 detects subjects included in the left-eye image 605 and the right-eye image 606 using a known pattern matching method. For each detected subject, the parallax map generation circuit 514 calculates a parallax amount based on the position of the subject in the left-eye image and the position of the subject in the right-eye image, and information on the calculated parallax amount (parallax amount information) A parallax map having Note that the information on the amount of parallax included in the parallax map may be included in image data or an image file stored in the memory unit 508, or may be saved as an associated file. In this example, it is assumed that information on the amount of parallax is included in the image file.

  Reference numeral 610 in FIG. 5B indicates a positional shift amount in the right-eye image 606 based on the position of the subject 602 in the left-eye image 605, that is, a parallax amount between 607L and 607R. Similarly, reference numeral 611 indicates a positional shift amount in the right-eye image 606 with reference to the position of the subject 604 in the left-eye image 605, that is, a parallax amount between 609L and 609R. For the subject 603, the position in the left-eye image 605 and the position in the right-eye image 606 are the same. That is, the subject 603 has no amount of parallax.

  Here, the reason why the stereoscopic effect varies depending on the amount of parallax will be described with reference to FIG. FIG. 6 is a diagram schematically showing a state of viewing a stereoscopic image. Reference numeral 701 denotes a screen surface of the display device. Reference numeral 702 indicates an observer, reference numeral 703L indicates the left eye of the observer, and reference numeral 703R indicates the right eye of the observer. The dotted lines schematically show how each subject projected on the screen is projected onto the left eye 703L and the right eye 703R.

  On the screen surface 701, a left-eye image and a right-eye image are displayed so as to be projected only on the left eye and only on the right eye, respectively. The images of the subjects 607L, 608L, and 609L in the left-eye image are projected onto the left eye 303L, and the images of the subjects 607R, 608R, and 609R in the right-eye image are projected onto the right eye 703R. As a result, the subject 602 represented by the subject 607L in the left-eye image and the subject 607R in the right-eye image appears to be present at the position indicated by reference numeral 704 at the back of the screen surface of the stereo display device.

  Also, the subject 603 represented by the subject 608L in the left-eye image and the subject 608R in the right-eye image appears to be present at the position 705 on the screen surface of the stereo display device. Furthermore, the subject 604 represented by the subject 609L in the left-eye image and the subject 609R in the right-eye image appears to jump out to a position 706 in front of the screen surface of the stereo display device. That is, the depth amount and the pop-out amount of these subjects depend on the parallax amount of the subject of the left-eye image and the right-eye image, the parallax amount 610 indicates the depth amount of the subject 602, and the parallax amount 611 indicates the pop-up amount of the subject 604. ing. The parallax amount between the left-eye image and the right-eye image indicates the parallax of the right eye and the left eye, and the parallax amount determines the depth amount and the pop-out amount. The parallax map generation circuit 514 obtains the above-described parallax amount. By detecting a subject included in the left-eye image 605 and the right-eye image 606 and obtaining the shift amount of the subject, the amount of parallax can be detected.

  7 and 8 are diagrams illustrating an example of a parallax amount editing process. FIG. 7 shows an example of generating a parallax map. 801 in FIG. 7 is a side view of the subject. 802 is a front view of the subject. Reference numeral 803 denotes an example of a parallax map obtained from a subject. In the parallax map 803, the parallax of the background portion of the subject is 0, the parallax of the square subject is 1, and the parallax of the round subject is 2. The parallax value may be an integer value, a negative value, or a real number.

  FIG. 8 shows an example of editing the parallax amount of the parallax map. In FIG. 8A, reference numeral 804 denotes a composite image generated from the left-eye image and the right-eye image. Reference numeral 805 in FIG. 8B denotes an image for the left eye. Reference numeral 806 in FIG. 8C denotes an image for the right eye. In FIG. 8D, reference numeral 807 denotes a parallax map.

  The system control unit 509 can instruct the parallax map generation circuit 514 to edit (weight) the parallax amount of the parallax map 707.

  A parallax map 810 in FIG. 8E is weighted and the parallax amount is doubled. Based on the parallax map 810 and the composite image 804, the system control unit 509 three-dimensionally displays the parallax-enlarged left-eye image 808 (FIG. 8F) and the parallax-enlarged right-eye image 809 (FIG. 8G). Generated as display image data. In the present embodiment, the system control unit 509 executes a parallax amount editing process (enlargement process) according to the resolution of the captured image.

Example 1
FIG. 9 is a flowchart illustrating a parallax map generation process executed by the imaging apparatus according to the first embodiment.

  First, the system control unit 509 executes a parallax amount enlargement process according to the resolution of the captured image (step S901). Subsequently, the system control unit 509 generates a parallax map having the parallax amount after the enlargement process (step S902). Then, the system control unit 509 stores the generated parallax map in the memory unit 508 (step S903).

  FIG. 10 is a flowchart for explaining an example of the parallax amount expansion processing in step S901 in FIG. In this embodiment, a resolution (reference resolution) serving as a reference for determining whether to increase the amount of parallax is set in advance. Then, the imaging device enlarges the amount of parallax when shooting is performed at a resolution different from the reference resolution.

  First, the system control unit 509 confirms the resolution of the captured image (step S1001). Next, the system control unit 509 determines whether the resolution of the captured image confirmed in step S1001 is different from a preset reference resolution (step S1002). If the resolution of the captured image is the same as the reference resolution, the process proceeds to step S1003. Then, the system control unit 509 sets 1 as a parallax amount enlargement rate (parallax enlargement rate). Thereby, the parallax amount at the time of photographing is applied as it is.

  If the resolution of the captured image is different from the reference resolution, the process proceeds to step S1004. Then, the system control unit 509 calculates an enlargement ratio of the parallax amount according to the resolution of the captured image (step S1004). Specifically, the system control unit 509 refers to a parallax expansion table stored in advance in the memory unit 508, and calculates a parallax amount expansion rate.

  FIG. 14 is a diagram illustrating an example of the parallax expansion table. In the parallax magnification table, an image size and a parallax magnification rate are set in association with each other. The image size is the size of the resolution of the captured image. The parallax magnification rate is correction information (magnification rate) of the parallax amount. In the present embodiment, the parallax magnification rate is used for enlarging the parallax amount calculated in step S1006 of FIG.

  The lower the resolution of the captured image, the higher the parallax magnification rate associated with it. Accordingly, in step S1004 in FIG. 10, the system control unit 509 calculates a higher parallax magnification rate as the resolution of the captured image is lower. In the present invention, the method for calculating the parallax magnification rate is not limited to the method performed using the parallax magnification table. For example, the system control unit 509 may obtain the parallax magnification rate based on the ratio (size ratio) of the resolution size of the captured image to the size of the reference resolution. Further, the system control unit 509 may calculate a value obtained by calculating a predetermined coefficient as a correction factor determined from the ratio of the resolution size of the captured image to the size of the reference resolution as the parallax magnification rate.

  Next, the processing from step S1005 to step S1008 is executed for all the pixels of the captured image. Specifically, the system control unit 509 calculates the amount of parallax for one pixel of the captured left-eye image and right-eye image (step S1006).

  Next, the system control unit 509 multiplies the parallax amount calculated in step S1006 by the parallax magnification calculated in steps S1003 and S1004 (step S1007). Thereby, the amount of parallax is expanded. The system control unit 509 stores the enlarged amount of parallax in the memory 508.

  Next, the system control unit 509 changes the pixel for which the amount of parallax is to be calculated to a pixel to be arranged next, and returns to the process of step S1006. The above process is repeated for all pixels of the captured image.

  FIG. 11 is a diagram illustrating an example of a parallax map when the parallax enlargement process according to the resolution is performed. FIG. 11A shows image data read from the image sensor 505 by photographing and a parallax map. Reference numeral 1101 denotes a left-eye image read from the image sensor 505 by photographing. Reference numeral 1102 denotes a right-eye image. Reference numeral 1103 denotes a parallax map. The parallax map 1103 is obtained from the left-eye image 1101 and the right-eye image 1102.

  FIG. 11B shows an example of the image data and the parallax map after the editing process of the parallax amount according to the resolution. The captured image (left-eye image and right-eye image) shown in FIG. 11A is converted by the system control unit 509 into an image size having a resolution set in the imaging device. The system control unit 509 edits the parallax amount according to the converted image size. Reference numeral 1104 denotes a left-eye image after the parallax amount is edited. Reference numeral 1105 denotes a right-eye image after editing the parallax amount. Reference numeral 1106 indicates a parallax map having a parallax amount after editing.

  FIG. 11C shows another example of image data and a parallax map after editing processing of the parallax amount according to the resolution. In the example shown in FIG. 11C, it is assumed that the image is taken at a resolution lower than the resolution set in the example shown in FIG. Since the resolution of the captured image is low, the system control unit 509 increases the enlargement ratio of the parallax amount. As a result, a left-eye image 1107, a right-eye image 1108, and a parallax map 1109 shown in FIG.

  Since the imaging apparatus of the present embodiment changes the amount of parallax between the left-eye image and the right-eye image according to the resolution of the captured image, an appropriate stereoscopic effect can be obtained even when an image with a low resolution is captured. A stereo image that can be generated can be generated.

(Example 2)
FIG. 12 is a flowchart illustrating a disparity map generation process performed by the imaging apparatus according to the second embodiment.

  First, the system control unit 509 calculates a parallax amount for each pixel based on the captured left-eye image and right-eye image, and generates a parallax map (step S1201). Subsequently, the system control unit 509 executes a process of enlarging the amount of parallax included in the parallax map generated in step S1201 according to the resolution of the captured image (step S1202). Then, the system control unit 509 stores the parallax map having the parallax amount after the enlargement process in the memory unit 508 (step S1203).

FIG. 13 is a flowchart illustrating an example of the parallax amount enlargement process in step S1202 of FIG.
First, the system control unit 509 confirms the resolution of the captured image (step S1301). Next, the system control unit 509 determines whether the resolution of the captured image confirmed in step S1301 is different from a preset reference resolution (step S1302). When the resolution of the captured image is the same as the reference resolution, the process is exited, and the parallax map generated in step S1201 in FIG. 12 is stored as it is.

  If the resolution of the captured image is different from the reference resolution, the process proceeds to step S1303. Then, the system control unit 509 calculates the parallax magnification rate according to the resolution of the captured image (step S1004). The process for calculating the parallax magnification in step S1004 is the same as the process for calculating the magnification of the parallax amount in step S1006 in FIG.

  Next, the system control unit 509 reads information on the parallax map from the memory unit 508 (step S1304). Then, the system control unit 509 enlarges the parallax amount included in the read parallax map by the parallax enlargement ratio calculated in step S1303, and writes the parallax map having the enlarged parallax amount back to the memory unit 508. The rewritten parallax map information is stored in step S1203 of FIG.

  According to the imaging apparatus of the second embodiment, it is possible to edit the amount of parallax included in the generated parallax map according to the resolution of the captured image, and an appropriate stereoscopic effect can be obtained even when an image with a low resolution is captured. A stereo image that can be obtained can be generated.

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

(Other examples)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

201 pixels 202 microlenses 203, 204 PD

Claims (9)

An imaging device including a pixel unit having a plurality of photoelectric conversion units that photoelectrically convert light beams that have passed through different regions divided by the exit pupil of the imaging optical system with respect to one microlens;
Setting means for setting the resolution of the image signal output by the image sensor;
Detecting means for detecting a parallax amount between left-eye image data and right-eye image data generated based on an image signal output from the image sensor;
An imaging apparatus comprising: an editing unit that edits the detected amount of parallax according to the resolution set by the setting unit. The imaging apparatus according to claim 1, further comprising a generation unit configured to generate a parallax map that is used to generate image data for three-dimensional display having the edited parallax amount. An imaging device including a pixel unit having a plurality of photoelectric conversion units that photoelectrically convert light beams that have passed through different regions divided by the exit pupil of the imaging optical system with respect to one microlens;
Setting means for setting the resolution of the image signal output by the image sensor;
The parallax used for generating the image data for three-dimensional display having the detected parallax amount by detecting the parallax amount of the left-eye image data and the right-eye image data generated based on the image signal output from the image sensor Parallax map generating means for generating a map;
An imaging apparatus comprising: an editing unit that edits the parallax amount of the generated parallax map in accordance with the resolution set by the setting unit. The editing unit determines whether the resolution set by the setting unit is different from a predetermined reference resolution, and edits the parallax amount when the resolution set by the setting unit is different from the reference resolution. The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. The editing means, when the resolution set by the setting means is different from the reference resolution, edits the parallax amount using the parallax amount correction information stored in the storage means in advance. Item 5. The imaging device according to Item 4. The editing means edits the parallax amount based on a size ratio between the resolution set by the setting means and the reference resolution when the resolution set by the setting means is different from the reference resolution. The imaging apparatus according to claim 4, wherein the imaging apparatus is characterized. The imaging apparatus according to any one of claims 4 to 6, wherein the editing unit enlarges the parallax amount at a higher magnification rate as the resolution set by the setting unit is lower. An imaging apparatus including an imaging device including a pixel unit having a plurality of photoelectric conversion units that photoelectrically convert light beams that have passed through different regions divided by an exit pupil of an imaging optical system with respect to one microlens. Control method,
Setting the resolution of the image signal output by the imaging device;
Detecting a parallax amount between left-eye image data and right-eye image data generated based on an image signal output from the image sensor;
A step of editing the detected amount of parallax in accordance with the set resolution. An imaging apparatus including an imaging device including a pixel unit having a plurality of photoelectric conversion units that photoelectrically convert light beams that have passed through different regions divided by an exit pupil of an imaging optical system with respect to one microlens. Control method,
Setting the resolution of the image signal output by the imaging device;
The parallax used for generating the image data for three-dimensional display having the detected parallax amount by detecting the parallax amount of the left-eye image data and the right-eye image data generated based on the image signal output from the image sensor Generating a map;
And a step of editing a parallax amount of the generated parallax map according to the set resolution.

Images