JP2013187878A - Imaging apparatus and control method of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus for precisely and three-dimensionally displaying on an external device an image which the imaging apparatus captures and switching the image to two-dimensional display when the external device three-dimensionally displays the image.SOLUTION: An imaging element 505 of an imaging apparatus includes a pixel section having a plurality of photoelectric conversion sections for photoelectrically converting luminous flux passing through different divided regions of an exit pupil of an imaging optical system and generating an image signal for one micro lens. The imaging apparatus synthesizes a left eye image and a right eye image, which are obtained on the basis of the image signal which the imaging element 505 outputs, and generates a synthesized image. The imaging apparatus generates a parallax map used for generating image data for three-dimensional display on the basis of the synthesized image and the left eye image/right eye image. When an external device three-dimensionally displays the image, the imaging apparatus transmits the synthesized image and the parallax map to the external device. When the external device two-dimensionally displays the image, the synthesized image is transmitted to the external device.

Description

  The present invention relates to an imaging apparatus and a method for controlling the imaging apparatus.

  In recent years, the spread of stereoscopic video related devices such as a three-dimensional (3D) cinema and a 3D display has been rapidly increasing. Although stereoscopic video shooting has been conventionally performed with a film-type camera or the like, an original image for generating a stereoscopic video is being shot with a digital camera or a digital video camera along with the spread of digital imaging devices. ing.

  As a mechanism for a user to view a stereoscopic video, right eye image data and left eye image data with parallax in the left-right direction so as to correspond to an image of an object viewed with the left eye and an image viewed with the right eye are provided. Prepared. A user can view each image stereoscopically by looking at the right eye and the left eye. As such a method, there is a method of dividing an image to be viewed by parallax, such as a parallax barrier method or a lenticular method. There is also known a method of presenting different videos for the left and right eyes of the user through filters having different characteristics on the left and right.

  On the other hand, Patent Documents 1 and 2 disclose a method for simultaneously capturing images from different viewpoints as a method for capturing an image that can be viewed as a stereoscopic video. Patent Document 1 discloses a solid-state imaging device in which a plurality of microlenses are formed, and one or more pairs of photodiodes are arranged in proximity to each of the microlenses. A first image signal is obtained from the output of one of the photodiode pairs, and a second image signal is obtained from the output of the other photodiode. By using the first and second image signals as the left-eye image and the right-eye image, respectively, the user can view the stereoscopic video.

  Patent Document 2 discloses an output parallax map having an output element having an output value corresponding to a shift to be applied to each pixel of the first image. A second image can be generated based on the output parallax map and the first image.

JP-A-58-24105 Special table 2008-518317

  In order to allow the viewer to view a stereoscopic video, the viewer may be allowed to view images with parallax in the left-right direction with corresponding eyes. This is realized by preparing a left-eye image for viewing with the left eye and a right-eye image for viewing with the right eye as three-dimensional display images using the techniques disclosed in Patent Documents 1 and 2. it can.

  Here, for example, the imaging device generates a parallax map based on the left-eye image and the right-eye image obtained from the output of the imaging device, and uses the left-eye image and the right-eye for three-dimensional display using the parallax map. Images.

  Here, it is assumed that the imaging device and an external device such as a PC are connected by USB or wireless, and a live view image captured by the imaging device is displayed in a three-dimensional manner on an image display unit (monitor) of the external device. . In this case, for example, the imaging apparatus generates a composite image from the left-eye image / right-eye image, and generates a parallax map from the generated composite image and the left-eye image / right-eye image. The imaging device transmits the composite image as a set with the parallax map to the external device. The external device generates a right-eye image and a left-eye image for three-dimensional display based on the composite image and the parallax map received from the imaging device, and displays them three-dimensionally.

  When the external device displays an image three-dimensionally, if the parallax map is not transmitted from the imaging device, the external device cannot display the image three-dimensionally. In addition, it is necessary for the external device to be able to switch from the three-dimensional display to the two-dimensional display according to the user operation during the three-dimensional display of the image.

  An object of the present invention is to provide an imaging apparatus that allows an image captured by an imaging apparatus to be displayed correctly in a three-dimensional display on an external apparatus and that the external apparatus can switch to a two-dimensional display during the three-dimensional display.

  An imaging apparatus according to an embodiment of the present invention includes a plurality of photoelectric conversion units that generate an image signal by photoelectrically converting a light beam that has passed through different regions of an exit pupil of an imaging optical system with respect to one microlens. An image sensor including a pixel unit, and an image for a left eye and an image for a right eye are generated based on an image signal output from the image sensor, and the generated image for the left eye and the image for the right eye are generated for each pixel. Image synthesis means for generating a composite image by adding to the image, and a positional deviation amount of the left-eye image / right-eye image with respect to the position of the generated composite image as a parallax amount, and according to the parallax amount A parallax map, a parallax map generating unit that generates a parallax map used to generate image data for three-dimensional display, and the external device executes either three-dimensional display or two-dimensional display of an image from an external device Receiving means for receiving control information indicating the above, and when the received control information indicates that the external device performs three-dimensional display of the image, the composite image and the parallax map are displayed on the external device. And transmitting means for transmitting the composite image to the external device when the control information indicates that the external device performs two-dimensional display of the image.

  When the external apparatus displays an image three-dimensionally, the imaging apparatus of the present invention transmits information necessary for generating three-dimensional display image data to the external apparatus. As a result, the external device can reliably display the image in three dimensions. The imaging device of the present invention transmits two-dimensional display image data to the external device when the external device displays the image two-dimensionally. Thereby, it becomes possible for the external device to switch from the three-dimensional display to the two-dimensional display in accordance with a user operation.

It is a figure showing roughly the example of composition of the image sensor which an imaging device applies. It is a figure which shows the structural example of the pixel of an image pick-up element. It is the conceptual diagram showing a mode that the light beam which came out of the exit pupil of the imaging lens injects into an image pick-up element. It is a figure which shows the structural example of the imaging device of this embodiment. It is a figure which shows an example of the production | generation process of the parallax map in this embodiment. 6 is a flowchart illustrating an example of operation processing of the imaging apparatus according to the present embodiment.

  FIG. 1 is a diagram schematically illustrating a configuration example of an imaging element applied by the imaging apparatus of the present embodiment. The image sensor 100 includes a pixel array 101, a vertical selection circuit 102 that selects a row in the pixel array 101, and a horizontal selection circuit 104 that selects a column in the pixel array 101. The readout circuit 103 reads out the signal of the pixel selected by the vertical selection circuit 102 among the pixels in the pixel array 101. The reading circuit 103 includes a memory for storing signals, a gain amplifier, an AD converter, and the like for each column.

  The serial interface (SI) unit 105 determines an operation mode of each circuit according to an instruction from an external circuit. The vertical selection circuit 102 sequentially selects a plurality of rows in the pixel array 101 and extracts pixel signals to the readout circuit 103. The horizontal selection circuit 104 sequentially selects a plurality of pixel signals read by the reading circuit 103 for each column. In addition to the components shown in FIG. 1, the image sensor 100 includes, for example, a timing generator that provides a timing signal to the vertical selection circuit 102, the horizontal selection circuit 104, the readout circuit 103, a control circuit, and the like. These detailed explanations are omitted.

  FIG. 2 is a diagram illustrating a configuration example of pixels of the image sensor 100. FIG. 2A schematically shows the configuration of one pixel. FIG. 2B shows the arrangement of the pixel array 101. A pixel 201 illustrated in FIG. 2A includes a microlens 202 as an optical element and a plurality of photodiodes (hereinafter abbreviated as PD) as light receiving elements.

  FIG. 2A illustrates an example in which two pixels, the left PD 203 and the right PD 204, are provided in one pixel, but three or more (for example, four or nine) PDs may be used. The PD 203 photoelectrically converts the received light beam and outputs a left-eye image. The PD 204 photoelectrically converts the received light beam and outputs a right-eye image. The pixel 201 includes, for example, a pixel amplification amplifier that extracts a PD signal to the reading circuit 103, a row selection switch, a PD signal reset switch, and the like in addition to the illustrated components.

  In order to provide a two-dimensional image, the pixel array 101 is arranged in a two-dimensional array like a large number of pixels 301 to 304 shown in FIG. The PDs 301L, 302L, 303L, and 304L correspond to the PD 203 in FIG. PDs 301R, 302R, 303R, and 304R correspond to the PD 204 in FIG. That is, the imaging apparatus according to the present embodiment includes a plurality of first photoelectric conversion units (PD 203) that output a left-eye image and a second photoelectric conversion unit (PD 204) that outputs a right-eye image. An imaging device including a pixel portion is provided.

  Next, light reception of the imaging element 100 having the pixel configuration illustrated in FIG. FIG. 3 is a conceptual diagram illustrating a state in which a light beam emitted from the exit pupil of the photographing lens enters the image sensor 100.

  The pixel array 101 includes a microlens 202, a color filter 403, and PDs 404 and 405. PD 404 and PD 405 correspond to PD 203 and PD 204 in FIG.

  In FIG. 3, the center of the light beam emitted from the exit pupil 406 of the photographing lens with respect to the microlens 202 is an optical axis 409. The light emitted from the exit pupil 406 enters the image sensor 100 with the optical axis 409 as the center. Partial areas 407 and 408 are areas of the exit pupil 406 of the photographing lens. Light rays 410 and 411 are the outermost light rays of the light passing through the partial region 407. Light rays 412 and 413 are the outermost light rays of the light passing through the partial region 408.

  Out of the light beams emitted from the exit pupil 406, with the optical axis 409 as a boundary line, the upper light beam enters the PD 405, and the lower light beam enters the PD 404. That is, the PD 404 and the PD 405 each receive light beams from different regions obtained by dividing the exit pupil of the photographing optical system. In this way, each light receiving element detects light in a different region at the exit pupil, and therefore, in a situation where light is taken from a point light source, photographed images having different shapes can be obtained. .

  FIG. 4 is a diagram illustrating a configuration example of the imaging apparatus according to the present embodiment. With reference to FIG. 4, an application example of the image sensor 100 shown in FIG. 1 to a digital camera which is an image pickup apparatus will be described. The lens unit 501 constituting the imaging optical system forms an image of light from the subject on the imaging element 505. The imaging element 505 corresponds to the imaging element 100 illustrated in FIG. 1 and has a pixel configuration illustrated in FIG.

  The lens driving device 502 performs zoom control, focus control, aperture control, and the like. The mechanical shutter 503 is controlled by a shutter driving device 504. The image sensor 505 converts the subject image formed by the lens unit 501 into an image signal. The imaging signal processing circuit 506 performs various processes and corrections on the image signal output from the imaging element 505. The timing generator 507 outputs a timing signal necessary for the image sensor 505 and the image signal processing circuit 506.

  A system control unit 509 is a control unit that performs various calculations and controls the entire imaging apparatus, and performs processing by a CPU (central processing unit) (not shown) executing a program. As an operation peculiar to the present embodiment, the system control unit 509 performs a 3D live view command or 2D live view command from an external device (PC) connected to the imaging device via the external I / F unit 512. It is determined which of the commands is received. The 3D live view command is control information indicating that the PC displays an image three-dimensionally. The 2D live view command is control information indicating that the PC displays an image in two dimensions.

  When the system control unit 509 determines that a 3D live view command has been received from the PC, the system control unit 509 executes the following processing. The system control unit 509 instructs the image composition circuit 513 to execute composite image data generation processing. Also, the system control unit 509 instructs the parallax map generation circuit 514 to generate a parallax map. Further, the system control unit 509 transmits the composite image data and the parallax map as a set to the PC via the external I / F unit 512. The PC generates right-eye image data and left-eye image data for three-dimensional display based on the received composite image data and the parallax map, and three-dimensionally displays it on the display monitor.

  When the system control unit 509 determines that a 2D live view command has been received from the PC, the system control unit 509 executes the following processing. The system control unit 509 instructs the image composition circuit 513 to execute composite image data generation processing. Then, the system control unit 509 transmits the composite image data as two-dimensional display image data to the PC via the external I / F unit 512. The PC displays the received composite image data two-dimensionally on the display monitor. Note that the system control unit 509 can also realize phase difference AF by detecting a phase difference based on the left-eye image and the right-eye image.

  The memory unit 508 includes a memory that temporarily stores image data. A storage medium control interface unit (hereinafter abbreviated as I / F unit) 510 is provided for recording or reading image data or the like on the recording medium 511. The recording medium 511 that can be attached to and detached from the imaging apparatus is a semiconductor memory or the like. The external I / F unit 512 transmits / receives data to / from an external device. The display device 521 displays various information and captured images in accordance with the display data output from the display control circuit 522. The photometric device 515 acquires a photometric value used for exposure control.

  The imaging signal processing circuit 506 performs image processing by distributing imaging data output from the imaging element 505 into a left-eye image and a right-eye image. The memory unit 508 functions as a storage unit that stores the output data of the imaging signal processing circuit 506, the synthesized image generated by the image synthesizing circuit, and the parallax map generated by the parallax map generating circuit.

  The image composition circuit 513 functions as an image composition unit that performs the following processing. The image composition circuit 513 generates a left-eye image and a right-eye image based on the image signal output from the image sensor, and generates a composite image based on the generated left-eye image and right-eye image. Specifically, the image composition circuit 513 generates a composite image by adding the left-eye image and the right-eye image for each pixel (addition average). This composite image is an image in which the shape of the subject is correctly reflected.

  Referring to FIG. 2B as an example, the image composition circuit 513 generates a left-eye image from the image signals output from the PDs 301L, 302L, 303L, and 304L among the image signals output from the PDs 301L to 304R. The image composition circuit 513 generates a right eye image from the image signals output from the PDs 301R, 302R, 303R, and 304R. That is, the image composition circuit 513 functions as image generation means for generating left-eye image data and right-eye image data based on the image signal output from the image sensor. Further, the image composition circuit 513 adds the output of PD301L and the output of PD301R, adds the output of PD302L and the output of PD302R, adds the output of PD303L and the output of PD303R, and outputs the output of PD304L and the output of PD304R. Add the output. Thereby, a composite image is generated.

  The parallax map generation circuit 514 functions as a parallax map generation unit that generates a parallax map. Specifically, the parallax map generation circuit 514 acquires the left-eye image / right-eye image generated by the image composition circuit 513 and the composite image. The parallax map generation circuit 514 uses the amount of positional deviation between the left-eye image and the right-eye image based on the position of the composite image as the parallax amount. Then, the parallax map generation circuit 514 generates a parallax map corresponding to the parallax amount and used for generating image data for three-dimensional display. The control method of the imaging apparatus according to the present embodiment is realized by, for example, the function of the processing unit included in the imaging apparatus illustrated in FIG.

  FIG. 5 is a diagram illustrating an example of a disparity map generation process according to the present embodiment. Reference numeral 601 in FIG. 5A indicates a composition obtained by photographing a subject. Reference numerals 602, 603, and 604 denote subjects. In the composition shown in FIG. 5A, the subjects 602, 603, and 604 are arranged in this order from the top. In addition, the subject is arranged side by side in the depth direction as shown in FIG. Reference numeral 604 is the closest subject, and reference numeral 602 is the farthest subject.

  FIG. 5B shows a stereo image obtained by photographing the composition shown in FIG. An image 605 is a left-eye image, and an image 606 is a right-eye image. In the left-eye image 605, subjects 602, 603, and 604 are shown as 607L, 608L, and 609L, respectively. In the right-eye image 606, subjects 602, 603, and 604 are shown as 607R, 608R, and 609R, respectively.

  There is a positional shift between the subject in the left-eye image 605 and the subject in the right-eye image 606. In the present embodiment, the amount of positional deviation is defined as the amount of parallax.

  Reference numeral 610 indicates a positional shift amount in the right-eye image 606 based on the position of the subject 602 in the left-eye image 605, that is, a parallax amount between 607L and 607R. Similarly, reference numeral 611 indicates a positional shift amount in the right-eye image 606 with reference to the position of the subject 604 in the left-eye image 605, that is, a parallax amount between 609L and 609R. For the subject 603, the position in the left-eye image 605 and the position in the right-eye image 606 are the same. That is, the subject 603 has no amount of parallax.

  First, the parallax map generation circuit 514 detects subjects included in the left-eye image 605 and the right-eye image 606 using a known pattern matching method. The parallax map generation circuit 514 executes the following processing for each detected subject. The parallax map generation circuit 514 calculates a positional deviation amount from the midpoint between the centroids of the subject in the left-eye image 605 and the right-eye image 606 to the centroid of the subject in the left-eye image 605 as a parallax amount. In other words, the parallax map generation circuit 514 uses the position of the center of gravity of the subject in the composite image generated based on the image for left eye 605 and the image for right eye 606 as a reference to determine the position of the center of gravity of the subject in the image for left eye. The amount of displacement is calculated as the amount of parallax.

  The calculated amount of parallax is the amount of parallax corresponding to the left-eye image. Of course, the parallax map generation circuit 514 calculates the positional deviation amount of the position of the center of gravity of the subject in the right-eye image as a parallax amount corresponding to the right-eye image based on the position of the center of gravity of the subject in the composite image. May be.

  The system control unit 509 may function as an acquisition unit that acquires the size of a display monitor (image display screen) that displays image data for three-dimensional display included in the PC. The system control unit 509 may function as an editing unit that edits the parallax amount of the parallax map based on the acquired size of the image display screen. Specifically, the system control unit 509 decreases the parallax amount of the parallax map when the size of the image display screen is large, and increases the parallax amount of the parallax map when the size of the image display screen is small. As a result, on a PC that displays an image three-dimensionally based on the composite image received from the imaging device and the parallax map, an image with a stereoscopic effect that does not give the viewer a sense of discomfort according to the size of the image display screen is provided. can do.

  In the example illustrated in FIG. 5B, for the subject 602, the parallax map generation circuit 514 calculates a parallax amount 612 that is half of the parallax amount 610. For the subject 604, the parallax map generation circuit 514 calculates a parallax amount 613 that is half the parallax amount 611. The parallax map generation circuit 514 stores information on the calculated parallax amounts 612 and 613 and information on the position of the image serving as a reference for the parallax amount in the memory unit 508 as a parallax map. In this example, the information on the position of the image serving as a reference for the amount of parallax indicates the center of gravity of the subject in the composite image. As described above, in the example illustrated in FIG. 5B, the subject 603 has no amount of parallax.

  Next, an operation in a case where the PC that has received the composite image and the parallax map from the imaging apparatus performs three-dimensional display of the image will be described. The PC confirms that the position of the image serving as a reference for the amount of parallax indicated by the parallax map is the center of gravity of the subject in the composite image. Then, the PC generates the image data for reproduction of the image corresponding to the parallax amount by moving the subject included in the composite image by the amount of the parallax corresponding to the parallax map. In this example, the PC generates left-eye image data as reproduction image data.

  Further, the PC inverts the amount of parallax indicated by the parallax map, and the amount of parallax obtained by the inversion is calculated as the positional deviation amount of the position of the center of gravity of the subject in the right-eye image with reference to the center of gravity of the subject in the composite image. To do. The PC moves the subject included in the composite image by the amount of the parallax amount indicated by the parallax map, thereby generating image data for reproduction of an image other than the image corresponding to the parallax amount, that is, right-eye image data. To do. Then, the PC displays the generated right-eye image data and left-eye image data.

  FIG. 6 is a flowchart illustrating an example of operation processing of the imaging apparatus according to the present embodiment. When the main power supply is turned on, the power supply for the control system is turned on, and the power supply for the image pickup system circuit such as the image pickup signal processing circuit 506 is turned on. A live view start button (not shown) included in the imaging device is pressed, or a live view start command is notified to the imaging device from a PC connected to the imaging device by wire or wireless. In other words, the system control unit 509 functions as a receiving unit that receives control information indicating whether the external device performs three-dimensional display or two-dimensional display of an image from the external device.

  The system control unit 509 included in the imaging apparatus determines whether the notified live view start command is a 3D live view command (step S801). If the system control unit 509 determines that the notified live view start command is a 3D live view command, the process proceeds to step S802.

  Next, the system control unit 509 starts live view, that is, real-time display of an image captured from the image sensor 505 (step S802). Specifically, the system control unit 509 starts processing for developing and placing the image signal output from the image sensor 505 on a VRAM periodically (for example, 30 times per second).

  First, the system control unit 509 stores the left-eye image data generated by the output signal from the image sensor in the RAM (step S803). Further, the system control unit 509 stores the right-eye image data generated by the output signal from the image sensor in the RAM (step S804).

  Next, the image composition circuit 513 generates composite image data by combining the left-eye image data and right-eye image data stored in the RAM, and stores the generated composite image data in the VRAM (step S805). Subsequently, the parallax map generation circuit 514 generates a parallax map based on the left-eye image data / right-eye image data and the composite image data, and stores the generated parallax map in the RAM (step S806).

  Next, the system control unit 509 determines whether an image acquisition request is received from the PC (step S807). If the system control unit 509 determines that an image acquisition request has not been received from the PC, the process advances to step S803. If the system control unit 509 determines that an image acquisition request has been received from the PC, the process advances to step S808. Then, the system control unit 509 transmits the composite image data and the parallax map to the PC (step S808), and ends the process. That is, when the received control information (command) indicates that the PC performs three-dimensional display of an image (Yes in S801 in FIG. 6), the system control unit 509 sends the composite image and the parallax map to the PC. Then, it is transmitted (S808).

  If the system control unit 509 determines in step S801 that the notified live view start command is not a 3D live view command but a 2D live view command, the process proceeds to step S809.

  Steps S809 to S812 are the same as steps S802 to S805. After the process of step S812, the process proceeds to step S813. Step S813 is the same as step S807. In step S814, the system control unit 509 transmits the composite image data to the PC and ends the process. That is, the system control unit 509 transmits the composite image to the PC when the received control information (command) indicates that the PC executes the two-dimensional display of the image (No in S801 in FIG. 6). (S808). That is, when the notified live view start command is a 2D live view command, a parallax map is not generated. In particular, when the system control unit 509 receives a 2D live view command during transmission of the composite image and the parallax map to the PC (No in S801), the system control unit 509 is a canceling unit that executes the following processing. Function. The system control unit 509 functions as a cancellation unit that instructs the parallax map generation unit 514 to stop the generation of the parallax map.

  When the external apparatus displays an image three-dimensionally, the imaging apparatus according to the present embodiment transmits information (synthesized image and parallax map) necessary for generating three-dimensional display image data to the external apparatus. As a result, the external device can reliably display the image in three dimensions. The imaging apparatus according to the present embodiment transmits two-dimensional display image data to the external device when the external device displays an image two-dimensionally. Thereby, it becomes possible for the external device to switch from the three-dimensional display to the two-dimensional display in accordance with a user operation.

(Other examples)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

201 pixels 202 microlenses 203, 204 PD

Claims (5)

An imaging device including a pixel unit having a plurality of photoelectric conversion units that photoelectrically convert light beams that have passed through different regions divided by the exit pupil of the imaging optical system with respect to one microlens;
Based on the image signal output from the image sensor, a left-eye image and a right-eye image are generated, and a composite image is generated by adding the generated left-eye image and right-eye image for each pixel. Image synthesizing means,
Generation of image data for three-dimensional display, which is a parallax map corresponding to the amount of parallax, with a positional deviation amount of the left-eye image / right-eye image relative to the position of the generated composite image as a reference amount Parallax map generating means for generating a parallax map used for
Receiving means for receiving control information indicating whether the external device performs three-dimensional display or two-dimensional display of an image from an external device;
When the received control information indicates that the external device performs three-dimensional display of an image, the composite image and the parallax map are transmitted to the external device, and the control information is An imaging apparatus, comprising: a transmission unit configured to transmit the composite image to the external apparatus when the external apparatus indicates to perform two-dimensional display of an image. When the external device performs three-dimensional display of the image,
Based on the composite image received from the imaging device and the parallax map, the subject included in the composite image is moved by the amount of parallax according to the parallax map, thereby allowing the left-eye image or the right-eye image to be moved. Generating image data for reproduction of an image corresponding to the parallax amount,
Generating reproduction image data of an image other than the image corresponding to the parallax amount of the left-eye image or the right-eye image by moving the subject included in the composite image by an amount corresponding to the reversed parallax amount. The imaging apparatus according to claim 1, wherein the imaging apparatus is characterized. An obtaining unit for obtaining a size of an image display screen included in the external device;
The imaging apparatus according to claim 1, further comprising an editing unit that edits the parallax map based on the acquired size of the image display screen. When the transmission unit is transmitting the composite image and the parallax map to the external device, and the reception unit receives control information indicating that the external device performs two-dimensional display of the image. The imaging apparatus according to claim 1, further comprising: a stopping unit that instructs the parallax map generating unit to stop generating the parallax map. An imaging apparatus having an imaging element including a pixel unit having a plurality of photoelectric conversion units that photoelectrically convert light beams that have passed through different regions divided by the exit pupil of the imaging optical system with respect to one microlens. Control method,
Receiving control information indicating whether the external device performs three-dimensional display or two-dimensional display of an image from the external device;
Based on the image signal output from the image sensor, a left-eye image and a right-eye image are generated, and a composite image is generated by adding the generated left-eye image and right-eye image for each pixel. And a process of
When the received control information indicates that the external device performs three-dimensional display of an image, the amount of displacement of the left-eye image / right-eye image based on the position of the generated composite image A parallax map according to the parallax amount, and a parallax map used for generating image data for three-dimensional display;
When the received control information indicates that the external device performs three-dimensional display of an image, the composite image and the parallax map are transmitted to the external device, and the control information is And a step of transmitting the composite image to the external device when the external device indicates to perform two-dimensional display of an image.

Images