JP2013070153A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily capture a three-dimensionally viewable image of a subject without a special constitution.SOLUTION: An imaging apparatus comprises: an imaging unit for capturing a first image; an identification unit for identifying a main subject from the first image captured by the imaging unit; a distance information acquisition unit for acquiring distance information on a distance to the main subject identified by the identification unit; and a display control unit which, when the imaging unit captures a second image having a parallax with respect to the first image, performs control to supplementarily display a supplementary image on a display unit, on the basis of the distance information acquired by the distance information acquisition unit.

Description

  The present invention relates to an imaging apparatus that acquires an image.

  Conventionally, a pair of images having horizontal parallax, such as an image for the right eye and an image for the left eye, can be acquired by two independent imaging means, and these images can be observed with the left and right eyes. There has been proposed a method of obtaining a stereoscopic image by displaying the image (for example, Patent Document 1).

Japanese Patent Laid-Open No. 2005-130312

  However, in the technique of Patent Document 1, there are problems that an increase in manufacturing cost and an increase in the size of the imaging apparatus main body are caused by having two imaging means. In addition, when the right eye image and the left eye image have different orientations or angles, a three-dimensional image cannot be obtained. Therefore, it is necessary to shoot with the orientation, the angle, and the like matched.

  Therefore, an object of the imaging apparatus of the present invention is to obtain an image that allows a subject to be easily stereoscopically viewed without a special configuration.

  The imaging apparatus of the present invention includes an imaging unit that acquires a first image, a specifying unit that specifies a main subject from the first image acquired by the imaging unit, and a distance to the main subject specified by the specifying unit A distance information acquisition unit that acquires information and a display based on the distance information acquired by the distance information acquisition unit when a second image having parallax with respect to the first image is acquired by the imaging unit. And a display control unit for displaying an auxiliary image to be auxiliary displayed on the unit.

  Further, when the second image is acquired by the analysis unit that analyzes the subject in the first image and the imaging unit, the analysis result of the subject by the analysis unit and the main information specified by the distance information acquisition unit An estimation unit that estimates a state of the main subject in the second image based on distance information to the subject.

  The estimation unit may be any of a position moved in a horizontal direction from the position where the first image was acquired, or a position moved a predetermined angle from the position where the first image was acquired with the main subject as the center. The state of the main subject of the second image acquired at one of the positions is estimated.

  Further, the display control unit includes a display that suggests a movement from a position at which the first image is acquired to a position at which the second image is acquired, and a position at which the optical axis of the imaging unit acquires the second image. The display suggests the rotation of the optical axis of the imaging unit until it coincides with a straight line connecting the position with the main subject.

  Moreover, it is preferable that the display of the state of the main subject based on the result estimated by the estimation unit is a display of an auxiliary frame including at least a partial region of the main subject in the second image.

  Moreover, it is preferable that the display unit can display a subject frame including at least a partial region of the main subject in the first image based on the analysis result of the subject by the analysis unit.

  In addition, it is preferable that a designating unit for designating an imaging magnification is provided, and the auxiliary frame is enlarged or reduced according to the imaging magnification designated by the designating unit when the second image is acquired.

  The analysis unit analyzes the state of the subject in the second image, and based on the analysis result of the subject in the first image and the analysis result of the subject in the second image, the first image And a determination unit for determining whether or not the subject can be stereoscopically viewed using the second image.

  Further, when the determination unit determines that stereoscopic viewing of the subject is impossible, the stereoscopic viewing of the subject using the first image and the corrected second image is enabled. And a correction unit that corrects the second image.

  In addition, a recording unit that records the first image, the second image, and the auxiliary frame in one file is provided.

  According to the imaging apparatus of the present invention, it is possible to easily obtain an image capable of stereoscopic viewing of a subject without any special configuration.

It is a block diagram which shows the structure of the imaging device 10 in embodiment of this invention. 6 is a diagram illustrating an example in which a left-eye image and a subject frame F are displayed in a superimposed manner. FIG. FIG. 4 is a diagram illustrating a positional relationship between both eyes of a user who performs shooting and a subject. It is a figure which shows an example which superimposed and displayed the image for left eyes, and the assist frame A. FIG. It is a flowchart which shows the operation | movement at the time of imaging | photography. 4 is a diagram illustrating a state in which a subject S of a through image is accommodated in an assist frame A. FIG. (A) It is a figure which shows moving the imaging device 10 to a horizontal direction. (B) It is a figure which shows rotating the imaging device 10 to a pan direction.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus 10 according to the present embodiment. The imaging device 10 has a three-dimensional shooting mode as one of the shooting modes. The three-dimensional shooting mode is a shooting mode for acquiring a pair of images that are sources of a stereoscopic image such as a left-eye image and a right-eye image. In this three-dimensional imaging mode, for example, after acquiring a left-eye image, the user moves the imaging device 10 to acquire a right-eye image. This right-eye image differs from the previously acquired left-eye image in so-called composition such as the direction of the subject and the background. Therefore, in this three-dimensional imaging mode, before acquiring the right-eye image, the user can recognize a preferable state (the direction and size of the object) of the subject included in the right-eye image to be acquired from now on. Assist display. Details of the assist display will be described later.

  As shown in FIG. 1, the imaging device 10 includes an imaging lens 11, an imaging device 12, an A / D conversion unit 13, a buffer memory 14, an image processing unit 15, a display unit 16, a distance measuring sensor 17, an acceleration sensor 18, and a memory. 19, an operation unit 20, a recording I / F unit 21, a recording medium 22, a control unit 23, and a bus 24.

  The imaging lens 11 forms a subject image on the imaging surface of the imaging element 12. The imaging element 12 photoelectrically converts the subject light that has passed through the imaging lens 11 and outputs analog image signals corresponding to R, G, and B colors. In the photographing mode, the image sensor 12 performs thinning readout at predetermined intervals to obtain a through image. Thereafter, the image pickup device 12 acquires a main image when a release button 25 described later is fully pressed. An image signal output from the image sensor 12 is input to the A / D converter 13. The A / D converter 13 converts the analog image signal output from the image sensor 12 into a digital image signal. The digital image signals are collected into one frame and recorded in the buffer memory 14 as image data. The buffer memory 14 temporarily records image data in the pre-process and post-process of image processing by the image processing unit 15 described later.

  The image processing unit 15 performs image processing on the image data recorded in the buffer memory 14. Examples of the image processing include well-known resolution conversion processing, WB (white balance) adjustment, brightness adjustment, color interpolation, gradation conversion processing, and contour enhancement processing. The image processing unit 15 also executes processing for compressing in JPEG (Joint Photographic Experts Group) format and the like, and processing for decompressing and restoring the compressed data.

  The display unit 16 displays various images. Various images displayed on the display unit 16 are a through image, a main image, a menu image, an image recorded on a recording medium 22 described later, and the like. The distance measuring sensor 17 is activated when the release button 25 is half-pressed, and detects the distance to the subject S. The acceleration sensor 18 is constituted by, for example, a gyro sensor, and detects a moving distance and a rotation angle of the imaging device 10.

  The operation unit 20 includes a release button 25, a cross key 26, and the like. The operation unit 20 includes a release button 25, a cross key 26, and the like. When the release button 25 is half-pressed, AE calculation, AF calculation, and WB adjustment are executed. Further, the release button 25 performs processing related to imaging when the release button 25 is fully pressed. The cross key 26 is operated when a menu image is displayed. The states of the release button 25 and the cross key 26 are detected by the control unit 23, and a sequence based on the detected button and key states is executed. The recording I / F unit 21 writes / reads data to / from the recording medium 22 when the recording medium 22 is connected.

  The control unit 23 performs overall control of the imaging apparatus 10 according to a predetermined sequence program, and executes various calculations (AF, AE, etc.) necessary for shooting. The control unit 23 has functions such as an analysis unit 27 and an estimation unit 28. Hereinafter, a case where the functions of the analysis unit 27 and the estimation unit 28 are effective in the three-dimensional imaging mode will be described.

  When the left eye image is acquired, the analyzing unit 27 analyzes the subject S included in the left eye image. As a method for analyzing the subject S, well-known pattern matching and feature amount extraction are used.

  The estimation unit 28 estimates the state of the subject S at the time of acquiring the right-eye image based on the analysis result analyzed by the analysis unit 27. The estimation of the subject S includes generation of the subject frame F and the assist frame A. First, the subject frame F will be described. The estimation unit 28 uses the focus point position used at the time of AF calculation when acquiring the image for the left eye, the subject S analyzed by the analysis unit 27 and the distance from the subject S (hereinafter, subject distance M), A three-dimensional subject frame F indicating the state (direction, size) of the subject S included in the left-eye image is generated. The subject frame F is a frame such as a rectangular parallelepiped or a cube. As is well known, since the image is obtained by projecting a three-dimensional subject image onto an imaging surface orthogonal to the photographing optical axis, the subject frame F displayed on the display unit 16 is a three-dimensional image. The frame is displayed in a state of being projected on the imaging surface (see FIG. 2).

  FIG. 3 shows a positional relationship between both eyes of the user who performs shooting and the subject S. As a condition for a person to feel a stereoscopic effect when observing the subject, for example, parallax, in other words, a straight line connecting the subject S and the left eye L and a straight line connecting the subject S and the right eye R are included. The angle θ formed is 4 degrees. In addition, when the above-described angle is less than 4 degrees, the distance to the subject (subject distance M) is long, so that there is no parallax and it is difficult to feel a stereoscopic effect on the subject.

  Accordingly, the estimation unit 28 assists in determining the composition of the right-eye image so that the subject S is stereoscopically displayed when the stereoscopic image is displayed using the left-eye image and the right-eye image. Frame A is generated. The assist frame A can be generated by rotating the subject frame F by a predetermined angle θ about the vertical direction. This angle θ is determined by the following procedure.

  First, the estimation unit 28 determines whether or not the subject distance M is less than or equal to a threshold value. As this threshold value, for example, when a human observes the subject S, the subject distance M when the subject S feels a three-dimensional feeling can be cited. For example, when the subject distance M is less than or equal to the threshold, the estimation unit 28 calculates the angle θ using the distance D between the human left eye L and the right eye R and the subject distance M. Generally, the distance D between the human left eye L and right eye R is 6 to 7 cm. On the other hand, when the subject distance M exceeds the threshold value, when the subject S is observed, the subject S does not feel a three-dimensional effect. A certain 4 degrees is defined as the angle θ.

  After determining this angle θ, the estimation unit 28 generates an assist frame A obtained by rotating the generated subject frame F by 4 degrees. When rotating the subject frame F, for example, the subject frame F may be rotated about a straight line passing through the center of the upper surface of the subject frame F and extending in the vertical direction. FIG. 4 shows an example in which the left-eye image and the assist frame A are superimposed and displayed.

  The bus 24 connects the buffer memory 14, the image processing unit 15, the display unit 16, the distance measuring sensor 17, the acceleration sensor 18, the recording I / F unit 21, and the control unit 23, thereby inputting and outputting data and signals. Execute.

  Next, the operation at the time of photographing will be described based on the flowchart of FIG. The flowchart in FIG. 5 will be described on the assumption that the three-dimensional imaging mode is set. In the following description, an example is given of a scene in which the imaging device 10 captures a single subject S in a state where the imaging device 10 is held sideways.

  Step S101 is processing for determining whether or not the release button 25 is half-pressed. When it is determined that the release button 25 has been half-pressed (when the determination in step S101 is YES), the control unit 23 proceeds to step S102. On the other hand, when it is determined that the release button 25 is not half-pressed (when the determination in step S101 is NO), the control unit 23 waits until the release button 25 is half-pressed.

  Step S102 is processing for detecting AE, AF calculation, WB adjustment, and subject distance M. The control unit 23 performs AE, AF calculation, and WB adjustment. The distance measuring sensor 17 detects a subject distance M from the imaging apparatus 10 to the subject S.

  Step S103 is a process for determining whether or not the release button 25 has been fully pressed. When it is determined that the release button 25 has been fully pressed (when the determination in step S103 is YES), the control unit 23 proceeds to step S104. On the other hand, when it is determined that the release button 25 is not fully pressed (when the determination in step S103 is NO), the control unit 23 waits until the release button 25 is fully pressed.

  Step S104 is processing for acquiring a left-eye image. The image sensor 12 acquires an image for the left eye. Thereafter, the image sensor 12 acquires a through image.

  Step S105 is processing for analyzing the subject S. The analysis unit 27 analyzes the subject S of the left-eye image.

  Step S106 is processing to generate a subject frame F. The estimation unit 28 uses the focus point position used in the AF calculation in step S102, the subject S and the subject distance M analyzed by the analysis unit 27, and the subject indicating the state of the subject S included in the left-eye image. A frame F is generated.

  Step S107 is a process for generating the assist frame A. First, the estimation unit 28 determines whether or not the subject distance M detected in step S102 is equal to or smaller than a threshold value, and determines an angle θ for rotating the subject frame F based on the determination result. For example, when it is determined that the subject distance M is equal to or less than the threshold, the estimation unit 28 calculates the angle θ using the subject distance M and the distance D between the left eye and the right eye. On the other hand, when it is determined that the subject distance M exceeds the threshold, the estimation unit 28 determines the angle θ described above to be 4 degrees. Finally, the estimating unit 28 rotates the previously generated subject frame F by the angle θ calculated in a predetermined direction. The estimation unit 28 generates the assist frame A by rotating the subject frame F by an angle θ.

  Step S108 is a process for displaying the assist frame A and the through image in a superimposed manner. The display unit 16 superimposes and displays the assist frame A and the through image. Thereby, an assist display is performed. For example, the user horizontally moves the imaging device 10 in the right direction. Next, the user performs imaging so that the optical axis of the imaging lens 11 immediately after moving the imaging device 10 in the horizontal direction matches a straight line connecting the position of the subject S and the position for acquiring the right-eye image. The apparatus 10 is rotated (hereinafter, rotated in the pan direction). Thereby, as shown in FIG. 6, the subject S of the through image is in a state of being accommodated in the assist frame A.

  Steps S109 to S111 are the same processes as steps S101 to S103. In step S110, the control unit 23 performs AE calculation and WB adjustment so that the brightness and color of the right-eye image are the same as those of the left-eye image.

  Step S112 is processing for acquiring a right-eye image. The image sensor 12 acquires a right-eye image.

  Step S113 is processing for determining whether or not stereoscopic viewing of the subject S is impossible using the left-eye image and the right-eye image. First, the analysis unit 27 analyzes the subject S from the right-eye image and detects the size, position, orientation, and the like of the subject S. Next, the control unit 23 compares the size, position, orientation, and the like of the subject S between the left-eye image and the right-eye image, and uses the left-eye image and the right-eye image. It is determined whether or not stereoscopic viewing is impossible. If the control unit 23 determines that stereoscopic viewing of the subject S is not possible (when the determination in step S113 is YES), the control unit 23 proceeds to step S114. On the other hand, when the control unit 23 determines that stereoscopic viewing of the subject S is possible (when the determination in step S113 is NO), the control unit 23 proceeds to step S115.

  Step S114 is a process for correcting. The image processing unit 15 corrects the right-eye image using the left-eye image and the corrected right-eye image so that the subject S can be stereoscopically viewed. For example, the image processing unit 15 compares the subject distance M, the size of the eye or face of the subject S between the left eye image and the right eye image, the height of the subject S, and the like, thereby comparing the left eye image. It is determined whether or not the size of the subject S matches the right-eye image. When the size of the subject S is different between the left eye image and the right eye image, the image processing unit 15 determines that the subject S of the right eye image matches the size of the subject S of the left eye image. The included area is enlarged or the right-eye image is reduced.

  Further, when the position of the subject S in the left-eye image and the right-eye image does not match, the image processing unit 15 adjusts the horizontal position of the right-eye image so as to match the position of the subject S in the left-eye image. And the vertical position are corrected, or the inclination is corrected. Further, the image processing unit 15 detects the orientation of the subject S from the positions, relative distances, and the like of the subject's eyes, nose, and mouth when the orientation of the subject S does not match the left-eye image and the right-eye image. Then, the detected direction of the subject S is corrected so as to be a predetermined direction. Further, if the brightness and hue of the left-eye image and the right-eye image do not match, the image processing unit 15 performs luminance correction and hue on the right-eye image so as to match the brightness and hue of the left-eye image. Make corrections.

  Step S115 is a recording process. When the image correction in step S114 is performed, the control unit 23 uses the same image for the left eye acquired in step S104, the assist frame A generated in step S106, and the image for the right eye corrected in step S114. Record to file. On the other hand, when the image correction of step S114 is not performed, the control unit 23 matches the left-eye image acquired in step S104, the assist frame A generated in step S106, and the right-eye image acquired in step S112. To the file. Note that the control unit 23 may record this file in a file format conforming to the multi-picture format standard.

  As described above, the imaging device 10 according to the present embodiment generates the assist frame A based on the previously acquired image for the left eye, and displays the generated assist frame A in a superimposed manner on the through image. Therefore, when the right-eye image is acquired, it is possible to perform assist display that is intuitive and easy for the user to understand. Therefore, according to the imaging device 10 of the present embodiment, it is possible to easily obtain an image that allows the subject S to be stereoscopically viewed without any special configuration.

  Moreover, since the imaging device 10 records the image for the left eye, the image for the right eye, and the assist frame A in the same file, the file is easy to handle for the user.

  In the above-described embodiment, the subject frame F and the assist frame A have been described as being composed of frames such as a rectangular parallelepiped or a cube, but the present invention is not limited thereto. For example, the assist frame A may be an auxiliary display of the subject S of the right eye image.

  The method for stereoscopically viewing the subject S using the left-eye image and the right-eye image is not limited. For example, the user may stereoscopically view the subject S by the parallel method or the intersection method using the left-eye image and the right-eye image. Further, the display unit 16 may be provided with a liquid crystal shutter, and the left eye image and the right eye image may be alternately displayed corresponding to the liquid crystal shutter. Further, the image processing unit 15 may generate a stereoscopic television image in which left-eye images and right-eye images are alternately arranged in a vertical stripe pattern.

  In the above embodiment, an example in which the assist frame A including the entire subject S is generated has been described. However, the present invention is not limited to this. For example, the assist frame A including only a part of the subject S such as a face may be generated.

  In the above-described embodiment, a scene where one subject S is photographed has been described as an example. However, a scene where a plurality of subjects S are photographed can also be handled. In this case, after step S105, the control unit 23 displays the image for the left eye acquired in step S104 on the display unit 16, and accepts selection of the reference subject S from the user via the cross key 26. That's fine.

  In the above embodiment, an example in which only the assist frame A is superimposed and displayed on the through image is shown, but the present invention is not limited to this. For example, the analysis unit 27 analyzes the subject S every time a through image is acquired based on the moving distance and the rotation angle of the imaging device 10 detected by the acceleration sensor 18. Similarly, the estimation unit 28 generates a subject frame F at any time based on the subject S analyzed by the analysis unit 27 every time a through image is acquired. Then, the display unit 16 superimposes and displays the subject frame F, the assist frame A, and the through image. Thereby, the user can recognize the subject frame F at any time.

  In addition, when the subject frame F displayed on the through image matches the assist frame A, the control unit 23 may notify the user of the match by changing the color of the subject frame F or the like. Further, the control unit 23 may control the image sensor 12 to automatically acquire the right eye image when the subject frame F displayed on the through image matches the assist frame A.

  Further, as an assist of the assist frame A, as shown in FIG. 7A, an arrow 30 indicating that the imaging apparatus 10 is moved in the horizontal direction and a message 31 “moving horizontally in the right direction” may be displayed. . Further, as shown in FIG. 7B, an arrow 32 indicating that the imaging device 10 is rotated leftward, FIG. 33 when the imaging device 10 is viewed from above, and a message “Rotate in panning” 34 are displayed. May be. Further, the estimation unit 28 may calculate the movement distance in the horizontal direction and the rotation angle in the pan direction of the imaging device 10 when acquiring the right-eye image, and may display them on the display unit 16. Furthermore, the imaging device 10 may be provided with a generating unit that generates sound, and the message 31 and the message 34 may be generated by sound. With these displays and voices, it is possible to perform an assist display that is easier to understand for the user.

  Instead of displaying the assist frame A, only the arrow 30 or the arrow 32, or only the message 31 or the message 34 may be displayed, or both the arrow and the message may be displayed.

  It is also possible to use all or part of the left-eye image acquired earlier as an auxiliary image. Here, when at least a part of the image for the left eye is used as the auxiliary image, the image for the left eye is slightly shifted to form the auxiliary image.

  Further, GPS information may be used. For example, the imaging apparatus 10 is provided with a GPS receiver, and GPS information from a GPS satellite is acquired by the GPS receiver. Based on the GPS information and the assist frame A, the control unit 23 calculates the acquisition position of the right eye image that enables stereoscopic viewing of the subject S using the left eye image and the right eye image. Thereafter, when the imaging device 10 moves to the position, the control unit 23 notifies the user that the position for acquiring the right-eye image has been reached by an alarm or the like. Thereby, even when the subject distance M between the imaging device 10 and the subject S is large, the right-eye image can be acquired at an appropriate position.

  In the above-described embodiment, an example in which it is determined whether stereoscopic vision of the subject S is impossible using the left-eye image and the right-eye image is not limited thereto. For example, it may be determined whether or not stereoscopic viewing of the subject S is impossible using the left-eye image and the through image before acquiring the right-eye image. In this case, when the size of the subject S of the left-eye image and the through image is different, the control unit 23 uses the optical zoom or the electronic zoom to match the size of the subject S of the left-eye image. Zoom in or zoom out the image. In addition, when the position or orientation of the subject S in the left-eye image and the through-image does not match, the control unit 23 displays a message indicating that there is no position or orientation. This increases the possibility that the subject S can be stereoscopically viewed using the left-eye image and the right-eye image. Note that when the through image is enlarged or reduced by the electronic zoom, the image processing unit 15 similarly enlarges or reduces the right-eye image.

  In the above-described embodiment, an example in which the right-eye image is corrected when it is determined in step S113 that stereoscopic viewing of the subject S is impossible has been described, but the present invention is not limited thereto. For example, when it is determined that stereoscopic viewing of the subject S is impossible, the control unit 23 may display a warning and prompt the user to acquire the right eye image again. Furthermore, the control unit 23 displays a warning and determines the right-eye image when it determines that correction is impossible because the deviation of the size, position, orientation, and the like of the subject S between the left-eye image and the right-eye image is large. You may be prompted to get it again.

  In the above-described embodiment, an example is shown in which the image for the right eye is acquired after the image for the left eye is acquired first, but the image for the left eye is acquired after the image for the right eye is acquired first. You may get it.

  In addition, as the interval between the position where the image for the left eye is acquired and the position where the image for the right eye is acquired becomes wider, the stereoscopic effect can be more emphasized. Therefore, the user can set the degree of stereoscopic effect such as weak, medium and strong, and the interval between the position where the left eye image is acquired and the position where the right eye image is acquired is set according to the degree set by the user. It may be changed.

  Further, in the above-described embodiment, an example in which the imaging magnification when acquiring the left-eye image and the right-eye image is the same is shown, but the present invention is not limited to this. For example, when the imaging magnification is changed after the left-eye image is acquired, the estimation unit 28 enlarges or reduces the assist frame A according to the changed imaging magnification.

  In the above-described embodiment, the state in which the orientation of the imaging device 10 is held sideways has been described as an example. However, the state in which the image pickup apparatus 10 is held vertically can also be handled. Furthermore, the estimation unit 28 generates an assist frame A for portrait orientation when the acceleration sensor 18 detects that the orientation of the imaging device 10 has been changed from landscape orientation to portrait orientation after acquiring the left-eye image. To do.

  In the above embodiment, the imaging apparatus 10 has been described as an example, but the present invention is not limited to this. For example, the present invention can be similarly applied to a portable terminal device such as a mobile phone having an imaging function.

DESCRIPTION OF SYMBOLS 10 ... Imaging device, 12 ... Image sensor, 15 ... Image processing part, 16 ... Display part, 17 ... Distance sensor, 18 ... Acceleration sensor, 23 ... Control part, 27 ... Analysis part, 28 ... Estimation part

Claims (10)

An imaging unit for acquiring a first image;
A specifying unit for specifying a main subject from the first image acquired by the imaging unit;
A distance information acquisition unit that acquires distance information to the main subject specified by the specification unit;
When the second image having parallax with respect to the first image is acquired by the imaging unit, an auxiliary image to be auxiliary displayed on the display unit based on the distance information acquired by the distance information acquisition unit A display control unit to display;
An imaging apparatus comprising: The imaging device according to claim 1,
An analysis unit for analyzing a subject in the first image;
When acquiring the second image by the imaging unit, based on the analysis result of the subject by the analysis unit and the distance information to the main subject specified by the distance information acquisition unit, the second image in the second image An imaging apparatus comprising: an estimation unit that estimates a state of a main subject. The imaging device according to claim 2,
The estimation unit is either one of a position moved in a horizontal direction from the position where the first image was acquired, or a position moved a predetermined angle from the position where the first image was acquired around the main subject. An imaging apparatus, wherein the state of the main subject of the second image acquired at the position of is estimated. In the imaging device according to any one of claims 1 to 3,
The display control unit includes a display suggesting a movement from a position where the first image is acquired to a position where the second image is acquired, a position where the optical axis of the imaging unit acquires the second image, and the main An image pickup apparatus that performs display suggesting rotation of an optical axis of the image pickup unit until it coincides with a straight line connecting a position with a subject. In the imaging device according to any one of claims 1 to 4,
The display of the state of the main subject based on the result estimated by the estimation unit is a display of an auxiliary frame including at least a partial region of the main subject in the second image. The imaging apparatus according to claim 5,
The display unit is capable of displaying a subject frame including at least a partial region of the main subject in the first image based on an analysis result of the subject by the analysis unit. apparatus. In the imaging device according to claim 5 or 6,
It has a specification part that specifies the imaging magnification,
The imaging apparatus according to claim 1, wherein the auxiliary frame is enlarged or reduced according to the imaging magnification designated by the designation unit when the second image is acquired. In the imaging device according to any one of claims 1 to 7,
The analysis unit analyzes the state of the subject in the second image;
Whether the subject can be stereoscopically viewed using the first image and the second image based on the analysis result of the subject in the first image and the analysis result of the subject in the second image. An imaging apparatus, further comprising a determination unit that determines whether or not. The imaging device according to claim 8,
When the determination unit determines that stereoscopic viewing of the subject is impossible, the stereoscopic viewing of the subject using the first image and the corrected second image is possible. An imaging apparatus comprising: a correction unit that corrects two images. The imaging apparatus according to any one of claims 5 to 7,
An imaging apparatus comprising: a recording unit that records the first image, the second image, and the auxiliary frame in one file.

Images