JP5464816B2 - Imaging apparatus and control method thereof - Google Patents

Description

  The present invention relates to an imaging apparatus such as a digital camera, and more particularly to an imaging apparatus that performs display for assisting manual focus.

  The focus function of an imaging apparatus (hereinafter also referred to as a camera) includes auto focus and manual focus, and a focus function used by a photographer can be selected.

  In manual focus, the photographer himself checks whether or not the subject is in focus, but there are cases where it is difficult to focus accurately only by visual observation. For this reason, Patent Documents 1 and 2 disclose cameras that display a so-called split image so that the focus state can be easily confirmed in order to assist focusing.

Further, in the cameras disclosed in Patent Documents 3 and 4, an area desired to be focused in the imaging screen is enlarged and displayed on a liquid crystal display, thereby facilitating manual focusing.
JP 59-50671 A JP 2001-309210 A JP-A-4-354274 JP 11-55560 A

  When displaying a split image, the focus state can be accurately confirmed by confirming the amount of shift between the upper and lower images of the split image. However, since the range displayed as a split image is narrow, it is difficult to grasp the focus state for subjects other than the main subject being focused.

  In addition, when the area to be focused is enlarged and displayed, a wider range of focus states can be confirmed than when a split image is displayed. That is, it is easy to check not only the main subject but also the focus state for other subjects. However, it is difficult to focus accurately compared to the split image.

  The present invention provides an imaging apparatus with high convenience and operability during manual focus.

An imaging apparatus according to one aspect of the present invention includes an image generation unit that generates image data based on a signal obtained by photoelectrically converting an optical image formed by a light beam incident on an imaging optical system from a subject using a sensor; A phase difference between the two optical images based on a signal obtained by photoelectrically converting two optical images formed by the two light beams split among the light beams incident on the imaging optical system from a subject. Split image generation means for generating a split image corresponding to the above, a partial image generation means for generating a partial image corresponding to a part of the image data, a display means for displaying an image, and during manual focus, The display means includes a focus assisting means capable of switching and displaying the split image and the partial image .

According to another aspect of the present invention, there is provided a method for controlling an image pickup apparatus, wherein image data is obtained based on a signal obtained by photoelectrically converting an optical image formed by a light beam incident on an image pickup optical system from a subject. Generating the two optical images formed by the two light beams split from the light beams incident on the imaging optical system from the subject, based on the signals obtained by photoelectric conversion by the sensor, Generating a split image corresponding to the phase difference of the optical image, generating a partial image corresponding to a part of the image data, and displaying the split image on the display means during manual focusing. And a step of switching and displaying the partial image .

  According to the present invention, it is possible to realize an imaging apparatus with high convenience and operability during manual focus.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows the configuration of an imaging apparatus 101 such as a digital camera that is Embodiment 1 of the present invention. The image pickup apparatus 101 according to the present exemplary embodiment is configured to display a split image and a region including a region to be focused and a peripheral region thereof in the image pickup screen according to an operation by an operator (photographer) during manual focus. Switch between enlarged display.

  In FIG. 1, reference numeral 1 denotes an imaging lens (imaging optical system) that forms an optical image of a subject (first optical image: hereinafter also referred to as a subject image) with a light beam incident from the subject, and includes a focus lens 1a. . The focus lens 1 a is driven in the optical axis direction by the focus lens driving unit 2. A manual focus ring (manual focus operation member) 30 is provided on the outer periphery of the lens barrel of the imaging lens 1 so as to be rotatable. The rotation of the manual focus ring 30 moves the focus lens 1a in the optical axis direction via a transmission mechanism (not shown).

  Reference numeral 3 denotes an aperture, which is driven by an aperture controller 4.

  5 is a half mirror. The luminous flux from the subject that has passed through the imaging lens 1 passes through the half mirror 5 and reaches the first imaging element 6. The first image sensor 6 is composed of a CCD sensor or a CMOS sensor, and is driven by the first image sensor drive unit 7 to photoelectrically convert the subject image formed by the image pickup lens 1. The first image sensor 6 outputs a color image signal corresponding to the subject image.

  On the other hand, a part of the light beam from the subject reflected by the half mirror 5 reaches the second imaging element 9 via the pupil division optical member 8 configured to divide the imaging lens 1 into pupils. The second image sensor 9 is also composed of a CCD sensor or a CMOS sensor. The second image sensor 9 is driven by the second image sensor drive unit 7 to photoelectrically convert a part of the subject image formed by the imaging lens 1. The second image sensor 9 outputs a monochrome image signal corresponding to a part of the subject image. The first and second imaging elements 6 and 9 are disposed at positions optically conjugate with the imaging lens 1.

  The first analog signal processing unit 11 performs predetermined analog signal processing such as gamma processing on the color imaging signal output from the first imaging element 6 to generate an analog image signal. The first A / D converter 12 converts the image signal for imaging into a digital image signal. The first digital signal processing unit 13 performs digital signal processing such as noise removal and edge enhancement on the digital image signal to generate a digital image signal for recording and display (hereinafter referred to as main image data). The first image sensor 6, the first A / D converter 12, and the first digital signal processor 13 correspond to an image generating unit.

  The second analog signal processing unit 26 performs predetermined analog signal processing such as gamma processing on the monochrome imaging signal output from the second imaging device 9 to generate an analog image signal. The second A / D converter 27 converts the analog image signal into a digital image signal. The second digital signal processing unit 28 performs digital processing such as noise removal and edge enhancement on the digital image signal to generate a digital image signal for a monochromatic split image (hereinafter referred to as a split image). The second image sensor 9, the second A / D converter 27, and the second digital signal processor 28 correspond to a split image generating unit.

  The microcomputer (focus assist means) 14 controls the entire imaging apparatus 101. The buffer memory 15 is built in the imaging device 101 and temporarily stores image data. The recording medium 16 is configured by a detachable card type semiconductor memory or an optical disk. The recording medium 16 stores image data, setting information regarding the imaging device 101 at the time of imaging, setting information regarding a print image, and the like.

  The recording control unit 17 records image data, setting information regarding the imaging apparatus 101 at the time of imaging, and the like in the buffer memory 15 or the recording medium 16. Further, the recording control unit 17 reads out and outputs the image data recorded in the buffer memory 15 or the recording medium 16 in accordance with an instruction from the microcomputer 14.

  The storage unit 18 is composed of a ROM and a RAM, and stores programs, constants, variables, and the like for operating the microcomputer 14.

  The display unit (display unit) 19 is configured by a liquid crystal display or the like. The display control unit 20 controls the display unit 19 to display image data, a split image, an enlarged image, a menu screen, and the like.

  The image enlarging unit 21 reads the main image data generated based on the image pickup signal from the first image sensor 6 from the buffer memory 15 and enlarges a partial area of the main image data at a predetermined enlargement ratio to enlarge an image. (Partial image) data is generated. The image enlargement unit 21 is an example of a partial image generation unit that generates a partial image corresponding to a part of the main image data.

  In addition, the image composition unit 22 performs a process of compositing the main image data so that the enlarged image data and the split image described above are superimposed. The synthesized image is output to the display control unit 19 and displayed on the display unit 19.

  The operation unit 24 includes an operation unit (operation unit) including a power button, a shutter button, a menu button, up / down / left / right buttons, a selection button, and the like. The operation control unit 23 receives a signal from the operation unit 24 and outputs a command signal corresponding to the operation of the operation unit 24 to the microcomputer 14.

  The AF control unit 25 uses the image signal in the selected AF area among a plurality of AF areas (focus detection areas) set in the imaging screen during autofocus, and focuses on the subject included in the AF area. The in-focus position of the lens 1a is obtained. Then, the focus lens driving unit 2 is controlled so as to move the focus lens 1a to the in-focus position, and an in-focus state is obtained.

  The focus detection unit 29 uses the digital image signal from the second A / D conversion unit 26 to obtain the defocus amount. When the defocus amount falls within a predetermined range including 0, the in-focus state is detected.

  Next, enlarged display will be described among the focus auxiliary displays at the time of manual focus in the present embodiment.

  The microcomputer 14 reads the main image data obtained by using the first image sensor 6 from the buffer memory 15 and outputs it to the image composition unit 22. Further, the microcomputer 14 extracts image data of a partial area to be enlarged and displayed from the main image data and outputs the extracted image data to the image enlargement unit 21. The image enlarging unit 21 enlarges the image data of the partial area at a predetermined enlargement ratio to generate enlarged image data. The enlarged image data is output to the image composition unit 22.

  The image composition unit 22 outputs an image obtained by combining (superimposing) the main image data and the enlarged image data to the display control unit 20. Thereby, as shown in FIG. 2, the enlarged image LI can be displayed on the display unit 19 so as to be superimposed on the main image data MI.

  Next, split image display among the focus auxiliary displays during manual focus in the present embodiment will be described.

  As described above, in the split image, two object partial images (second optical images) formed by dividing the light flux from the imaging lens 1 by the pupil division optical member 8 are photoelectrically generated by the second imaging element 9. It is generated based on the imaging signal obtained by the conversion. The “two subject partial images” referred to here are two optical images formed by a light flux from a part of the subject captured by the first image sensor 6.

  The split image is composed of upper and lower divided images having a lateral shift amount corresponding to a phase difference (that is, a defocus amount) corresponding to the focus state (focus state) of the imaging lens 1. The upper and lower divided images are displayed without being shifted from each other in the focused state. On the other hand, in the state of the front pin and the rear pin, the images are displayed shifted in opposite directions depending on the defocus direction.

  The split image is combined (superposed) with the main image data read from the buffer memory 15 by the image combining unit 22. The image composition unit 22 outputs this composite image to the display control unit 20. As a result, the split image SI as shown in FIGS. 3 and 4 can be displayed on the display unit 19 so as to overlap the main image data MI.

  In FIG. 3, the upper and lower divided images of the split image SI are shifted in the horizontal direction. That is, the outline of the subject portion included in the upper and lower divided images is shifted in the horizontal direction. This indicates an out-of-focus state.

  Further, in FIG. 4, there is no deviation between the upper and lower divided images of the split image SI. In other words, the contour lines of the subject portions included in the upper and lower divided images match in the horizontal direction. This indicates that the in-focus state.

  Next, the operation (control method) at the time of manual focus in the image pickup apparatus 101 of the present embodiment will be described with reference to FIG. This operation is executed by the microcomputer 14 in accordance with a computer program (image processing program) stored in the storage unit 18.

  First, in step 501, the microcomputer 14 sets (selects) an imaging mode corresponding to the operation of the mode dial of the operation unit 24. Next, in step 502, the microcomputer 14 displays a menu screen on the display unit 19 according to the operation of the menu button of the operation unit 24, and sets the focus mode to the manual focus mode according to the operation of the selection button.

  Next, in step 503, the microcomputer 14 displays a live view image on the display unit 19. In the live view image, an image signal (frame image) generated at a predetermined cycle based on an imaging signal from the first imaging element 6 is sequentially output to the display unit 19 via the buffer memory 15 and the display control unit 20. Is displayed as a moving image.

  Next, in step 504, the microcomputer 14 performs a process for selecting a focus assist display (focus assist mode). Detailed operation in this step is shown in FIG.

  In FIG. 6, first, in step 601, the microcomputer 14 detects a focus auxiliary display selection operation. When the menu button of the operation unit 24 is operated by the operator, the microcomputer 1414 causes the display unit 19 to display the menu screen for selecting the focus auxiliary display shown in FIG. Then, on this menu screen, the focus assist display (focus assist mode) selected by the operator using the up and down buttons and the select button of the operation unit 24 is detected.

  Here, one of the following four is selected: “no display” that does not perform focus auxiliary display, “split image”, “enlarged display”, and “split image & enlarged display” in which the split image is displayed together with the enlarged image. The

  Next, in step 602, the microcomputer 14 determines whether “no display” is selected in step 601. If “no display” is selected, the processing in step 504 is completed. If “no display” is not selected, the process proceeds to step 603.

  In step 603, the microcomputer 14 determines whether or not “split image” is selected in step 601. If it is determined that “split image” has been selected, the process proceeds to step 604 and the fact that “split image” has been selected is stored in the ROM of the storage unit 18 as setting information. If “split image” is not selected, the process proceeds to step 605.

  In step 605, the microcomputer 14 determines whether or not “enlarged display” is selected in step 601. If “enlarged display” is selected, the process proceeds to step 604 and the fact that “enlarged display” is selected is stored in the ROM of the storage unit 18 as setting information. If “enlarged display” is not selected, the process proceeds to step 607.

  In step 607, the microcomputer 14 stores, as setting information, in the ROM of the storage unit 18 that “split image & enlarged display” is selected as “split image & enlarged display” is selected, and in step 504. Terminate the process.

  As described above, in step 504 (603 to 607), the selection result of the focus auxiliary display is stored in the ROM of the storage unit 18, and when manual focus is performed after the selection is performed, the stored focus is stored. The selection result of the auxiliary display is automatically reflected. Even when the imaging apparatus 101 is turned off and then turned on again, the selection result in step 504 before the interruption is reflected. Thereby, only when the focus auxiliary display is changed, a new operation for selecting the focus auxiliary display may be performed.

  Next, in step 505 in FIG. 5, the microcomputer 14 performs AF area designation processing. Detailed operation in this step is shown in FIG.

  In FIG. 8, first, in step 801, the microcomputer 14 detects selection of an AF area designation method. Here, it is assumed that one of “area designation” and “position designation” can be selected. The microcomputer 14 displays the selection screen shown in FIG. 9 on the display unit 19 and detects which designation method is selected according to the operation of the up and down buttons and the selection button of the operation unit 24 by the operator.

  Next, in step 802, the microcomputer 14 determines whether or not “area designation” is selected in step 801. If “area specification” is selected, the process proceeds to step 803 to display the area selection screen shown in FIG. Next, proceeding to step 804, one predetermined area is selected from a plurality of predetermined areas (indicated by a dotted frame in the figure) in accordance with the operation of the up / down / left / right buttons and the selection button of the operation unit 24 by the operator. Determined as AF. Then, the determined AF area is stored in the storage unit 18 and the process of step 505 is ended. If “area designation” is not selected, the process proceeds to step 805.

  In step 805, the microcomputer 14 displays the position designation screen shown in FIG. In step 806, the cursor C is moved to a position corresponding to the operation of the up / down / left / right button of the operation unit 24 by the operator. Then, the area surrounded by the cursor C is determined as the AF area AF in accordance with the operation of the selection button, the determined AF area is stored in the storage unit 18, and the process of step 505 is ended. Thereafter, the process proceeds to step 506.

  In FIG. 5, in step 506, the microcomputer 14 performs focus auxiliary display position designation processing. The detailed operation at this step is shown in FIG.

  In FIG. 12, first, in step C01, the microcomputer 14 selects the focus auxiliary display to be displayed on the AF area designated in step 505. At this time, the display unit 19 displays “no display” which does not display any focus auxiliary display on the AF area, and the focus auxiliary display stored in the storage unit 18 in step 504 as a selection candidate.

  FIG. 13 shows the display screen at step C01 when “split image & enlarged display” is selected at step 504. In this case, “No display”, “Split image” and “Enlarged display” are displayed as selection candidates, and the split image and the enlarged display are superimposed on the AF area to display “Split image & enlarged overlap display”. "Is additionally displayed as a selection candidate.

  The microcomputer 14 detects which selection candidate is selected according to the operation of the up and down buttons and the selection button of the operation unit 24 by the operator.

  Next, in step C02, the microcomputer 14 determines whether “no display” is selected in step C01. If “no display” is selected, the process proceeds to step C05. If “no display” is not selected, the process proceeds to step C03.

  In step C03, the microcomputer 14 causes the focus assist display selected in step C01 to be displayed on the display unit 19 so as to overlap the AF area selected in step 505. The detailed operation at this step is shown in FIG. Here, it is assumed that the center area of the imaging screen is designated as the AF area in step 505.

  In FIG. 14, first, in step E01, the microcomputer 14 determines whether or not “split image” is selected in step C01. If “split image” is selected, the process proceeds to step E02, where the split image SI is displayed on the AF area selected in step 505 as shown in FIG. Then, the display position information of the split image is stored in the storage unit 18, and the process in step C03 is terminated. If “split image” is not selected, the process proceeds to step E03.

  In step E03, the microcomputer 14 determines whether or not “enlarged display” is selected in step C01. If “enlarged display” is selected, the process proceeds to step E04, and the enlarged image LI is displayed on the AF area selected in step 505 as shown in FIG. Then, the display position information of the enlarged image is stored in the storage unit 18, and the process of step C03 is ended. If “enlarged display” is not selected, the process proceeds to step E05.

  In step E05, the microcomputer 14 performs the split image enlargement process in preparation for displaying the split image superimposed on the enlarged image on the assumption that “split image & enlarged overlap display” is selected in step C01.

  Specifically, the digital image signal for the split image described above is input to the image enlargement unit 21, and the split image is used at an enlargement ratio corresponding to the enlargement ratio of the enlarged image (for example, the same enlargement ratio as that of the enlarged image). Enlarge the digital image signal. Thereby, an enlarged split image is generated.

  Next, in step E06, the microcomputer 14 inputs the split image and the enlarged image enlarged in step E05 to the image composition unit 22 for synthesis. Then, the synthesized image is displayed superimposed on the AF area selected in step 505. As a result, as shown in FIG. 15, the enlarged image LI and the enlarged split image SI are superimposed and displayed on the AF area in the main image data MI displayed on the display unit 19. Then, the microcomputer 14 stores the display position information of the enlarged image and the enlarged split image in the storage unit 18, and ends the process in step C03. Thereafter, the process proceeds to Step C04.

  Thus, by enlarging the split image and displaying it on the enlarged image, manual focusing while viewing the split image becomes easier. Furthermore, when the in-focus state is obtained by enlarging the split image at the same magnification as the magnification of the enlarged image, the contour of the subject portion in the split image matches the contour of the subject portion in the enlarged image. To do. Therefore, it is possible to clearly tell the operator that the camera is in focus.

  Next, in step C04, the microcomputer 14 determines whether or not there is a focus auxiliary display (position undecided auxiliary display) for which the display position has not been determined at the stage where the process of step C03 is completed. For example, if “split image & enlarged display” is selected in step 504, but “split image” or “no display” is selected in step C01, the display position of the enlarged image or the split image and the enlarged image are still displayed. Both display positions are not determined. As described above, when there is a position-undecided auxiliary display, the process proceeds to step C05. When there is no position-undetermined auxiliary display, the process of step 505 is terminated and the process proceeds to step 506.

  In step C05, the microcomputer 14 causes the operator to select how to determine the display position of the position-undetermined auxiliary display. Options include “automatic arrangement” that automatically designates the display position of the position-undecided auxiliary display and “manual arrangement” that allows the operator to designate the display position of the position-undecided auxiliary display.

  FIG. 16 shows a selection screen displayed on the display unit 19 when the display position of both the split image and the enlarged image is not determined in step C05.

  The operator operates the up / down button and the selection button of the operation unit 24 to select one of them and proceeds to Step C06. In step C06, it is determined whether or not “automatic placement” is selected in step C05. If it is selected, the process proceeds to step C07, and if it is not selected, the process proceeds to step C08.

  In step C07, the microcomputer 14 automatically arranges the position-undecided auxiliary display. The image composition unit 22 reads out the position information of the AF area designated at step 505 from the storage unit 18 and further stores the position information of the focus auxiliary display whose display position has already been determined at step E02 or step E04. Read from. Then, the position where the AF area and the display position do not overlap with the determined focus auxiliary display is determined as the display position of the position-undecided auxiliary display.

  For example, when “split image & enlarged display” is selected and the AF area AF is designated at the center of the imaging screen as shown in FIG. 17, it is designated not to display any focus auxiliary display on the AF area AF. When it is done, display is performed as shown in FIG. That is, the enlarged split image SI and the enlarged image LI are displayed so as to be superimposed on the right side (or left side) of the AF area AF so that they do not overlap the AF area AF.

  Further, for example, when “split image & enlarged display” is selected and the AF area AF is designated at the center of the imaging screen, when the split image is displayed on the AF area, the position-undecided auxiliary display is displayed. The enlarged image is displayed on the right side (or left side) of the AF area. In this way, the enlarged image is prevented from overlapping the AF area and the split image.

  Next, in step C08, the microcomputer 14 causes the operator to select a display position designation method on the assumption that “manual arrangement” has been selected in step C05. Here, as in the AF area designation method in step 801, selection is made from “area designation” and “position designation”. The display unit 19 displays a selection screen similar to that shown in FIG. Then, the microcomputer 14 detects which display position designation method is selected in accordance with the operation of the up / down button and the selection button of the operation unit 24 by the operator, and proceeds to Step C09.

  In step C09, the microcomputer 14 determines whether or not “designate area” is selected in step C08. If “area designation” is selected, the process proceeds to step C 10, and an area designation screen similar to FIG. 10 is displayed on the display unit 19. Next, proceeding to step C11, the microcomputer 14 determines an area for displaying the position-undecided auxiliary display according to the operation of the up / down / left / right button and the selection button of the operation unit 24 by the operator, and displays information on the display area The data is stored in the storage unit 18 and the process proceeds to Step C14.

  On the other hand, if “area designation” is not selected in step C09, the process proceeds to step C12.

  In step C12, the microcomputer 14 causes the display unit 19 to display a screen for allowing the operator to specify a position for displaying the position-undetermined auxiliary display. For example, when the display position of the split image is designated, the screen shown in FIG. 19 is displayed on the display unit 19.

  Next, proceeding to step C13, the microcomputer 14 moves the cursor according to the operation of the up / down / left / right buttons of the operation unit 24 by the operator, and changes the position of the cursor according to the operation of the selection button. The display position is determined. And the information of the determined display position is memorize | stored in the memory | storage part 18, and it progresses to step C14.

  In step C14, the microcomputer 14 determines whether or not the display position designation of all the focus auxiliary displays selected to be displayed in step 504 has been completed. If not completed yet, the process returns to step C05, and the display position designation of the position-undetermined auxiliary display is performed from step C05. When the display position designation of all the focus auxiliary displays is completed, the process of step 506 is terminated and the process proceeds to step 507.

  In FIG. 5, in step 507, the microcomputer 14 waits until the shutter button of the operation unit 24 is pressed after focusing by manual focus by the operator. The focus state indicated by the focus auxiliary display on the display unit 19 is changed by manual focus. The operator focuses on the subject included in the AF area while viewing the focus assist display.

  Next, in step 508, the microcomputer 14 performs an imaging process in response to the shutter button being pressed by the operator.

  In step 509, the microcomputer 14 records the main image data generated by the imaging process on the recording medium 16 through the recording control unit 17.

  As described above, in this embodiment, at the time of manual focus, the split image and the enlarged image can be switched and displayed on the display unit 19 according to the selection operation of the operator. For this reason, it is possible to select the focus auxiliary display which is easier for the operator to use among the split image and the enlarged image.

  In this embodiment, both the split image and the enlarged image can be displayed simultaneously. Thereby, at the time of manual focus, the advantages of the split image and the enlarged image can be used, and an imaging device that is easier to use can be realized. That is, it is possible to grasp the focus state with respect to a subject other than the main subject by checking the enlarged image of the main subject and the area in the vicinity thereof while enabling accurate focusing with the split image. If the focus state of the subject other than the main subject is not the state desired by the operator, the focus state is adjusted by operating the aperture 3 and then the manual focus is performed again. An image can be obtained.

  As described above, according to the present embodiment, it is possible to realize an imaging apparatus with high convenience and operability during manual focus.

  Next, Example 2 of the present invention will be described. The configuration of the image pickup apparatus in the present embodiment is the same as that shown in the first embodiment (FIG. 1). For this reason, in this embodiment, the same reference numerals as those in Embodiment 1 are used for the components of the imaging apparatus.

  Also in the imaging apparatus of the present embodiment, during manual focus, display of the split image, the enlarged image, and both is switched according to the operator's selection operation.

  The flowchart in FIG. 20 shows the operation (control method) at the time of manual focus in the image pickup apparatus in the present embodiment. This operation is executed by the microcomputer 14 in accordance with a computer program (image processing program) stored in the storage unit 18.

  Steps K01 to K05 in FIG. 20 are the same as steps 501 to 505 shown in FIG. That is, the microcomputer 14 sets the imaging mode in step K01, and sets the focus mode to the autofocus mode in step K02. Next, a live view image is displayed on the display unit 19 in step K03, and focus auxiliary display is selected in step K04. Further, an AF area is designated in step K05.

  Next, in step K06, the microcomputer 14 is focused by manual focus by the operator and waits for the shutter button of the operation unit 24 to be pressed.

  In step K07, the microcomputer 14 performs an imaging process in response to the shutter button being pressed by the operator.

  Next, in step K08, the microcomputer 14 records the main image data generated by the imaging process on the recording medium 16 through the recording control unit 17.

  FIG. 21 shows the detailed operation in step K06 when display of both the split image and the enlarged image is selected in step K04. Here, in step K05, the AF area is set as the upper right area of the imaging screen, and in step K04, display of both the split image and the enlarged image is selected, and further, these are automatically arranged so as not to overlap the AF area. Will be described.

  In step L01, as shown in FIG. 22, the microcomputer 14 displays the enlarged image LI so as not to overlap the AF area set at the upper right of the display unit 19. MI indicates main image data (hereinafter also referred to as main image).

  Next, in step L02, the microcomputer 14 determines whether or not it is in focus. The determination of whether or not it is in focus is made through the focus detection unit 26. If it is in focus, the process proceeds to step K07 via step K06. If not in focus, the process proceeds to step L03.

  In Step L03, the microcomputer 14 determines whether or not the defocus amount of the imaging lens 1 with respect to the main subject in the AF area is larger than a predetermined value stored in the storage unit 18. The defocus amount is obtained by the focus detection unit 26. When the defocus amount is larger than the predetermined value, the process proceeds to step L04, and when the defocus amount is smaller than the predetermined value, the process proceeds to step L05.

  In step L04, the microcomputer 14 erases the split image displayed on the display unit 19. As a result, only the enlarged image is displayed on the display unit 19 as the focus auxiliary display.

  In step L05, the microcomputer 14 causes the display unit 19 to display the split image. Accordingly, both the split image and the enlarged image are displayed on the display unit 19 as the focus auxiliary display.

  At this time, as shown in FIG. 23, the split image SI is enlarged at a predetermined enlargement ratio (preferably the same enlargement ratio as that of the enlarged image), and is displayed superimposed on the enlarged image LI.

  Next, in step L06, the microcomputer 14 waits while manual focus is performed by the operator. The operator focuses on the subject included in the AF area while looking at the focus assist display.

  Then, the process returns to step L02, and the processes of steps L03 to L05 are repeated until the in-focus state is confirmed by the focus detection unit 29.

  In this way, when the defocus amount is larger than the predetermined value, only the enlarged image is displayed on the display unit 19, and when the defocus amount is smaller than the predetermined value, at least the split image is displayed (display of the enlarged image is not always necessary). Absent). Accordingly, manual focusing can be roughly performed in a state far from the focused state, and fine (accurate) focusing using the split image can be performed when the focused state is approached.

  In this way, convenience and operability during autofocus can be improved.

  FIG. 24 shows the detailed operation in step K06 when split image display is selected in step K04 of the present embodiment.

  Here, a case will be described in which the AF area is set as the upper right area of the imaging screen in step K05, split image display is selected in step K04, and automatic arrangement is performed so as to overlap the AF area.

  In step O01, as shown in FIG. 25, the microcomputer 14 displays the split image SI so as to overlap the AF area AF set in the upper right of the display unit 19.

  Next, in step O02, the microcomputer 14 determines whether or not it is in focus. If it is in focus, the microcomputer ends the process of step K06 and proceeds to step K07. If not in focus, the process proceeds to step O03, waits for manual focus, and then proceeds to step O04.

  In step O04, the microcomputer 14 determines whether or not the narrow-down button of the operation unit 24 has been operated. Prior to imaging, the aperture button is operated to reduce the aperture 3 to the set aperture state through the aperture controller 4 and confirm the depth of focus of the imaging lens 1 with respect to a subject other than the main subject.

  Here, a case where the narrow-down button is operated while the split image is displayed will be described.

  The image signal for the split image generated using the second image sensor 9 is obtained by a pupil-divided light beam, but the light beam is a light beam from a part of the subject, so the amount of light is small. Moreover, the image signal for the split image is a monochromatic image signal. Therefore, even in a state before the diaphragm 3 is narrowed down, the split image is a slightly darker image than the main image.

  In this case, if the aperture 3 is narrowed by operating the aperture button, the amount of light is further reduced and the main image becomes darker. However, the split image that is a single color image is considerably darker than the main image. For this reason, it is difficult to see the split image, and there is a possibility that it cannot be used for focusing. For this reason, when the narrow-down button is operated, the processes of step O05 and step O06 are performed.

  In step O05, the microcomputer 14 erases the split image displayed on the display unit 19. In step O06, as shown in FIG. 26, the enlarged image LI is displayed so as to overlap the AF area AF in the display unit 19, and the process returns to step O02.

  On the other hand, if it is determined in step O04 that the narrow-down button has not been operated, the process proceeds to step O07, and the microcomputer 14 erases the enlarged image on the display unit 19. Then, the process proceeds to Step O08.

  In step O08, the microcomputer 14 displays the split image so as to overlap the AF area on the display unit 19, as shown in FIG. Then, the process returns to step O02.

  As described above, when the diaphragm 3 is narrowed down while the split image is displayed, the split image that becomes dark and difficult to use is erased and an enlarged image is displayed instead. When the narrowing is canceled, the enlarged image is erased and the split image is displayed.

  In this way, according to the present embodiment, it is possible to improve convenience and operability during autofocus.

  In the first and second embodiments described above, the image pickup apparatus that generates the main image data and the split image using the separate image pickup elements 6 and 9 has been described. However, the present invention is applied to an image pickup apparatus using the following image pickup element. Can also be applied.

  FIG. 27 shows a pixel array of an image sensor used in an image pickup apparatus that is Embodiment 3 of the present invention.

  The image sensor 60 in this embodiment is a first photoelectric conversion cell group (imaging pixels) that photoelectrically converts a subject image (first optical image) formed by a light beam from an imaging lens and outputs a first imaging signal. Group) 201. Further, the image sensor 60 photoelectrically converts two optical images (second optical images) formed by dividing the light flux from the imaging lens, and outputs a second imaging signal. Cell groups (split image generation pixel groups) 202 and 203 are included. The first imaging signal is used to generate main image data, and the second imaging signal is used to generate a split image.

  The split image generation pixels form a pair of two pixels diagonally adjacent to each other, and the pairs are discretely (and periodically) arranged in the imaging device 60 (that is, the imaging pixel group).

  28 is a front view of the split image generation pixel 202, and the lower side of FIG. 28 is a cross-sectional view of the split image generation pixel 202 taken along line B-B ′ in the front view. The split image generation pixel 202 does not have any of the R, G, and B color filter layers of the imaging pixel 201, and the micro lens 301 is provided at the position closest to the light incident side. In the front view, the microlens 301 is not shown. Reference numeral 302 denotes a smoothing layer for forming a plane for forming the microlens 301.

  Reference numeral 303 a denotes a light shielding layer, which has a diaphragm opening eccentric in one direction with respect to the center O of the photoelectric conversion region 305. 304 is a smooth layer.

  29 is a front view of the split image generation pixel 203, and the lower side of FIG. 5 is a sectional view of the split image generation pixel 203 when cut along the line BB ′ in the front view. Yes. This split image generation pixel 203 also does not have a color filter layer, and a microlens 301 is provided at a position closest to the light incident side (on the smooth layer 302). In the front view, the microlens 301 is not shown.

  Reference numeral 303b denotes a light shielding layer, which has an aperture opening decentered in a direction opposite to the light shielding layer 303a provided in the split image generation pixel 202 with respect to the center O of the photoelectric conversion region 305. That is, the light shielding layers 303a and 303b of the split image generations 202 and 203 have diaphragm openings at symmetrical positions with the optical axis (O) of each microlens 301 interposed therebetween.

  According to such a configuration, the case where the imaging optical system is viewed from the split image generation pixel 202 and the case where the imaging optical system is viewed from the split image generation pixel 203 are equivalent to the symmetrical division of the pupil of the imaging optical system. . That is, the microlens 301 and the light shielding layers 303a and 303b constitute a so-called pupil division optical system.

  Two more approximate images are formed on the split image generation pixels 202 and 203 adjacent to each other as the number of pixels of the image sensor 60 increases. A phase difference corresponding to the focus state of the imaging optical system is generated in the two images. The direction of the phase difference is reversed between the front pin state and the rear pin state. For this reason, the split image corresponding to the phase difference can be generated by using the imaging signals from the split image generation pixels 202 and 203.

  By using such an image pickup device 60, it is possible to improve convenience and operability during autofocus while making the image pickup apparatus compact.

  Each embodiment described above is only a representative example, and various modifications and changes can be made to each embodiment in carrying out the present invention.

  For example, in each of the above-described embodiments, the case where a split image and an enlarged image are displayed has been described. The enlarged image here may be displayed by enlarging a part of the image data “on display” or may be displayed by enlarging “on data processing”, but in the latter case, it is not always necessary. It is not limited to “enlargement processing” but may be “reduction processing”. Even in the former case, if the original image is displayed large, it is not necessary to “enlarge”.

1 is a block diagram illustrating a configuration of an imaging apparatus that is Embodiment 1 of the present invention. FIG. 6 is a diagram illustrating an enlarged display at the time of manual focus in the first embodiment. FIG. 6 is a diagram illustrating split image display (unfocused state) during manual focus according to the first exemplary embodiment. FIG. 6 is a diagram illustrating split image display (in-focus state) during manual focus in the first embodiment. 6 is a flowchart illustrating an operation during manual focus of the imaging apparatus according to the first exemplary embodiment. 6 is a flowchart illustrating focus auxiliary display selection processing according to the first exemplary embodiment. FIG. 6 is a diagram illustrating a menu screen for selecting a focus assist display in the first embodiment. 5 is a flowchart illustrating AF area designation processing according to the first embodiment. FIG. 6 is a diagram illustrating a screen for selecting an AF area designation method according to the first embodiment. FIG. 6 is a diagram for explaining “area specification” that is an AF area specifying method according to the first embodiment. FIG. 5 is a diagram for explaining “position designation” which is a method for designating an AF area according to the first embodiment. 7 is a flowchart illustrating display position designation processing for focus auxiliary display according to the first exemplary embodiment. FIG. 6 is a diagram illustrating a screen for selecting a focus auxiliary display to be displayed on an AF area according to the first embodiment. 7 is a flowchart showing display processing steps in a focus assist display operation on an AF area in the first embodiment. FIG. 6 is a diagram illustrating a state in which both a split image and an enlarged display are displayed during manual focus in the first embodiment. FIG. 6 is a diagram illustrating a screen for selecting a method for specifying a display position for focus auxiliary display according to the first embodiment. FIG. 5 is a diagram illustrating a state where an AF area is designated at the center of the screen in the first embodiment. FIG. 6 is a diagram illustrating a state in which a split image and an enlarged display are displayed on the right side of an AF area in the first embodiment. FIG. 5 is a diagram illustrating a screen for setting a split image display position according to the first embodiment. 9 is a flowchart showing an operation at the time of manual focus of the image pickup apparatus that is Embodiment 2 of the present invention. 9 is a flowchart showing an operation in a manual focus step in the second embodiment. FIG. 10 is a diagram illustrating a state in which an enlarged image is displayed in the second embodiment. The figure which shows a mode that both the enlarged image and the split image are displayed in Example 2. FIG. 9 is a flowchart showing another operation of the manual focus step in the second embodiment. FIG. 10 is a diagram illustrating a display state of a split image in the second embodiment. FIG. 10 is a diagram showing a state of displaying an enlarged image in Example 2. FIG. 6 is a diagram illustrating a pixel array of an image sensor used in an imaging apparatus that is Embodiment 3 of the present invention. The front view and sectional drawing of a phase difference detection pixel provided in the image sensor of FIG. The front view and sectional drawing of another phase difference detection pixel provided in the image sensor of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Imaging device 1 Imaging lens 1a Focus lens 3 Aperture 6 1st imaging device 8 Optical member for pupil division 9 Second imaging device 14 Microcomputer 19 Display unit 21 Image enlargement unit 22 Image composition unit 24 Operation unit 25 AF control unit 29 Focus detection unit 30 Manual focus ring

Claims (7)

Image generating means for generating image data based on a signal obtained by photoelectrically converting an optical image formed by a light beam incident on the imaging optical system from a subject with a sensor ;
Based on a signal obtained by photoelectrically converting the two optical images formed by the two light beams split by the sensor of the light beam incident on the imaging optical system from an object, the phase difference of the two optical images Split image generation means for generating a split image corresponding to
Partial image generation means for generating a partial image corresponding to a part of the image data;
Display means for displaying an image;
An imaging apparatus comprising: focus assisting means capable of switching and displaying the split image and the partial image on the display means during manual focus. Having operating means operated by an operator;
The imaging apparatus according to claim 1, wherein the focus assisting unit switches and displays the split image and the partial image on the display unit in accordance with an operation of the operation unit.   The focus assisting means switches to displaying the partial image when the aperture of the imaging optical system is narrowed down while the split image is being displayed on the display means. The imaging device described in 1.   The focus assisting means causes the display means to display the partial image when a defocus amount of the imaging optical system is larger than a predetermined value, and causes the display means to display at least the defocus amount when the defocus amount is smaller than the predetermined value. The image pickup apparatus according to claim 1, wherein a split image is displayed.   The imaging apparatus according to claim 1, wherein the focus assisting unit is capable of switching to display both the split image and the partial image on the display unit.   The imaging apparatus according to claim 5, wherein the focus assisting unit enlarges the split image according to an enlargement ratio of the partial image and displays the enlarged image on the display unit. Generating image data based on a signal obtained by photoelectrically converting an optical image formed by a light beam incident on the imaging optical system from a subject with a sensor ;
Based on a signal obtained by photoelectrically converting the two optical images formed by the two light beams split by the sensor of the light beam incident on the imaging optical system from an object, the phase difference of the two optical images Generating a split image corresponding to
Generating a partial image corresponding to a part of the image data;
A method for controlling an image pickup apparatus, comprising: a step of switching and displaying the split image and the partial image on a display means during manual focus.