JP5747510B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus.

  Focus detection pixels including a microlens and a pair of photoelectric conversion units disposed behind the microlens are arranged on a planned focal plane (imaging plane) of the photographing optical system. Thereby, a pair of image signals corresponding to a pair of images formed by the pair of focus detection light beams passing through the optical system is generated, and the focus adjustment of the photographing optical system is performed by detecting an image shift amount between the pair of image signals. A focus detection method using a so-called pupil division type phase difference detection method for detecting a state is known.

  There is also known an imaging apparatus in which such focus detection pixels are mixed with imaging pixels in one imaging device to realize imaging operations by the imaging pixels and focus detection operations at a plurality of positions on the imaging surface (for example, Patent Document 1).

JP 2008-152012 A

An imaging device according to the present invention includes an imaging pixel that outputs an imaging signal, a focus detection pixel that receives a pair of light beams that have passed through a pair of regions of a pupil of a photographing optical system, and outputs first and second data strings. Are subjected to the first correlation calculation or the second correlation calculation on the first and second data strings in the focus detection area set on the imaging surface and the image pickup elements arranged two-dimensionally. A focus detection unit that calculates a defocus amount, a high-luminance object image position detection unit that detects the position of a high-luminance object image on the imaging surface based on an imaging signal, and a high-luminance based on the position of the high-luminance object image A ghost position estimation unit that estimates the position of a ghost formed corresponding to the object image, and the focus detection unit does not include the position of the focus detection area in the vicinity of the ghost position estimated by the ghost position estimation unit If the first correlation performance It was carried out, and performing a second correlation operation when the position of the focus detection area is included in the vicinity of the ghost estimated by the ghost position estimating unit.
An imaging device according to the present invention includes an imaging element having a focus detection pixel that receives a pair of light beams that have passed through a pair of regions of a pupil of an imaging optical system and outputs first and second data strings, and an imaging surface. A focus detection unit that calculates the defocus amount by performing the first correlation calculation or the second correlation calculation on the first and second data strings in the focus detection area set above, and a high value on the imaging surface A high-brightness object image position detection unit that detects the position of a luminance object image, and a ghost position estimation unit that estimates the position of a ghost formed corresponding to the high-brightness object image based on the position of the high-brightness object image The focus detection unit performs a first correlation calculation when the position of the focus detection area is not included in the vicinity of the ghost position estimated by the ghost position estimation unit, and the position of the focus detection area is estimated by the ghost position estimation unit. Was And performing a second correlation calculation if included in the vicinity of the paste.
In addition, an imaging apparatus according to the present invention is set on an imaging surface having an imaging element having focus detection pixels that receive a pair of light beams that have passed through a pair of regions of a pupil of a photographing optical system and output a pair of focus detection signals. A selection unit that selects a predetermined focus detection area from the plurality of focus detection areas that have been performed, a focus detection unit that calculates a defocus amount based on a pair of focus detection signals in the predetermined focus detection area selected by the selection unit, A high-brightness object image position detection unit that detects the position of a high-brightness object image on the imaging surface, and a ghost position that estimates the position of a ghost formed corresponding to the high-brightness object image based on the position of the high-brightness object image When the position of the estimation unit and the predetermined focus detection area is included in the vicinity of the ghost position estimated by the ghost position estimation unit, the predetermined focus detection area is included in the vicinity of the ghost position. And a change unit that changes the focus detection area to a predetermined focus detection area, and the focus detection unit includes a predetermined focus detection area when the position of the predetermined focus detection area is not included in the vicinity of the ghost position estimated by the ghost position estimation unit. The defocus amount is calculated based on the pair of focus detection signals at, and when the position of the predetermined focus detection area is included in the vicinity of the ghost position estimated by the ghost position estimation unit, in the focus detection area changed by the change unit A defocus amount is calculated based on a pair of focus detection signals .

  An imaging apparatus according to the present invention includes an imaging element in which an imaging pixel that outputs an imaging signal and a focus detection pixel that outputs a focus detection signal are two-dimensionally mixed, and a focus detection area set on an imaging surface. A focus adjustment control means for performing focus adjustment control including a focus detection operation for detecting a focus adjustment state based on the focus detection signal in the camera, and a focus adjustment operation based on the detected focus adjustment state, on the imaging surface based on the imaging signal A high luminance object image position detecting means for detecting the position of the high luminance object image, and a ghost position estimating means for estimating a position of a ghost formed corresponding to the high luminance object image based on the position of the high luminance object image; The focus adjustment control means varies the focus adjustment control control according to whether or not the position of the focus detection area is included in the vicinity of the ghost position estimated by the ghost estimation means. And wherein the door.

  According to the imaging apparatus of the present invention, it is possible to prevent a focus detection error caused by a ghost image.

It is a figure which shows the structure of the digital camera of one embodiment. It is a figure which shows the focus detection area on the imaging | photography screen set to the imaging surface. It is a front view which shows the detailed structure of an image pick-up element. It is a front view which shows the detailed structure of an image pick-up element. It is a flowchart which shows the imaging operation of a digital camera. It is a figure which shows the periodic switching of exposure control. It is a figure for demonstrating generation | occurrence | production of the ghost by a high-intensity object. It is a figure which shows the example of a composition of the to-be-photographed object in the screen at the time of normal exposure. It is a figure showing the area | region which showed the luminance distribution in a screen with light and dark. It is a figure which shows the luminance distribution of the image obtained by high-intensity object exposure. It is a figure which shows the estimated ghost generating position. It is a figure which shows the estimated ghost generating position. It is a figure which shows the estimated ghost generating position. It is a figure which shows an example of the display screen of a liquid crystal display element. It is a front view which shows the detailed structure of an image pick-up element. It is a front view which shows the detailed structure of an image pick-up element.

--- First embodiment ---
As an imaging apparatus according to an embodiment, a digital camera with interchangeable lenses will be described as an example. FIG. 1 is a diagram illustrating a configuration of a digital camera according to an embodiment. As shown in FIG. 1A, the digital camera 201 according to the present embodiment includes an interchangeable lens 202 and a camera body 203, and the interchangeable lens 202 is attached to the camera body 203 via a mount unit 204. An interchangeable lens 202 having various photographing optical systems can be attached to the camera body 203 via a mount unit 204.

  The interchangeable lens 202 includes a lens 209, a zooming lens 208, a focusing lens 210, a diaphragm 211, a lens drive control device 206, and the like. The lens drive control device 206 includes a microcomputer (not shown), a memory, a drive control circuit, and the like. The lens drive control unit 206 performs drive control for adjusting the focus of the focusing lens 210 and adjusting the aperture diameter of the aperture 211, and detecting the states of the zooming lens 208, the focusing lens 210, and the aperture 211. Further, transmission of lens information and reception of camera information (defocus amount, aperture value, etc.) are performed by communication with a body drive control device 214 described later. The aperture 211 forms an aperture having a variable aperture diameter at the center of the optical axis in order to adjust the amount of light and the amount of blur.

  The camera body 203 includes an imaging device 212, a body drive control device 214, a liquid crystal display device drive circuit 215, a liquid crystal display device 216, an eyepiece lens 217, a memory card 219, an operation member 220, an AD conversion device 221, and the like. In the image sensor 212, image pickup pixels are two-dimensionally arranged (rows and columns), and focus detection pixels are incorporated in portions corresponding to focus detection positions (focus detection areas). Details of the image sensor 212 will be described later.

  The body drive control device 214 includes hardware such as a microcomputer, a memory, and a drive control circuit. As shown in FIG. 1B, the body drive control device 214 includes, for example, an exposure control function unit 2141, a focus detection function unit 2142, a focus adjustment function unit 2143, an inter-control device communication function unit 2144, and a display control function unit 2145. , Recording control function unit 2146, image signal reading function unit 2147, photographing function unit 2148, image signal processing function unit 2149, high-luminance object information detection function unit 2150, ghost information estimation function unit 2151, and focus detection operation determination function unit 2152. including. Each of these functional units may be realized individually by the hardware described above or may be realized individually by software.

  The exposure control function unit 2141 performs exposure control of the image sensor 212. The image signal reading function unit 2147 reads pixel signals (image signals) from the image sensor 212. The focus detection function unit 2142 performs a focus detection calculation based on a pixel signal (focus detection signal) of the focus detection pixel. The focus adjustment function unit 2143 repeatedly performs focus adjustment of the interchangeable lens 202. The image signal processing function unit 2149 performs image signal processing of the captured image based on the pixel signal read by the image signal reading function unit 2147. The display control function unit 2145 controls the liquid crystal display element driving circuit 215 to cause the liquid crystal display element 216 to display a captured image that has been subjected to image signal processing by the image signal processing function unit. The recording control function unit 2146 records the image signal of the captured image on the memory card 219. The shooting function unit 2148 performs camera operation control and the like. The inter-control device communication function unit 2144 communicates with the lens drive control device 206 through the electrical contact 213 to receive lens information and transmit camera information. Details of processing performed by each of the high-luminance object information detection function unit 2150, the ghost information estimation function unit 2151, and the focus detection operation function unit 2152 will be described later.

  The liquid crystal display element 216 functions as an electric view finder (EVF). The liquid crystal display element driving circuit 215 displays a through image (captured image) on the liquid crystal display element 216 based on the captured image data read from the image sensor 212, and the photographer observes the through image via the eyepiece 217. be able to. The memory card 219 is an image storage that stores image data captured by the image sensor 212.

  The AD conversion device 221 performs AD conversion on the pixel signal output from the image sensor 212 and sends it to the body drive control device 214. The imaging device 212 may have a configuration in which the AD conversion device 221 is incorporated.

  A subject image is formed on the imaging surface of the imaging element 212 by the light beam that has passed through the interchangeable lens 202. This subject image is photoelectrically converted by the image sensor 212, and the pixel signals of the imaging pixels and focus detection pixels are sent to the body drive control device 214.

  The body drive control device 214 calculates the defocus amount based on the pixel signal (focus detection signal) from the focus detection pixel of the image sensor 212 and sends this defocus amount to the lens drive control device 206. In addition, the body drive control device 214 processes the pixel signal (imaging signal) of the imaging pixel of the imaging element 212 to generate image data, stores the image data in the memory card 219, and reads the through image read from the imaging element 212. The signal is sent to the liquid crystal display element driving circuit 215, and a through image (captured image) is displayed on the liquid crystal display element 216. Further, the body drive control device 214 sends aperture control information to the lens drive control device 206 to control the aperture of the aperture 211.

  The lens drive controller 206 updates the lens information according to the focusing state, zooming state, aperture setting state, aperture opening F value, and the like. Specifically, the positions of the zooming lens 208 and the focusing lens 210 and the aperture value of the aperture 211 are detected, and lens information is calculated according to these lens positions and aperture values, or prepared in advance. Lens information corresponding to the lens position and aperture value is selected from the look-up table.

  The lens drive control device 206 calculates a lens drive amount based on the received defocus amount, and drives the focusing lens 210 to the in-focus position according to the lens drive amount. Further, the lens drive control device 206 drives the diaphragm 211 in accordance with the received diaphragm value.

  The operation member 220 is a member that is manually operated by the user in order to select one focus detection area from a plurality of focus detection areas described later. The body drive control device 214 performs focus detection processing in the focus detection area selected via the operation member 220.

  FIG. 2 is a diagram showing a focus detection position (focus detection area) on a scheduled imaging plane of the interchangeable lens 202, that is, a shooting screen set on the imaging plane. An example of a region (a focus detection area, a focus detection position) where an image is sampled on a shooting screen at the time of detection is shown. In this example, focus detection areas 1601 to 1625 are arranged at the center (on the optical axis) on the rectangular shooting screen 100 and at 25 locations in the vertical and horizontal directions. Focus detection pixels are linearly arranged in the longitudinal direction of the focus detection area indicated by a rectangle. The focus detection pixels are arranged in the horizontal direction in the focus detection area 1613 at the center of the shooting screen 100, and the focus detection pixels are arranged in the vertical direction in the focus detection areas 1601 and 1625 at the left and right ends of the shooting screen 100. The

  3 and 4 are front views showing a detailed configuration of the image sensor 212. FIG. FIG. 3 shows the details of the pixel arrangement in which the vicinity of the focus detection areas arranged in the vertical direction in FIG. 2 is enlarged. FIG. 4 shows details of the pixel arrangement in which the vicinity of the focus detection areas arranged in the horizontal direction in FIG. 2 is enlarged. Imaging pixels 310 are densely arranged on the imaging element 212 in a two-dimensional square lattice pattern. The imaging pixel 310 includes a red pixel (R), a green pixel (G), and a blue pixel (B), and is arranged according to a Bayer arrangement rule.

  In FIG. 3, focus detection pixels 313 and 314 for vertical focus detection having the same pixel size as the imaging pixel 310 are alternately used for focus detection of an image whose luminance changes in the vertical direction. They are continuously arranged on a straight line in the vertical direction to be continuously arranged. Similarly, in FIG. 4, focus detection pixels 315 and 316 for horizontal focus detection having the same pixel size as the imaging pixel 310 for focus detection of an image whose luminance changes in the horizontal direction are alternately green and blue pixels. Are continuously arranged on a horizontal straight line to be continuously arranged.

  The shape of each microlens of the imaging pixel 310 and the focus detection pixels 313, 314, 315, and 316 is a shape obtained by cutting out from a circular microlens originally larger than the pixel size into a square shape corresponding to the pixel size.

  The imaging pixel 310 includes a rectangular microlens 10, a photoelectric conversion unit 11 whose light receiving area is limited to a square by a light shielding mask, and a color filter (not shown). The color filters include three types of red (R), green (G), and blue (B), and have spectral sensitivity characteristics corresponding to the respective colors. In the image pickup device 212, image pickup pixels 310 having respective color filters are arranged in a Bayer array.

  The focus detection pixels 313, 314, 315, and 316 are provided with white filters that transmit all visible light in order to perform focus detection for all colors. The white filter has a spectral sensitivity characteristic such that the spectral sensitivity characteristics of the green pixel, the red pixel, and the blue pixel are added, and the light wavelength region exhibiting high sensitivity is each color filter in each of the green pixel, the red pixel, and the blue pixel. Includes a light wavelength region exhibiting high sensitivity.

  As shown in FIG. 3, the focus detection pixel 313 includes a photoelectric conversion unit 13 in which a light receiving region is limited to an upper half of a square (upper half when a square is divided into two equal parts by a horizontal line) using a rectangular microlens 10 and a light shielding mask. And a white filter (not shown).

  Further, as shown in FIG. 3, the focus detection pixel 314 is a photoelectric conversion in which a light receiving area is limited to a lower half of a square (lower half when a square is divided into two equal parts by a horizontal line) using a rectangular microlens 10 and a light shielding mask. And a white filter (not shown).

  When the focus detection pixel 313 and the focus detection pixel 314 are displayed with the microlens 10 superimposed, the photoelectric conversion units 13 and 14 in which the light receiving area is limited to a half of a square by a light shielding mask are arranged in the vertical direction.

  Further, when the remaining portion obtained by halving the square is added to the portion of the light receiving region limited to the half of the square described above, a square having the same size as the light receiving region of the imaging pixel 310 is obtained.

  As shown in FIG. 4, the focus detection pixel 315 is a photoelectric conversion unit in which a light receiving region is limited to a left half of a square (left half when a square is divided into two equal parts by a vertical line) using a rectangular microlens 10 and a light shielding mask. 15 and a white filter (not shown).

  Further, as shown in FIG. 4, the focus detection pixel 316 is a photoelectric sensor in which the light receiving region is limited to the right half of a square (right half when the square is divided into two equal parts by a vertical line) using a rectangular microlens 10 and a light shielding mask. It is comprised from the conversion part 16 and a white filter (not shown).

  When the focus detection pixel 315 and the focus detection pixel 316 are displayed with the microlens 10 superimposed, the photoelectric conversion units 15 and 16 in which the light receiving area is limited to a half of a square by a light shielding mask are arranged in the horizontal direction.

  Further, when the remaining portion obtained by halving the square is added to the portion of the light receiving region limited to the half of the square described above, a square having the same size as the light receiving region of the imaging pixel 310 is obtained.

  In the configuration of the imaging pixel and the focus detection pixel as described above, under a general light source, the output level of the green imaging pixel and the output level of the focus detection pixel are substantially equal, and the red imaging pixel and the blue detection pixel The output level of the imaging pixel is smaller than this.

  The pair of focus detection pixels 313, 314, 315, and 316 described above receive a pair of focus detection light beams that pass through a pair of distance measurement pupils disclosed in, for example, Japanese Unexamined Patent Application Publication No. 2009-124575, and a pair of focus detection signals. Is output. The photoelectric conversion units 13, 14, 15, and 16 of the pair of focus detection pixels 313, 314, 315, and 316 and the pair of distance measurement pupils are in an optically conjugate relationship by the microlens 10.

  In general, the distance between the pair of distance measurement pupils is the distance measurement pupil distance from the microlens array in which the plurality of microlenses 10 are two-dimensionally arranged to the distance measurement pupil plane where the pair of distance measurement pupils are located. It is set to be the same as the exit pupil distance of the system (interchangeable lens 202). When a plurality of interchangeable lenses are selectively attached, the distance measurement pupil distance is set to the average exit pupil distance of the plurality of interchangeable lenses.

  A large number of the pair of focus detection pixels 313 and 314 described above are arranged alternately and linearly, and the output of the photoelectric conversion unit of each focus detection pixel is collected into a pair of output groups corresponding to the pair of distance measurement pupils. Information on the intensity distribution of the pair of images formed on the focus detection pixel array (vertical direction) by the pair of light beams passing through each of the distance measurement pupils is obtained. By applying an image shift detection calculation process (correlation calculation process, phase difference detection process) to this information, the image shift amount of a pair of images is detected by a so-called pupil division type phase difference detection method. Furthermore, by performing a conversion operation according to the proportional relationship between the distance between the center of gravity of the pair of distance measurement pupils and the distance measurement pupil distance, the deviation between the planned image formation surface and the image formation surface at the focus detection position (vertical direction) is performed. (Defocus amount) is calculated.

  As with the focus detection pixels 313 and 314, a pair of distance measurement pupils is set for the focus detection light beams received by the focus detection pixels 315 and 316. A large number of pairs of focus detection pixels 315 and 316 are arranged alternately and in a straight line, and the output of the photoelectric conversion unit of each focus detection pixel is collected into a pair of output groups corresponding to the pair of distance measurement pupils. Information on the intensity distribution of the pair of images formed on the focus detection pixel array (horizontal direction) by the pair of light beams respectively passing through the distance pupil is obtained. Based on this information, the deviation (defocus amount) between the planned imaging plane and the imaging plane at the focus detection position (horizontal direction) is calculated.

  FIG. 5 is a flowchart showing the imaging operation of the digital camera 201 of the present embodiment. When the power of the digital camera 201 is turned on in step S100, the body drive control device 214 starts an imaging operation after step S110. In step S100, the imaging device is set to a live view operation mode in which imaging and image display are repeated at a constant cycle (for example, 60 frames per second). Note that a high-intensity flag described later is initialized (OFF).

  In this operation mode, as shown in FIG. 6, exposure control is periodically switched in principle. Such exposure control is performed by the exposure control function unit 2141. In FIG. 6, the horizontal axis represents time, and one unit time corresponding to one frame is 1/60 second. 6A, 6B, and 6C are described in association with each other by substantially aligning the times. In FIG. 6A, the normal exposure control shown as a frame that is not normally hatched is executed. In the normal exposure, as shown in FIGS. 6B and 6C, the imaging pixels of the image sensor and the exposure pixels suitable for live view display (exposure amounts at which the average luminance of the display screen becomes a predetermined level) and The charge accumulation time of the focus detection pixel is controlled, an image signal is read from the image sensor every 1/60 seconds, and is updated and displayed every 1/60 seconds by EVF. Instead of the electronic shutter control for controlling the charge accumulation time, the ISO sensitivity of the image sensor 212 may be changed.

  In FIG. 6A, as shown as a hatched frame, high-luminance exposure for detecting a ghost caused by a high-luminance object, which will be described later, is performed periodically, for example, once every four frames. An exposure control processing cycle in which exposure for high luminance is performed is called a high luminance detection cycle. As shown in FIGS. 6B and 6C, the charge accumulation times of the image pickup pixels and focus detection pixels of the image pickup device are controlled so that the exposure amount at the time of exposure for high luminance is smaller than the normal exposure. As will be described later, high-brightness exposure may not be performed depending on the determination result in step S120 of FIG. 5, and thus high-brightness exposure is not necessarily performed periodically.

  Here, generation of a ghost due to a high-luminance object will be described with reference to FIG. In FIG. 7, a light beam 120 emitted from a high-luminance object passes through the lens 110 and reaches a point 125 on the imaging surface 101 as a light beam that forms a normal image. The light beam 120 is reflected at a point 1101 on the rear surface 110b of the lens 110, and the reflected light beam 130 is further reflected at a point 1102 on the lens front surface 100a. The reflected light beam 140 passes through the lens 110 and is reflected on the imaging surface 101. This point 145 is reached as a harmful ray.

  This causes a so-called ghost. The so-called flare that does not form a clear image is also included in the ghost. If the ghost amount becomes a non-negligible amount compared to the amount of regular light at the position where the ghost occurs, it can be visually recognized on the display screen and adversely affects the focus detection in the focus detection area near the position where the ghost occurs. Will give. In other words, harmful rays that cause ghosts are incident on the focus detection pixels through a path other than the normal rays passing through the pair of distance measuring pupils regulated by the aperture opening of the photographing lens, and therefore only one of the pair of focus detection pixels. Or an image is formed on a surface whose position in the optical axis direction is different from that of a regular image. Therefore, if focus detection is performed in the vicinity of the ghost image, focus detection becomes impossible or a large error occurs in the focus detection result.

  In step S110, it is determined whether the current frame is a frame in the high luminance detection cycle (once every four frames in the example of FIG. 6A). If it is a high-intensity detection cycle, the process proceeds to step S120, and if not, the process proceeds to a series of operations during normal exposure after step S200.

  In step S120, it is determined whether or not a saturated region exists in the image obtained in the previous frame. For example, if a predetermined number or more of pixel signals indicating the maximum value of AD conversion exist for a pixel signal after AD conversion, a saturated region is determined to exist. This determination is performed by the high luminance object information detection function unit 2150. If it is determined in step S120 that there is no saturated region, that is, there is no high-luminance object, the high-luminance flag is turned off in step S130, and the process proceeds to a series of operations during normal exposure after step S200. The high brightness flag will be described later in step S150.

  If it is determined in step S120 that there is a saturated region, exposure control of the image sensor is performed with an exposure amount for high luminance detection in step S140, and an image signal is read out. Here, the exposure amount for high-luminance detection is an amount that is smaller than the normal exposure amount as described above, and is, for example, 1/8 to 1/64 of the normal exposure amount. Exposure control with an exposure amount for high brightness detection is performed by an exposure control function unit 2141.

  In step S150, a luminance distribution on the screen is obtained based on the read image signal, and it is determined whether or not an image of a high-luminance object exists on the screen. For example, in exposure control during normal exposure, a portion having a predetermined luminance or higher than the luminance set as a reference for an appropriate exposure amount is determined as a high luminance object image. Alternatively, a portion having a predetermined luminance or higher than the luminance at the peak position of the luminance histogram distribution in the screen during normal exposure is determined as a high luminance object image. The determination of the image of the high luminance object is performed by the high luminance object information detection function unit 2150.

  If it is determined in step S150 that there is no image of a high-luminance object, the high-luminance flag is turned off in step S160, the process returns to step S110, and the next imaging frame operation is started. The high-intensity flag is a flag indicating a determination result regarding the presence / absence of a high-intensity object image in the high-intensity detection cycle.

  If it is determined in step S150 that there is a high-luminance object image, in step S170, after turning on the high-luminance flag, the position of the peak of the luminance distribution in the region where it is determined that the high-luminance object image exists is set to high. The position of the luminance object image is determined, and the size of the high luminance object is determined based on a region within the predetermined luminance difference from the peak luminance around the peak position. The size of the high brightness object is determined by the high brightness object information detection function unit 2150.

  Details of the processing in steps S120, S140, and S170 will be described with reference to FIGS. FIG. 8 shows a composition example of the subject in the screen during normal exposure. A person 810 as a main subject, a background mountain 820, a sky 830, and a sun 840 as a high-intensity object located near the center of the screen 800. Configure.

  FIG. 9 shows a region 900 in which the luminance distribution in the screen 800 is shown in light and dark corresponding to FIG. 8, and the region 900 includes regions 910 to 940. Since the main subject person 810 is backlit, the corresponding area 910 is darkest. Since the periphery of the sun 840, which is a high-luminance object, is a saturated region over a wide range, the corresponding region 940 is brightest. A region 920 corresponding to the mountain 820 is darker than the region 910, and a region 930 corresponding to the sky 830 is brighter than the region 940.

  FIG. 10 shows the luminance distribution of the image obtained by the high-luminance object exposure, and the screen 1000 corresponds to the area 900 in FIG. Since the exposure amount is greatly reduced, only the high-luminance partial region 1400 corresponding to the sun 840 is clearly recognized on the luminance distribution, and the partial regions other than the sun 840 are the high-luminance partial region 1400 corresponding to the sun 840. It is recognized as a background luminance area 1500 that is significantly lower than the luminance. In FIG. 10, the center position of the high luminance partial area 1400 on the screen 1000 (or the peak position of the luminance histogram distribution) is determined as the position P0 of the high luminance object image. The position P0 is determined to be represented by coordinates (X0, Y0) with the center C0 of the screen 1000 as the origin. Further, the range of the diameter D0 around the position P0 (X0, Y0) of the high luminance object image is set as the size of the high luminance object image. For example, the diameter D0 is determined such that the average luminance within the range is a luminance obtained by subtracting a predetermined luminance from the luminance at the position P0 (X0, Y0) of the high-luminance object image.

  In step S180, based on the high-luminance object information including the position, size, and luminance of the high-luminance object image (high-luminance subject) obtained in step S170, the position where the ghost occurs and the size of the ghost on the screen 800. And ghost information such as ghost brightness. The ghost information is estimated by the ghost information estimation function unit 2151. 11 to 13 are diagrams for explaining an example of processing performed in step S180. In FIG. 11, the position where the ghost is generated is estimated and displayed on the screen 800 as being on a straight line 150 passing through the position P1 of the image of the sun 840 of the high brightness object and the screen center position C1. In general, the shape of an optical element such as a lens in an optical system is rotationally symmetric with respect to the center of the optical axis. It is an estimation based on the knowledge that it occurs on a straight line passing through. In this estimation, the ghost generation position can be estimated based only on the position information of the high-luminance object image.

  FIG. 12 is a diagram showing an example of a screen 800 that estimates and displays a ghost generation region defined by the straight line 151 and the straight line 152 using information on the size of the high-luminance object image. A ghost generation region defined by the straight line 151 and the straight line 152 is estimated as a region having a width corresponding to information on the size of the high-luminance object image with the straight line 150 as the center.

  FIG. 13 is a diagram showing an example of a screen 800 displayed by estimating the ghost occurrence positions G1 and G2 and the luminance distribution of the ghost by ray tracing calculation based on the lens information obtained by communication with the interchangeable lens 202. . The lens information includes, for example, the configuration of the optical system (interchangeable lens 202), the refractive index of the lens, the shape of the lens surface, the focal length of the lens, the lens arrangement, the presence / absence of a coat on the lens and the type of coat, and the reflection of each lens surface. Including the ratio, aperture position, aperture diameter or F value. Regarding the luminance distribution of the ghost, two ghosts are generated in FIG. The ranges R11 and R21 in the vicinity of the ghost occurrence positions G1 and G2 are each expressed as a region having the highest luminance, and the ranges R12 and R22 outside the ranges R11 and R21 are respectively expressed as regions having lower luminance than R11 and R21. ing.

  Since such ray tracing calculation takes time, it may be performed as follows. That is, high-luminance object information including the position, size, and luminance of the high-luminance object image is transmitted from the body drive control device 214 on the camera body 203 side to the lens drive control device 206 on the interchangeable lens 202 side. The lens drive control device 206 receives the ghost information including the ghost position and the luminance distribution obtained by referring to the table stored in advance based on the received high-luminance object information and lens information, and the body drive control device 214. Send back to. The table stored in advance by the lens drive control device 206 stores ghost information empirically in accordance with lens information and high-luminance object information, or results obtained by experiment or calculation in advance. As described above with reference to FIG. 11, using the condition that a ghost occurs on a straight line passing through the position of the high-luminance object image and the center position of the screen, the position information based on the two-dimensional data is used as the position information of the high-luminance object image. Instead, the memory capacity of the table can be greatly reduced by using distance data from the center of the screen.

  When the process of step S180 is completed, the process returns to step S110, and the operation of the next imaging frame is started.

  On the other hand, if it is determined in step S110 that the current imaging frame is not a high-intensity detection cycle, the exposure control of the imaging device is performed with an exposure amount for obtaining an appropriate exposure image for live view display in step S200, and the image signal Is read. Exposure control is performed by the exposure control function unit 2141, and image signal reading is performed by the image signal reading function unit 2147. In step S210, the liquid crystal display element driving circuit 215 is controlled based on the obtained image signal, and an image is displayed on the liquid crystal display element 216. The generation of the display image is performed by the image signal processing function unit 2149, and the control of the liquid crystal display element driving circuit 215 is performed by the display control function unit 2145.

  In step S220, the liquid crystal display element driving circuit 215 is controlled so as to superimpose and display the position of the focus detection area selected by the user on the image 800 displayed on the liquid crystal display element 216. For example, on the display screen 2160 of the liquid crystal display element 216 shown in FIG. 14, a frame corresponding to one focus detection area 1621 selected by the user from among 25 focus detection areas 1601 to 1625 superimposed on the image 800. The line is displayed in red. Such display image generation is performed by the image signal processing function unit 2149, and the liquid crystal display element driving circuit 215 is controlled by the display control function unit 2145.

  In step S230, it is determined whether or not the high luminance flag is ON. If it is OFF, the process proceeds to step S270. If it is ON, the process proceeds to step S240. In step S240, an image of the sun 840 is superimposed on the display of the image 800 and the focus detection areas 1601 to 1625 as shown in FIG. 14 based on the ghost information obtained in step S180 of the latest high-intensity detection cycle. The liquid crystal display element driving circuit 215 is controlled to display the ghost generation positions G1 and G2 caused by the high-luminance object image and the ranges R11, R12, R21, and R22. The liquid crystal display element driving circuit 215 is controlled by a display control function unit 2145. For example, when the focus detection area 1621 is selected, the user can visually recognize that a part of the focus detection area 1621 displayed in red in step S220 overlaps the ghost range R21 or R22.

  In step S250, based on the position of the focus detection area selected by the user and the ghost information, it is determined whether or not there is a ghost effect on the focus detection of the focus detection area. The focus detection operation determination function unit 2152 determines whether there is a ghost effect on focus detection. For example, when the user selects one of the focus detection areas 1612, 1616, 1617, and 1621 partially included in the ranges R11, R12, R21, and R22 in the vicinity of the ghost generation positions G1 and G2 shown in FIG. Is determined to have a ghost effect, and the process proceeds to step S260.

  Whether or not a part of the focus detection area selected by the user is included in the ghost ranges R11, R12, R21, and R22 depends on the ghost occurrence position calculated in step S180 of the most recent high-intensity detection cycle. The determination is made based on a predetermined determination formula using the brightness and the luminance. The predetermined determination formula is, for example, the distance from each of the ghost generation positions G1 and G2 to the selected focus detection area, or the luminance between the luminance of the ghost generation positions G1 and G2 and the luminance in the vicinity of the focus detection area. It is determined empirically or experimentally depending on the difference.

  In step S260, the display frame of the focus detection area is flushed to inform the user that lens driving for focus detection and focus adjustment in the selected focus detection area is prohibited, and the process returns to step S110. The operation of the next imaging frame is started.

  On the other hand, if it is determined that there is no ghost effect on the focus detection in the focus detection area selected in step S250, the process proceeds to step S270. In step S270, focus detection is performed based on focus detection pixel data (focus detection signal) in the selected focus detection area, and a defocus amount is calculated. Such focus detection and defocus amount calculation are performed by the focus detection function unit 2142.

  In step S280, it is determined whether or not the subject is in focus. If the subject is in focus, the process proceeds to step S300. If the subject is out of focus, the process proceeds to step S290. The in-focus state refers to a state where the absolute value of the defocus amount calculated in step S270 is equal to or less than a predetermined threshold value. The focus detection function unit 2142 determines whether or not it is in focus.

  In step S290, the defocus amount is transmitted to the lens drive control device 206, and the focusing lens 210 of the interchangeable lens 202 is driven to the in-focus position. If the reliability of the defocus amount is low or focus detection is impossible, this is transmitted to the lens drive control unit 206, and the drive control of the focusing lens 210 of the interchangeable lens 202 is not updated. Then, it returns to step S110 and starts the operation of the next imaging frame. Control information indicating that the defocus amount to the lens drive control device 206 and focus detection is impossible is generated by the focus adjustment function unit 2142, and transmission of the control information is performed by the inter-control device communication function unit 2144.

  In step S300, it is determined whether or not shooting is ON, that is, whether or not a shooting instruction is given by an operating member (not shown). If shooting is not instructed, the process returns to step S110, and the next time. The operation of the imaging frame is started. If a shooting instruction has been issued in step S300, exposure control of the image sensor 212 is performed with an appropriate exposure amount for imaging in step S310, and an image signal of the captured image is read. The shooting function unit 2148 determines whether or not a shooting instruction has been issued. Exposure control is performed by the exposure control function unit 2141, and image signal reading is performed by the image signal reading function unit 2147.

  In step S320, the read image signal is recorded in the memory card 219 as captured image data, and the process returns to step S110 to start the operation of the next imaging frame. Recording of the captured image data to the memory card 219 is performed by the recording control function unit 2146.

Next, details of a general image shift detection calculation process (correlation calculation process) used in step S270 of FIG. 5 will be described. For a pair of data strings (A1 _{1 to} A1 _M , A2 _{1 to} A2 _M : M is the number of data) read from the focus detection pixel string, the following correlation calculation formula (1) is used to calculate the correlation The quantity C (k) is calculated.
C (k) = Σ | A1 _n −A2 _{n + k} | (1)

In equation (1), Σ operations are accumulated for n. The range taken by n is limited to the range in which the data of A1 _n , A1 _{n + 1} , A2 _{n + k} , A2 _{n + 1 + k} exists according to the image shift amount k. The image shift amount k is an integer and is a relative shift amount with the data interval of the data string as a unit.

  As disclosed in Japanese Patent Application Laid-Open No. 2010-128205, the calculation result of Expression (1) has a minimum correlation amount C (k) when the image shift amount (for example, k = kj = 2) with a high correlation between a pair of data. become. The smaller the correlation amount C (k), the higher the degree of correlation between the pair of data.

An image shift amount ks that gives a minimum value C (ks) with respect to a continuous correlation amount is obtained by using a three-point interpolation method according to equations (2) to (5).
ks = kj + D / SLOP (2)
C (ks) = C (kj) − | D | (3)
D = {C (kj−1) −C (kj + 1)} / 2 (4)
SLOP = MAX {C (kj + 1) -C (kj), C (kj-1) -C (kj)} (5)

  Whether or not the image shift amount ks calculated by Expression (2) is reliable is determined as follows. As disclosed in Japanese Patent Application Laid-Open No. 2010-128205, when the degree of correlation between a pair of data is low, the value of the minimum value C (ks) of the interpolated correlation amount increases. Therefore, when the minimum value C (ks) is equal to or greater than a predetermined threshold, it is determined that the reliability of the calculated image shift amount is low, and the calculated image shift amount ks is canceled.

  Alternatively, in order to normalize the minimum value C (ks) with the contrast of the data, the value obtained by dividing the minimum value C (ks) by the difference SLOP that is proportional to the contrast is equal to or greater than a predetermined value. It is determined that the reliability of the image shift amount is low, and the calculated image shift amount ks is canceled.

  Alternatively, if the difference SLOP that is a value proportional to the contrast is equal to or smaller than a predetermined value, it is determined that the subject has low contrast and the reliability of the calculated image shift amount is low, and the calculated image shift amount ks is Cancel.

As disclosed in JP 2010-128205 A, when the degree of correlation between a pair of data is low and there is no drop in the correlation amount C (k) between the shift ranges k _{min to} k _max of the image shift amount k In such a case, it is determined that the focus cannot be detected.

When it is determined that the calculated image shift amount ks is reliable, the image shift amount shft is converted by the equation (6). In equation (6), the detection pitch PY has a size twice as large as the pixel pitch of the focus detection pixels.
shft = PY × ks (6)

The image shift amount shft calculated by Expression (6) is multiplied by a predetermined conversion coefficient Kd to convert it to a defocus amount def. The conversion coefficient Kd corresponds to the opening angle of the pair of light beams received by the focus detection pixel, and corresponds to a value obtained by dividing the distance measuring pupil distance described above by the center of gravity distance between the pair of distance measuring pupils.
def = Kd × shft (7)

  As described above, in the present invention, high-luminance object information is detected, ghost information is estimated based on the high-luminance object information, and focus detection operation is controlled based on the ghost information. Therefore, even when a ghost occurs, it is possible to prevent the focus detection operation from being disabled or the focus adjustment operation from malfunctioning due to an increase in the error of the focus detection result.

---- Modified example ---
(1) In the operation flowchart of FIG. 5 described in the above-described embodiment, the focus detection operation in the focus detection area located in the vicinity of the ghost occurrence position is prohibited, but after performing the focus detection operation, The focus adjustment operation according to the focus detection result may be prohibited.

(2) In the operation flowchart of FIG. 5 described in the above-described embodiment, the focus detection operation in the focus detection area located in the vicinity of the ghost occurrence position is uniformly prohibited. However, when the ghost luminance is a predetermined ratio (for example, 10%) or less as compared with the luminance around the ghost, the focus detection may be permitted because the influence of the ghost is small.

(3) In the operation flowchart of FIG. 5 described in the above-described embodiment, when the selected focus detection area is located in the vicinity of the ghost generation position, the focus detection operation in the focus detection area is prohibited. Yes. However, the focus detection operation may be performed by automatically switching to a focus detection area in the vicinity of the selected focus detection area that is not affected by a ghost.

(4) In the operation flowchart of FIG. 5 described in the above-described embodiment, the focus detection operation in the focus detection area located in the vicinity of the ghost occurrence position is prohibited, but the correlation calculation in the focus detection process described above. The expression may be changed from the expression (1) to another arithmetic expression.

  In the focus detection process in the focus detection area located in the vicinity of the ghost generation position, the pair of images detected by the focus detection pixels may be affected by the ghost and the light amount balance may be lost. Therefore, as a correlation calculation expression in the focus detection process, for example, Expression (8) is used in order to perform a correlation calculation that can maintain the image shift detection accuracy with respect to the loss of the light amount balance as compared with Expression (1).

That is, for a pair of data strings (A1 _{1 to} A1 _M , A2 _{1 to} A2 _M : M is the number of data) read out from the focus detection pixel string, disclosed in Japanese Patent Application Laid-Open No. 2007-333720 is shown below. The correlation amount C (k) is calculated using the correlation calculation formula (8).
C (k) = Σ | A1 n × A2 n + 1 + k -A2 n + k × A1 n + 1 | ··· (8)

In equation (8), Σ operations are accumulated for n. The range taken by n is limited to the range in which the data of A1 _n , A1 _{n + 1} , A2 _{n + k} , A2 _{n + 1 + k} exists according to the image shift amount k. The image shift amount k is an integer and is a relative shift amount with the data interval of the data string as a unit.

(5) In the above-described embodiment, exposure control may be performed by changing the charge accumulation time of the image sensor 212, or by changing the gain of the image sensor 212 or by changing the aperture diameter of the diaphragm. Exposure control can be performed.

(6) In the above-described embodiment, the exposure operation for high brightness detection is performed at a rate of once per several times of the normal exposure operation performed at a constant cycle. However, when the image sensor 212 having a large dynamic range is used or when high detection accuracy is not required for high-brightness object detection, high-brightness object detection can also be performed from the captured image obtained by the normal exposure operation.

(7) In the above-described embodiment, the focus detection area for performing focus detection is manually selected by the user. However, the present invention is not limited to this. For example, a specific image pattern (for example, a human face image) is detected from the entire image by image processing, and one or more focus detection areas are automatically selected according to the position of the specific image pattern. May be. Alternatively, focus detection may be performed simultaneously in a plurality of focus detection areas in the first step when the power is turned on, and one focus detection area may be automatically selected according to the obtained plurality of focus detection results. For example, it is possible to select a focus detection area that gives the closest result among a plurality of focus detection results.

(8) In the embodiment described above, the focus detection operation is changed depending on whether or not the focus detection area selected from the plurality of focus detection areas is in the vicinity of the ghost occurrence position. It is not limited to this. Even when only one focus detection area is provided, for example, when only the focus detection area 1613 at the center of the screen in FIG. 2 is provided, the effect of the present invention can be obtained.

(9) In the partially enlarged view of the image sensor 212 shown in FIGS. 3 and 4, an example including a pair of focus detection pixels 313 and 314 and a pair of focus detection pixels 315 and 316 each having one photoelectric conversion unit. Although shown, a pair of photoelectric conversion units may be provided in one focus detection pixel. FIGS. 15 and 16 are partial enlarged views of the image sensor 212 corresponding to FIGS. 3 and 4. The focus detection pixel 311 includes a pair of photoelectric conversion units 13 and 14, and the focus detection pixel 312 includes a pair of photoelectric conversion units 15. , 16.

  The focus detection pixel 311 shown in FIG. 15 performs a function corresponding to the pair of the focus detection pixel 313 and the focus detection pixel 314 shown in FIG. 3, and the focus detection pixel 312 shown in FIG. 16 is the focus detection pixel shown in FIG. It performs a function corresponding to a pair of 315 and the focus detection pixel 316. As shown in FIGS. 15 and 16, the focus detection pixels 311 and 312 include the microlens 10 and a pair of photoelectric conversion units 13 and 14 or a pair of photoelectric conversion units 15 and 16. A white filter is disposed in the focus detection pixels 311 and 312. The white filter has a spectral sensitivity characteristic that combines the spectral sensitivity characteristic of a photodiode that performs photoelectric conversion and the spectral sensitivity characteristic of an infrared cut filter (not shown). That is, the focus detection pixels 311 and 312 exhibit spectral sensitivity characteristics that are obtained by adding the spectral sensitivity characteristics of the green pixel, the red pixel, and the blue pixel. The light wavelength region exhibiting high sensitivity includes light wavelength regions in which each color filter exhibits high sensitivity in each of the green pixel, the red pixel, and the blue pixel.

(10) In the image pickup device according to the above-described embodiment, an example in which the focus detection pixel includes a white filter has been described. However, the present invention is also applied to a case where the same color filter as the image pickup pixel (for example, a green filter) is provided. can do.

  For example, only the focus detection pixels 312 shown in FIG. 16 may be two-dimensionally arranged to form the image sensor 212, and color filters arranged in a Bayer arrangement may be provided on the two-dimensionally arranged focus detection pixels 312. In such a configuration, data equivalent to that of the imaging pixel 310 can be calculated by adding data of the pair of photoelectric conversion units 15 and 16 of the focus detection pixel 312 during imaging. At the same time, by performing correlation calculation between the focus detection pixels 312 of the same color at the time of focus detection, it is possible to obtain a focus detection result for each color, and focus detection is possible even when there is no contrast only with luminance. become.

(11) In the embodiment described above, the spectral sensitivity of the focus detection pixel is set so as to cover the entire visible light wavelength region, but the spectral sensitivity of the focus detection pixel is not limited to this. . For example, the spectral sensitivity of the focus detection pixel can be set to the same spectral sensitivity as that of the green pixel.

(12) In the above-described embodiment, the focus detection operation in the focus detection area located in the vicinity of the ghost occurrence position is uniformly prohibited. However, when the spectral sensitivity of the focus detection pixel corresponds to a specific color (for example, green) as in Modification (10), the color of the high-luminance object image is detected in the detection of the high-luminance object image, The focus detection operation may be controlled according to the color. For example, even if an affirmative determination is made in step S250 of FIG. 2, if the color of the high-luminance object image deviates from the spectral sensitivity of the focus detection pixel, the process proceeds to step S270 to perform the focus detection operation and is not deviated. In this case, the process proceeds to step S260 to prohibit the focus detection operation.

(13) In the above-described embodiment, high-luminance object image detection or ghost information estimation is performed depending on the determination result of whether or not a saturated region exists in the image obtained in the previous frame in step S120 in FIG. Not done. However, if an affirmative determination is made in step S110 in FIG. 5, high-luminance object image detection or ghost information estimation may be performed.

(14) In the above-described embodiment, a CCD image sensor, a CMOS image sensor, or the like can be used as the image sensor.

(15) The present invention is not limited to an image sensor provided with a focus detection pixel for pupil division type phase difference detection, and can also be applied to an image sensor provided with a focus detection pixel used for so-called contrast detection.

(16) In the imaging device according to the above-described embodiment, an example in which the imaging pixel includes a Bayer array color filter is shown, but the configuration and the array of the color filter are not limited to this. For example, the present invention can be applied to an arrangement other than the arrangement of complementary color filters (green: G, yellow: Ye, magenta: Mg, cyan: Cy) or a Bayer arrangement. Further, the present invention can also be applied to a monochrome image sensor that does not include a color filter.

(17) The imaging device is not limited to a digital camera having a configuration in which an interchangeable lens is attached to the camera body as described above. For example, the present invention can be applied to a lens-integrated digital camera or video camera. Furthermore, the present invention can be applied to a small camera module built in a mobile phone, a surveillance camera, a visual recognition device for a robot, an in-vehicle camera, and the like.

10 microlens, 11, 13, 14, 15, 16 photoelectric conversion unit,
100 shooting screen,
101 imaging surface, 110 lens, 120 rays,
125, 145, 1101, 1102 points, 130, 140 reflected rays,
150, 151, 152 straight line,
201 digital camera, 202 interchangeable lens, 203 camera body,
204 mount unit, 206 lens drive control device,
208 zooming lens, 209 lens, 210 focusing lens,
211 Aperture, 212 Image sensor, 213 Electrical contact,
214 body drive control device,
215 liquid crystal display element driving circuit, 216 liquid crystal display element, 217 eyepiece,
219 memory card, 220 operation member, 221 AD converter,
310 imaging pixels,
311, 312, 313, 314, 315, 316 focus detection pixel,
800, 1000 screens, 810 people, 820 mountains, 830 sky, 840 sun,
900, 910, 920, 930, 940, 1400, 1500 region,
1601, 1602, 1603, 1604, 1605, 1606, 1607, 1608, 1609, 1610, 1611, 1612, 1613, 1614, 1615, 1616, 1617, 1618, 1619, 1620, 1621, 1622, 1623, 1624, 1625 Detection area,
2141 exposure control function unit, 2142 focus detection function unit, 2143 focus adjustment function unit,
2144 inter-control device communication function unit, 2145 display control function unit,
2146 recording control function unit, 2147 image signal readout function unit,
2148 shooting function unit, 2149 image signal processing function unit,
2150 high brightness object information detection function unit, 2151 ghost information estimation function unit,
2152 focus detection operation determination function unit,
2160 Display screen

Claims (11)

An imaging pixel that outputs an imaging signal and a focus detection pixel that receives a pair of light beams that have passed through a pair of regions of the pupil of the imaging optical system and outputs the first and second data strings are two-dimensionally mixed. An image sensor arranged
A focus detection unit that calculates a defocus amount by performing a first correlation calculation or a second correlation calculation on the first and second data strings in the focus detection area set on the imaging surface;
A high-luminance object image position detection unit that detects a position of a high-luminance object image on the imaging surface based on the imaging signal;
A ghost position estimating unit that estimates a position of a ghost formed corresponding to the high-luminance object image based on the position of the high-luminance object image;
The focus detection unit performs the first correlation calculation when the position of the focus detection area is not included in the vicinity of the ghost position estimated by the ghost position estimation unit , and the position of the focus detection area is An imaging apparatus that performs the second correlation calculation when included in the vicinity of the ghost position estimated by a ghost position estimation unit . An imaging device having focus detection pixels that receive a pair of light beams that have passed through a pair of regions of the pupil of the photographing optical system and output the first and second data strings;
A focus detection unit that calculates a defocus amount by performing a first correlation calculation or a second correlation calculation on the first and second data strings in the focus detection area set on the imaging surface;
A high-brightness object image position detection unit that detects the position of the high-brightness object image on the imaging surface;
A ghost position estimating unit that estimates a position of a ghost formed corresponding to the high-luminance object image based on the position of the high-luminance object image;
The focus detection unit performs the first correlation calculation when the position of the focus detection area is not included in the vicinity of the ghost position estimated by the ghost position estimation unit, and the position of the focus detection area is An imaging apparatus that performs the second correlation calculation when included in the vicinity of the ghost position estimated by a ghost position estimation unit . The imaging device according to claim 1 or 2,
In the first correlation calculation, the difference between the first data in the first data string and the second data in the second data string is determined while relatively shifting the first and second data strings. The integrated value of
The second correlation calculation includes two first data in the first data string and two second data in the second data string while relatively shifting the first and second data strings. Integration of the difference between the product of one of the two first data and one of the two second data and the product of the other of the two first data and the other of the two second data An imaging device characterized by calculating a value . In the imaging device according to any one of claims 1 to 3,
  A plurality of the focus detection pixels are arranged in the focus detection area to form a focus detection pixel row,
  The focus detection pixel column outputs the first and second data columns, and the imaging apparatus is characterized in that: In the imaging device according to claim 4 which cites claim 1 or claim 1 ,
The high-luminance object image position detection unit is configured to detect the high-luminance object based on the imaging signal at a first exposure amount for obtaining a captured image and the imaging signal at a second exposure amount that is smaller than the first exposure amount. An image pickup apparatus for detecting a position of an image. The imaging device according to any one of claims 1 to 5 ,
The ghost position estimation unit estimates the position of the ghost on a straight line connecting the position of the high-luminance object image and the intersection of the imaging surface and the optical axis of the photographing optical system. . The imaging apparatus according to any one of claims 1 to 6 ,
The imaging apparatus according to claim 1, wherein the ghost position estimation unit estimates the position of the ghost based on information relating to a configuration of the photographing optical system. The imaging device according to any one of claims 1 to 7 ,
An imaging apparatus, further comprising: a ghost luminance estimation unit that estimates a ghost luminance of the ghost based on a luminance of the high luminance object image. The imaging device according to any one of claims 1 to 8 ,
A focus adjustment unit that performs a focus adjustment operation based on the defocus amount ;
The focus adjustment unit performs the focus adjustment operation when the position of the focus detection area is not included in the vicinity of the ghost position estimated by the ghost position estimation unit ,
The operation of the focus detection unit is prohibited when the position of the focus detection area is included in the vicinity of the ghost position estimated by the ghost position estimation unit . In the imaging device according to claim 1 or 5 ,
The image processing apparatus includes a display unit that displays a captured image based on the captured image signal, and displays the position of the focus detection area and the position of the ghost estimated by the ghost position estimation unit while being superimposed on the captured image. An imaging device. An imaging device having a focus detection pixel that receives a pair of light beams that have passed through a pair of regions of a pupil of a photographing optical system and outputs a pair of focus detection signals;
A selection unit that selects a predetermined focus detection area from a plurality of focus detection areas set on the imaging surface;
A focus detection unit that calculates a defocus amount based on the pair of focus detection signals in the predetermined focus detection area selected by the selection unit;
A high-brightness object image position detection unit that detects the position of the high-brightness object image on the imaging surface;
A ghost position estimation unit that estimates a position of a ghost formed corresponding to the high-luminance object image based on the position of the high-luminance object image;
When the position of the predetermined focus detection area is included in the vicinity of the ghost position estimated by the ghost position estimation unit, the predetermined focus detection area is changed to a focus detection area not included in the vicinity of the ghost position. A change unit, and
The focus detection unit is based on the pair of focus detection signals in the predetermined focus detection area when the position of the predetermined focus detection area is not included in the vicinity of the ghost position estimated by the ghost position estimation unit. A defocus amount is calculated, and when the position of the predetermined focus detection area is included in the vicinity of the ghost position estimated by the ghost position estimation unit, the pair of pairs in the focus detection area changed by the change unit An image pickup apparatus that calculates a defocus amount based on a focus detection signal .

Images