JP2015142364A5

JP2015142364A5 -

Info

Publication number: JP2015142364A5
Application number: JP2014016193A
Authority: JP
Filing date: 2014-01-30
Publication date: 2017-03-02
Anticipated expiration: 2034-01-30

Description

上記目的を達成するために、撮像光学系の射出瞳の異なる領域を透過した光束をそれぞれ光電変換して信号を出力する複数の光電変換部と、前記複数の光電変換部に対応する１つのマイクロレンズとからなる、複数の単位画素を有する撮像手段から得られた信号を処理する本発明の画像処理装置は、前記複数の光電変換部それぞれから出力された信号が飽和しているかどうかを判定する判定手段と、前記複数の光電変換部のうち、前記判定手段により飽和していると判定された信号を出力した第１の光電変換部と同じマイクロレンズに対応する他の光電変換部である第２の光電変換部から出力された信号を補正する際の補正の特性と前記第２の光電変換部から出力された信号のレベルに基づいて、前記第１の光電変換部から出力された信号が飽和していない場合に得られる補正後の信号レベルを推定する推定手段とを有する。 In order to achieve the above object, a plurality of photoelectric conversion units for photoelectrically converting light beams transmitted through different regions of the exit pupil of the imaging optical system and outputting signals, and one micro corresponding to the plurality of photoelectric conversion units An image processing apparatus according to the present invention that processes a signal obtained from an imaging unit that includes a plurality of unit pixels and that determines whether a signal output from each of the plurality of photoelectric conversion units is saturated. and determining means, said plurality of photoelectric conversion unit is the other of the photoelectric conversion unit corresponding to the same microlens as the first photoelectric conversion unit outputting the have the determine the constant signal is saturated by the determination unit A signal output from the first photoelectric conversion unit based on correction characteristics when correcting the signal output from the second photoelectric conversion unit and the level of the signal output from the second photoelectric conversion unit But And a estimation means for estimating a signal level after correction obtained when no sum.

Claims

A plurality of units comprising a plurality of photoelectric conversion units that photoelectrically convert light beams transmitted through different regions of the exit pupil of the imaging optical system and output signals, and one microlens corresponding to the plurality of photoelectric conversion units An image processing apparatus for processing a signal obtained from an imaging means having pixels,
Determination means for determining whether signals output from each of the plurality of photoelectric conversion units are saturated;
Among the plurality of photoelectric conversion unit, second photoelectric is another photoelectric conversion unit corresponding to the same microlens as the first photoelectric conversion unit outputting the have the determine the constant signal is saturated by the determination unit The signal output from the first photoelectric conversion unit is saturated based on the correction characteristics when correcting the signal output from the conversion unit and the level of the signal output from the second photoelectric conversion unit. An image processing apparatus comprising: an estimation unit configured to estimate a signal level after correction obtained when no signal is present.

The determining means further determining whether said first signal output from the other photoelectric conversion units corresponding to the same microlens as the photoelectric conversion portion is saturated, and less than a predetermined threshold value The estimation unit performs the estimation using a photoelectric conversion unit that is not saturated as a result of the determination and that is equal to or greater than the threshold value as the second photoelectric conversion unit. The image processing apparatus described.

Said estimating means, a result of the determination, the other or the photoelectric conversion portion are all saturated, or if all smaller than the threshold value, among the other photoelectric conversion section, an output from the slowest photoelectric conversion portion The image processing apparatus according to claim 2, wherein the estimation is performed on the basis of a correction characteristic when correcting the detected signal and a signal level when the photoelectric conversion unit is saturated.

Obtaining means for obtaining photographing conditions when photographing is performed by the imaging means;
The image processing apparatus according to claim 1, further comprising: a storage unit that stores the correction characteristics for different shooting conditions.

A plurality of units comprising a plurality of photoelectric conversion units that photoelectrically convert light beams transmitted through different regions of the exit pupil of the imaging optical system and output signals, and one microlens corresponding to the plurality of photoelectric conversion units An image processing apparatus for processing a signal obtained from an imaging means having pixels,
Determination means for determining whether signals output from each of the plurality of photoelectric conversion units are saturated;
Among the plurality of photoelectric conversion unit, corresponding to the first and sensitivity of the photoelectric conversion unit, the same microlens with the first photoelectric conversion section which outputs the signal determine the constant when saturated by the determination unit Based on the difference from the sensitivity of the second photoelectric conversion unit that is another photoelectric conversion unit, the signal output from the first photoelectric conversion unit and the signal output from the second photoelectric conversion unit An image processing apparatus comprising: a correction unit that corrects a signal output from the first photoelectric conversion unit so that the difference maintains the difference in sensitivity.

Among the plurality of photoelectric conversion unit, and sensitivity of the first photoelectric conversion unit, based on the difference between the sensitivity of the second photoelectric conversion unit, and a signal output from the first photoelectric conversion unit, Correction means for correcting the signal output from the first photoelectric conversion unit so that the difference from the signal output from the second photoelectric conversion unit maintains the difference in sensitivity;
The correction when it is determined that a parallax between a plurality of images obtained from a signal output from a photoelectric conversion unit arranged at the same position of the plurality of unit pixels is larger than a predetermined first condition. And selecting means for selecting the estimation means when it is determined that the parallax is smaller than a predetermined second condition. The image processing apparatus according to item.

Obtaining means for obtaining an aperture value and a focal length when photographing is performed by the imaging means;
Detecting means for detecting the degree of focus of the photographed image;
The selection unit is configured such that when the aperture value is greater than or equal to a predetermined first threshold, and when the focal length is equal to or less than a predetermined second threshold, the degree of focus is determined in advance . If less than the threshold, it is determined that the parallax is small, the aperture value is smaller than the first threshold value, if the focal length is longer than the second threshold value, and the aperture value of the first The image processing apparatus according to claim 6, wherein the parallax is determined to be large when the degree of focus is smaller than a threshold value and the focus degree is lower than the third threshold value.

Among the plurality of photoelectric conversion unit, and sensitivity of the first photoelectric conversion unit, based on the difference between the sensitivity of the second photoelectric conversion unit, and a signal output from the first photoelectric conversion unit, Correction means for correcting the signal output from the first photoelectric conversion unit so that the difference from the signal output from the second photoelectric conversion unit maintains the difference in sensitivity;
The correction is performed when it is determined that the luminance difference between the plurality of images obtained from the signals output from the photoelectric conversion units arranged at the same positions of the plurality of unit pixels is larger than a predetermined first condition. And selecting means for selecting the estimation means when it is determined that the brightness difference is smaller than a second condition determined in advance. The image processing apparatus according to item 1.

An analysis means for analyzing the scene of the photographed image;
The said selection means judges that the said brightness | luminance difference is large when the said image is a backlight or a night view, and judges that the said brightness | luminance difference is small otherwise. Image processing device.

The image processing apparatus according to claim 1, further comprising an adding unit that adds the signals output from the plurality of photoelectric conversion units for each unit pixel.

The image processing apparatus further includes a focus detection unit configured to form a plurality of images from signals output from the photoelectric conversion units arranged at the same positions of the plurality of unit pixels, and to perform focus detection based on a correlation value between the plurality of images. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

The imaging means;
An imaging apparatus comprising: the image processing apparatus according to claim 1.

A plurality of units comprising a plurality of photoelectric conversion units that photoelectrically convert light beams transmitted through different regions of the exit pupil of the imaging optical system and output signals, and one microlens corresponding to the plurality of photoelectric conversion units An image processing method for processing a signal obtained from an imaging means having pixels,
A determination step for determining whether a signal output from each of the plurality of photoelectric conversion units is saturated;
Estimating means, said plurality of photoelectric conversion unit, are the determining step further photoelectric conversion unit corresponding to the same microlens as the first photoelectric conversion unit outputting the have the determine the constant signal is saturated by A signal output from the first photoelectric conversion unit based on correction characteristics when correcting the signal output from the second photoelectric conversion unit and the level of the signal output from the second photoelectric conversion unit And an estimation step for estimating a corrected signal level obtained when is not saturated.

A plurality of units comprising a plurality of photoelectric conversion units that photoelectrically convert light beams transmitted through different regions of the exit pupil of the imaging optical system and output signals, and one microlens corresponding to the plurality of photoelectric conversion units An image processing method for processing a signal obtained from an imaging means having pixels,
A determination step for determining whether a signal output from each of the plurality of photoelectric conversion units is saturated;
Correction means, said plurality of photoelectric conversion unit, said the decision process is saturated by the sensitivity of the first photoelectric conversion unit outputting the determine the constant signal, the same micro the first photoelectric conversion unit Based on the difference from the sensitivity of the second photoelectric conversion unit, which is another photoelectric conversion unit corresponding to the lens, the signal output from the first photoelectric conversion unit and the second photoelectric conversion unit And a correction step of correcting the signal output from the first photoelectric conversion unit so that the difference from the detected signal maintains the difference in sensitivity.

Correction means, said plurality of photoelectric conversion unit, and sensitivity of the first photoelectric conversion unit, based on the difference between the sensitivity of the second photoelectric conversion unit is output from said first photoelectric conversion portion A correction step of correcting the signal output from the first photoelectric conversion unit so that the difference between the received signal and the signal output from the second photoelectric conversion unit maintains the difference in sensitivity,
When the selection unit determines that the parallax between the plurality of images obtained from the signal output from the photoelectric conversion unit arranged at the same position of the plurality of unit pixels is larger than the predetermined first condition The selection step of selecting the estimation step when the correction step is selected and it is determined that the parallax is smaller than a predetermined second condition. Image processing method.

Correction means, said plurality of photoelectric conversion unit, and sensitivity of the first photoelectric conversion unit, based on the difference between the sensitivity of the second photoelectric conversion unit is output from said first photoelectric conversion portion A correction step of correcting the signal output from the first photoelectric conversion unit so that the difference between the received signal and the signal output from the second photoelectric conversion unit maintains the difference in sensitivity,
When the selection unit determines that the luminance difference between the plurality of images obtained from the signals output from the photoelectric conversion units arranged at the same position of the plurality of unit pixels is larger than the first condition determined in advance. The method further comprises a selection step of selecting the correction step and selecting the estimation step when it is determined that the brightness difference is smaller than a predetermined second condition. The image processing method as described.

The program for functioning a computer as each means of the image processing apparatus of any one of Claims 1 thru | or 11.

A computer-readable storage medium storing the program according to claim 17.