CN102957846A - Image processing method, image processing apparatus and image pickup apparatus - Google Patents
Image processing method, image processing apparatus and image pickup apparatus Download PDFInfo
- Publication number
- CN102957846A CN102957846A CN2012102985846A CN201210298584A CN102957846A CN 102957846 A CN102957846 A CN 102957846A CN 2012102985846 A CN2012102985846 A CN 2012102985846A CN 201210298584 A CN201210298584 A CN 201210298584A CN 102957846 A CN102957846 A CN 102957846A
- Authority
- CN
- China
- Prior art keywords
- image
- input picture
- filter
- frequency
- frequency band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 85
- 238000003672 processing method Methods 0.000 title claims abstract description 16
- 230000003287 optical effect Effects 0.000 claims abstract description 94
- 238000012546 transfer Methods 0.000 claims abstract description 54
- 238000000034 method Methods 0.000 claims abstract description 23
- 238000011084 recovery Methods 0.000 claims description 84
- 230000008859 change Effects 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 230000005693 optoelectronics Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 abstract description 5
- 230000006870 function Effects 0.000 description 88
- 230000004075 alteration Effects 0.000 description 14
- 238000003860 storage Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 239000004065 semiconductor Substances 0.000 description 3
- 230000006866 deterioration Effects 0.000 description 2
- 230000004907 flux Effects 0.000 description 2
- 230000001915 proofreading effect Effects 0.000 description 2
- 108010022579 ATP dependent 26S protease Proteins 0.000 description 1
- 101100419874 Caenorhabditis elegans snr-2 gene Proteins 0.000 description 1
- 206010010071 Coma Diseases 0.000 description 1
- 201000009310 astigmatism Diseases 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000023886 lateral inhibition Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
- H04N25/615—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4" involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20048—Transform domain processing
- G06T2207/20056—Discrete and fast Fourier transform, [DFT, FFT]
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention refers to an image processing method, an image processing apparatus and an image pickup apparatus. The image processing method acquires an input image and information (S11,S12) on an image capturing condition, acquires an optical transfer function (S13) corresponding to the image capturing condition, calculates a specific frequency (S14) at which an index value obtained by using the optical transfer function becomes a predetermined value in each azimuth direction, and produces a window function to divide a frequency band of the input image into lower and higher frequency side bands (S15) than the specific frequency in each azimuth direction. Then, the method produces, by using the window function and the optical transfer function, an image restoration filter to perform the image restoration process on the lower frequency side band of the input image and to restrict the image restoration process on the higher frequency side band thereof, and performs the image restoration process (S160 using the image restoration filter.
Description
Technical field
The present invention relates to for the carries out image Recovery processing to proofread and correct (reducing) by the deteriorated image processing techniques of the image of image pick-up device generation.
Background technology
The image of catching that is produced by the image pick-up device such as digital camera comprises fuzzy component, and described fuzzy component is the image deterioration component that is caused by, the filed curvature poor such as spherical aberration, intelligent image of image capture optical system (being called hereinafter " optical system " for short) and the various aberrations the astigmatism.It is because the luminous flux of launching from a point of object forms the image with some divergence at the image pickup surface of imageing sensor that fuzzy component like this is generated, and in the situation that do not have aberration or the described luminous flux of diffraction usually to converge to a point.
The fuzzy component here optically is expressed as point spread function (PSF), and from by defocusing cause fuzzy different.In addition, because poor between the fuzzy fog-level that can be considered to each color wavelength of the color in the coloured image that the longitudinal chromatic aberration of optical system, spherochromatism (chromatic spherical aberration) or look coma (chromatic comatic aberration) generate.In addition, the horizontal color displacement that is caused by the ratio chromatism, of optical system can be considered to the position skew or the phase deviation that cause owing to the difference to the image capture multiplying power of each optical wavelength.
The Fourier transform of point spread function (PSF) provides and has illustrated about the frequency component information of aberration and the optical transfer function (OTF) of expressing by plural number.The absolute value of this optical transfer function (OTF) (being amplitude components) is called as modulation transfer function (MTF), and phase component is called as phase transfer function (PTF).MTF and PTF represent respectively because the amplitude components of the image deterioration that aberration causes and the frequency characteristic of phase component.In the following description, phase component is expressed as phase angle by following formula, and wherein Re (OTF) and Im (OTF) represent respectively real part and the imaginary part of OTF.
PTF=tan
-1[Im(OTF)/Re(OTF)]
As mentioned above, the optical transfer function (OTF) of optical system has produced deteriorated to the amplitude components of image and phase component, so that comprise poor asymmetric fuzzy of similar intelligent image at the deteriorated image in the each point place of object.
As the deteriorated method that is used for proofreading and correct at deteriorated image (input picture) the deteriorated and phase component (PTF) of such amplitude components (MTF), the method for the information that known use is relevant with the optical transfer function (OTF) of optical system.The method is called as " image recovery " or " image restoration ", and hereinafter, is called as " image Recovery processing " by the processing of using the information relevant with the optical transfer function (OTF) of optical system to proofread and correct deteriorated image.A kind of as in the image Recovery processing, known a kind of convolution method, this convolution method are carried out the image recovery filter of the contrary characteristic with optical transfer function to the convolution of the input picture in the real space (real space).
For carries out image Recovery processing effectively, need to obtain the more accurately OTF of optical system.For example, the information relevant with the design load of optical system makes it possible to calculate OTF.In addition, the intensity distributions execution Fourier transform of catching in the image of point-source of light made it possible to calculate OTF.
Except the OTF that designs and manufacture the ordinary optical system the OTF with extremely high performance optical system depends on picture altitude (position in the input picture) and significant change.Therefore, for to input picture carries out image Recovery processing highly precisely, need to use based on OTF and depend on the variation of picture altitude and the image that produces recovers filter.In order to change the image recovery characteristics according to picture altitude, wish that the variation that recovers filter along with image in the real space comes the carries out image Recovery processing.
Japanese Patent Laid-Open No.2007-183842 discloses a kind of image processing method, the degree that the method comes the control chart picture to recover with the control parameter, thus change continuously the degree that image recovers.
Yet, depend on characteristic or the image capture conditions of the lens in the optical system, may appear in the Nyquist frequency band of imageing sensor MTF and fall zero or approach zero situation.Hereinafter, MTF falls zero or approach and zero be called as " withered and fallen enter ", and the withered and fallen frequency that enters to occur is called as " withered and fallen enter frequency " hereinafter.
Withered and fallenly enter by aberration or diffraction and cause.In addition, withered and fallenly enter also by the user's who uses image pick-up device hand shake and cause.Figure 12 A shows the withered and fallen example that enters, transverse axis representation space frequency wherein, and the longitudinal axis represents MTF.Occured withered and fallenly to enter by the frequency place of downward arrow indication in the drawings, this frequency is the withered and fallen frequency that enters.
The absolute value that Wei Na (Wiener) filter that is generally used for the image Recovery processing provides the image shown in Figure 12 B to recover the frequency characteristic (recovery gain characteristic) of filter, transverse axis representation space frequency wherein, the longitudinal axis represents to recover gain.Will after Weiner filter is described in detail.
In Figure 12 B, in the low frequency side frequency band of the frequency of being indicated by downward arrow, obtaining to amplify, and in the high frequency side frequency band of this frequency, obtaining the low pass filter effect.This recovery gain characteristic provides to be had profile in the real space shown in Figure 12 C the image of (coefficient of each position (tap) in the filter) recovers filter.Use this image to recover to produce in the high frequency details of image Recovery processing in input picture of filter fuzzy.
In addition, Figure 13 A to 13C shows another example.Transverse axis among Figure 13 A represents until the frequency of the sample frequency of nyquist frequency twice.Figure 13 B shows the recovery gain characteristic that image recovers filter, and Figure 13 C shows the profile of image recovery filter in the real space.In Figure 13 C, a plurality of positions of coefficient value in narrow position range that image recovers filter acutely change.
There is following situation, namely, when the PSF of the PSF that makes input picture owing to the foozle of optical system or the luminance saturation in the input picture etc. and optical system not simultaneously, in the result images (Recovery image) of image Recovery processing, generate the pseudomorphism such as ringing (ringing).In this case, the image recovery filter shown in Figure 13 C becomes responsive for the difference of PSF, and easily generates pseudomorphism.
Thereby, in order to obtain the high definition Recovery image, prevent that the withered and fallen measure that enters is extremely important.
Although the degree that disclosed image processing method can the control chart picture recovers in Japanese Patent Laid-Open No.2007-183842, the method allow the user to change the degree that image recovers, can not enter frequency and change the characteristic that image recovers filter according to withered and fallen.Therefore, disclosed method can reduce degree that image recovers suppressing owing to the withered and fallen pseudomorphism that enters to cause in Japanese Patent Laid-Open No.2007-183842, but the high definition Recovery image can not be provided.
Summary of the invention
Even the invention provides the image processing techniques that the high definition Recovery image still is provided when MTF withered and fallen enters to exist.
As one aspect of the present invention, the invention provides a kind of for the image processing method to the input picture carries out image Recovery processing that produced by image pick-up device.The method comprises: the step of obtaining the input picture information relevant with the image capture conditions when producing input picture in image pick-up device, obtain the step with the optical transfer function of image pick-up device corresponding to the information relevant with image capture conditions, calculate the step that becomes the characteristic frequency of predetermined value by the desired value of using optical transfer function to obtain at each azimuth direction, produce window function take with the frequency band division of input picture as the step than lower frequency side frequency band and the high frequency side frequency band of the characteristic frequency of calculating at each azimuth direction, recover filter by using window function and optical transfer function to produce image, with the step of limited images Recovery processing on carries out image Recovery processing on the described lower frequency side frequency band of input picture and the described high frequency side frequency band at input picture, and use image to recover the step of filter carries out image Recovery processing.
As another aspect of the present invention, the invention provides a kind of image processing apparatus that is configured to the input picture carries out image Recovery processing that is produced by image pick-up device.This image processing apparatus comprises: the importation is configured to obtain the input picture information relevant with the image capture conditions when producing input picture in image pick-up device; Calculating section, be configured to obtain the optical transfer function with image pick-up device corresponding to the information relevant with image capture conditions, and be configured to calculate the characteristic frequency that becomes predetermined value by the desired value of using optical transfer function to obtain at each azimuth direction; The window function generating portion, be configured to produce window function take with the frequency band division of input picture as lower frequency side frequency band and high frequency side frequency band than the characteristic frequency of calculating at each azimuth direction; The filter generating portion, be configured to by using window function and optical transfer function, produce image and recover filter, with limited images Recovery processing on carries out image Recovery processing on the described lower frequency side frequency band of input picture and the described high frequency side frequency band at input picture; And the processing section, be configured to use image to recover filter carries out image Recovery processing.
As again one side of the present invention, the invention provides a kind of image pick-up device with above-mentioned image processing apparatus.
(with reference to the accompanying drawings) according to the following description to exemplary embodiment, other features of the present invention will become obvious.
Description of drawings
Fig. 1 is the flow chart of processing as the image of embodiments of the invention 1.
The image that will be used for the image Recovery processing during the image that Fig. 2 shows embodiment 1 is processed recovers filter.
The image that Fig. 3 shows among the embodiment 1 recovers the value of the tap in the filter.
Fig. 4 A and 4B show respectively before the image Recovery processing among the embodiment 1 and PSF afterwards.
Fig. 5 A and 5B show respectively before the image Recovery processing among the embodiment 1 and afterwards MTF and PTF.
Fig. 6 shows the MTF on the mutual different azimuth direction among the embodiment 1 and withered and fallenly enters frequency.
Fig. 7 shows the MTF on the mutually orthogonal azimuth direction among the embodiment 1 and withered and fallenly enters frequency.
Fig. 8 A to 8D shows the window function among the embodiment 1.
Fig. 9 A to 9C shows the characteristic of the image recovery filter among the embodiment 1.
Figure 10 A to 10C shows another characteristic of the image recovery filter among the embodiment 1.
Figure 11 is the block diagram that illustrates as the configuration of the image pick-up device of embodiments of the invention 2.
Figure 12 A to 12C shows the traditional images Recovery processing that uses Weiner filter.
Figure 13 A to 13C shows another traditional images Recovery processing that uses Weiner filter.
Embodiment
To describe hereinafter exemplary embodiment of the present invention with reference to the accompanying drawings.
At first, before describing specific embodiment, will be described the definition of the term that will use in an embodiment and the image Recovery processing of in an embodiment execution.
" input picture "
Input picture is the digital picture that produces by the image capture of being carried out by image pick-up device (that is, the output of the imageing sensor by using the object images that is formed by the image capture optical system from opto-electronic conversion).Imageing sensor is made of the photo-electric conversion element such as ccd sensor or cmos sensor.Digital picture is according to the optical transfer function (OTF) of image pick-up device (that is, being consisted of and comprised the image capture optical system of aberration by lens and various optical filter) and deteriorated.The image capture optical system can be made of the reflecting surface such as the speculum that has respectively curvature.In addition, the image capture optical system can by removably with image pick-up device attached (interchangeable).In image pick-up device, imageing sensor and by using the signal processor composing images capture systems that produces digital picture (input picture) from the output of imageing sensor.
Input picture has the information relevant with the color component such as R, G and B component.Except RGB, color component can also be by such as LCH(light, colourity and tone), YCbCr(brightness, blue poor and red poor), optional a kind of expression the in the general color space XYZ, Lab, Yuv and the JCh, perhaps can express by colour temperature.
Input picture and Recovery image (output image) can have the information relevant with the image capture conditions, image capture distance (object distance) etc. of image capture conditions, the focal length that comprises the image capture optical system and aperture value in the image pick-up device when producing input picture.Hereinafter, the information relevant with image capture conditions is called as " image capture conditions information ".In addition, input picture can have the various control informations that will be used for proofreading and correct input picture.
When the output input picture and image processing apparatus, during the carries out image Recovery processing, wish to add image capture conditions information and control information to input picture from image pick-up device to the image processing apparatus that separates with it.Not only can be by adding input picture to, and can by direct or indirect communication and by removably with the attached storage medium of these devices, image processing apparatus can receive image capture conditions information and control information from image pick-up device.
" image Recovery processing "
The overview of image Recovery processing is as follows.As g (x, y) expression input picture (deteriorated image), f (x, y) the non-deteriorated original image of expression, h (x, y) expression represents convolution and (x by right point spread function (PSF), the * of optical transfer function (OTF) formation Fourier, y) coordinate time in the expression input picture, following formula is set up:
g(x,y)=h(x,y)*f(x,y)。
Above-mentioned expression formula is converted to the form on two-dimentional frequency surface by Fourier transform, the following formula of the form of amassing is provided for each frequency:
G(u,v)=H(u,v)·F(u,v)
Wherein H represents the result of the Fourier transform of point spread function (PSF), in other words, optical transfer function (OTF), G and F represent respectively the result of the Fourier transform of g and h, the lip-deep coordinate of (u, v) two-dimentional frequency of expression, in other words, frequency.
Following both sides with above-mentioned expression formula provide original image divided by H from the deteriorated image that is produced by image pick-up device:
G(u,v)/H(u,v)=F(u,v)。
With F (u, v), namely G (u, v)/H (u, v) turns back to real surface the Recovery image of equal value with original image f (x, y) is provided by inverse Fourier transform.
When R represents H
-1Inverse Fourier transform as a result the time, shown in following formula, the image in the real surface is carried out process of convolution also makes it possible to provide original image:
g(x,y)*R(x,y)=f(x,y)。
This R (x, y) in the above-mentioned expression formula is that image recovers filter.When input picture was two dimensional image, it also was the two dimensional filter with tap (unit) usually that image recovers filter, and each tap is corresponding to each pixel of two dimensional image.In addition, the increase that image recovers the quantity of the tap (unit) in the filter usually improves image and recovers precision, thereby the aberration characteristic etc. that depends on desired picture quality, image-capable, image capture optical system arranges the realized quantity of tap.
Because image recovers filter and need to reflect at least aberration characteristic, thus image recover filter from the horizontal direction with vertical direction in each on to have a conventional edge enhancement filter (high pass filter) etc. of about three taps different.Produce image based on optical transfer function (OTF) and recover filter, it can highly precisely proofread and correct the deteriorated of the amplitude components of deteriorated image (input picture) and phase component.
In addition, because actual input picture (deteriorated image) comprises noise component(s), use the aforesaid image that produces from the complete inverse number of optical transfer function (OTF) to recover filter and not only recover deteriorated image, also obviously amplify noise component(s).This be because, be added in the amplitude of noise component(s) under the state of amplitude components of input picture, such image recovers filter modulation transfer function (MTF) (being the amplitude components of image capture optical system) is risen to 1 in whole frequency range.Although deteriorated corresponding MTF is returned to 1 with the amplitude of image capture optical system, the power spectrum of noise component(s) is promoted simultaneously, and this causes noise component(s) to be exaggerated according to the degree (namely recovering gain) of the lifting of MTF.
Therefore, the noise component(s) that is included in the input picture makes it possible to good Recovery image is provided as the image that is used for appreciating.This lifting of noise component(s) illustrates by following formula, and wherein N represents noise component(s):
G(u,v)=H(u,v)·F(u,v)+N(u,v)
G(u,v)/H(u,v)=F(u,v)+N(u,v)/H(u,v)。
As the method that is used for addressing this is that, the known Weiner filter of for example using following formula (1) to express, Weiner filter comes control chart as recovery extent according to the strength ratio (SNR) of picture signal and noise signal.
In above-mentioned expression formula (1), the frequency characteristic of M (u, v) expression Weiner filter, | H (u, v) | the absolute value (MTF) of expression optical transfer function (OTF).The method reduces to recover gain when MTF is low at each frequency place, in other words, increase when MTF is higher and recover gain.The MTF of general image capture optical system is high and low in the high-frequency side in the low frequency side, so that the method is finally recovered gain in the high-frequency lateral inhibition of picture signal.
The example of image recovery filter has been shown in Fig. 2 and 3.Recover filter for image, recover the quantity that precision is determined tap (unit) according to aberration characteristic and the desired image of image capture optical system.It is the two dimensional filter with 11 * 11 taps that image shown in Figure 2 recovers filter.Although Fig. 2 has omitted the value (coefficient value) of each tap, Fig. 3 shows the cross section that this image recovers filter, wherein shows the value (being also referred to as hereinafter " values of tap ") of tap by broken line.The distribution that recovers values of tap in the filter at image turns back to a point ideally for the signal value (PSF) that will spatially distribute owing to aberration.
Image Recovery processing carries out image is recovered the convolution of each values of tap on each pixel (corresponding to each tap) of input picture of filter.In convolution, in order to improve the signal value of the specific pixel in the input picture, this pixel matching is recovered the center tap of filter to image.Then, recover each of tap of filter for the pixel in the input picture and image to reply, the pixel signal values of calculating input image and image recover the product of the values of tap (coefficient value) of filter, and replace the signal value of the pixel corresponding with the center tap of filter with the summation of product.
With reference to Fig. 4 A, 4B, 5A and 5B the characteristic that the image in real space and the frequency space recovers is described.Fig. 4 A shows image and recovers PSF(point spread function before), Fig. 4 B shows image and recovers PSF afterwards.MTF after Fig. 5 A shows (a) image recovery MTF before and (b) image recovers.Fig. 5 B shows the PTF(phase transfer function of (a) image before recovering) and (b) image recover PTF afterwards.PSF before image recovers asymmetricly distributes, because asymmetry, PTF is along with frequency non-linearly changes.The image Recovery processing amplifies MTF and PTF is corrected to zero, becomes symmetrical and sharp-pointed so that image recovers PSF afterwards.
This image recovers filter and can obtain by the inverse Fourier transform based on the function of the inverse function design of the optical transfer function (OTF) of image capture optical system.The image that uses in an embodiment recovers filter and can at random change, and for example, Weiner filter can be recovered filter as image.In the situation that use Weiner filter, the image recovery filter that carries out convolution for the input picture at real space can produce by the inverse Fourier transform of expression formula (1).
In addition, even because image capture conditions is identical, and optical transfer function (OTF) still changes according to picture altitude (position in the input picture), therefore, the image that use recovers filter and changes according to picture altitude.
Will be described below specific embodiments of the invention.
[embodiment 1]
Fig. 1 is the flow chart as the process (image processing method) of the image processing of the first embodiment of the present invention (embodiment 1).According to the image processing program of the computer program of installing as the storage medium by such as semiconductor memory or CD, this image is processed by the computer that is made of CPU etc. and be included in the image processing apparatus and is carried out.
At step S11, computer obtains input picture (being also referred to as hereinafter " catching image ") from image pick-up device.Can be by the wired or wireless communication between image processing apparatus and the image pick-up device, perhaps by the storage medium such as semiconductor memory or CD, carry out and catch obtaining of image from image pick-up device.
Next, at step S12, computer obtains when image pick-up device carries out image capture the image capture conditions information of (, produce when catching image).As mentioned above, image capture conditions information comprises the additional identification information (Camera ID) such as focal length and the parameter the aperture value, image pickup distance and the image pick-up device of image capture optical system.When the image capture optical system was provided as Interchangeable lens, image capture conditions information comprised the identifying information (lens ID) of Interchangeable lens.The acquisition of information that provides to catching image is provided image capture conditions information, perhaps can obtain by wired or wireless communication or by storage medium.
Next, at step S13, controller obtains the optical transfer function corresponding to (being suitable for) image capture conditions.Can be by selecting corresponding to image capture conditions in a plurality of optical transfer functions pre-stored from be arranged on the inner or outside memory of image processing apparatus, perhaps by producing (calculating) optical transfer function according to the pre-stored function of the variable that the parameter with image capture conditions substitutes that comprises, and obtain optical transfer function.
The a plurality of optical transfer functions corresponding with the image capture conditions of selecting discretely can be stored in advance in the memory.In this case, when the image capture conditions of reality is different from the image capture conditions of storage, can calculate by using optical transfer function corresponding to two or more image capture conditions that approaches with the image capture conditions of reality to carry out interpolation, and produce the optical transfer function corresponding with actual image capture conditions.Discrete selection like this can reduce to be stored in the amount of the data of the optical transfer function in the memory.Can carry out interpolation by any means such as bilinear interpolation (linear content) or bicubic interpolation calculates.
Next, at step S14, computer obtains characteristic frequency, at this characteristic frequency place, becomes threshold value (predetermined value) by the desired value of using the optical transfer function acquisition of obtaining at step S13.This embodiment uses the absolute value (MTF) of optical transfer function (OTF) as desired value.Yet, can use any other desired value, as long as they are by using optical transfer function to obtain.Will after desired value is described in detail.
Next, at step S15, it is zero window function that computer is created in this characteristic frequency place value.Will after window function is described in detail.
Next, at step S16, computer recovers filter by produce image with optical transfer function and window function.Will after image is recovered filter generation be described in detail.
Next, at step S17, the computer carries out image is recovered filter to catching the convolution of image, namely to catching image carries out image Recovery processing, and it is carried out predetermined development treatment.Then, at step S18, computer is exported Recovery image as output image.
To be described in detail how obtaining characteristic frequency at step S14 place.Fig. 6 shows MTF(a), (b) and frequency characteristic (c).MTF(a shown in Figure 6), (b) and (c) by normalization, the nyquist frequency that 1 shown in wherein on the transverse axis determines as the pixel pitch by imageing sensor.MTF(a among Fig. 6), (b) and (c) show at the mutual example of the MTF on different three azimuth directions of the optical characteristics of image capture optical system.MTF(a) and (b) to become the frequency f a of threshold value t1 and fb be characteristic frequency on their corresponding orientation angular direction.MTF(c) do not become threshold value t1, therefore on its azimuth direction, do not have characteristic frequency.Can threshold value t1 be set arbitrarily according to purpose.For example, with characteristic frequency as the above-mentioned withered and fallen situation that enters frequency under, threshold value t1 is set to 0.Yet, for practical purpose, not exclusively be 0 but enough little MTF can be regarded as 0, so that threshold value t1 can be set to larger than 0 value, the MTF of 0.03(3% for example), and the MTF frequency that becomes this value can be defined as entering characteristic frequency corresponding to frequency with withered and fallen.
MTF along with frequency near situation about increasing 0 or reduce (situation about existing such as pseudo resolution), thereby exist MTF to change a plurality of frequencies that threshold value are converted to a side lower than this threshold value from a side higher than this threshold value.In this case, wish to use minimum in a plurality of frequencies one as characteristic frequency.
In addition, in the mutual different situation of the MTF on a plurality of azimuth directions as shown in Figure 6, also wish each azimuth direction is arranged mutually different characteristic frequency.In this case, the different characteristic frequency of each azimuth direction can be stored as function data or look-up table data.On the other hand, in the different characteristic frequency of each azimuth direction (for example, minimum) can be used as representative characteristic frequency.
Next, will be to being described in detail for generation of the processing that image recovers filter at step S16.The Weiner filter of being expressed by above-mentioned expression formula (1) in the following description, is used as recovering for designed image the exemplary basic function of filter.This is processed by using M (u, v) and window function W (u, v) in the expression formula (1) to produce the frequency characteristic M that image recovers filter according to following formula (2)
L(u, v).
M
L(u,v)=(M(u,v)-1)·W(u,v)+1（2）
Has frequency characteristic M
LThe image of (u, v) recovers only carries out image Recovery processing in by the frequency band (being called as hereinafter " image recovery frequency band ") of window function restriction of filter.In other words, image recovery filter is generated as according to window function goes up the carries out image Recovery processing at the frequency band lower than specific frequency (being called as hereinafter " lower frequency side frequency band ") in catching image, and at the upper limited images Recovery processing of the frequency band higher than specific frequency (being called as hereinafter " high frequency side frequency band ").
With reference to Fig. 9 A to 9C such image being recovered filter is described.Fig. 9 A shows the MTF identical with the MTF shown in Figure 12 A.In Fig. 9 A, transverse axis representation space frequency, the longitudinal axis represents MTF.
In addition, Fig. 9 B shows the frequency characteristic that the image that recovers frequency band according to characteristic frequency (withered and fallen enter frequency) limited images recovers filter.In Fig. 9 B, transverse axis representation space frequency, the longitudinal axis represents to recover gain.From relatively being appreciated that of Fig. 9 B and Figure 12 B, image shown in Fig. 9 B recovers filter does not have the low pass filter effect at the high frequency side frequency band, so that Fig. 9 C(wherein, transverse axis represents the tap position in the filter, and the longitudinal axis represents values of tap (coefficient value)) shown in the image profile that recovers filter be sharp-pointed.Thereby, use this image to recover filter carries out image Recovery processing and can recover admirably the image section of its frequency in the lower frequency side frequency band, keep simultaneously having low MTF but do not change as the image section of catching the detail section existence in the image (that is, not can owing to the image Recovery processing produces fuzzy).
In addition, Figure 10 A shows the MTF identical with the MTF shown in Figure 13 A.In Figure 10 A, transverse axis representation space frequency, the longitudinal axis represents MTF.Figure 10 C shows the frequency characteristic that another image that recovers frequency band according to characteristic frequency (withered and fallen enter frequency) limited images recovers filter.In Figure 10 B, transverse axis representation space frequency, the longitudinal axis represents to recover gain.Figure 10 C shows the profile that image recovers filter.According to the comparison of Figure 13 C, a plurality of positions of coefficient value in narrow position range that the image shown in Figure 10 C recovers filter acutely do not change.Thereby the image recovery filter shown in Figure 10 B has the tolerance limit to the difference of PSF, recovers admirably the image section that its frequency band comprises that non-zero falls into simultaneously.
Owing to the OTF of image capture optical system along with picture altitude (namely catching the position in the image) changes, so withered and fallenly enter frequency and also depend on picture altitude.Thereby, can obtain characteristic frequency is recovered filter to change the image that is produced characteristic in each position in catching image.In this case, except changing characteristic frequency, can carry out processing according to the flow chart of describing in this embodiment.
Next, will the window function that produce at step S15 be described in detail.Fig. 7 shows the MTF on two mutually orthogonal azimuth directions.Fig. 8 A and 8C show from the top distribution of the MTF shown in Figure 7 that (that is, the surface from vertical direction to two dimensional image) sees.Dotted line among Fig. 8 A and the 8C each represents according to threshold value t1 decision shown in Figure 7 and the characteristic frequency that changes according to azimuth direction.Solid line among Fig. 8 A and the 8C each represents that the value of window function becomes 0 frequency, and window function has than 0 large value in solid line inside.Comprise enough less and therefore can be regarded as 0 value than 1 as " 0 " of the value of window function.
Fig. 8 B shows the profile of the window function shown in Fig. 8 A.The profile of the window function among the dotted line presentation graphs A among Fig. 8 B on the vertical direction, the profile among the solid line presentation graphs 8A among Fig. 8 B on the horizontal direction.Wish that entering characteristic (shown in Fig. 8 B) according to the MTF that depends on azimuth direction withered and fallen produces window function.Window function shown in Fig. 8 B is the function of the non-rotating symmetry corresponding with the characteristic frequency that changes according to azimuth direction (withered and fallen enter frequency).
As another example, Fig. 8 C and 8D show the rotational symmetric window function that produces as the withered and fallen representative characteristic frequency that enters the minimum value of frequency (characteristic frequency) on each azimuth direction by using.In the situation of using such window function, although MTF does not comprise withered and fallenly entering, image recovers frequency band and narrows down at the azimuth direction that carries out frequency band limits by window function.
By using from the actual MTF(that changes according to azimuth direction be, the absolute value of OTF) characteristic frequency that obtains and produce like this window function, the image that makes it possible to produce window function and have optical transfer function (OTF) coupling good accuracy and the image capture optical system recovers filter.
Can be by coming the known window function such as Gaussian window or Hamming window of asymmetric conversion according to the particular frequency characteristics on each azimuth direction that obtains from optical transfer function or can newly be produced, and produce window function.
In addition, can produce based on the MTF at each picture altitude place the window function W (u, v) that mates with the characteristic frequency that changes according to azimuth direction.The example of this window function illustrates with following formula (3):
W(u,v)=|H(u,v)|
N
Wherein, N represents real parameters.
Recover filter because the image Recovery processing produces image with the OTF at each picture altitude place, therefore this method of the MTF generation window function by using each picture altitude place does not increase the amount of data.In addition, even when being difficult to express accurately the azimuth characteristic of characteristic frequency by function, the method still makes it possible to produce window function.This is can be corresponding to MTF because of the frequency that limits by window function.
Even input picture comprises the withered and fallen of MTF and enter, this embodiment still makes it possible to obtain the high definition Recovery image, is suppressed at simultaneously the undesired effect that generates on the high frequency side frequency band of characteristic frequency such as image blurring and ringing.
[embodiment 2]
Next, with reference to Figure 11 the image pick-up device as the second embodiment of the present invention (embodiment 2) is described.Image pick-up device has the image processing apparatus by the image processing method carries out image Recovery processing of describing among the embodiment 1.
Image capture optical system 201 makes the light from the object (not shown) form object images.Imageing sensor 202 opto-electronic conversion object images are with the output analog electrical signal.Be converted to digital signal to be imported into image processor 204 from the analog signal of imageing sensor 202 outputs by A/D converter 203.
The digital signal of 204 pairs of inputs of image processor is carried out various images and is processed to produce and catch image (input picture), then carries out the image Recovery processing of describing among the embodiment 1 to catching image.Produce system's composing images capture systems of the part of catching image 204 from imageing sensor 202 to image processor.The part of carries out image Recovery processing is corresponding to the image processing apparatus that comprises importation, calculating section, window function generating portion, filter generating portion and processing section in the image processor 204.
State detector 207 obtains (describing among the embodiment 1) the image capture conditions information when image is caught in generation that will be used to by the image Recovery processing of image processor 204 execution.State detector 207 can obtain image capture conditions information from system controller 210.In addition, state detector 207 can obtain from the image capture optical system controller 206 of the movement of the operation of control aperture diaphragm 201a and the lens 201b such as zoom lens or condenser lens the image capture conditions about image capture optical system 201.Image processor 204 as computer is carried out by using the image Recovery processing of flow chart description shown in Figure 1.Optical transfer function (OTF) and will being stored in advance in the memory 208 for generation of the coefficient data of optical transfer function (OTF).
Image processor 204 will store by the Recovery image (output image) that the image Recovery processing produces the image recording media 209 such as semiconductor memory or CD into, and make display unit 205 show Recovery image.The a series of aforesaid operations of system controller 210 controls.
Image capture optical system 201 can comprise the optical element such as low pass filter and infrared cutoff filter.When image capture optical system 201 comprised the optical element such as low pass filter of the optical transfer function (OTF) that affects image capture optical system 201, this optical element should be paid attention to when image recovers filter producing.When using infrared cutoff filter, since it in R, G and the B passage each PSF(its be the integrated value of the point spread function (PSF) of spectral wavelength) exert an influence, particularly the PSF of R channel exerted an influence, so infrared cutoff filter should be paid attention to when producing the image recovery filter.
As mentioned above, image capture optical system 201 can be exchanged with image pick-up device.
[embodiment 3]
Although embodiment 2 described use image processing method image pick-up device (namely, be provided with the image pick-up device of image processing apparatus), but the third embodiment of the present invention (embodiment 3) will be described the situation of coming the real-time image processing method by the image processing program that is installed to personal computer.In this case, personal computer is corresponding to image processing apparatus.Personal computer obtains by what image pick-up device produced by wired or wireless communication or from the line of another person's computer by the internet from image pick-up device and catches image (unrecovered image).
Personal computer can obtain and catches image by recording therein the image recording media of catching image.Then, obtained catch image personal computer according to image processing program carries out image Recovery processing, and the Recovery image that obtains of output.
Although reference example embodiment has described the present invention, it being understood that to the invention is not restricted to disclosed exemplary embodiment.The scope of following claim should be followed the most wide in range explanation to comprise all such modifications and 26S Proteasome Structure and Function of equal value.
Claims (7)
1. an image processing method is used for the input picture carries out image Recovery processing by the image pick-up device generation be is characterized in that, said method comprising the steps of:
Obtain the input picture information (S11, S12) relevant with the image capture conditions when in described image pick-up device, producing described input picture;
Obtain the optical transfer function (S13) with described image pick-up device corresponding to the information relevant with described image capture conditions;
Calculate the characteristic frequency (S14) that becomes predetermined value by the desired value of using described optical transfer function to obtain at each azimuth direction;
Produce window function take with the frequency band division of described input picture as lower frequency side frequency band and high frequency side frequency band (S15) than the described characteristic frequency of calculating at each azimuth direction;
By using described window function and described optical transfer function, produce image and recover filter, with limited images Recovery processing (S15) on carries out image Recovery processing on the described lower frequency side frequency band of described input picture and the described high frequency side frequency band at described input picture; And
Use described image to recover filter carries out image Recovery processing (S16).
2. image processing method according to claim 1, wherein, described characteristic frequency is that described desired value becomes minimum in the frequency of predetermined value.
3. image processing method according to claim 1, wherein, described window function is the function of the non-rotating symmetry corresponding with the described characteristic frequency that changes according to described azimuth direction.
4. image processing method according to claim 1, wherein, the step that produces described window function produces described window function by the absolute value with described optical transfer function.
5. image processing method according to claim 1 wherein, calculates step each position in described input picture of described characteristic frequency and calculates described characteristic frequency, and
Wherein, produce step each position in described input picture that described image recovers filter and change the characteristic that described image recovers filter.
6. an image processing apparatus is configured to the input picture carries out image Recovery processing by the image pick-up device generation be is characterized in that, described image processing apparatus comprises:
Importation (204) is configured to obtain the input picture information relevant with the image capture conditions when producing input picture in described image pick-up device;
Calculating section (204), be configured to obtain the optical transfer function with described image pick-up device corresponding to the information relevant with described image capture conditions, and be configured to calculate the characteristic frequency that becomes predetermined value by the desired value of using described optical transfer function to obtain at each azimuth direction;
Window function generating portion (204), be configured to produce window function take with the frequency band division of described input picture as lower frequency side frequency band and high frequency side frequency band than the described characteristic frequency of calculating at each azimuth direction;
Filter generating portion (204), be configured to by using described window function and described optical transfer function, produce image and recover filter, with limited images Recovery processing on carries out image Recovery processing on the described lower frequency side frequency band of described input picture and the described high frequency side frequency band at described input picture; And
Processing section (204) is configured to use described image to recover filter carries out image Recovery processing.
7. image pick-up device comprises:
Image capture system is configured to comprise the imageing sensor (202) for the opto-electronic conversion of carrying out the object images that is formed by image capture optical system (201), and is configured to catch image by using from the output generation of described imageing sensor; And
Image processing apparatus is configured to as described input picture carries out image Recovery processing of catching image,
It is characterized in that, described image processing apparatus comprises:
Importation (204) is configured to obtain the described input picture information relevant with the image capture conditions when producing described input picture in described image pick-up device;
Calculating section (204), be configured to obtain the optical transfer function with described image pick-up device corresponding to the information relevant with described image capture conditions, and be configured to calculate the characteristic frequency that becomes predetermined value by the desired value of using optical transfer function to obtain at each azimuth direction;
Window function generating portion (204), be configured to produce window function take with the frequency band division of described input picture as lower frequency side frequency band and high frequency side frequency band than the described characteristic frequency of calculating at each azimuth direction;
Filter generating portion (204), be configured to by using described window function and described optical transfer function, produce image and recover filter, with limited images Recovery processing on carries out image Recovery processing on the described lower frequency side frequency band of described input picture and the described high frequency side frequency band at input picture; And
Processing section (204) is configured to use described image to recover filter carries out image Recovery processing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410720384.4A CN104363366B (en) | 2011-08-26 | 2012-08-21 | Image processing method, image processing apparatus and image pick-up device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2011184794A JP5344648B2 (en) | 2011-08-26 | 2011-08-26 | Image processing method, image processing apparatus, imaging apparatus, and image processing program |
| JP2011-184794 | 2011-08-26 |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410720384.4A Division CN104363366B (en) | 2011-08-26 | 2012-08-21 | Image processing method, image processing apparatus and image pick-up device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102957846A true CN102957846A (en) | 2013-03-06 |
| CN102957846B CN102957846B (en) | 2015-09-30 |
Family
ID=47743212
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210298584.6A Active CN102957846B (en) | 2011-08-26 | 2012-08-21 | Image processing method, image processing apparatus and image pick-up device |
| CN201410720384.4A Active CN104363366B (en) | 2011-08-26 | 2012-08-21 | Image processing method, image processing apparatus and image pick-up device |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410720384.4A Active CN104363366B (en) | 2011-08-26 | 2012-08-21 | Image processing method, image processing apparatus and image pick-up device |
Country Status (3)
| Country | Link |
|---|---|
| US (1) | US8934732B2 (en) |
| JP (1) | JP5344648B2 (en) |
| CN (2) | CN102957846B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105453539A (en) * | 2013-08-02 | 2016-03-30 | 富士胶片株式会社 | Image processing device, image capture device, image processing method, and program |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6253365B2 (en) * | 2013-11-22 | 2017-12-27 | キヤノン株式会社 | Image processing method, imaging apparatus, and image processing apparatus |
| JP6385206B2 (en) * | 2014-09-02 | 2018-09-05 | キヤノン株式会社 | Image processing apparatus, imaging apparatus, image processing method, image processing program, and storage medium |
| JP6350205B2 (en) * | 2014-10-21 | 2018-07-04 | 富士通株式会社 | Processing apparatus, processing method, and processing program |
| JP6347763B2 (en) * | 2015-05-19 | 2018-06-27 | キヤノン株式会社 | Image processing apparatus, imaging apparatus, image processing method, and image processing program |
| JP6214713B1 (en) * | 2016-04-18 | 2017-10-18 | キヤノン株式会社 | Image processing apparatus, imaging apparatus, lens apparatus, image processing method, program, storage medium, and information processing method |
| CN111562584B (en) * | 2020-04-30 | 2022-08-16 | 北京中安智能信息科技有限公司 | Passive sonar azimuth history map processing method, device and equipment |
| JP2022129053A (en) * | 2021-02-24 | 2022-09-05 | キヤノン株式会社 | Image processing device, imaging device, image processing method, and program |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101258740A (en) * | 2005-07-28 | 2008-09-03 | 京瓷株式会社 | Imaging device and image processing method |
| JP2011135563A (en) * | 2009-11-30 | 2011-07-07 | Canon Inc | Image capturing apparatus, and image processing method |
| CN102165761A (en) * | 2008-09-30 | 2011-08-24 | 佳能株式会社 | Image processing method, image processing apparatus, and image pickup apparatus |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5414782A (en) * | 1992-12-16 | 1995-05-09 | The United States Of Amercia As Represented By The Secretary Of Commerce | Procedure for digital image restoration |
| JP4787959B2 (en) * | 2006-01-10 | 2011-10-05 | 国立大学法人東京工業大学 | Image restoration filter and image restoration method using the same |
| US8280180B2 (en) * | 2007-12-04 | 2012-10-02 | Hewlett-Packard Development Company, L.P. | Method and system for image restoration in the spatial domain |
| JP2009239077A (en) * | 2008-03-27 | 2009-10-15 | Canon Inc | Position detection apparatus, position detection method, exposure apparatus, and device fabrication method |
| US8477206B2 (en) * | 2008-09-30 | 2013-07-02 | Canon Kabushiki Kaisha | Image processing apparatus and image processing method for performing image restoration using restoration filter |
| JP5441652B2 (en) * | 2009-12-09 | 2014-03-12 | キヤノン株式会社 | Image processing method, image processing apparatus, imaging apparatus, and image processing program |
-
2011
- 2011-08-26 JP JP2011184794A patent/JP5344648B2/en active Active
-
2012
- 2012-08-21 CN CN201210298584.6A patent/CN102957846B/en active Active
- 2012-08-21 CN CN201410720384.4A patent/CN104363366B/en active Active
- 2012-08-23 US US13/592,471 patent/US8934732B2/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101258740A (en) * | 2005-07-28 | 2008-09-03 | 京瓷株式会社 | Imaging device and image processing method |
| CN102165761A (en) * | 2008-09-30 | 2011-08-24 | 佳能株式会社 | Image processing method, image processing apparatus, and image pickup apparatus |
| JP2011135563A (en) * | 2009-11-30 | 2011-07-07 | Canon Inc | Image capturing apparatus, and image processing method |
Non-Patent Citations (1)
| Title |
|---|
| 马卫红: "基于图像分析的光学传递函数测试技术研究", 《中国博士学位论文全文数据库 基础科学辑》, 15 April 2006 (2006-04-15) * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105453539A (en) * | 2013-08-02 | 2016-03-30 | 富士胶片株式会社 | Image processing device, image capture device, image processing method, and program |
| CN105453539B (en) * | 2013-08-02 | 2019-02-22 | 富士胶片株式会社 | Image processing apparatus, photographic device and image processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| JP5344648B2 (en) | 2013-11-20 |
| JP2013045404A (en) | 2013-03-04 |
| CN104363366A (en) | 2015-02-18 |
| US8934732B2 (en) | 2015-01-13 |
| CN104363366B (en) | 2017-07-25 |
| US20130050541A1 (en) | 2013-02-28 |
| CN102957846B (en) | 2015-09-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102930506B (en) | Image processing apparatus, image processing method, and image pickup apparatus | |
| CN102930507B (en) | Image processing method, image processing apparatus and image pick-up device | |
| CN102957846B (en) | Image processing method, image processing apparatus and image pick-up device | |
| US8692909B2 (en) | Image processing device and image pickup device using the same | |
| US8798389B2 (en) | Image processing method, image processing apparatus, and image pickup apparatus for correcting degradation component of image | |
| US9100583B2 (en) | Image processing apparatus for correcting an aberration of an image containing a luminance saturation part, image pickup apparatus, image processing method, and non-transitory recording medium storing program | |
| US9830689B2 (en) | Image processing apparatus that performs image restoration processing, method of controlling the same, and storage medium | |
| US8737757B2 (en) | Image processing method, image processing apparatus, and image pickup apparatus for correcting degradation component of image | |
| US9167216B2 (en) | Image processing apparatus, image capture apparatus and image processing method | |
| US8830351B2 (en) | Image processing method and image processing apparatus for image restoration to reduce a detected color shift | |
| US10217202B2 (en) | Image processing apparatus, image capturing apparatus, and storage medium | |
| WO2011122283A1 (en) | Image processing device and image capturing device using same | |
| CN105049680A (en) | Image processing apparatus that performs image restoration processing and image processing method | |
| JP2010086138A (en) | Image processing method, image processing apparatus, and image pickup apparatus | |
| JP2011124692A5 (en) | ||
| US10217193B2 (en) | Image processing apparatus, image capturing apparatus, and storage medium that stores image processing program | |
| WO2011121763A1 (en) | Image processing apparatus and image capturing apparatus using same | |
| CN102158731A (en) | Image processing system and method | |
| JP2014150423A (en) | Imaging device, image processing device, image processing method, image processing program, and storage medium | |
| CN102158730B (en) | Image processing system and method | |
| JP6415108B2 (en) | Image processing method, image processing apparatus, imaging apparatus, image processing program, and storage medium | |
| JP5645981B2 (en) | Imaging apparatus, image processing apparatus, image processing method, image processing program, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |