JP5780747B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to a technique for correcting chromatic aberration of magnification of image data.

  Conventionally, a technique for correcting chromatic aberration of magnification caused by an imaging optical system is known (see, for example, Patent Document 1). In the technique disclosed in Patent Document 1, in order to correct lateral chromatic aberration, first, an image signal picked up by an image pickup device having a Bayer array color filter is converted into an R (red) component, a G (green) component, and a B ( Color separation into blue) components. An interpolated R component is generated by interpolating a pixel value from an adjacent R component pixel for a pixel having no R component, and an interpolated pixel value from an adjacent B component pixel for a pixel having no B component. Thus, an interpolation B component is generated. After that, the magnification chromatic aberration correction circuit corrects the magnification chromatic aberration by replacing each pixel value of the interpolated R component with a pixel value at a position where the interpolation R component should be based on the G component. In addition, when the pixel position of the pixel to be replaced with the pixel value at the original position has a deviation of less than one pixel, the pixel to be replaced by interpolating the deviation of less than one pixel from the peripheral R component pixel value The value is calculated. The same replacement is performed for the interpolation B component, and the chromatic aberration of magnification is corrected by correcting the pixel positions of the interpolation R component and the interpolation B component with respect to the G component.

  The R component, B component, and G component with corrected lateral chromatic aberration are then subjected to image quality adjustment processing such as gamma correction and aperture correction, and then converted into a luminance component and a color difference component. When the color difference component is generated, false color suppression processing is performed so that aliasing in the vicinity of the Nyquist frequency does not appear in the image as a false color signal.

  Conventionally, a technique for reducing noise by dividing an image signal into a plurality of frequency bands and frequency-synthesizing the image signals processed for each frequency band is known (for example, see Patent Document 2). . The technology disclosed in Patent Document 2 reduces only noise components while preserving broadband edge components by reducing noise components while preserving edge components for every n frequency bands from Step 1 to Step n. doing.

  Applying the techniques disclosed in the above first and second patent documents, performing chromatic aberration of magnification to perform image quality adjustment processing such as gamma correction and aperture correction, and then performing noise reduction processing while performing false color suppression processing It is possible to output the luminance component and the color difference component by performing the above.

JP 2008-015946 A JP 2008-015741 A

  However, in the technology assumed as described above, it is necessary to store the band-limited image signal in a large number of planes in a memory constituted by a DRAM and the like, and further, it is necessary to store the image signals of each plane for each frequency component. There is. Therefore, in the case of processing that requires high speed, such as continuous shooting, the amount of memory access per unit time increases, and when the upper limit of the memory access bandwidth is reached, the processing performance is degraded. In addition, an increase in the required memory capacity increases the cost of the image processing apparatus.

  Therefore, an object of the present invention is to perform lateral chromatic aberration correction and noise reduction without causing a reduction in processing performance and an increase in cost.

The image processing apparatus according to the present invention performs false color suppression processing on first image data composed of a Bayer array of R, G1, G2, and B color components, using the G1 and G2 color components separately. First converting means for converting the first image data into second image data composed of R and B color components and luminance components, and outputting the second image data for each of a plurality of bands ; First storage means for storing the second image data in a storage medium, and reading the second image data for each of a plurality of frequency bands stored in the storage medium, and for each of the plurality of frequency bands And correction means for correcting chromatic aberration of magnification for the R and B color components of the second image data.

  According to the present invention, it is possible to perform lateral chromatic aberration correction and noise reduction without degrading processing performance and increasing costs.

It is a figure which shows the structure of the image processing apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the color filter of a Bayer arrangement. It is a figure which shows the structure of the signal processing circuit in 1st Embodiment in detail. It is a figure which shows the structure of R thinning-out circuit in detail. It is a flowchart which shows the selection process of the thinning-out method in RB thinning-out circuit. It is a figure which shows the structure of the signal processing circuit in 2nd Embodiment in detail. It is a figure which shows the structure of the signal processing circuit in a comparative example in detail. It is a flowchart which shows the process of the system control circuit in 3rd Embodiment.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings.

  First, a first embodiment of the present invention will be described. FIG. 1 is a diagram showing a configuration of an image processing apparatus according to the first embodiment of the present invention. In FIG. 1, an image forming optical system 101 includes a lens, a diaphragm, and the like, and performs focus adjustment and exposure adjustment. Reference numeral 102 denotes an image sensor such as a CCD that converts an optical image into an electrical signal. Reference numeral 103 denotes an A / D conversion circuit that converts an analog image signal from the image sensor 102 into a digital image signal. A signal processing circuit 104 performs processing such as aberration correction and noise reduction of the imaging optical system on the image data (digital image signal) output from the A / D conversion circuit 103. Reference numeral 105 denotes a memory control circuit for writing / reading image data to / from the memory (DRAM) 106. A system control circuit 107 controls the operation of the entire image processing apparatus.

  A Bayer array color filter as shown in FIG. 2 is arranged for each pixel on the imaging surface of the image sensor 102, and each pixel outputs a pixel value corresponding to the color of the color filter. In FIG. 2, the G filter positioned in the horizontal direction of the R filter and in the vertical direction of the B filter is a G1 filter, and the G filter positioned in the vertical direction of the R filter and in the horizontal direction of the B filter is a G2 filter. And

  FIG. 3 is a diagram showing in detail the configuration of the signal processing circuit 104 in the first embodiment. In FIG. 3, reference numeral 201 denotes a frequency resolution circuit that receives A / D converted image data (first image data) as an input. Reference numeral 202 denotes a frequency synthesis circuit, and image data output therefrom is stored in the memory 106. An image buffer area 220 used by the signal processing circuit 104 is an area secured in the memory 106 of FIG. Reference numerals 203 to 205 denote low-pass filter circuits (LFP). Reference numerals 206 to 208 denote downsampling circuits. Reference numerals 209 to 211 denote image data of R / G1 / G2 / B (R component, G1, G2, B component) and Y / R / B (Y component, R component, B component) image data (second component). Is a format conversion circuit for converting the image data). Further, the format conversion circuits 209 to 211 perform false color suppression processing. The image buffer area 220 has a configuration as an application example of the storage medium, and the format conversion circuits 209 to 211 have a configuration as an application example of the first conversion means.

The false color suppression process is realized by the following method, for example. That is, the higher correlation of the (R-G1) component or (R-G2) component is selected for each pixel based on the spatial correlation of the optical image formed on the image sensor 102 (R-Ga1). Ingredients. In addition, the G1 component and the G2 component are set to the same G component, and a Gb component interpolated from the G component is generated for each pixel, and an (R-Gb) component is generated. Further, depending on the saturation, the (R-Ga1) component or the (R-Gb) component is selected for each pixel to be a Cr component. The Cb component is similarly generated. Thereby, Cr component and Cb component which are color difference signals in which false color is suppressed for each pixel are generated. The Cr component and the Cb component may be values obtained by weighted addition of the (R-Ga1) component and the (R-Gb) component, or the value of the (R-Ga1) component may be used as it is. Further, the Y component that is a luminance signal is generated by, for example, the following calculation using the R component, the G component, and the B component that are interpolated according to the spatial correlation of the optical image formed on the image sensor 102. The
Y = 33R + 0.59G + 0.11B

  The format conversion circuits 209 to 211 generate Y as the Y component, (Cr + Y) as the R component, and (Cb + Y) as the B component based on the Y component that is the luminance signal, the Cr component that is the color difference signal, and the Cb component, Y / R / B image data is output.

Reference numerals 212 to 214 denote RB thinning circuits (R thinning circuit + B thinning circuit) for reducing the resolution of the RB. FIG. 4 is a diagram showing the configuration of the R thinning circuit in detail. In FIG. 4, reference numeral 401 denotes a horizontal low-pass filter circuit. Here, the low-pass filter circuit 401 can be realized by, for example, a transfer function H (z) = ½ (1 + Z ⁻¹ ). Reference numeral 402 denotes a selector circuit that selects the presence or absence of the low-pass filter circuit 401. Reference numeral 403 denotes a horizontal thinning circuit. As will be described later, the system control circuit 107 selects either an even phase or an odd phase as the thinning phase, and the horizontal direction thinning circuit 403 performs a thinning process on the R component image data at the selected thinning phase. The B thinning circuit has the same configuration as the R thinning circuit. As will be described later, the system control circuit 107 selects whether or not the low-pass filter circuit 401 is used for each frequency band. Note that the RB thinning circuits 212 to 214 are configured as application examples of the thinning means.

  As a result, the frequency resolving circuit 201 outputs Y / RB image data composed of two planes (two surfaces) of a Y component and an RB component that are band-limited for each frequency band to the image buffer area 220 (Y / RB). -2 to Y / RB-4). Further, image data that is not band-limited is output as Bayer array image data (Bayer-1).

  The frequency synthesizing circuit 202 performs magnification chromatic aberration correction by the magnification chromatic aberration correction circuits 215 to 218 for each frequency band. For Bayer-1, the magnification chromatic aberration correction circuit 215 performs magnification chromatic aberration correction after performing R interpolation or B interpolation. For Y / RBs 2 to 4, the chromatic aberration correction circuits 216 to 218 for magnification select an interpolation phase in accordance with the thinning phase selected by the RB thinning circuits 212 to 214 as shown in FIG. That is, when the thinning phase is an even phase, an even phase is selected as the interpolation phase, and when the thinning phase is an odd phase, the odd phase is also selected. For Y / RBs 2 to 4, magnification chromatic aberration correction circuits 216 to 218 perform magnification chromatic aberration correction for R and B components using the Y component as a reference instead of the G component.

  In the R interpolation and the B interpolation, in this embodiment, the pixel value for interpolating the R component and the B component is generated by the average value of the peripheral pixels. However, other conventionally known techniques may be used. For example, a technique for improving the resolution of the R component and the B component by using a high frequency component of the G component is known. If this technique is applied by replacing the G component with the Y component, resolution degradation can be recovered when correcting lateral chromatic aberration even if the horizontal resolution of the R component and B component is reduced by RB decimation. Further, R interpolation and B interpolation may be applied to Bayer-1 by the technique.

  Note that a known method may be applied to the lateral chromatic aberration correction. For example, in the correction data storage memory (not shown), the R component for the imaging position of the Y component (or G component) depends on the state of the imaging optical system 101 (zoom position, focus position, aperture value, etc.) and image height. The deviation of the imaging position is stored. The magnification chromatic aberration correction circuits 215 to 218 connect the R component in the target pixel corresponding to the state of the imaging optical system 101 when the image sensor 102 generates a video signal and the image height of the target pixel to be corrected. Reads out the image position deviation. Then, the magnification chromatic aberration correction circuits 215 to 218 interpolate the R component value at the position corresponding to the deviation amount from the R component value at the peripheral pixel at the position, and use it as the R component value at the target pixel. . This is similarly performed for the B component.

  The noise reduction circuit 219 generates a Cr component by (R−Y) by inverse conversion of the format conversion circuits 209 to 211. Similarly, the noise reduction circuit 219 generates a Cb component by (BY). The noise reduction process itself is performed separately for the luminance component and the color difference component. Then, for each pixel and each Y / Cr / Cb component, among Y / Cr / Cb components of each frequency band subjected to noise reduction, Y / of any frequency band according to the edge information of the subject. A Cr / Cb component is selected and generated as an output image.

  FIG. 5 is a flowchart showing a thinning method selection process in the RB thinning circuits 212 to 214. In step S101, the system control circuit 107 selects whether or not the low-pass filter circuit 401 is used in the RB thinning circuits 212 to 214. In step S102, the system control circuit 107 selects a thinning phase in the RB thinning circuits 212 to 214. In step S103, the system control circuit 107 selects the phase of R interpolation and B interpolation in the magnification chromatic aberration correction circuits 216 to 218 in accordance with the thinning phase selected in step S102.

  As described above, in order to perform lateral chromatic aberration correction, the R component and the B component are required, and in order to perform the false color suppression process, it is necessary to distinguish between the G1 component and the G2 component. Therefore, the image processing apparatus according to the present embodiment performs R / G1 / G2 / B image data as Y / R / B image data while performing false color suppression processing in which it is necessary to distinguish between the G1 component and the G2 component. Data is converted and stored in the image buffer area 220. Thereby, the memory capacity of the image buffer area 220 can be reduced as compared with the case where the image data decomposed into a plurality of frequency bands is converted into R / G1 / G2 / B image data. Here, the image data to be stored in the image buffer area 220 is not Y / Cr / Cb image data but Y / R / B image data. Later, the chromatic aberration of magnification using the R and B components is used. This is to perform correction. Furthermore, in the present embodiment, the memory capacity required for the image buffer area 220 is further reduced by using the RB thinning circuits 212 to 214.

  Next, a second embodiment of the present invention will be described. The configuration of the image processing apparatus according to this embodiment is the same as that shown in FIG. 1, but the detailed configuration of the signal processing circuit 104 is different from that of the first embodiment.

  FIG. 6 is a diagram showing in detail the configuration of the signal processing circuit 104 in the second embodiment. In FIG. 6, the frequency synthesis circuit 302 has the same configuration as the frequency synthesis circuit 202 of FIG. Also, the image buffer area 318 in FIG. 6 has the same configuration as the image buffer area 220 in FIG. Reference numeral 301 denotes a frequency resolving circuit. Reference numeral 303 denotes a low-pass filter circuit, and reference numeral 306 denotes a down-sampling circuit, each having the same configuration as the low-pass filter circuits 203 to 205 and down-sampling circuits 206 to 208 in FIG. Reference numeral 309 denotes a format conversion circuit, which is the same circuit as the format conversion circuits 209 to 211 in FIG. However, as shown in FIG. 3, three circuits are necessary in the first embodiment, but in the second embodiment, one circuit can be used as shown in FIG. 6, and the circuit scale is small.

  The low-pass filter circuits 304 and 305 are the same circuits as the low-pass filter circuit 303. However, the low-pass filter circuit 303 has four planes of image data handled as R / G1 / G2 / B, whereas the low-pass filter circuits 304 and 305 have three planes of image data handled as Y / R / B. The circuit scale is small. Similarly, the downsampling circuits 307 and 308 are the same circuit as the downsampling circuit 306, but the number of planes handled is different between 4 planes and 3 planes, so the circuit scale is small. Reference numerals 310 to 312 denote RB thinning circuits, which are similar to the RB thinning circuits 212 to 214 in FIG. In the present embodiment, since the RB thinning circuits 310 to 213 exist for each frequency band, it is possible to select R component and B component filtering and a thinning phase for each frequency band, as in FIG.

  Here, a comparative example with the first and second embodiments of the present invention will be described. The configuration of the image processing apparatus according to this comparative example is the same as the configuration shown in FIG. 1, but the detailed configuration of the signal processing circuit 104 is different from that of the first embodiment.

FIG. 7 is a diagram showing in detail the configuration of the signal processing circuit 104 in the image processing apparatus according to this comparative example. Reference numeral 2001 denotes a frequency resolving circuit. Reference numerals 2003 to 2005 denote low-pass filter circuits in the horizontal direction and the vertical direction. Here, the low-pass filter circuits 2003 to 2005 can be realized by, for example, a transfer function H (z) = 1/2 (1 + Z ⁻¹ ) in both the horizontal direction and the vertical direction. Reference numerals 2006 to 2008 denote horizontal and vertical downsampling circuits. The phase to be downsampled is the left pixel of the two left and right pixels in the horizontal direction and the upper pixel of the two upper and lower pixels in the vertical direction. An image buffer area 2014 is composed of a DRAM or the like. The frequency resolving circuit 2001 receives Bayer array image data as input, image data that is not band-limited (Bayer-1), and band-limited red, green, and blue components as third image data. Image data (R / G1 / G2 / B-2 to R / G1 / G2 / B-4) are output to the image buffer area 2014. The frequency resolving circuit 2001 has a configuration as an application example of the second conversion means.

  The image data of R / G1 / G2 / B-2 is band-limited to ½ in the horizontal and vertical directions by the low-pass filter circuit 2003, and the number of pixels is ½ in the horizontal and vertical directions by the down-sampling circuit 2006. Is thinned out. The input image data is a Bayer array, and each color filter component of R, G1, G2, and B has an original resolution of 1/2 in the horizontal direction and the vertical direction. Therefore, the image data after down-sampling has R component, G1 component, It is stored for each plane of G2 component and B component.

  The image data of R / G1 / G2 / B-3 is further band-limited to 1/2 in the horizontal direction and the vertical direction by the low-pass filter circuit 2004, and the number of pixels is also reduced by 1 in the horizontal direction and the vertical direction by the downsampling circuit 2007. 2 is thinned out.

  The image data of R / G1 / G2 / B-4 is further band-limited to 1/2 in the horizontal direction and the vertical direction by the low-pass filter circuit 2005, and the number of pixels is also reduced by 1 in the horizontal direction and the vertical direction by the downsampling circuit 2008. 2 is thinned out.

  Reference numeral 2002 denotes a frequency synthesis circuit. 2009 to 2012 are magnification chromatic aberration correction circuits. 2013 is a false color suppression and noise reduction circuit. The frequency synthesis circuit 2002 performs magnification chromatic aberration correction by the magnification chromatic aberration correction circuits 2009 to 2012 for each frequency band. For Bayer-1, the magnification chromatic aberration correction circuit 2009 performs magnification chromatic aberration correction after performing R interpolation or B interpolation. For R / G1 / G2 / B2 to 4, since the synchronization of the R component and the B component has already been completed, the R interpolation and B interpolation processing is skipped. Since the difference information between G1 and G2 is necessary in the subsequent false color suppression process, the G component is output to the false color suppression and noise reduction circuit 2013 as the G1 component and the G2 component.

  The false color suppression and noise reduction circuit 2013 performs false color suppression processing of the color difference component. Here, a color component is generated for each frequency component. At this stage, an edge component is detected for each frequency component, and noise reduction processing is performed. The generated color components are then combined and output as color difference signals of Cr and Cb components. The color difference signals of the Cr component and the Cb component are each output as a color difference signal CrCb of one plane with the horizontal resolution reduced to ½. Further, the luminance component is output as a luminance signal Y of one plane by performing noise reduction processing by the method disclosed in Patent Document 3.

  In the image processing apparatus according to this comparative example, it is necessary to store the band-limited image data in the R / G1 / G2 / B four planes in the image buffer area 2014 composed of DRAM or the like. It is necessary to store plane image data for each frequency band. Therefore, when a required processing speed is required to be high, such as continuous shooting, the memory access amount per unit time increases, and when the upper limit of the memory access bandwidth is reached, the processing performance is degraded. In addition, the necessary memory capacity increases, increasing the cost of the image processing apparatus.

  On the other hand, in the first and second embodiments, Y / RB image data composed of two planes of Y component and RB component, which is band-limited for each frequency band, is output to the image buffer area. Therefore, the required memory capacity can be reduced and the cost can be reduced. In addition, since the memory access amount per unit time can be reduced, it is possible to prevent a decrease in processing performance.

  As described above, according to the first and second embodiments, it is possible to perform the magnification chromatic aberration correction process and the noise reduction process without causing a reduction in processing performance or an increase in cost. In particular, according to the second embodiment, it can be realized with a small circuit scale.

  Next, a third embodiment of the present invention will be described. The configuration of the image processing apparatus according to this embodiment is the same as that shown in FIG. 1, but the detailed configuration of the signal processing circuit 104 is different from that of the first embodiment.

  The signal processing circuit 104 in the present embodiment has the operation mode of the signal processing circuit 104 in the first or second embodiment and the operation mode of the signal processing circuit 104 in the comparative example. Then, the system control circuit 107 determines the necessary memory bandwidth and switches between the two operation modes.

  As described above, according to the first or second embodiment, it is possible to perform the magnification chromatic aberration correction process and the noise reduction process without degrading the processing performance or increasing the cost (high performance mode (first mode)). . Further, according to the comparative example, since the color component resolution is not lowered in the image buffer area, it is possible to generate image data with higher image quality (high image quality mode (second mode)).

  In the following, a case where the performance is degraded due to the limitation of the memory bandwidth is described as an example where a still image of about 10 million pixels is shot by high-speed continuous shooting of up to 10 frames per second. However, the present invention is not limited to such a case. For example, the present invention can be applied even when the memory bandwidth that can be used for other reasons is limited, such as when recording high-definition moving images or when other processing is performed in parallel.

  FIG. 8 is a flowchart showing processing of the system control circuit 107 in the third embodiment. In step S201, the system control circuit 107 determines whether or not the high-speed continuous shooting mode is set. In the high-speed continuous shooting mode, the system control circuit 107 selects the high performance mode so that necessary performance such as 10 frames per second can be secured. On the other hand, if it is not the high-speed continuous shooting mode, the system control circuit 107 selects the high image quality mode in step S203.

  According to the present embodiment, when performing the magnification chromatic aberration correction process and the noise reduction process, the operation mode can be selected so that the image quality and performance are optimized. As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

  104: signal processing circuit, 107: system control circuit, 201, 301: frequency decomposition circuit, 202, 302: frequency synthesis circuit, 220, 318: image buffer area, 203-205, 303-305: low-pass filter circuit, 206- 208, 306 to 308: downsampling circuit, 209 to 211, 309: format conversion circuit, 212 to 214, 310 to 312: RB thinning circuit, 215 to 218, 313 to 316: magnification chromatic aberration correction circuit, 219 and 317: noise Reduction circuit

Claims (13)

The first image data is obtained by subjecting the first image data composed of the Bayer arrangement of the R, G1, G2, and B color components to false color suppression processing using the G1 and G2 color components separately. First converting means for converting the image data into second image data comprising R and B color components and luminance components, and outputting the second image data for each of a plurality of frequency bands ;
First storage means for storing the second image data in a storage medium;
Read the second image data for each of a plurality of frequency bands stored in the storage medium, and perform lateral chromatic aberration correction on the R and B color components of the second image data for each of a plurality of frequency bands. An image processing apparatus comprising correction means. The first image data is obtained by subjecting the first image data composed of the Bayer arrangement of the R, G1, G2, and B color components to false color suppression processing using the G1 and G2 color components separately. First converting means for converting the image data into second image data comprising R and B color components and luminance components;
First storage means for storing the second image data in a storage medium;
Second conversion means for converting the first image data into third image data composed of R, G1, G2, and B color components;
Second storage means for storing the third image data in the storage medium;
A first mode in which the second image data is read from the storage medium and a chromatic aberration of magnification is corrected for the R and B color components of the second image data; and the third image is read from the storage medium. An image processing apparatus , comprising: a correction unit that switches and executes a second mode in which data is read and magnification chromatic aberration correction is performed . Thinning means for thinning out the R and B color components of the second image data so that the R and B color components of the second image data have a lower resolution than the luminance component;
It said first storage means, image according to claim 1 or 2, characterized in that for storing the second image data is color component thinned out for R and B by the thinning means in the storage medium Processing equipment. The image processing apparatus according to claim 3 , wherein the thinning unit thins R and B color components of the second image data in half in a horizontal direction . The correction means sets the resolution of the R and B color components of the second image data to the same resolution as the luminance component, and then performs magnification chromatic aberration correction on the R and B color components of the second image data. the image processing apparatus according to claim 3 or 4, characterized in that. The image processing apparatus according to claim 1 , further comprising a combining unit configured to combine the signals for each of the plurality of frequency bands that have been subjected to magnification chromatic aberration correction by the correcting unit.   7. The signal processing apparatus according to claim 6, wherein the synthesizing unit selects a signal in any one of the frequency bands according to edge information from the signals for each of the plurality of frequency bands subjected to the magnification chromatic aberration correction by the correcting unit. The image processing apparatus described. The image processing apparatus according to claim 2 , wherein the correction unit performs switching between the first mode and the second mode according to a required processing speed . The G1 color component is output from a pixel positioned in the horizontal direction of the pixel to which the R color component is output and the B color component is output, and the G2 color component is the R color. a vertical pixel which component is output, and, in any one of claims 1 to 8, wherein the output from the pixels located in the horizontal direction of the pixel color components of B are output The image processing apparatus described. An image processing method executed by an image processing apparatus,
The first image data is obtained by subjecting the first image data composed of the Bayer arrangement of the R, G1, G2, and B color components to false color suppression processing using the G1 and G2 color components separately. First converting means for converting the image data into second image data comprising R and B color components and luminance components, and outputting the second image data for each of a plurality of frequency bands;
First storage means for storing the second image data in a storage medium;
Read the second image data for each of a plurality of frequency bands stored in the storage medium, and perform lateral chromatic aberration correction on the R and B color components of the second image data for each of a plurality of frequency bands. An image processing method comprising correction means. An image processing method executed by an image processing apparatus,
The first image data is obtained by subjecting the first image data composed of the Bayer arrangement of the R, G1, G2, and B color components to false color suppression processing using the G1 and G2 color components separately. A first conversion step of converting the image data into second image data composed of R and B color components and luminance components;
A first storage step of storing the second image data in a storage medium;
A second conversion step of converting the first image data into third image data composed of R, G1, G2, and B color components;
A second storage step of storing the third image data in the storage medium;
A first mode in which the second image data is read from the storage medium and a chromatic aberration of magnification is corrected for the R and B color components of the second image data; and the third image is read from the storage medium. An image processing method comprising: a correction step of switching and executing a second mode in which data is read and magnification chromatic aberration correction is performed . The first image data is obtained by subjecting the first image data composed of the Bayer arrangement of the R, G1, G2, and B color components to false color suppression processing using the G1 and G2 color components separately. Converting the image data into second image data composed of R and B color components and luminance components, and outputting the second image data for each of a plurality of frequency bands ;
A storage step of storing the second image data in a storage medium;
Read the second image data for each of a plurality of frequency bands stored in the storage medium, and perform lateral chromatic aberration correction on the R and B color components of the second image data for each of a plurality of frequency bands. A program for causing a computer to execute a correction step. The first image data is obtained by subjecting the first image data composed of the Bayer arrangement of the R, G1, G2, and B color components to false color suppression processing using the G1 and G2 color components separately. A first conversion step of converting the image data into second image data composed of R and B color components and luminance components;
A first storage step of storing the second image data in a storage medium;
A second conversion step of converting the first image data into third image data composed of R, G1, G2, and B color components;
A second storage step of storing the third image data in the storage medium;
A first mode in which the second image data is read from the storage medium and a chromatic aberration of magnification is corrected for the R and B color components of the second image data; and the third image is read from the storage medium. A program for causing a computer to execute a correction step of switching and executing a second mode in which data is read and magnification chromatic aberration correction is performed.

Images