JP5078394B2 - Image processing apparatus and method - Google Patents

Description

  The present invention relates to an image processing apparatus and method.

  As described in Patent Document 1 below, an image captured by a solid-state image sensor causes shading that is a local distortion of amplitude due to dark current unevenness regardless of whether it is bright or dark.

  As means for correcting the shading, there is a method shown in Patent Document 2 below. As shown in FIG. 1, the solid-state imaging device includes a vertical optical black (hereinafter abbreviated as “OB”) portion 101, a horizontal OB portion 102, and an effective pixel portion 103. In this correction method, as shown in FIG. 2, the vertical OB unit 101 is divided into a predetermined number of areas for each OB for each photographing. Then, as shown in FIG. 3, an OB average value 302 for each region is calculated from the output 301 of the vertical OB unit. Then, as shown in FIG. 4, interpolation processing is performed by linear approximation, shading correction data 401 is acquired in real time, and shading correction is performed.

JP 2004-112474 A ([0011] [0012] [0013], FIG. 13) JP 2004-350103 A ([0006] to [0044])

  However, there is random noise in the image captured by the solid-state image sensor. Random noise occurs in any of the effective pixel portion 103, the vertical OB portion 101, and the horizontal OB portion 102. Therefore, the influence of random noise also occurs in the shading correction data generated from the average value of the output of the vertical OB unit 101 for each region. An example of shading correction data for an image with random noise will be described with reference to FIG.

  Based on the output 501 of the vertical OB unit 101 on which random noise is superimposed, an average value 502 for each region of the vertical OB unit output is calculated. The average value 502 of the vertical OB portion output has a step in the non-shaded regions 5, 6, 7, 8, and 9 in FIG.

  FIG. 6 shows an example in which shading correction data is generated by linearly approximating the average value 502 of the output of the vertical OB portion where the step occurs. Since a step due to random noise occurs in the average value 502 of the vertical OB portion output, the shading correction data 601 has an amplitude in the regions 5, 6, 7, 8, and 9 in FIG.

  When shading correction is performed using the shading correction data 601 on which random noise is superimposed, the image after the shading correction also has an amplitude in the regions 5, 6, 7, 8, and 9 in FIG. 3 where no shading changes, and the image quality deteriorates.

  In particular, in an image after shading correction by uniform light, the amplitude generated in the regions 5, 6, 7, 8, and 9 in which no shading changes in FIG. It was.

  As described above, there is a problem that random noise is superimposed on the shading correction data, and a step is generated in the image by performing the shading correction from the shading correction data.

  An object of the present invention is to generate shading correction data that is less affected by random noise in real time at the time of each shooting, and to enable highly accurate shading correction corresponding to environmental changes.

An image processing apparatus according to the present invention includes a solid-state imaging device including an effective pixel portion including a plurality of photoelectric conversion elements that are not shielded and an optical black portion including a plurality of light-shielded photoelectric conversion elements, and a plurality of the optical black portions. A determination unit that divides the image into regions and determines whether there is a change in shading between the plurality of regions based on an average value of output signals of the plurality of regions, and determines that there is no change in shading between the plurality of regions. A generation unit that generates shading correction data so that the shading correction data of the plurality of regions becomes the same, and the determination unit moves an average value of output signals of the plurality of regions adjacent to one region. When the average value is calculated and the average value of the output signal of the one region is within the threshold range with respect to the moving average value, there is no change in shading. And judging.

The image processing apparatus of the present invention includes a solid-state imaging device including an effective pixel portion having a plurality of photoelectric conversion elements that are not shielded and an optical black portion having a plurality of light-shielded photoelectric conversion elements, and the optical black portion. A determination unit that divides the image into a plurality of regions and determines whether or not there is a change in shading between the plurality of regions based on an average value of output signals of the plurality of regions, and there is no change in shading between the plurality of regions. A generation unit that generates shading correction data so that the shading correction data of the plurality of regions become the same when the determination is made, and the determination unit outputs the output signals of the adjacent regions before one region Shading changes when the difference between the moving average value of the average value and the moving average value of the average value of the output signals of the adjacent areas is the threshold value or less And judging the teeth.

  Shading correction data with little influence of random noise is generated in real time at every shooting, and highly accurate shading correction corresponding to environmental changes becomes possible.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
FIG. 13 is a diagram illustrating a configuration example of the image processing apparatus according to the first embodiment of the present invention. The image processing apparatus includes a solid-state imaging device 1301, a shading correction data setting unit 1301, an interpolation processing unit 1305, and a shading correction unit 1306. The shading correction data setting unit 1301 includes a three-region OB output average value calculation unit 1302, a determination unit 1303, and an OB output average value setting unit 1304.

  Hereinafter, an image processing method of the image processing apparatus will be described. As illustrated in FIG. 1, the solid-state imaging device 1301 includes a vertical optical black unit 101, a horizontal optical black unit 102, and an effective pixel unit 103 each having a plurality of photoelectric conversion elements. Hereinafter, the vertical optical black portion 101 is referred to as a vertical OB portion 101, and the horizontal optical black portion 102 is referred to as a horizontal OB portion 102. The photoelectric conversion element is, for example, a photodiode, and generates an image signal by photoelectric conversion. The solid-state imaging device 1301 includes an effective pixel portion 103 having a plurality of photoelectric conversion elements that are not shielded from light and optical black portions (hereinafter referred to as OB portions) 101 and 102 having a plurality of light-shielded photoelectric conversion elements. The photoelectric conversion elements in the OB units 101 and 102 can generate an image signal of an offset noise component because the light receiving unit is shielded from light. The photoelectric conversion element in the effective pixel unit 103 can generate an image signal corresponding to the subject.

  As shown in FIG. 2, the solid-state imaging device 1301 divides the vertical OB unit 101 into a certain number of regions for each OB for each shooting. As shown in FIG. 3, the shading correction data setting unit 1310 calculates an average value 302 for each region from the output signal 301 of the vertical OB unit 101. Hereinafter, a case where the vertical OB unit 101 is divided into a plurality of areas for processing will be described as an example, but the horizontal OB unit 102 may be divided into a plurality of areas for processing.

  FIG. 7 is a flowchart showing a processing example of the shading correction data setting unit 1310 according to the present embodiment, and FIG. 8 is a diagram for explaining FIG. 7 in detail. A shading correction data setting unit 1301 sets shading correction data.

  In order to simplify the explanation, the number of areas for which the moving average of the output average values of the vertical OB unit 101 used for the shading determination process is calculated is 3.

  As described above, the OB portion of the image is divided into regions including a certain number, and the average value of the OB portion output for each region is calculated. Next, in step S701, setting of shading correction data is started. Next, in step S702, the shading determination processing area center DECEIDE_AREA = 1 is set. Next, in step S703, 1 is added to DECIDE_AREA to set the shading determination processing region center DECIDE_AREA = 2.

  In step S704, three-region OB output average value calculating section 1302 calculates 3AREA_AVE, which is the OB portion output average value of three adjacent regions. The adjacent three areas are three areas centered on the shading determination processing area center DECIDE_AREA as shown in FIG. 8, and the OB portion output average value 801 of the adjacent three areas is shown as 3 AREA_AVE.

  Therefore, since the shading determination processing region center DECIDE_AREA = 2, the OB portion outputs of the regions 1, 2, and 3 are targets for calculation of the OB portion output average value (3AREA_AVE) 801 of the three regions.

  In steps S705 and S706, the determination unit 1303 determines whether there is a shading change. In step S705, the determination unit 1303 determines whether the OB portion output average value AREA_AVE of the shading determination processing region center DECIDE_AREA is larger than a value obtained by subtracting an arbitrary threshold σ1 from the three region OB portion output average value 801. If the determination result is true, in step S706, the determination unit 1303 has the OB portion output average value AREA_AVE of the shading determination processing region center DECIDE_AREA smaller than the value obtained by adding an arbitrary threshold σ1 to the three region OB portion output average value 801. Determine whether. In FIG. 8, it is determined whether the OB portion output average value AREA_AVE of DECIDE_AREA is within the range 802 of 3AREA_AVE−σ1 to 3 AREA_AVE + σ1.

  If the determination result in step S706 is true, there is no shading and the process proceeds to step S707. In step S707, the OB output average value setting unit 1304 sets the OB part output average value (3AREA_AVE) 801 of the three adjacent areas as the OB part output average value AREA_AVE of DECIDE_AREA. That is, the average value 801 of the OB portion output of the regions 1, 2, and 3 is set as the OB portion output average value AREA_AVE of the shading determination processing region center DECIDE_AREA = 2.

  After the processing in step S707 is completed, or if the determination in step S705 or S706 is false and there is a shading change, it is determined in step S708 whether there is an area to be determined next. In this example, since three areas are used for shading determination, it is determined whether DECIDE_AREA is equal to the final area LAST_AREA-1.

  If the determination result in step S708 is false, 1 is added to DECIDE_AREA in step S703 to shift the center of the shading determination processing area to the next, and the processes in and after step S704 are repeated.

  If the determination result in step S708 is true, the setting of shading correction data is terminated in step S709.

  As described above, the shading correction data setting unit 1310 performs shading on the average value of the output of the OB portion in a region where shading is performed, and on the plural regions without shading change, the value obtained by recalculating the average value of the output of the OB portion between the regions. The average value of a plurality of regions without change is used. After that, as illustrated in FIG. 4, the interpolation processing unit 1305 generates shading correction data 401 by performing an interpolation process on the average value of each region by linear approximation. The shading correction unit 1306 acquires the shading correction data 401 in real time and performs shading correction. Specifically, the shading correction unit 1306 performs shading correction by subtracting the shading correction data 401 from the image signal of the effective pixel unit 103. Therefore, the shading correction data 401 of the area without shading change increases the parameter of the output of the OB part by recalculating the average value of the output of the OB part, and is not easily affected by random noise. Can be obtained.

(Second Embodiment)
FIG. 9 is a flowchart showing a processing example of the shading correction data setting unit 1301 according to the second embodiment of the present invention, and FIG. 10 is a diagram for explaining FIG. 9 in detail. Hereinafter, the points of the present embodiment different from the first embodiment will be described.

  In order to simplify the explanation, the number of areas for which the moving average of the output average values of the vertical OB unit 101 used for the shading determination process is calculated is 3.

  The shading correction data setting unit 1301 divides an OB portion of the image into regions including a certain number, and calculates an average value of the OB portion output for each region. Next, in step S901, setting of shading correction data is started. In step S902, the shading determination processing area center DECEIDE_AREA = 2 is set. In step S903, 1 is added to DECIDE_AREA to set the shading determination processing region center DECIDE_AREA = 3.

  In step S904, three-region OB output average value calculation section 1302 calculates LEFT_3AREA_AVE1, which is the OB portion output average value of the adjacent three left regions. The adjacent three left areas are three areas including the shading determination processing area center DECIDE_AREA as shown in FIG. 10, and the OB portion output average value 1001 of the adjacent left three areas is shown as LEFT_3AREA_AVE1.

  Therefore, since the shading determination processing area center DECIDE_AREA = 3, the OB portion output in the areas 1, 2, and 3 is a target of calculation of the average value (LEFT_3AREA_AVE1) 1001.

  Further, in step S905, three-region OB output average value calculating section 1302 calculates RIGHT_3AREA_AVE1, which is the OB portion output average value of the adjacent three right regions. The adjacent three right areas are three areas including the shading determination processing area center DECIDE_AREA as shown in FIG. 10, and the OB portion output average value 1002 of the adjacent three right areas is shown as RIGHT_3 AREA_AVE1.

  Therefore, since the shading determination processing area center DECIDE_AREA = 3, the output of the OB part in the areas 3, 4, and 5 is a target for calculating the average value (RIGHT_3 AREA_AVE 1) 1002.

  In step S906, the determination unit 1303 determines whether there is a shading change. In step S906, the determination unit 1303 determines whether the absolute value 1003 of a value obtained by subtracting the right three region OB unit output average value RIGHT_3 AREA_AVE1 from the left three region OB unit output average value LEFT_3AREA_AVE1 is smaller than an arbitrary threshold σ2.

  In FIG. 10, this is illustrated as an absolute value 1003 of a value obtained by subtracting the right three-region OB section output average value (RIGHT_3 AREA_AVE1) 1002 from the left three-region OB section output average value (LEFT_3AREA_AVE1) 1001. It is determined whether the absolute value 1003 is smaller than the threshold σ2.

  If the determination result in step S906 is true, there is no shading change, and the process advances to step S907. In step S907, the OB output average value setting unit 1304 adds the left three region OB unit output average value 1001 to the right three region OB unit output average value 1001 as the OB portion output average value AREA_AVE of DECIDE_AREA, and then divides by two. Set the value.

  After the processing in step S907 is completed, or when the determination in step S906 is false and there is a shading change, it is determined in step S908 whether there is an area to be determined next. In this example, since the right three areas are used for the shading determination, it is determined whether DECIDE_AREA is equal to the final area LAST_AREA-2.

  If the determination result in step S908 is false, 1 is added to DECIDE_AREA in step S903 to shift the shading determination processing area center to the next, and the processes in and after step S904 are repeated.

  If the determination result in step S908 is true, the setting of shading correction data is terminated in step S909.

  As described above, the shading correction data setting unit 1310 performs shading on the average value of the output of the OB portion in a region where shading is performed, and on the plural regions without shading change, the value obtained by recalculating the average value of the output of the OB portion between the regions. The average value of a plurality of regions without change is used. After that, as illustrated in FIG. 4, the interpolation processing unit 1305 generates shading correction data 401 by performing an interpolation process on the average value of each region by linear approximation. A shading correction unit 1306 performs shading correction on the image data of the effective pixel unit 103 using the shading correction data 401. Therefore, the shading correction data 401 of the area without shading change increases the parameter of the output of the OB part by recalculating the average value of the output of the OB part, and is not easily affected by random noise. Can be obtained.

(Third embodiment)
FIG. 11 is a flowchart showing a processing example of the shading correction data setting unit 1310 according to the third embodiment of the present invention, and FIG. 12 is a diagram for explaining FIG. 11 in detail. Hereinafter, the points of the present embodiment different from the first embodiment will be described.

  In order to simplify the explanation, the number of areas for which the moving average of the output average values of the vertical OB unit 101 used for the shading determination process is calculated is 3.

  The shading correction data setting unit 1310 divides the OB part output unit of the image into areas including a certain number, and calculates an average value of the OB part output for each area. Next, in step S1101, the setting of shading correction data is started. In step S1102, the shading determination processing area center DECEIDE_AREA = 3 is set. In step S1103, 1 is added to DECIDE_AREA to set the shading determination processing region center DECIDE_AREA = 4.

  In step S1104, three-region OB output average value calculating section 1302 calculates LEFT_3AREA_AVE2, which is the OB portion output average value of the adjacent three left regions. The adjacent three left areas are three areas not including the shading determination processing area center DECIDE_AREA as shown in FIG. 12, and the OB portion output average value 1201 of the adjacent left three areas is shown as LEFT_3AREA_AVE2.

  Therefore, since the shading determination processing area center DECIDE_AREA = 4, the output of the OB portion in the areas 1, 2, and 3 is a target for calculating the average value (LEFT_3AREA_AVE2) 1201.

  Further, in step S1105, three-region OB output average value calculating section 1302 calculates RIGHT_3AREA_AVE2, which is the OB portion output average value of the adjacent three right regions. The adjacent three right areas are three areas not including the shading determination processing area center DECIDE_AREA as shown in FIG. 12, and the OB portion output average value 1202 of the adjacent three right areas is shown as RIGHT_3 AREA_AVE2.

  Therefore, since the shading determination processing area center DECIDE_AREA = 4, the OB portion outputs of the areas 5, 6, and 7 are targets for calculating the average value (RIGHT_3 AREA_AVE 2) 1202.

  In step S1106, the determination unit 1303 determines whether there is a shading change. In step S1106, the determination unit 1303 determines whether the absolute value 1203 of a value obtained by subtracting the right three region OB unit output average value 1202 from the left three region OB unit output average value 1201 is smaller than an arbitrary threshold σ3.

  In FIG. 12, this is shown as an absolute value 1203 of a value obtained by subtracting the right three area OB section output average value (RIGHT_3 AREA_AVE2) 1202 from the left three area OB section output average value (LEFT_3AREA_AVE2) 1201. It is determined whether the absolute value 1203 is smaller than the threshold σ3.

  If the determination result in step S1106 is true, there is no shading and the process proceeds to step S1107. In step S1107, the OB output average value setting unit 1304 adds the left three region OB unit output average value 1201 to the right three region OB unit output average value 1202 as the OB unit output average value AREA_AVE of DECIDE_AREA, and then divides by two. Set the value.

  After the processing in step S1107 is completed, or if the determination in step S1106 is false and there is a shading change, it is determined in step S1108 whether there is an area to be determined next. In this example, since the right three areas are used for the shading determination, it is determined whether DECIDE_AREA is equal to the final area LAST_AREA-3.

  If the determination result in step S1108 is false, 1 is added to DECIDE_AREA in step S1103 to shift the shading determination processing area center to the next, and the processes in and after step S1104 are repeated.

  If the determination result in step S1108 is true, the setting of shading correction data is terminated in step S1109.

  As described above, the shading correction data setting unit 1310 performs shading on the average value of the output of the OB portion in a region where shading is performed, and on the plural regions without shading change, the value obtained by recalculating the average value of the output of the OB portion between the regions. The average value of a plurality of regions without change is used. After that, as illustrated in FIG. 4, the interpolation processing unit 1305 generates shading correction data 401 by performing an interpolation process on the average value of each region by linear approximation. The shading correction unit 1306 uses the shading correction data 401 to perform shading correction on the image signal of the effective pixel unit 103. Therefore, the shading correction data 401 of the area without shading change increases the parameter of the output of the OB part by recalculating the average value of the output of the OB part, and is not easily affected by random noise. Can be obtained.

  As mentioned above, although this invention has been demonstrated by said embodiment, the technical scope of this invention is not limited to the said embodiment. For example, in the setting method of shading correction data having the same configuration as that of the first embodiment, when calculating 3AREA_AVE, which is an OB portion output average value of three regions, a weighting coefficient may be added to the OB portion output depending on the region. .

  As described above, according to the above-described embodiment, when the shading correction data is set in real time for each shooting, the shading change amount is detected from the OB portion output average value for each region. Then, in the area determined as having no shading change, the output of the OB part of the other area is also used for calculating the average value of the OB part output to increase the parameter so that random noise is not superimposed on the shading correction data.

  Specifically, in the shading correction of an image from a solid-state imaging device having a plurality of effective pixels and a plurality of OBs, the image is divided into areas including a certain number of OBs in real time for each shooting. Then, a shading change process is performed in which the shading change amount is extracted from the average value of the OB part output for each area and the presence / absence of the shading change is determined, and the average value is recalculated from the OB part output between the plural areas without shading change. Do. Then, the recalculated average value is used as an average value of a plurality of areas without shading change, and thereafter, shading correction data is generated by interpolating the average value of each area, and shading correction is performed.

  As described above, the average value of the output of the OB portion is calculated for the region where shading changes, and the average value of the output of the OB portion between the regions is recalculated between the plurality of regions without shading change. Average value. After that, shading correction data is generated by interpolating the average value of each region. Therefore, the shading correction data of the area without shading change increases the parameter of the output of the OB part by recalculating the average value of the output of the OB part, and is not easily affected by random noise. Can be obtained.

  In the above embodiment, the OB (Optical Black) signal of the solid-state imaging device (CMOS sensor) 1301 is corrected and signal processing is performed. Specifically, in the above embodiment, the vertical OB portion (region arranged above or below the pixel region) 101 is divided in the horizontal direction, and the average value of the OB portion for each region is obtained. If the OB portion average values are equal, the adjacent regions are combined and handled as one region. As a result, when shading of the OB signal occurs in the horizontal direction, it is possible to obtain a suitable black signal with reduced random noise and the like while suppressing the influence of shading.

  The solid-state imaging device 1301 includes an effective pixel portion 103 having a plurality of photoelectric conversion elements that are not shielded from light and OB portions 101 and 102 having a plurality of light-shielded photoelectric conversion elements. The three-region OB output average value calculation unit 1302 and the determination unit 1303 divide the OB unit 101 or 102 into a plurality of regions, and perform shading between the plurality of regions based on the average value AREA_AVE of the output signals of the plurality of regions. The presence or absence of a change is determined. The OB output average value setting unit 1304 and the interpolation processing unit 1305 generate the shading correction data so that the shading correction data in the plurality of regions become the same when it is determined that there is no shading change between the plurality of regions. Part. When it is determined that there is no change in shading, the average value AREA_AVE of the output signals of the plurality of regions becomes the same value, and the shading correction data of the plurality of regions becomes the same by the interpolation process.

  In the first embodiment, the three-region OB output average value calculation unit 1302 calculates a moving average value of average values of output signals of a plurality of regions adjacent to one region. The determination unit 1303 determines that there is no shading change when the average value AREA_AVE of the output signal of the one region is within a threshold range with respect to the moving average value.

  In the second and third embodiments, the three-region OB output average value calculation unit 1302 calculates the moving average value of the average values of the output signals of a plurality of regions adjacent to the front (left) of one region and the rear (right). And a moving average value of the average values of the output signals of a plurality of areas adjacent to. The determination unit 1303 determines that there is no change in shading when the difference between the two moving average values is equal to or less than a threshold value.

  In the second embodiment, the plurality of regions adjacent to the front of the one region and the plurality of regions adjacent to the rear of the one region are regions including the one region. In the third embodiment, the plurality of regions adjacent to the one region before and the plurality of regions adjacent to the back of the one region do not include the one region.

  The OB output average value setting unit 1304 corrects the average value of the output signals of the plurality of regions to the same value when it is determined that there is no shading change between the plurality of regions. The interpolation processing unit 1305 generates shading correction data by interpolating the average value of the output signals of the plurality of regions. The shading correction unit 1306 corrects the output signal of the effective pixel unit 103 using the shading correction data.

  The OB unit is a vertical OB unit 101 extending in the horizontal direction, and the three-region OB output average value calculation unit 1302 and the determination unit 1303 divide the OB unit into a plurality of horizontal regions. Accordingly, the shading correction unit 1306 can correct horizontal shading.

  The OB unit is a horizontal OB unit 102 extending in the vertical direction, and the three-region OB output average value calculation unit 1302 and the determination unit 1303 divide the OB unit into a plurality of vertical regions. Accordingly, the shading correction unit 1306 can correct vertical shading.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

It is a figure explaining arrangement | positioning of the effective pixel and OB part of a solid-state image sensor. It is a figure explaining the area division | segmentation of the OB part of a solid-state image sensor. It is a figure explaining the OB part output which has shading, and the OB part output average value for every area | region. It is a figure explaining the example of the conventional shading correction data setting. It is a figure explaining the OB part output on which random noise was superimposed and the OB part output average value for every area | region which has shading. It is a figure explaining the example of the shading correction data setting by the OB part output on which the conventional random noise was superimposed. It is a flowchart which shows the process example of the shading correction data setting part by the 1st Embodiment of this invention. It is a figure which shows the process example of the shading correction data setting part by the 1st Embodiment of this invention. It is a flowchart which shows the process example of the shading correction data setting part by the 2nd Embodiment of this invention. It is a figure which shows the process example of the shading correction data setting part by the 2nd Embodiment of this invention. It is a flowchart which shows the process example of the shading correction data setting part by the 3rd Embodiment of this invention. It is a figure which shows the process example of the shading correction data setting part by the 3rd Embodiment of this invention. It is a figure which shows the structural example of the image processing apparatus by the 1st Embodiment of this invention.

Explanation of symbols

101 Vertical OB unit 102 Horizontal OB unit 103 Effective pixel unit 1301 Solid-state imaging device 1302 Three-region OB output average value calculation unit 1303 Determination unit 1304 OB output average value setting unit 1305 Interpolation processing unit 1306 Shading correction unit 1310 Shading correction data setting unit

Claims (10)

A solid-state imaging device including an effective pixel portion having a plurality of photoelectric conversion elements not shielded and an optical black portion having a plurality of light-shielded photoelectric conversion elements;
A determination unit that divides the optical black portion into a plurality of regions, and determines whether or not there is a change in shading between the plurality of regions based on an average value of output signals of the plurality of regions;
A generation unit that generates shading correction data so that the shading correction data of the plurality of regions become the same when it is determined that there is no change in shading between the plurality of regions;
The determination unit calculates a moving average value of an average value of output signals of a plurality of regions adjacent to one region, and the average value of the output signal of the one region is within a threshold range with respect to the moving average value. there images processing device shall be the determining means determines that no change of shading when. A solid-state imaging device including an effective pixel portion having a plurality of photoelectric conversion elements not shielded and an optical black portion having a plurality of light-shielded photoelectric conversion elements;
A determination unit that divides the optical black portion into a plurality of regions, and determines whether or not there is a change in shading between the plurality of regions based on an average value of output signals of the plurality of regions;
A generation unit that generates shading correction data so that the shading correction data of the plurality of regions become the same when it is determined that there is no change in shading between the plurality of regions;
In the determination unit, the difference between the moving average value of the average values of the output signals of a plurality of regions adjacent to one region before and the moving average value of the average value of the output signals of a plurality of regions adjacent to the next region is equal to or less than a threshold value. sometimes shading images processing device shall be the determining means determines that no change of. The image processing apparatus according to claim 2 , wherein a plurality of areas adjacent to the one area and a plurality of areas adjacent to the one area include the one area. The image processing apparatus according to claim 2 , wherein a plurality of areas adjacent to the one area and a plurality of areas adjacent to the one area are areas not including the one area. Further, the image processing apparatus according to any one of claims 1-4, characterized in that it comprises a shading correcting unit for correcting the output signal of the effective pixel portion by using the shading correction data. When it is determined that there is no shading change between the plurality of regions, the generation unit corrects the average value of the output signals of the plurality of regions to the same value, and interpolates the average value of the output signals of the plurality of regions. the image processing apparatus according to any one of claims 1 to 5, characterized in that to generate the shading correction data by. The optical black portion is a vertical optical black portion extending in the horizontal direction,
The determination unit, an image processing apparatus according to any one of claims 1 to 6, characterized in that dividing the optical black portion into a plurality of regions in the horizontal direction. The optical black portion is a horizontal optical black portion extending in the vertical direction,
The determination unit, an image processing apparatus according to any one of claims 1 to 6, characterized in that dividing the optical black portion into a plurality of regions in the vertical direction. An image processing method performed by an image processing apparatus,
A determination step of dividing an optical black portion having a plurality of light-shielded photoelectric conversion elements into a plurality of regions and determining whether there is a change in shading between the plurality of regions based on an average value of output signals of the plurality of regions. When,
Have a generation step of generating a shading correction data as the shading correction data of said plurality of regions is the same when it is determined that there is no change in shading between said plurality of regions,
In the determination step, a moving average value of average values of output signals of a plurality of regions adjacent to one region is calculated, and the average value of output signals of the one region is within a threshold range with respect to the moving average value. An image processing method characterized by determining that there is no change in shading in some cases. An image processing method performed by an image processing apparatus,
A determination step of dividing an optical black portion having a plurality of light-shielded photoelectric conversion elements into a plurality of regions and determining whether there is a change in shading between the plurality of regions based on an average value of output signals of the plurality of regions. When,
A generation step of generating shading correction data so that the shading correction data of the plurality of regions become the same when it is determined that there is no change in shading between the plurality of regions;
In the determination step, the difference between the moving average value of the average values of the output signals of the plurality of areas adjacent before one area and the moving average value of the average value of the output signals of the plurality of areas adjacent after the one area is equal to or less than a threshold value. An image processing method characterized in that it is sometimes determined that there is no change in shading.

Images