WO2006064587A1 - 多分割読出ccd補正処理装置および方法 - Google Patents

多分割読出ccd補正処理装置および方法 Download PDF

Info

Publication number
WO2006064587A1
WO2006064587A1 PCT/JP2005/013133 JP2005013133W WO2006064587A1 WO 2006064587 A1 WO2006064587 A1 WO 2006064587A1 JP 2005013133 W JP2005013133 W JP 2005013133W WO 2006064587 A1 WO2006064587 A1 WO 2006064587A1
Authority
WO
WIPO (PCT)
Prior art keywords
correction
group information
pixel
line group
ccd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2005/013133
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
Ryutaro Ito
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Priority to EP05766297A priority Critical patent/EP1835765A4/en
Priority to US11/721,667 priority patent/US20090244321A1/en
Priority to CN2005800200026A priority patent/CN1969566B/zh
Publication of WO2006064587A1 publication Critical patent/WO2006064587A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/67Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
    • H04N25/671Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction
    • H04N25/672Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction between adjacent sensors or output registers for reading a single image
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/84Camera processing pipelines; Components thereof for processing colour signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/135Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
    • H04N25/136Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements using complementary colours
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/61Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
    • H04N25/611Correction of chromatic aberration
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/71Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors

Definitions

  • the present invention relates to an output line gain multi-division readout CCD correction processing apparatus and method for a camera using a multi-division readout CCD.
  • the signal path between each block is different, so that when the divided blocks are reconstructed into one screen, the pixel output is output between the blocks.
  • a level difference of values will occur. This level difference is mainly caused by differences due to the physical properties of the circuit. The difference takes a value specific to each CCD.
  • the level difference between the divided blocks is proportional to the amount of light received by the light receiving unit. Therefore, as disclosed in Patent Document 1, the level difference of the pixel output value generated between the respective blocks is compensated by correcting the gain of the amplification unit that amplifies the pixel output value of each block. A method to do this is proposed.
  • Patent Document 1 JP 2002-320142
  • Patent Document 1 uses a single correction approximate line group information common to all pixels, and outputs pixel values generated between blocks depending on the amount of light received by each pixel. This is to correct the level difference. Therefore, it is effective when using a high-quality CCD or a high-quality analog circuit that hardly causes errors such as hue. When using a low-quality CCD or an analog circuit with poor quality, such as a color error, it may not be possible to cope with a color error. This is because each CCD pixel has a unique correction characteristic.
  • the present invention has been made in view of the above problems, and when correcting the output value for a pixel of a CCD, a plurality of correction approximate line group information, or a set of correction approximate line group information and a plurality of errors
  • the corrected approximate straight line group information is created, and the most suitable one of these is selected dynamically.
  • the ratio of the color component (carrier component) is used to select the correction approximate straight line group information (error correction approximate straight line group information) and determine the correction processing ratio. This is because the left and right differences due to CCD characteristics and analog circuit variations are approximately proportional to the ratio of the carrier components, and the experimental results are determined.
  • a first invention includes a first corrected approximate straight line group information holding unit for holding a plurality of corrected approximate straight line group information for correcting an output difference between divided read blocks of a multi-divided read CCD, Based on the pixel output value acquired by the pixel output value acquisition unit for acquiring the pixel output value of the readout CCD, and held in the first correction approximate straight line group information storage unit A plurality of corrected approximate straight line group information forces that are used, a first selection unit that selects two or more sets of corrected approximate straight line group information, and two or more sets of corrected approximate straight line group information that are selected by the first selection unit are used. And a first correction processing unit that corrects the pixel output value.
  • a second invention provides a second corrected approximate straight line group information holding unit for holding corrected approximate straight line group information for correcting an output difference between divided read blocks of a multi-divided read CCD, and a multi-divided read Output Error correction approximate straight line group information holding section that holds error correction approximate straight line group information to correct output difference between CCD divided readout blocks, and pixel output that obtains output values for multi-divided readout CCD pixels
  • the correction approximate line group information held in the second correction approximate line group information holding unit is selected, and Pixel output acquired from the pixel output value acquisition unit
  • a second selection unit that selects error correction approximate straight line group information held in the error correction approximate straight line group information holding unit based on a value; and the corrected approximate straight line group information selected by the second selection unit; And a second correction processing unit that corrects the pixel output value by using error correction approximate straight line group information.
  • the first selection unit performs the selection based on a ratio of a pixel whose output is to be corrected and a pixel output value of the pixel adjacent to the pixel.
  • the present invention relates to a multi-segment CCD correction processing apparatus according to one invention.
  • the second selection unit performs the selection based on a ratio of a pixel whose output is to be corrected and a pixel output value of the pixel adjacent to the pixel.
  • the present invention relates to the multi-segment CCD correction processing apparatus described in the second invention.
  • the first correction processing section performs the correction by using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel close to the pixel.
  • the present invention relates to a multi-segment CCD correction processing apparatus according to the first invention having output ratio utilization correction means.
  • the second correction processing section performs the correction by using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel close to the pixel.
  • the present invention relates to a multi-segment CCD correction processing apparatus according to the second aspect of the invention having output ratio utilization correction means.
  • the first correction processing unit performs the correction by using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel close to the pixel.
  • Output ratio use correction means when the pixel output value acquired by the pixel output value acquisition unit is equal to or less than a predetermined value, the first output ratio use correction means is not used.
  • the present invention relates to a multi-divided CCD correction processing apparatus according to the first aspect of the invention having a part detour processing unit that performs correction.
  • the eighth invention has a reference correction approximate line group information holding unit for holding one reference correction approximate line group information, and the pixel output value acquired by the pixel output value acquisition unit is a predetermined value.
  • the reference correction approximate line group information held in the reference correction approximate line group information holding unit is converted into the two or more sets of correction approximate line group information.
  • the present invention relates to the multi-segment CCD correction processing apparatus according to the first invention which performs the correction by using instead.
  • the second correction processing unit includes a pixel whose output is to be corrected and a pixel close to the pixel.
  • the present invention relates to the multi-segment CCD correction processing apparatus according to the second aspect of the present invention, which has a part detour processing unit that performs the correction without using the second output ratio utilization correction unit.
  • a tenth aspect of the invention is the first aspect, the third aspect, the fifth aspect, the seventh aspect, and the seventh aspect of the invention having a first gain attenuating section that is disposed after the first correction processing section.
  • the multi-divided CCD correction processing apparatus according to any one of the eighth inventions.
  • the eleventh invention is any one of the second invention, the fourth invention, the sixth invention, and the ninth invention having a second gain attenuating section arranged at a subsequent stage of the second correction processing section.
  • the multi-divided CCD correction processing apparatus according to claim 1.
  • a twelfth aspect of the invention is a first gain amplifying unit arranged further upstream of a pixel output value acquisition unit arranged upstream of the first correction processing unit, and a subsequent stage of the first correction processing unit.
  • a multi-segment CCD correction processing apparatus according to any one of the first invention, the third invention, the fifth invention, the seventh invention, and the eighth invention having a first gain attenuating section disposed in About.
  • a thirteenth aspect of the invention is a second gain amplifying unit arranged further upstream of the pixel output value acquisition unit arranged before the second correction processing unit, and a subsequent stage of the second correction processing unit. And a second gain attenuating section disposed on the multi-divided CCD correction processing apparatus according to any one of the second, fourth, sixth, and ninth inventions.
  • a plurality of correction approximate straight line group information is created in advance and stored in a memory, and correction values can be determined therefrom during shooting. It becomes possible to accurately correct the difference in level of the divided pixel output values. Also, the corrected approximate straight line group information and the error corrected approximate straight line group information are created and stored in the memory, and after correcting with the corrected approximate straight line group information, the error is corrected with the error corrected approximate straight line group information. Since addition and subtraction can be performed, the amount of memory and the like can be reduced.
  • FIG. 4 is a diagram for explaining a method of generating correction approximate straight line group information according to the first embodiment.
  • FIG. 5 is a diagram for explaining a plurality of corrected approximate straight line group information in the first embodiment.
  • FIG. 5 is a diagram for explaining neighboring pixels in the first embodiment.
  • FIG. 8 is a diagram for explaining correction approximate straight line group information 1 of the first embodiment.
  • FIG. 9 Flow chart of processing in embodiment 1.
  • FIG. 12 is a diagram for explaining correction approximate straight line group information according to the second embodiment.
  • FIG. 13 A diagram for explaining the error correction approximate straight line group information of the embodiment 2.
  • FIG. 16 Flow chart of processing in embodiment 2.
  • FIG. 20 is a diagram for explaining a pixel 1 of a complementary color filter in Example 1 of Embodiment 5
  • FIG. 21 is a diagram for explaining a pixel 2 of the complementary color filter in Example 1 of Embodiment 5;
  • FIG. 22 is a diagram for explaining the correction method in Example 1 of Embodiment 5;
  • FIG. 30 is a specific gain correction circuit functional block diagram of example 3 of embodiment 7.
  • Fig.31 Flow chart of processing in embodiment 7.
  • FIG. 33 is a flowchart of processing in the eighth embodiment.
  • FIG. 35 is a functional block diagram of a specific gain correction circuit in Example 4 of Embodiment 9.
  • FIG. 36 is a flowchart of processing in the ninth embodiment.
  • FIG. 37 Functional block diagram of Embodiment 10.
  • FIG. 38 A specific overall functional block diagram of Example 5 of Embodiment 10.
  • FIG. 39 is a flowchart of processing in the tenth embodiment.
  • FIG. 40 Functional block diagram of Embodiment 11.
  • FIG. 41 is a flowchart of processing in Embodiment 11.
  • FIG. 42 A specific overall functional block diagram of Example 6 of Embodiment 10.
  • FIG. 43 is a diagram for explaining the concept of the corrected approximate straight line group information of the first embodiment (part 1).
  • FIG. 44 is a diagram for explaining the concept of the corrected approximate straight line group information of the first embodiment (part 2).
  • FIG. 45 is a diagram for explaining the concept of correction approximate straight-line group information in Embodiment 1 (part 3).
  • FIG. 46 is a diagram for explaining the concept of the corrected approximate straight line group information of the first embodiment (part 4).
  • FIG. 47 is a view for explaining correction approximate straight line group information 2 of embodiment 1.
  • FIG. 48 is a view for explaining a method of generating error correction approximate straight line group information according to the second embodiment.
  • FIG. 49 is a diagram showing a specific pixel array used for correction in the first embodiment.
  • the first embodiment mainly describes claim 1, claim 14, claim 22, and the like.
  • the second embodiment mainly describes claim 2, claim 15, claim 22, and the like.
  • the third embodiment mainly describes claims 3, 16, and the like.
  • the fourth embodiment mainly describes claims 4, 17, and the like.
  • Embodiment 5 mainly describes claims 5 and 18, and the like.
  • Embodiment 6 mainly describes claims 6, 19 and the like.
  • Embodiment 7 mainly describes claim 7, claim 20, and the like.
  • the ninth embodiment mainly describes claim 9, claim 21, and the like.
  • the tenth embodiment mainly describes claim 10, claim 12, and the like.
  • the eleventh embodiment mainly describes claim 11, claim 13, and the like.
  • Embodiment 1 will be described below.
  • the multi-segment CCD correction processing apparatus of this embodiment is characterized by performing pixel-specific correction, for example, by providing a correction rule for each color.
  • the concept of the present embodiment will be described.
  • FIG. 1 is a diagram for illustrating an example of the concept of the present embodiment.
  • a CCD using a complementary color filter (details will be described later) is described as an example.
  • the complementary color filter outputs Cl: Mg + Ye pixel output value and C2: G + Cy pixel output value alternately for a certain line, and C4: G + Ye for the next line.
  • Pixel output value, C3: Mg + Cy pixel output value are output alternately.
  • the multi-division CCD correction processing apparatus 0100 of the present embodiment is configured so that the first correction approximate straight line
  • the group information holding unit 0101 stores a plurality of corrected approximate straight line group information (in FIG. 1, for example, four sets, for example, created by photographing white, red, green, and blue subjects) in its own memory. keeping.
  • the pixel output value acquisition unit 0102 acquires the pixel output values of all the pixels.
  • the pixel output value a the output value of the pixel (C1) in the left corner in FIG. 1) of the specific pixel.
  • the first selection unit 0103 includes two or more sets of correction approximate line group information, for example, two sets of correction approximations for the pixel C1, from the plurality of correction approximate line group information held in the first correction approximate line group information holding unit. Select line group information (eg, white and red, or white and green).
  • the first correction processing unit 0104 uses the two sets of correction approximate straight line group information (for example, white and red, or white and green) selected by the first selection unit, and outputs the pixel output value a
  • the correction value B is calculated from the above and corrected.
  • correction approximate straight line group information for C2, C3, and C4 is created as in C1 (FIG. 1 shows two sets of correction approximate straight line group information for pixel C1. It is shown).
  • FIG. 43, FIG. 44, FIG. 45, and FIG. 46 are diagrams for explaining an example of the concept of the corrected approximate straight line group information, and illustrate the case where the CCD is divided into two on the left and right.
  • FIG. 43 is a diagram illustrating an example for explaining pixels that are to be used for the corrected approximate line group information and that are used to generate the corrected approximate line group information.
  • the 2-part CC D4300 is composed of L-CCD4301 in the left block and R-CCD4302 in the right block.
  • the L-CCD has pixel A (4303) and the R-CCD has pixel B (4304).
  • pixel A (4303) and pixel B (4304) are the same type of pixel (for example, CI: Mg + Ye of complementary color filter).
  • the pixel output value of pixel A is a
  • the pixel output value of pixel B is b.
  • pixel A and pixel B are pixels of the same image with uniform colors.
  • FIG. 44 is a diagram for illustrating an example of the concept of the generated corrected approximate straight line group information.
  • FIG. 45 is a diagram for explaining a plurality of corrected approximate straight line group information.
  • three sets of corrected approximate line group information (fl, f2, f3) are shown.
  • precise correction according to the pixel output value of each pixel can be performed.
  • FIG. 46 is a diagram illustrating an example of a correspondence relationship between CCD pixels and corrected values when correction is performed using the corrected approximate straight line group information.
  • CCD pixel number, pixel type, pixel output value, correction approximate straight line group information to be used, correction value, and corrected value are a set.
  • the correction approximate straight line group information selected based on the predetermined condition is fl, and the correction approximation
  • the correction value obtained using the straight line group information is + K1
  • the corrected value of the pixel output value is al + K1.
  • FIG. 2 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing device 0200 of the present embodiment includes a first correction approximate straight line group information holding unit 0201, a pixel output value acquisition unit 0202, a first selection unit 0203, and a first correction processing unit 0204. It consists of
  • CCD Charge Coupled Devices
  • CCD refers to an image sensor that converts light into electric charge by the photoelectric effect! Uh.
  • FIG. 50 is a diagram for illustrating a general CCD concept.
  • CCD5000 is generally A light receiving unit 5001, a vertical transfer unit 5002, and a horizontal transfer unit 5003 are provided.
  • photodiodes light receiving elements
  • luminance light signal intensity
  • a light receiving unit having a plurality of light receiving element forces receives light from a subject and converts the received light into electric charges by a photoelectric effect. The converted charge is transferred to the vertical transfer unit.
  • the electric charge transferred to the vertical transfer unit is transferred to the horizontal transfer unit for the first one line 5004 (the portion surrounded by the dotted line in FIG. 50, also referred to as a row).
  • the horizontal transfer unit outputs the transferred charge for one line to a signal amplifier circuit or the like as charge corresponding to one scanning line.
  • charges for the next line are transferred from the vertical transfer unit to the horizontal transfer unit.
  • a CCD when a CCD is used for the imaging part of a recording device that records video, such as a video camera, the transfer of the charge for one frame is completed within a time of 1Z30 seconds or less.
  • the charge output from the CCD is amplified to a predetermined pixel output value by a signal amplification circuit, and necessary image processing is performed by various circuits.
  • the light receiving element can only have the light intensity information, color information cannot be obtained! (That is, the amount of electric charge (for the present specification, both the pixel output value (to be described later)). Can only be saved). Therefore, in order to express color, CCDs have the ability to separate light using primary color filters and complementary color filters, and one color filter is compatible with one light-receiving element. Therefore, the CCD is configured to generate color information by combining the color information of multiple pixels.
  • the “primary color filter” refers to filters of R (Red: Red), G (Green: Green), and B (Blue: Blue), which are the three primary colors of light.
  • a CCD light receiving element cannot identify a color as described above.
  • the CCD light receiving element used in digital cameras is equipped with RGB filters, which are the three primary colors of light, in order to obtain color information.
  • the color filter array pattern that is attached to each pixel on the CCD is usually fine in the order of RGB even if it is an RGB primary color filter. In many cases, it takes twice as much green as the other two colors because it is the most responsive to human eyes.
  • the primary color filter is characterized by vivid colors. However, in the case of a low-resolution CCD, when the captured image is enlarged, this arrangement pattern may become apparent as noise.
  • primary color filters tend to have low sensitivity and generally low sensitivity.
  • the “complementary color filter” refers to Cy (Cyan: Cyan, Green + Blue), Mg (Magenta: Magenta, Blue + Red), Ye (Yellow: Yellow, Green + Red).
  • G (Green:) is a filter with an offset (see the part 5005 enclosed by the dotted line in Fig. 50).
  • the complementary color filter is used, the pixel output values of Cyan, Magenta, and Yellow are calculated to generate the pixel output values of Red, Green, and Blue.
  • Complementary color filters are characterized by the fact that the color RGB is reproduced by performing calculations once, so that the color reproduction is not smooth and the tone is not as vivid as the primary color filter. In addition, the gradation becomes narrower in the calculation process, resulting in a hard tone.
  • the complementary color filter generally has high sensitivity because of its high light transmittance and calculation by adding green, which contains the most luminance information for the human eye.
  • the complementary color filter generally has a high resolution because it has a characteristic that sharpness can be easily calculated at the stage of image generation. For example, an image of a digital camera equipped with a complementary color filter CCD, as a general tendency, tends to have a calm color with high shear.
  • the "first correction approximate straight line group information holding unit” is configured to hold a plurality of correction approximate straight line group information for correcting an output difference between the divided read blocks of the multi-division readout CCD.
  • multi-division readout means that the light receiving unit is divided into a plurality of blocks, and the vertical transfer unit and the horizontal transfer unit are also divided into a plurality of blocks corresponding to the blocks, and pixel output values (described later) are obtained. To output. In the case of division only in the vertical direction, the vertical transfer unit does not need to be divided. In the case of division only in the horizontal direction, the horizontal transfer unit does not need to be divided. Examples of multi-participation are 2 divisions, 3 divisions, 4 divisions, and so on.
  • One of the purposes of the division here is to allow the output value for one frame (or one field) of pixels to be transferred within a predetermined time even when the number of CCD pixels is large. is there.
  • the "output difference between divided readout blocks” refers to a level difference in pixel output values that occurs between a plurality of blocks when the same intensity of light is applied. These level differences are mainly
  • the pixel output value output from each block divided into a plurality of blocks has a different signal path from the output from the plurality of blocks of the horizontal transfer unit to the next processing circuit, for example, the signal amplification circuit.
  • the next processing circuit for example, the signal amplification circuit.
  • correction approximate straight line group information refers to data information used to approximately correct the level difference of pixel output values between a plurality of blocks with a straight line group.
  • the corrected approximate straight line group information is obtained by taking the pixel output value of each pixel on the horizontal axis and the gain difference of the pixel output values between the reference block and other blocks on the vertical axis.
  • a graph is displayed by drawing. Note that the vertical axis is not limited to the gain difference, and may be the ratio of pixel output values between the reference block and other blocks, the value of multiplication, etc.! /.
  • white correction approximate straight line group information is obtained by photographing a white subject to be used for correction in advance while changing the pixel output value and gaining the pixel output value between the reference block and other blocks. It is generated by calculating the difference. By performing this operation for a plurality of colors (for example, red, green, blue, etc.), correction approximate straight line group information of a plurality of colors is generated. Generated The corrected approximate straight line group information is held in the memory of the first corrected approximate straight line group information holding unit. Here, a plurality of pieces of corrected approximate straight line group information are generated for each basic pixel type.
  • the correction approximate straight line group information may be generated for each digital video recording device (for example, a digital camera, a movie, etc.) having a multi-segment CCD correction processing device, or all multi-segment CCD correction processing devices. Correction approximate straight line group information common to digital video recording apparatuses having the above may be generated. However, there is usually an individual difference in characteristics for each digital video recording device having a multi-segment CCD correction processing device, so that correction approximate straight line group information is generated for each digital video recording device having a multi-segment CCD correction processing device. Is preferred. In addition, the correction approximate straight line group information should be created by the manufacturer before shipment from the factory, but the user can adjust it after shipment from the factory!
  • a notation such as pixel A indicates that the pixel for specifying the pixel arrangement is A
  • a notation such as a indicates an output value for a pixel of pixel A or an output value for a pixel whose type is A. It is shown that.
  • the notation such as pixel (A1) indicates that the pixel type is A1.
  • notation such as pixel A (A1) indicates that the type of pixel A is A1! /.
  • FIG. 3 is a diagram for explaining an example of the concept of the two-divided CCD.
  • 2 split CCD (0300) Is divided into left and right L-CCD (0301) and right R-CCD (0302).
  • all the pixels of the two-divided CCD are assumed to be composed of, for example, a repeated arrangement of four types of pixels (Al), (A2), (A3), and (A4).
  • four colors (Al), (A2), (A3), and (A4) represent one color.
  • the pixel area at the center of the two-divided CCD is divided into a left central pixel area 0303 and a right central pixel area 0304.
  • the left center pixel area and right center pixel area have four types of pixels (Al), (A2), (A3), and (A4), respectively.
  • the pixel output values of the left center pixel region and the right center pixel region are measured for each pixel type. For example, the average value of the pixel output values of the pixel (A1) in the left center pixel area and the right center pixel area is calculated, and the gain difference between the average values of the pixel output values of the pixels (A1) in the respective areas is calculated. To do.
  • FIG. 4 is a diagram for explaining an example of a method of generating corrected approximate straight line group information (in the case of a bisector CCD).
  • the horizontal axis is the pixel output value
  • the vertical axis is the gain difference between the left and right pixels.
  • FIG. 5 shows an example of the corrected approximate straight line group information for the pixel (A1), for example.
  • the pixel output value of pixel (Al) is corrected using correction approximate straight line group information of multiple colors (white, red, green, blue).
  • the other types of pixels (A2), (A3), and (A4) are similarly corrected using a plurality of correction approximate line group information.
  • the sizes of the left central pixel region and the right central pixel region can be freely set.
  • the pixel region used for generating the corrected approximate straight line group information is not limited to the central portion. In other words, the arrangement may be separated on the left and right.
  • the pixel area used for generating the corrected approximate line group information is the minimum pixel area for generating the corrected approximate line group information (for example, four types of pixels (Al), (A2), ( (When using A3) and (A4), it may be 4 pixels on the left and right), but it is preferable to have multiple pixel areas for one type of pixel.
  • the plurality of corrected approximate straight line group information held in the first corrected approximate straight line group information holding unit is used by being output to the first selecting unit.
  • the “pixel output value acquisition unit” is configured to acquire the pixel output value of the multi-division readout CCD.
  • the “pixel output value” refers to a value of a signal output to an image forming a display device that displays an image.
  • the pixel output value may be a value for each pixel (light receiving element) that constitutes the multi-division readout CCD !, and the pixel output value is calculated (for example, addition, It may be a value obtained by performing subtraction.
  • the output values for the four types of pixels Cy, Mg, Ye, and G used in the complementary color filter are changed to Cl: Mg + Ye, C2: G + Cy, C3: Mg + Cy, and C4: G + Ye pixels.
  • the output values for the four types of pixels Cy, Mg, Ye, and G used in the complementary color filter may be converted to the three types of primary pixels R, G, and
  • the force correction process may be performed by converting the output value for B pixels.
  • the pixel output value is used by being output to the first selection unit and the first correction processing unit.
  • the “first selection unit” is based on the pixel output value acquired by the pixel output value acquisition unit! /, And a plurality of correction approximate straight lines held in the first correction approximate straight line group information holding unit.
  • Group information power It is configured to select two or more sets of corrected approximate straight line group information!
  • Output for pixel “Based on the value” is not limited to the pixel itself (referred to as the pixel of interest), but is the result of performing a predetermined calculation process on the pixel output values of the neighboring pixels close to itself. The purpose is to include the value.
  • the “proximity pixel” when attention is paid to a certain pixel A means a pixel adjacent to A or several pixels left and right, several pixels up and down, and several pixels away from each other in an oblique direction.
  • the “predetermined arithmetic processing” includes the ratio of the pixel output values of itself and adjacent pixels, and the ratio of the sum and difference of the pixel output values of itself and adjacent pixels. For example, suppose that its own pixel is A (pixel output value is a) and its neighboring pixel is B (pixel output value is b), for example, aZb, bZa, (a + b) Z (a- b), (a- b) Z (a + b), etc.
  • FIG. 6 is a diagram for explaining an example of the concept of adjacent pixels.
  • the pixel of CCD (0600) consists of four types of pixels (Al), (A2), (A3), and (A4).
  • the four types of pixels (Al), (A2), (A3), and (A4) are the unit of color expression 0601, and these four types of pixels are arranged repeatedly to form all the pixels.
  • the ratio alZa2 between the pixel output values al and a2 is used as the predetermined arithmetic processing.
  • the pixel of interest is the pixel of interest 0602 (A1)
  • the adjacent pixel is, for example, the pixel (A2) circled in FIG.
  • the proximity pixel 0603 (A2) is a pixel adjacent to the target pixel 0602 (A1).
  • Other neighboring pixels for example, the neighboring pixel 0604 (A2) are pixels that are not adjacent to the target pixel 0602 (A1).
  • the concept of neighboring pixels is the same when the ratio a3Za4 of the pixel output values a3 and a4 is used as the predetermined arithmetic processing.
  • the predetermined calculation processing includes processing of pixel output value power of several pixels, which is not limited to processing of only one pixel output value.
  • processing of pixel output value power of several pixels which is not limited to processing of only one pixel output value.
  • FIG. 7 is a diagram for explaining an example of a concept in a case where a pixel operation value obtained by filtering a pixel output value from several pixels is used for the predetermined arithmetic processing.
  • the pixel of CCD (0700) is composed of four types of pixels (Al), (A2), (A3), and (A4).
  • the four types of pixels (A 1), (A2), (A3), and (A4) are the unit of color expression 0701, and these four types of pixels are repeatedly arranged to form all the pixels. .
  • the ratio alZa2 of the pixel output values a1 and a2 is used as the predetermined arithmetic processing. As shown in FIG.
  • the ratio of color components is used to select correction approximate straight line group information.
  • the ratio of color components is used to select correction approximate straight line group information.
  • the above-mentioned ratios alZa2 and a3 / a4 are used. This is determined from the CCD characteristics of the multi-segment CCD correction processor and the experimental results that the difference between blocks due to analog circuit variations is approximately proportional to the carrier component ratio.
  • the most suitable information is dynamically selected from a plurality of corrected approximate line group information. For example, it is assumed that correction approximate straight line group information of a plurality of colors (white, red, green, and blue) is created for the pixel (A1). At this time, if the ratio alZa2 is 1 or more, the red correction approximate line group information is selected, and if it is less than 1, the green correction approximate line group information is selected.
  • “selecting two or more sets of corrected approximate line group information” is not limited to selecting two or more sets of corrected approximate line group information arbitrarily from a plurality of corrected approximate line group information, One set is fixed in advance, and arbitrarily selecting one or more other sets from a plurality of corrected approximate straight line group information is included. For example, a set of correction approximate line group information (for example, white) may be fixed, and another set of correction approximate line group information (for example, red) may be selected. The “selection” is performed according to information for identifying the corrected approximate straight line group information, for example, color information. The selected two or more sets of corrected approximate straight line group information are used by being output to the first correction processing unit.
  • the “first correction processing unit” is configured to correct the pixel output value using two or more sets of corrected approximate straight line group information selected by the first selection unit.
  • “correction of pixel output value” means correction using pixel output value according to a predetermined rule, (pixel output value) and (ratio of output values for multiple pixels) according to a predetermined rule. And the like that can be corrected using.
  • predetermined rule for example, when the pixel output value is equal to or smaller than (or higher than) the predetermined correction approximate straight line group information is selected.
  • a rule is that when the pixel output value is within a predetermined value range, a predetermined correction approximate straight line group information is selected by a ratio of a plurality of pixel output values.
  • FIG. 47 is a diagram for illustrating an example of the concept of the corrected approximate straight line group information used for correction. The correction method will be described based on FIG.
  • a correction value obtained by adding this gain difference to its own pixel output value specifically, The gain difference K1 is added to its own pixel output value a, and a + Kl is used as the correction value. Further, correction is performed in the same manner for other pixels of the same type as A1 (A1). In the same way, when correcting pixels (A2), (A3), and (A4), using multiple correction approximate line group information for pixels (A2), (A3), and (A4), respectively.
  • the pixel output values a2, a3, a4, etc. are used for correction. Less than With the above operation, the four types of pixels (Al), (A2), (A3), and (A4) that make up all the pixels can be corrected.
  • a set of correction approximate line group information is not used for one type of pixel, but two or more sets of correction approximate line group information are used according to the number of pixel types as a whole. )
  • a set of correction approximate line group information is not used for one type of pixel, but two or more sets of correction approximate line group information are used according to the number of pixel types as a whole. The case where correction is performed will be described.
  • a two-divided CCD is used, and four types of pixels (Al), (A2), (A3), and (A4) are used as pixels constituting the CCD.
  • FIG. 8 is a diagram for illustrating an example of the concept of corrected approximate straight line group information used for correction.
  • FIG. 49 shows specific pixels A (A1), B (Al), C (A2), D (Al), E (A2), F (A1) arranged at different positions used for correction. It is a figure which shows an example of the concept of).
  • the correction method will be described based on FIGS. First, if the pixel output value for a specific pixel A (A1) in the left block is a (ku La), white correction approximate straight line group information is selected according to a predetermined rule (rule 1). From 8, obtain the gain difference G1 with the pixel output value in the right block. In this example, the pixel output value of the left pixel is corrected based on the right block.
  • a correction value obtained by adding this gain difference to the output value for its own pixel, specifically a + G 1 obtained by adding the gain difference G1 to its own pixel output value a is corrected.
  • the magnitude of the pixel output value is used to select the corrected approximate line group information.
  • the red correction approximate straight line group information is selected (rule 2), and the gain from the right block is calculated according to FIG. Get the difference G2.
  • Pixel B (A1) is corrected by adding the gain difference G2 to its pixel output value b.
  • the pixel output value d of the pixel D (A1) is determined according to a predetermined rule.
  • the pixel output value e of the neighboring pixel E (A2) is calculated, and if the ratio dZe is smaller than 1, green correction approximate straight line group information is selected (rule 3), and from FIG.
  • Pixel D (A1) is corrected by adding the gain difference G3 to its own pixel output value.
  • the blue correction approximate straight line group information is selected according to a predetermined rule (Rule 4 ) From Fig. 8, the gain difference G4 of the right block force is obtained.
  • Pixel F (A1) is corrected by adding gain difference G4 to its pixel output value. In addition, correction is performed in the same manner for other pixels of the same type as A1 (A1).
  • the pixel output value of the reference divided block is not corrected, but the present invention is not limited thereto.
  • the left block adds a correction value obtained by gain difference to the pixel output value
  • the right block subtracts the correction value obtained by gain difference from the pixel output value. It can also be configured.
  • FIG. 9 is an example of the processing flow of the present embodiment.
  • the pixel output value acquisition step acquires the pixel output value of the multi-segment readout CCD (step S0901).
  • the first selection step is based on the pixel output value acquired in the pixel output value acquisition step! Select approximate line group information (step S0902).
  • the first correction processing step corrects the pixel output value using two or more sets of correction approximate straight line group information selected in the first selection step (step S0903).
  • This embodiment can be applied to a digital video recording apparatus having a multi-segment CCD correction processing apparatus, for example, a digital camera, a movie, a video camera, and the like.
  • the multi-divided CCD correction processing apparatus of the present embodiment it is possible to correct the hue between the divided blocks of the CCD having poor quality. This is because a plurality of correction approximate line group information can be used to perform appropriate correction according to the pixel.
  • the correction approximate straight line group information when the correction approximate straight line group information is created, first, the carrier component (in this specification, the output value for the pixel, and so on) is close to 0 (for example, white). The data of this is acquired and the corrected approximate straight line group information is created. After that, obtain multiple data for large carrier components (for example, red, green, blue, etc.). A plurality of error-corrected approximate line group information is created, including the difference from the corrected approximate line group information of the component having a large component. In normal shooting, correction is first performed using correction approximate straight line group information that is close to the carrier component force ⁇ .
  • a carrier component ratio with a neighboring pixel is detected for each pixel, and error correction approximate straight line group information is selected according to the ratio.
  • An error correction value is calculated from the selected error correction approximate straight line group information, and the final error correction value is determined from the carrier component and the ratio of the carrier component.
  • the final error correction value is calculated by adding / subtracting the determined error correction value to / from the correction value calculated by the correction approximate line group information.
  • the calculation is not limited to the above two-step correction value calculation, but multi-step correction value calculation (three-step correction) is performed to further correct the error after performing carrier component gain correction between a plurality of blocks. By performing the above, correction with higher accuracy can be performed.
  • FIG. 11 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 1100 of the present embodiment includes a second correction approximate straight line group information holding unit 1101, an error correction approximate straight line group information holding unit 1102, a pixel output value acquisition unit 1103, and a second selection unit 1104. And a second correction processing unit 1105.
  • the “second corrected approximate straight line group information holding unit” is configured to hold corrected approximate straight line group information for correcting an output difference between the divided read blocks of the multi-division readout CCD.
  • the corrected approximate straight line group information held in the second corrected approximate straight line group information holding unit may be one or more sets.
  • the corrected approximate straight line group information held in the second corrected approximate straight line group information holding unit is used for calculating the correction value in the first stage.
  • Fig. 12 shows an example of corrected approximate straight line group information for the pixel (A1), for example, among the four types of pixels (Al), (A2), (A3), and (A4) that constitute all the pixels.
  • the correction approximate straight line group information of the reference color (for example, white) used for correction is shown.
  • FIG. 12 shows corrected approximate straight line group information in the case of a two-segment CCD. The gain difference of the pixel output value is between.
  • correction approximate straight line group information is generated for the other pixels (A2), (A3), and (A4).
  • the corrected approximate straight line group information held in the second corrected approximate straight line group information holding unit is used by being output to the second selecting unit.
  • the method of generating the corrected approximate straight line group information is the same as the method of generating the corrected approximate straight line group information of the first embodiment, and thus the description thereof is omitted.
  • the "error correction approximate straight line group information holding unit” is configured to hold error correction approximate straight line group information for correcting an output difference between the divided read blocks of the multi-division readout CCD.
  • error correction approximate straight line group information refers to the reference correction approximation used to further correct the error after calculating the first-stage correction value using the reference correction approximate straight line group information.
  • the correction approximate straight line group information of the difference from the straight line group information! Error correction Approximate line group information is, for example, the pixel output value of each pixel on the horizontal axis, and the gain difference between the pixel output values of the reference correction approximate line group information and other corrected approximate line group information on the vertical axis.
  • the graph is displayed by drawing the error correction approximate straight line group information.
  • the error correction approximate line group information held in the error correction approximate line group information holding unit may be one or more sets.
  • the error correction approximate line group information held in the error correction approximate line group information holding unit is used for calculation of correction values in the second and subsequent stages.
  • FIG. 48 is a diagram illustrating an example of generating error correction approximate line group information for red when white is used as reference approximate line group information for correction.
  • the left side of FIG. 48 shows the white and red correction approximate line group information generated in the same manner as in the first embodiment, and the right side of FIG. 48 shows the generated error correction approximate line group information.
  • G be the error in white and red correction approximate line group information in the pixel output value L.
  • the red as shown on the right side of FIG.
  • the error correction approximate straight line group information is generated.
  • the error correction approximate straight line group information of other colors is similarly generated.
  • Fig. 13 shows error correction approximate straight line group information for pixel (A1), for example, among four types of pixels (Al), (A2), (A3), and (A4) constituting all pixels. Shows an example, error correction
  • the horizontal axis represents the pixel output value
  • the vertical axis represents the error from the reference correction approximate line group information.
  • the dynamic range of the vertical axis represents error correction when the vertical axis of the plurality of corrected approximate straight line group information held in the first corrected approximate straight line group information holding unit of Embodiment 1 requires 14 bits.
  • the vertical axis of the approximate line group information can be reduced to 8 bits. Error correction approximate straight line group information is similarly generated for the other pixels (A2), (A3), and (A4).
  • the error correction approximate line group information held in the error correction approximate line group information holding unit is used by being output to the second selection unit.
  • the method for generating the error correction approximate straight line group information is implemented except that it is generated by calculating the difference from the reference correction approximate straight line group information held in the second correction approximate straight line group information holding unit. Since this is the same as the generation method of the correction approximate straight line group information of form 1, the description is omitted.
  • the "pixel output value acquisition unit” is configured to acquire the pixel output value of the multi-division readout CCD.
  • the pixel output value is used by being output to the second selection unit and the second correction processing unit. Since the other points are the same as those of the pixel output value acquisition unit of the first embodiment, description thereof is omitted.
  • the "second selection unit” is based on the pixel output value acquired by the pixel output value acquisition unit! /, And the corrected approximate straight line group information held in the second corrected approximate straight line group information holding unit In addition, based on the pixel output value acquired from the pixel output value acquisition unit, the error correction approximate line group information held in the error correction approximate line group information holding unit is selected. Is configured. The selected corrected approximate straight line group information and error corrected approximate straight line group information are used by being output to the second correction processing unit. Note that the concept of the method of selecting the corrected approximate straight line group information and the error corrected approximate straight line group information is the same as that of the (first selection unit) in the first embodiment, and thus the description thereof is omitted.
  • the "second correction processing unit” includes the correction approximate straight line group information selected by the second selection unit and the error.
  • the pixel output value is corrected using the corrected approximate straight line group information. That is, the correction value calculation in the first stage is performed using the reference correction approximate line group information, and the correction value calculation in the second stage and thereafter is performed using the error correction approximate line group information. For example, consider the case of using four types of pixels (Al), (A2), (A3), and (A4).
  • a correction value is calculated based on the correction approximate straight line group information selected by the second selection unit.
  • an error correction value is calculated based on the error correction approximate line group information selected by the second selection unit.
  • the final correction value of the pixel output value of the pixel (A1) is determined based on the correction value calculated based on the correction approximate straight line group information and the error correction value calculated based on the error correction approximate straight line group information.
  • the specific way of thinking of correction is explained below.
  • the basic concept other than the calculation of correction values in two or more stages using the corrected approximate straight line group information and the error corrected approximate straight line group information is the correction of the first embodiment. Since this is the same as the method, the details will be omitted.
  • FIG. 14 shows an example of the concept of the reference white correction approximate line group information used for the calculation of the correction value in the first stage. It is assumed that the pixel output value for the specific pixel A (A1) in the left block. At this time, gain difference G1 is obtained from FIG.
  • FIG. 15 shows an example of the concept of error correction approximate straight line group information used for the calculation of the correction value in the second stage.
  • the ratio between the pixel output value a of pixel A (A1) and the pixel output value b of adjacent pixel B (A2) was calculated, and the ratio aZb was 1 or more.
  • the corrected approximate straight line group information is selected, and the error gl from the reference corrected approximate straight line group information is obtained from FIG.
  • a final correction value is calculated as Gl + gl from the gain difference G1 and the error gl.
  • the same calculation can be performed for other pixels of the same type as A1 (A1). Further, other types of pixels (A2), (A3), and (A4) can be similarly calculated. All the pixels are configured by the above operations. 4 It is possible to correct the types of pixels (Al), (A2), (A3), and (A4).
  • the present invention is not limited to the calculation of the two-stage correction value.
  • FIG. 10 is a diagram for illustrating an example of the concept of the multi-segment CCD correction processing apparatus of the present embodiment.
  • a CCD using a complementary color filter is described.
  • the second correction approximate line group information holding unit 1001 previously stores correction approximate line group information (a set of, for example, white color in FIG. 10) in its own memory.
  • Error correction approximate straight line group information holding unit 1002 stores error correction approximate straight line group information (in FIG. 10, for example, three sets, for example, red, green, and blue). Etc.) created by shooting the subject.
  • the pixel output value acquisition unit 1003 acquires the pixel output values of all the pixels.
  • the pixel output value a the output value of the pixel (C1) in the left corner in Fig.
  • the second selection unit 1004 stores the white correction approximate line group information held in the second correction approximate line group information holding unit and the error correction approximate line group information holding unit! Information, for example, red error correction approximate line group information for pixel (C1) is selected.
  • the second correction processing unit 1005 uses the white correction approximate straight line group information and the red error correction approximate straight line group information selected by the second selection unit to calculate the correction value Bl from the pixel output value a. , B2 is calculated and corrected.
  • correction approximate straight line group information and error correction approximate straight line group information for (C2), (C3), and (C4) are created as in (C1) (see FIG. 10).
  • the multi-segment CCD correction processing apparatus is characterized in that correction is performed with reference correction approximate line group information, and the error is further corrected with error correction approximate line group information.
  • the generation method of the error correction approximate line group information is characterized in that it is a difference from the reference correction approximate line group information. For this reason, the error correction approximate straight line group information Since the dynamic range can be reduced, memory capacity can be saved.
  • the dynamic range requires 14 bits, but when the error correction approximate line group information of the present embodiment is used. Requires 8 bits of dynamic range.
  • the basic concept of the correction method is the same as in the first embodiment.
  • FIG. 16 is an example of the processing flow of this embodiment.
  • the pixel output value acquisition step acquires the pixel output value of the multi-segment readout CCD (step S 1601).
  • the second selection step selects correction approximate straight line group information based on the pixel output value acquired in the pixel output value acquisition step, and further acquires the pixel output value acquisition. Based on the pixel output value acquired from the acquisition step! Then, error correction approximate straight line group information is selected (step S 1602).
  • the second correction processing step uses the corrected approximate straight line group information selected in the second selection step and the error correction approximate straight line group information to output the pixel output value. Is corrected (step S1603).
  • This embodiment can be applied to a digital video recording apparatus having a multi-segment CCD correction processing apparatus, for example, a digital camera, a movie, a video camera, and the like.
  • the multi-divided CCD correction processing apparatus of the present embodiment it is possible to correct the hue between the divided blocks of the CCD having poor quality. This is because appropriate correction according to the pixel can be performed using the corrected approximate straight line group information and the error corrected approximate straight line group information. Further, since the error correction approximate line group information is used, the memory capacity required for storage can be reduced as compared with the case where only the correction approximate line group information is used.
  • the first selection unit performs the selection based on the ratio between the pixel whose output is to be corrected and the pixel output value of the pixel close to the pixel.
  • the present invention relates to the multi-segment CCD correction processing apparatus according to Embodiment 1.
  • the present embodiment is characterized in that a ratio of color components (carrier components) is used for selecting the corrected approximate straight line group information. This was determined from the experimental results that the difference between the left and right due to CCD characteristics and variation in the analog circuit is approximately proportional to the ratio of the carrier components.
  • the first selection unit has a plurality of correction approximate straight line group information forces held in the first correction approximate straight line group information holding unit based on the ratio of the pixel output values. Except for selecting the corrected approximate straight line group information, the description is omitted because it is the same as that of the first embodiment.
  • two or more sets of correction approximate line group information power corrections are used based on the ratio of the pixel output values of the pixels adjacent to itself (the ratio of the carrier components). Positive approximate straight line group information can be selected.
  • Embodiment 4 will be described below.
  • the second selection unit performs the selection based on the ratio between the pixel whose output is to be corrected and the pixel output value of the pixel adjacent to the pixel.
  • the present invention relates to the multi-segment CCD correction processing apparatus described in Embodiment 2.
  • the present embodiment is characterized in that a ratio of color components (carrier components) is used for selection of corrected approximate straight line group information (error corrected approximate straight line group information). This is because the experimental results were determined when the left and right differences due to CCD characteristics and analog circuit variations were approximately proportional to the ratio of the carrier components.
  • the second selection unit selects the correction approximate straight line group information based on the ratio of the pixel output values, and further, the error correction approximate straight line group based on the ratio of the pixel output values.
  • the description is omitted because it is the same as that of the second embodiment except that information is selected.
  • the correction approximate straight line group information and the error correction approximate straight line group information used for the correction are calculated based on the ratio of the pixel output values of the pixels close to itself (the ratio of the carrier component). You can choose.
  • Embodiment 5 will be described below.
  • the first correction processing unit performs the correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel close to the pixel.
  • the present invention relates to a multi-segment CCD correction processing apparatus according to the first embodiment having first output ratio use correction means.
  • FIG. 17 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 1700 of the present embodiment includes a first correction approximate straight line group information holding unit 1701, a pixel output value acquisition unit 1702, a first selection unit 1703, a first correction processing unit 1704, a force Become.
  • the first correction processing unit has first output ratio utilization correction means 1705.
  • the "first correction processing unit” has first output ratio utilization correcting means.
  • the “first output ratio use correction means” is configured to perform correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel adjacent to the pixel. .
  • the ratio of the color component carrier component
  • Example 1 of the present embodiment will be described below.
  • the multi-divided CCD correction processing apparatus in the case of dividing into two will be described.
  • FIG. 18 is a diagram showing an example of an overall block diagram of an apparatus including the multi-segment CCD correction processing apparatus according to the present embodiment.
  • the multi-divided CCD correction processing device of this embodiment is divided into a two-divided readout method CCD1801, a 2-block CDS (Correlated Double Sampling) ZADC (Analog Digital Conversion: AD conversion) circuit 1805, and a gain detection circuit.
  • CCD1801 two-divided readout method
  • ZADC Analog Digital Conversion: AD conversion
  • AD conversion Analog Digital Conversion
  • EEPROM nonvolatile memory
  • control microcomputer 1808 gain correction circuit
  • gain correction circuit first selection unit, 1809, pixel rearrangement circuit 1810, CCD signal processing circuit 1811, and carrier component detection circuit 1812.
  • FIG. 19 is a diagram illustrating an example of a block diagram relating to the gain correction circuit of the present embodiment.
  • the block diagram of FIG. 19 includes a carrier component detection circuit 1901, a gain correction circuit 1902, a correction approximate straight line selection circuit (corresponding to the first selection unit) 1903, and a correction circuit based on reference correction approximate straight line group information (first (Corresponding to one correction processing unit) 1904 and correction circuit based on correction approximate straight line group information with large carrier (corresponding to the first correction processing unit) 1905 and correction value calculation circuit based on carrier component ratio (first output ratio use correction 1906) and 1906.
  • the two-divided readout method CCD 1801 includes a light receiving element (photodiode), a vertical transfer CCD 1802, and a horizontal transfer CCD (corresponding to a horizontal transfer unit) 1803 and 1804.
  • the imaging light of the subject is photoelectrically converted by the light receiving element 1802 and accumulated as a charge.
  • This charge is transferred to a vertical transfer CCD (corresponding to the vertical transfer unit) 1802 at a certain timing.
  • Vertical transfer CCD 1802 is divided into left and right parts, left half vertical transfer CCD is left half horizontal transfer CCD 1803, right half vertical transfer CCD is right half horizontal transfer CCD 180 4, at the timing of each line Sent.
  • Horizontal transfer CCD1803 and 1804 transfer the transferred charge to the left and right respectively, and output it as a voltage signal via the left and right amplifiers Is done.
  • the output signal is sent to the 2-block CDSZADC circuit 1805 and digitized.
  • the signals that have been AZD-converted and read out separately in two blocks produce a level difference. It is known that this level difference is caused by the inside of the CCD and the AZD conversion circuit and depends on the output level of the light receiving element (Japanese Patent Laid-Open No. 2002-320412). Experiments also confirmed that the difference varies depending on the color component (carrier component, pixel output value of a certain type of pixel). It has also been confirmed that it varies depending on the characteristics of the substrate. Up to this point, when creating correction approximate line group information and normal shooting! The operation is the same.
  • 20 and 21 are diagrams showing an example of the arrangement of complementary color filters.
  • the complementary color filters are arranged in an array as shown in FIG. 20, and when a moving image is taken, output values for pixels in the vertical direction are added and output in the form shown in the array in FIG.
  • the pixel output value cl of the pixel (C1: Mg + Ye) and the pixel output value c2 of the pixel (C2: G + Cy) are alternately output for one line
  • the pixel (C4: G + Ye) pixel output value c4 and pixel (C3: Mg + Cy) pixel output value c3 are alternately output.
  • the pixel output value dl for (M g) and the pixel output value d2 for (G) alternate in one field, and the pixel output value d4 (Cy) for (Ye) in the next field.
  • Output value d3 is output alternately.
  • the horizontal ratio is close to 1.
  • clZc2 l
  • c3Zc4 l
  • the output value el for the pixel (R) is alternated with the output value e2 for the pixel (G), and the next line is for the pixel (G).
  • Data average values for example, pixel output value cl of pixel (C1), pixel output value c2 of (C2), pixel output value c3 of (C3), and pixel output value c4 of (C4) From the average value, the left and right gain difference (for example, the left and right pixels (Cl), (C2), (C3), and (C4) in the CCD central area Output gain values cl, c2, c3, c4), and create correction approximate straight line group information for correction (for example, pixels (Cl), (C2), (C3), (Create corrected approximate line group information for each of (C4)). Recording is also performed according to the ratio of horizontal carrier components at this time.
  • correction approximate straight line group information having a plurality of carrier components is created.
  • a subject having a large carrier component for example, red, green, blue, etc.
  • the correction approximate straight line group information and the ratio of each line are recorded.
  • subjects of three colors, red, green, and blue are photographed while changing the amount of photographic light, and the pixel output values cl, c2, c3, and c4 are measured for each of the three colors, and the pixel output values for each line are measured.
  • the ratio of clZc2 and c3Zc4 is calculated.
  • red, blue, and green subjects are photographed while changing the light intensity.
  • Cl / c2> wr—C1C2 is taken from a red subject
  • clZc2 wr—C1C2 is taken from a green subject.
  • C3Zc4> wr— Create C3C4 from a blue subject and c3Zc4 wr— C3C4 from a green subject.
  • the control microcomputer 18 08 sets the correction approximate line group information recorded in the nonvolatile memory to the gain correction circuit and the ratio of the horizontal carrier component to the gain correction circuit before shooting.
  • the carrier component detection circuit 1812 and the gain correction circuit 1809 have the configuration shown in FIG. 19, and operate as follows.
  • the right output of the signals output from the CCD during normal imaging is input to the carrier component detection circuit 1901 after AD conversion.
  • the lines are (C1) and (C2), clZc2 is calculated.
  • the lines are (C3) and (C4), c3Zc4 is calculated, and this is used as the carrier component detection result.
  • the signal and carrier component detection results are input to the gain correction circuit 1902.
  • the detection result of the carrier component is input to the correction approximate line selection circuit 1903, and the correction approximate line group information having the carrier component is selected.
  • the correction approximate straight line group information corresponding to it is selected.
  • This is input to the correction circuit 1905 based on the large correction approximate line group information of the next carrier and used for correction.
  • the ratio pr-ClC2 corresponding to this corrected approximate straight line group information recorded at the same time is also selected. This is used in the calculation by the correction point calculation circuit 1906 based on the carrier component ratio.
  • the input signal is input to both the correction circuit 1904 for the reference correction approximate straight line group information (having carrier component of almost zero) and the correction circuit 1905 for the large correction approximate straight line group information. Calculated.
  • FIG. 22 is a diagram for explaining an example of calculation of correction values.
  • the respective corrected approximate straight line group information power correction values are obtained in accordance with the output values for the input pixels.
  • Each of the obtained correction values is sent to a correction point calculation circuit 1906 based on the ratio of carrier components.
  • the correction point calculation circuit 1906 determines the final correction point based on the carrier component ratio detected in 1901.
  • the correction value calculated from the ratio, reference correction approximate straight line group information A is A
  • the correction value based on the correction approximate straight line group information with a large carrier component is B
  • the coefficient of the nonlinear conversion circuit is K
  • the output is
  • E K * (x_ratio-wr_ClC2) / (pr_ClC2-wr_ClC2)
  • FIG. 23 is a diagram showing an example of a block diagram related to the gain correction circuit when the coefficient K of the nonlinear conversion circuit is used.
  • the block diagram of FIG. 23 shows a carrier component detection circuit 2301, a gain correction circuit 2302, a correction approximate line selection circuit (corresponding to the first selection unit) 2303, and a correction circuit based on the reference correction approximate line group information (first Corresponding to correction processing unit) 2304, correction circuit using correction approximate straight line group information with large carrier (corresponding to first correction processing unit) 2305, correction value calculating circuit based on carrier component ratio (first output ratio using correction means ) 230 6 and a non-linear conversion circuit 2307.
  • FIG. 24 is a diagram for explaining the coefficient K of the nonlinear conversion circuit. As shown in Fig. 24, the output is nonlinear with respect to the input. By using a non-linear conversion circuit, correction can be performed with higher accuracy.
  • the multi-divided CCD correction processing apparatus of this embodiment it is possible to correct the hue between the divided blocks of the CCD having poor quality. This is because the correction can be performed using the ratio of the pixel whose output is to be corrected and the pixel output value of the pixel adjacent to the pixel.
  • the second correction processing unit performs the correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel close to the pixel.
  • the present invention relates to a multi-segment CCD correction processing apparatus according to the second embodiment having a second output ratio utilization correction means.
  • FIG. 25 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 2500 of the present embodiment includes a second correction approximate straight line group information holding unit 2501, an error correction approximate straight line group information holding unit 2502, a pixel output value acquisition unit 2503, and a second selection unit 2504. And the second correction processing unit 2505.
  • the second correction processing unit has a second output ratio utilization correction means 2505.
  • second correction approximate straight line group information holding unit “error correction approximate straight line group information holding unit”, “pixel output value acquisition unit”, and “second selection unit” are the same as those in the second embodiment. The description is omitted.
  • the “second correction processing unit” has second output ratio use correction means.
  • the “second output ratio use correction means” is configured to perform correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel adjacent to the pixel.
  • Example 2 of the present embodiment will be described below.
  • the multi-divided CCD correction processing apparatus in the case of dividing into two will be described.
  • FIG. 18 is a diagram showing an example of an overall block diagram of the multi-segment CCD correction processing apparatus of the present example, which is the same as Example 1 of the fifth embodiment.
  • FIG. 26 is a diagram illustrating an example of a block diagram related to the gain correction circuit of the present embodiment.
  • the block diagram of FIG. 26 shows a carrier component detection circuit 2601, a gain correction circuit 2602, an error correction approximate straight line selection circuit diagram (corresponding to the second selection unit) 2603, and a correction circuit based on reference correction approximate straight line group information (first 2604, correction circuit based on error correction approximate straight line group information (corresponding to second correction processing unit) 2605, and error correction amount calculation circuit based on carrier component ratio (second output ratio utilization correction) 2606).
  • correction approximate straight line group information is created from the difference from the reference correction approximate line group information.
  • FIG. 27 is a diagram for explaining an example of error correction approximate line group information.
  • the error correction approximate line group information is the difference between the pixel output value of the correction approximate line group information serving as the reference in Fig. 22 and the pixel output value of the correction approximate line group information having a large carrier component. is there.
  • three colors for example, red, green and blue
  • cl / c2> wr_ClC2
  • c3 / c4> wr—C3C4
  • c3 / c4 wr Creates error correction approximate straight line group information of C3C4.
  • the corrected approximate straight line group information, the error corrected approximate straight line group information, and the carrier component ratio are recorded in the nonvolatile memory via the control microcomputer 1808. That is, here, a set of reference correction approximate straight line group information, a plurality of error correction approximate straight line group information, and a ratio of carrier components when the respective straight line group information is generated. (The ratio is the same as in Example 1)
  • the control microcomputer 18 08 corrects the correction approximate straight line recorded in the non-volatile memory with respect to the gain correction circuit before shooting.
  • the group information, error correction approximate straight line group information, and ratio of horizontal carrier components are set in the gain correction circuit.
  • the carrier component detection circuit 1812 and the gain correction circuit 1809 are configured as shown in FIG. 26 and operate as follows.
  • the right output of the signals output from the CCD during normal imaging is input to the carrier component detection circuit 2601 after AD conversion.
  • the lines are (Cl) and (C2)
  • clZc2 is calculated.
  • the lines are (C3) and (C4)
  • c3Zc4 is calculated, and this is used as the carrier component detection result.
  • the signal and carrier component detection results are input to the gain correction circuit 2602.
  • the input signal is input to both the correction circuit 2604 for the reference correction approximate line group information (carrier component is almost zero) and the correction circuit 2605 for error correction approximate line group information.
  • an error correction value is calculated. This is indicated by 2201 in FIG. 22 (the correction value from the reference correction approximate straight line group information is the same as in Example 1), and each corrected approximate straight line group information according to the output value for the input pixel as indicated by 2701 in FIG. Then, the correction value and the error correction value are obtained from the error correction approximate straight line group information.
  • the obtained error correction value is sent to the error correction amount calculation circuit 2606 based on the ratio of the carrier component, and the error correction amount is calculated.
  • F E * (X ratio—wr—ClC2) Z (pr—C1C2—wr—C1C2)
  • the error correction value by 605 is E
  • the coefficient of the nonlinear circuit is K
  • the output is F
  • the final error correction value is G
  • F K * (x_ratio-wr_ClC2) / (pr_ClC2-wr_ClC2)
  • FIG. 28 is a diagram showing an example of a block diagram related to the gain correction circuit when the coefficient K of the nonlinear conversion circuit is used.
  • the block diagram of FIG. 28 shows a carrier component detection circuit 2801, a gain correction circuit 2802, an error correction approximate straight line selection circuit diagram (corresponding to the second selection unit) 2803, and a correction circuit based on reference correction approximate straight line group information (first 2804, correction circuit based on error correction approximate line group information (corresponding to second correction processing unit) 2805, error correction amount calculation circuit based on carrier component ratio (second output ratio utilization correction means) 2806 and a non-linear conversion circuit 2807.
  • the multi-segment CCD correction processing apparatus of the present embodiment it is possible to correct the hue between the divisional blocks of the CCD having poor quality. This is because the correction can be performed using the ratio of the pixel whose output is to be corrected and the pixel output value of the pixel adjacent to the pixel. Further, since the error correction approximate line group information is used, the memory capacity required for storage can be reduced as compared with the case where only the correction approximate line group information is used. This is because the dynamic range of the error-corrected approximate line group information can be made smaller than the corrected approximate line group information.
  • the first correction processing unit performs the correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel close to the pixel.
  • the first output ratio use correction means for the pixel output value acquired by the pixel output value acquisition unit is less than a predetermined value.
  • the present invention relates to the multi-segment CCD correction processing apparatus according to the first embodiment, which includes a partial detour processing unit that performs the correction without using the first output ratio use correction unit.
  • FIG. 29 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 2900 of the present embodiment includes a first correction approximate straight line group information holding unit 2901, a pixel output value acquisition unit 2902, a first selection unit 2903, a first correction processing unit 2904, a partial With the detour processing unit 29 06, it will also be powerful.
  • the first correction processing unit includes first output ratio use correction means 2905.
  • the "first correction processing unit” has first output ratio utilization correcting means.
  • the “first output ratio use correction means” is configured to perform correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel adjacent to the pixel.
  • the "partial bypass processing unit” performs correction without using the first output ratio use correction unit.
  • Example 3 will be described below.
  • the correction point is calculated as follows.
  • the correction value for which the reference correction approximate line group information power is also calculated is A
  • the correction value based on the correction approximate line group information with a large carrier component Is B and the final correction value is D
  • FIG. 30 is a diagram illustrating an example of a block diagram related to the gain correction circuit according to the present embodiment.
  • the block diagram of FIG. 30 shows a carrier component detection circuit 3001, a gain correction circuit 3002, a correction approximate straight line selection circuit (corresponding to the first selection unit) 3003, and a correction circuit based on reference correction approximate straight line group information (first (Corresponding to one correction processing unit) 3004 and a correction circuit using correction approximate straight line group information with a large carrier (corresponding to the first correction processing unit) 3005 and a correction value calculating circuit based on the ratio of the carrier component (first output ratio use correction (Corresponding to the means) 3006 and a partial detour processing unit 3007. If the pixel output value input to the partial bypass processing unit is equal to or less than a predetermined value, the output of the correction amount calculation circuit 3005 in FIG. . The corrected signal is sent to the pixel rearrangement circuit 1810 in FIG. 18, rearranged to one line, and then sent to the CCD signal processing 1811 to generate the YCrCb signal.
  • FIG. 31 is an example of the processing flow of the present embodiment.
  • the pixel output value acquisition step acquires the pixel output value of the multi-segment readout CCD (step S3101).
  • the partial bypass processing step determines whether or not the pixel output value acquired in the pixel output value acquisition step is less than or equal to a predetermined value. Advances to step S3103, and if not less than the predetermined value, advances to step S3104 (step S3102).
  • the partial bypass processing step performs correction without using the first output ratio use correction means (step S3103).
  • the first selection step is based on the pixel output value acquired in the pixel output value acquisition step! Correction approximate straight line group information is selected (step S3104).
  • the first correction processing step uses two or more sets of correction approximate straight line group information selected in the first selection step using the first output ratio use correction means. Correct the pixel output value (step S3105).
  • the partial bypass processing unit since the partial bypass processing unit is included, when the pixel output value acquired by the pixel output value acquisition unit is equal to or less than a predetermined value, the first output ratio utilization correction unit You can make corrections without using.
  • Embodiment 8 will be described below.
  • the multi-segment CCD correction processing apparatus of the present embodiment has a reference correction approximate straight line group information holding unit that holds one reference correction approximate straight line group information, and the pixel output acquired by the pixel output value acquisition unit. If the value is equal to or less than a predetermined value, the reference correction approximate straight line group information held in the reference correction approximate straight line group information holding part is not used, and the two or more sets of corrections are not used.
  • the multi-divided CCD correction processing apparatus according to the first embodiment which performs the correction by using instead of the approximate straight line group information.
  • FIG. 32 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 3200 of the present embodiment includes a first correction approximate straight line group information holding unit 3201, a pixel output value acquisition unit 3202, a first selection unit 3203, a first correction processing unit 3204, a reference A correction approximate straight line group information holding unit 3205.
  • first correction approximate straight line group information holding unit (pixel output value acquisition unit), (first selection unit), (first correction processing unit) [0251]
  • the "first correction approximate straight line group information holding unit”, “pixel output value acquisition unit”, “first selection unit”, and “first correction processing unit” are the same as those in the first embodiment, and thus description thereof is omitted. To do.
  • the "reference correction approximate line group information holding unit” is configured to hold reference correction approximate line group information.
  • the “reference correction approximate straight line group information” includes, for example, white correction approximate straight line group information close to the carrier component force ⁇ .
  • the method of correcting using the reference correction approximate straight line group information is the same as the method of correcting using the corrected approximate straight line group information described in the first embodiment, and a description thereof will be omitted.
  • FIG. 33 is an example of the processing flow of this embodiment.
  • the pixel output value acquisition step acquires the pixel output value of the multi-segment readout CCD (step S3301).
  • the reference correction approximate straight line group information holding step determines whether or not the pixel output value acquired by the pixel output value acquisition unit is equal to or less than a predetermined value, If it is less than or equal to the value, the process proceeds to step S3303, and if not less than the predetermined value, the process proceeds to step S3304 (step S3302).
  • the reference correction approximate straight line group information holding step does not use the first selection step, but the reference correction approximate straight line group information holding step holds the reference correction approximate straight line. Correction is performed using group information instead of two or more sets of corrected approximate straight line group information (step S3303).
  • the first selection step is based on the pixel output value acquired in the pixel output value acquisition step! Select approximate line group information (step S3304).
  • the first correction processing step uses two or more sets of correction approximate straight line group information selected in the first selection step using the first output ratio utilization correction means. To correct the pixel output value (step S3305).
  • correction when the pixel output value is less than or equal to a predetermined value, correction can be performed using one reference correction approximate line group information.
  • Embodiment 9 will be described below.
  • the second correction processing unit performs the correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel close to the pixel. If the pixel output value acquired by the pixel output value acquisition unit is equal to or less than a predetermined value, the second output ratio use correction unit is not used and the second output ratio use correction unit is not used.
  • the multi-divided CCD correction processing apparatus according to the second embodiment having a partial detour processing unit that performs correction.
  • FIG. 34 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 3400 of the present embodiment includes a second correction approximate straight line group information holding unit 3401, an error correction approximate straight line group information holding unit 3402, a pixel output value acquisition unit 3403, and a second selection unit 3404. And the second correction processing unit 3405 and the partial detour processing unit 3406.
  • the second correction processing unit includes second output ratio use correction means 3405.
  • the "second correction processing unit” has second output ratio utilization correction means.
  • the “second output ratio use correction means” is configured to perform correction using a ratio between a pixel whose output is to be corrected and a pixel output value of a pixel adjacent to the pixel.
  • the "partial bypass processing unit" performs correction without using the second output ratio use correction unit.
  • F E * (x_ratio-wr_ClC2) / (pr_ClC2-wr_ClC2)
  • FIG. 35 is a diagram showing an example of a block diagram related to the gain correction circuit of the present embodiment.
  • the block diagram of FIG. 35 shows a carrier component detection circuit 3501, a gain correction circuit 3502, an error correction approximate straight line selection circuit diagram (corresponding to the second selection unit) 3503, and a correction circuit based on reference correction approximate straight line group information (first 3504, correction circuit based on error correction approximate straight line group information (corresponding to second correction processing unit) 3505, and error correction amount calculation circuit based on carrier component ratio (second output ratio utilization correction) 3506 and a partial detour processing unit 3507. If the pixel output value input to the partial bypass processing unit is equal to or less than a predetermined value, the output of the error correction amount calculation circuit 3506 based on the carrier component ratio is used as the correction value F as it is.
  • the corrected signal is sent to the pixel rearrangement circuit 1810 in FIG. 18 and rearranged to one line, and then sent to the CCD signal processing 1811 to generate the YCrCb signal.
  • FIG. 36 is an example of the process flow of the present embodiment.
  • the pixel output value acquisition step acquires the pixel output value of the multi-segment readout CCD (step S3601).
  • the partial bypass processing step determines whether or not the pixel output value acquired in the pixel output value acquisition step is less than or equal to a predetermined value. Advances to step S3603, and if not less than the predetermined value, advances to step S3604 (step S3602).
  • the partial bypass processing step performs correction without using the first output ratio use correction means (step S3603).
  • the second selection step selects based on the pixel output value acquired in the pixel output value acquisition step, and further performs the pixel output acquired from the pixel output value acquisition step. Based on output value! Then select the error correction approximate line group information (Step S3604).
  • the second correction processing step uses the corrected approximate straight line group information selected in the second selection step and the error correction approximate straight line group information to calculate the pixel output value. Correct (Step S3605).
  • the second output ratio utilization correction unit You can make corrections without using.
  • the multi-divided CCD correction processing apparatus is described in any one of Embodiments 1, 3, 5, 7, and 8 having a first gain attenuating unit disposed at a stage subsequent to the first correction processing unit.
  • the present invention relates to a multi-segment CCD correction processing apparatus.
  • the multi-divided CCD correction processing apparatus of the present embodiment includes a first gain amplifying unit that is disposed further upstream of the pixel output value acquisition unit that is disposed upstream of the first correction processing unit, and the first correction processing. And a first gain attenuating unit disposed at a subsequent stage of the first, third, fifth, seventh, and eighth embodiments.
  • FIG. 37 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 3700 of this embodiment includes a first correction approximate straight line group information holding unit 3701, a pixel output value acquisition unit 3702, a first selection unit 3703, a first correction processing unit 3704, The first gain amplifying unit 3 705 and the first gain attenuating unit 3706 are included. Note that the first gain amplifying unit may be omitted.
  • first correction approximate line group information holding unit "pixel output value acquisition unit”, “first selection unit”, and “first correction processing unit” are the same as those in the first embodiment, and thus the description thereof is omitted. To do.
  • the "first gain amplifying unit” is disposed further upstream of the pixel output value acquisition unit disposed upstream of the first correction processing unit, and is configured to amplify the pixel output value. By amplifying the pixel output value with the first gain amplifying unit, the gain difference between the divided blocks can be obtained with high resolution. Examples of the magnification that the first gain amplifying unit amplifies include 4 times and 8 times.
  • the "first gain attenuation unit” is arranged after the first correction processing unit and configured to attenuate the pixel output value. By attenuating, the amplified pixel output value can be set to an appropriate value. Examples of the magnification at which the first gain attenuation unit attenuates include 1Z2 times, 1Z4 times, and the like.
  • Example 5 of the present embodiment will be described below.
  • the multi-divided CCD correction processing apparatus in the case of dividing into two will be described.
  • adjustment is performed by combining the magnifications of the first gain amplifying unit and the first gain attenuating unit.
  • the entire game Use the following method to amplify ins four times. Normally, when the gain is increased, the first gain amplifying unit is quadrupled, but in the present invention, the first gain amplifying unit is set to 8 times.
  • the first gain amplification unit is multiplied by 8 to create the corrected approximate line group information. (Some correction approximate straight line group information is prepared according to the magnification of the first gain amplification section.)
  • FIG. 38 is a diagram showing an example of an overall block diagram of an apparatus including the multi-segment CCD correction processing apparatus according to the present embodiment.
  • the multi-segment CCD correction processing apparatus of this embodiment includes a two-segment readout method CCD3801, a two-block CDSZADC circuit 3805, a gain detection circuit (corresponding to a pixel output value acquisition unit) 3806, and a non-volatile memory (such as EEPROM) 3807, control microcomputer 3808, gain correction circuit (corresponding to first selection unit and first correction processing unit) 3809, pixel rearrangement circuit 3810, CCD signal processing A circuit 3811; a carrier component detection circuit 3812; and AGC1 (3814: corresponding to the first gain amplifying unit) and AGC2 (3815: corresponding to the first gain attenuating unit).
  • CCD3801 a two-block CDSZADC circuit 3805
  • a gain detection circuit corresponding to a pixel output value acquisition unit
  • Example 5 of Embodiment 5 AGC1 is added after the 2-block CDSZADC circuit to amplify the gain (for example, 8 times), and after adding gain correction, AGC2 is added. And an appropriate gain (for example, 1Z2 times). This makes it possible to increase brightness by increasing the gain just after CDSZADC in the dark. In the two-divided CCD correction, the difference between the left and right can be obtained with high resolution by increasing the amplification factor.
  • Example 6 of this embodiment will be described below. In Example 6, 4 minutes The multi-divided CCD correction processing apparatus in the case of splitting will be described.
  • FIG. 42 is a diagram showing an example of a CCD used in the multi-segment CCD correction processing apparatus in the case of four divisions.
  • the configuration other than the CCD force division is the same as that of the fifth embodiment.
  • the color-dependent processing method for each pixel is the same as for 2-division CCD correction.
  • the difference from the 2-part CCD is that the correction process is repeated four times.
  • the procedure for the correction process is described below.
  • the CCD 4201 is divided into a CCD area 1, a CCD area 2, a CCD area 3, and a CCD area 4.
  • correction area 1, correction area 2, correction area 3, correction area 4, and correction area 5 are shown as central areas used for creating correction approximate straight line group information.
  • Correction is performed using correction area 1 for CCD area 1 and CCD area 2. At this time, correction is made so that CCD area 2 is aligned with CCD area 1.
  • Correction is performed using correction area 2 for CCD area 2 and CCD area 3. At this time, the CCD area 4 is corrected to match the CCD area 3.
  • correction area 3 matches up and down, but correction area 4 and correction area 5 may not match up and down.
  • twisting occurs at the line connecting correction areas 4, 3, and 5 above and below.
  • the twisting correction circuit 4202 is used to correct this twist.
  • FIG. 39 is an example of the process flow of the present embodiment.
  • the first gain amplification step amplifies the pixel output value of the multi-division read CCD (step S3901).
  • the pixel output value acquisition step acquires the pixel output value of the multi-division readout CCD (step S3902).
  • the first selection step is based on the pixel output value acquired in the pixel output value acquisition step! Approximate line group information is selected (step S 3903).
  • the first correction processing step corrects the pixel output value using two or more sets of correction approximate straight line group information selected in the first selection step (step S3904). ).
  • the first gain attenuation step corrects the corrected pixel output value (step S3905).
  • the gain difference of the pixel output values between the divided blocks can be acquired with high resolution.
  • the corrected pixel output value can be attenuated to an appropriate value.
  • the multi-division CCD correction processing device includes the second gain attenuating unit arranged at the subsequent stage of the second correction processing unit, and the multi-division according to any one of the embodiments 2, 4, 6, and 9.
  • the present invention relates to a CCD correction processing apparatus.
  • the multi-divided CCD correction processing apparatus of the present embodiment includes a second gain amplifying unit that is disposed further upstream of the pixel output value acquisition unit that is disposed upstream of the second correction processing unit, and a second correction process. And a second gain attenuating unit arranged at a subsequent stage of the unit.
  • the multi-divided CCD correction processing apparatus according to any one of Embodiments 2, 4, 6, and 9.
  • FIG. 40 is an example of a functional block diagram of the present embodiment.
  • the multi-segment CCD correction processing apparatus 4000 of the present embodiment includes a second correction approximate straight line group information holding unit 4001, an error correction approximate straight line group information holding unit 4002, a pixel output value acquisition unit 4003, and a second selection unit 4004.
  • second The second correction processing unit 4005, the second gain amplification unit 4005, and the second gain attenuation unit 4006 are included. Note that the second gain amplifying unit may be omitted.
  • the “second gain amplifying unit” is arranged further upstream of the pixel output value acquisition unit arranged upstream of the second correction processing unit, and is configured to amplify the pixel output value. By amplifying the pixel output value in the second gain amplifying unit, the gain difference between the divided blocks can be obtained with high resolution. Examples of the magnification that the second gain amplification unit amplifies include 4 times and 8 times.
  • the "second gain attenuation unit” is arranged after the second correction processing unit, and is configured to attenuate the pixel output value. By attenuating, the amplified pixel output value can be set to an appropriate value. Examples of the magnification at which the second gain attenuator attenuates include 1Z2 times and 1Z4 times.
  • the adjustment is performed by combining the magnifications of the second gain amplifying unit and the second gain attenuating unit. For example, to amplify the overall gain by a factor of 4, use it as follows. Normally, when the gain is increased, the second gain amplifying unit is quadrupled, but in the present invention, the second gain amplifying unit is set to eight times.
  • the second gain amplification unit is multiplied by 8 to create (error) corrected approximate line group information.
  • (error) correction near the second gain amplification unit magnification Prepare similar line group information.
  • the second gain amplifying unit is set to 8 times and the second gain attenuating unit is set to 1Z2 times.
  • FIG. 41 is an example of the process flow of the present embodiment.
  • the first gain amplification step amplifies the pixel output value of the multi-division read CCD (step S4101).
  • the pixel output value acquisition step acquires the pixel output value of the multi-segment readout CCD (step S4102).
  • the second selection step selects the correction approximate straight line group information based on the pixel output value acquired in the pixel output value acquisition step! Error correction approximate line group information is selected based on the pixel output value acquired from the pixel output value acquisition step (step S4103).
  • the second correction processing step uses the corrected approximate straight line group information selected in the second selection step and the error correction approximate straight line group information to output the pixel output value. Is corrected (step S4104).
  • the second gain attenuation step corrects the corrected pixel output value (step S4105).
  • the second gain amplifying unit since the second gain amplifying unit is provided, the gain difference between the divided blocks can be acquired with high resolution. In addition, since the second gain attenuating unit is provided, the corrected pixel output value can be attenuated to an appropriate value. Industrial applicability
  • the present invention can be used for a multi-division readout CCD correction processing apparatus and method for gain of an output line in a camera using a multi-division readout CCD.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Facsimile Image Signal Circuits (AREA)
  • Image Processing (AREA)
PCT/JP2005/013133 2004-12-15 2005-07-15 多分割読出ccd補正処理装置および方法 Ceased WO2006064587A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP05766297A EP1835765A4 (en) 2004-12-15 2005-07-15 MULTI-SEGMENT READING CCD CORRECTION DEVICE AND METHOD
US11/721,667 US20090244321A1 (en) 2004-12-15 2005-07-15 Multi-segment reading ccd correcting apparatus and method
CN2005800200026A CN1969566B (zh) 2004-12-15 2005-07-15 多区段读出ccd校正处理装置和方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2004362188A JP4486876B2 (ja) 2004-12-15 2004-12-15 多分割読出ccd補正処理装置および方法
JP2004-362188 2004-12-15

Publications (1)

Publication Number Publication Date
WO2006064587A1 true WO2006064587A1 (ja) 2006-06-22

Family

ID=36587650

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2005/013133 Ceased WO2006064587A1 (ja) 2004-12-15 2005-07-15 多分割読出ccd補正処理装置および方法

Country Status (7)

Country Link
US (1) US20090244321A1 (enExample)
EP (1) EP1835765A4 (enExample)
JP (1) JP4486876B2 (enExample)
KR (1) KR100845673B1 (enExample)
CN (1) CN1969566B (enExample)
TW (1) TW200633507A (enExample)
WO (1) WO2006064587A1 (enExample)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104113674B (zh) * 2014-07-09 2017-05-24 宁波摩视光电科技有限公司 基于fpga的线阵ccd成像系统的图像实时校正输出方法
KR20210142108A (ko) 2019-03-20 2021-11-24 소니그룹주식회사 데이터 보호체, 데이터 보호 시일 및 묘화 장치

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6072603A (en) 1996-02-26 2000-06-06 Eastman Kodak Company Multiple output CCD image block balancing
JP2002185971A (ja) * 2000-12-11 2002-06-28 Nikon Corp 色むら補正装置及び電子カメラ
JP2002320142A (ja) 2001-04-19 2002-10-31 Sony Corp 固体撮像装置
JP2003009162A (ja) * 2001-06-22 2003-01-10 Nippon Hoso Kyokai <Nhk> 撮像装置
JP2003101851A (ja) * 2001-09-21 2003-04-04 Canon Inc 撮像装置、撮像方法、コンピュータ読み取り可能な記憶媒体及びコンピュータプログラム
JP2004350202A (ja) * 2003-05-26 2004-12-09 Canon Inc 撮像装置及び補正方法
JP2004357238A (ja) * 2003-05-30 2004-12-16 Canon Inc 撮像装置及びその画像処理方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7015966B1 (en) * 1999-03-15 2006-03-21 Canon Kabushiki Kaisha Reducing discontinuities in segmented imaging sensors
US6731338B1 (en) * 2000-01-10 2004-05-04 Canon Kabushiki Kaisha Reducing discontinuities in segmented SSAs
JP4655383B2 (ja) * 2001-02-23 2011-03-23 ソニー株式会社 イメージセンサの画像信号処理装置
FR2822327B1 (fr) * 2001-03-16 2003-08-01 Thales Electron Devices Sa Procede et dispositif de prise d'image electronique en plusieurs zones
JP3871194B2 (ja) * 2001-08-02 2007-01-24 日本ビクター株式会社 撮像装置
JP4213943B2 (ja) * 2002-07-25 2009-01-28 富士通マイクロエレクトロニクス株式会社 画質を向上させた画像処理回路
JP4115220B2 (ja) * 2002-09-19 2008-07-09 キヤノン株式会社 撮像装置
US7123298B2 (en) * 2003-12-18 2006-10-17 Avago Technologies Sensor Ip Pte. Ltd. Color image sensor with imaging elements imaging on respective regions of sensor elements

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6072603A (en) 1996-02-26 2000-06-06 Eastman Kodak Company Multiple output CCD image block balancing
JP2002185971A (ja) * 2000-12-11 2002-06-28 Nikon Corp 色むら補正装置及び電子カメラ
JP2002320142A (ja) 2001-04-19 2002-10-31 Sony Corp 固体撮像装置
JP2003009162A (ja) * 2001-06-22 2003-01-10 Nippon Hoso Kyokai <Nhk> 撮像装置
JP2003101851A (ja) * 2001-09-21 2003-04-04 Canon Inc 撮像装置、撮像方法、コンピュータ読み取り可能な記憶媒体及びコンピュータプログラム
JP2004350202A (ja) * 2003-05-26 2004-12-09 Canon Inc 撮像装置及び補正方法
JP2004357238A (ja) * 2003-05-30 2004-12-16 Canon Inc 撮像装置及びその画像処理方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1835765A4

Also Published As

Publication number Publication date
KR20070065266A (ko) 2007-06-22
EP1835765A1 (en) 2007-09-19
US20090244321A1 (en) 2009-10-01
TW200633507A (en) 2006-09-16
TWI351221B (enExample) 2011-10-21
CN1969566A (zh) 2007-05-23
JP4486876B2 (ja) 2010-06-23
EP1835765A4 (en) 2012-05-02
CN1969566B (zh) 2010-08-18
JP2006173942A (ja) 2006-06-29
KR100845673B1 (ko) 2008-07-11

Similar Documents

Publication Publication Date Title
US7777804B2 (en) High dynamic range sensor with reduced line memory for color interpolation
US8023018B2 (en) Drive method for solid-state imaging device, solid-state imaging device, and imaging apparatus
US8040413B2 (en) Solid-state image pickup device
US8310577B1 (en) Method and apparatus for color compensation
JP3824237B2 (ja) 画像処理装置および方法、記録媒体、並びにプログラム
JP5049155B2 (ja) プログレッシブ・インタレース変換方法、画像処理装置及び画像撮像装置
US20080278609A1 (en) Imaging apparatus, defective pixel correcting apparatus, processing method in the apparatuses, and program
US8013914B2 (en) Imaging apparatus including noise suppression circuit
US7710483B2 (en) Solid-state imaging apparatus, driving method thereof, and camera
JP3991011B2 (ja) 画像信号処理装置
JP2003259224A (ja) 撮像装置
US20090303353A1 (en) Image brightness compensating apparatus and method, recorded medium recorded the program performing it
US6900838B1 (en) Method of processing image signal from solid-state imaging device, image signal processing apparatus, image signal generating apparatus and computer program product for image signal processing method
JP2000041179A (ja) 画像入力装置のシェーディング補正方法および画像入力 装置
JP4486876B2 (ja) 多分割読出ccd補正処理装置および方法
JPH11355667A (ja) 画素信号処理装置
US20060103746A1 (en) Image capture device
JP2009303020A (ja) 撮像装置及び欠陥画素補正方法
JP4486874B2 (ja) 多分割読出ccdの補正近似直線群情報生成方法及び多分割読出ccdの補正処理装置製造方法
JP2004350319A (ja) 画像信号処理方法およびその方法を用いた画像信号処理装置およびその方法の手順を表すプログラムコードを記録した記録媒体
JP2002185971A (ja) 色むら補正装置及び電子カメラ
JP2009141583A (ja) 撮像装置
JP2010016450A (ja) 撮像装置
JPH10224807A (ja) 画像信号処理方法及び電子スチルカメラ
JP2006253796A (ja) 画像信号処理装置およびその方法

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 200580020002.6

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 1020067026826

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 11721667

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2005766297

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2005766297

Country of ref document: EP