US8970747B2 - Imaging device - Google Patents

Imaging device Download PDF

Info

Publication number
US8970747B2
US8970747B2 US14/317,766 US201414317766A US8970747B2 US 8970747 B2 US8970747 B2 US 8970747B2 US 201414317766 A US201414317766 A US 201414317766A US 8970747 B2 US8970747 B2 US 8970747B2
Authority
US
United States
Prior art keywords
pixel
pixels
defective
defective pixel
sparse
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
US14/317,766
Other languages
English (en)
Other versions
US20140307130A1 (en
Inventor
Yoshinori Furuta
Tomoyuki Kawai
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Assigned to FUJIFILM CORPORATION reassignment FUJIFILM CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FURUTA, YOSHINORI, KAWAI, TOMOYUKI
Publication of US20140307130A1 publication Critical patent/US20140307130A1/en
Application granted granted Critical
Publication of US8970747B2 publication Critical patent/US8970747B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H04N5/367—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/843—Demosaicing, e.g. interpolating colour pixel values
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
    • H04N9/045—

Definitions

  • the presently disclosed subject matter relates to an imaging device provided with a single-plate type of color imaging element, and in more detail, relates to an imaging device which obtains a pixel value of a defective pixel from a pixel value of a peripheral pixel in a periphery of the defective pixel by interpolation processing.
  • imaging devices such as a digital camera, which are provided with a single-plate type of color imaging element that takes an object image formed on an imaging surface by a photographing optical system.
  • a single-plate type of color imaging element On the imaging surface of the single-plate type of color imaging element, a large number of red (R), green (G) and blue (B) pixels are arrayed according to a predetermined pattern (see Japanese Patent Laid-Open No. 2009-027684).
  • color filters each having a single color are provided on each of the pixels, and accordingly each of the pixels has color information only on the single color.
  • an output image of the color imaging element becomes an RAW image (mosaic image), and accordingly a multichannel image is obtained by interpolation processing (also referred to as synchronization processing or demosaic processing, hereafter the same) that interpolates a pixel of which the color is lost (hereinafter referred to as missing pixel), from a peripheral pixel.
  • interpolation processing also referred to as synchronization processing or demosaic processing, hereafter the same
  • the color imaging element there is the case where such a pixel exists as not to output a signal, or as to output a high level of a dark output due to a dark current or the like, in other words, a so-called defective pixel exists, due to various causes (for instance, crack) in a manufacturing process.
  • a so-called defective pixel exists, due to various causes (for instance, crack) in a manufacturing process.
  • the peripheral pixel of the missing pixel is a defective pixel
  • accurate color information on the missing pixel cannot be obtained. Because of this, the pixel value (output value) of the defective pixel is not used, but the interpolation processing is performed which interpolates the pixel value by using a pixel value in a peripheral pixel having the same color as that of the defective pixel, which is positioned in the periphery.
  • the imaging device described in Japanese Patent Laid-Open No. 2001-036821 performs the interpolation processing when an exposure time is within a standard exposure time, based on a result of having detected the defective pixel, which has been obtained beforehand; and on the other hand, when the exposure time is longer than the standard exposure time, performs a test photography, detects the defective pixel and performs the interpolation processing based on the detection result.
  • the imaging device described in Japanese Patent Laid-Open No. 2002-330353 detects the defects, stores the defective pixels in EEPROM sequentially from the defective pixel having a higher level of defect; and performs the interpolation processing sequentially from the defective pixel having the higher level of defect, based on the defective pixel information stored in the EEPROM.
  • a G pixel is arrayed in a checkered shape (checker pattern). Because of this, other G pixels are not arranged so as to be adjacent to an individual G pixel in the horizontal and vertical directions.
  • dense G pixel a G pixel to which another G pixel is arranged so as to be adjacent in the horizontal and vertical directions
  • sparse G pixel a G pixel to which another G pixel is not arranged so as to be adjacent
  • the dense G pixel is the defective pixel
  • a G pixel which is arranged so as to be adjacent to this defective pixel in the horizontal and vertical directions does not need to be subjected to the interpolation processing, and accordingly the influence of the defective pixel resists spreading (for instance, see FIG. 5 ).
  • an R pixel or a B pixel is arranged so as to be adjacent to the G pixel in the horizontal and vertical directions, and the pixel values of the G pixels (missing pixel) which correspond to the positions of these RB pixels need to be obtained by the interpolation processing. Because of this, when the sparse pixel is the defective pixel, the influence of this defective pixel tends to easily spread (for instance, see FIG. 6 ).
  • the interpolation processing of the pixel value of the defective pixel in the color imaging element it is preferable that the interpolation processing is performed for the pixel values of all the defective pixels by using pixel values of the peripheral pixels having the same colors, respectively.
  • the imaging device does not usually perform the interpolation processing for all of the defective pixels.
  • An object of the presently disclosed subject matter is to provide an imaging device which can provide an adequate photographed image.
  • the invention according to the first aspect of the presently disclosed subject matter includes: a color imaging element in which color filters of a plurality of colors are arranged on a plurality of pixels that are formed of photoelectric conversion elements, respectively, which are arrayed in a horizontal direction and a vertical direction, in accordance with a predetermined color filter array, wherein color filters of at least one color include a sparse filter in which a first adjacent number of adjacent color filters having a same color in the horizontal direction and vertical direction is relatively small, or a second adjacent number of adjacent color filters having a same color in an oblique direction is relatively small, when both of the first adjacent number is M (0 ⁇ M ⁇ 4), and a dense filter in which the first adjacent number or the second adjacent number is relatively large, and the plurality of pixels include a sparse pixel corresponding to the sparse filter and a dense pixel corresponding to the dense filter; an acquiring unit configured to acquire a piece of defective pixel information concerning a defective pixel that is included in the
  • An imaging device includes a defective pixel information memory unit configured to register pieces of defective pixel information therein, and set a ratio of a registration number of the pieces of defective pixel information on the sparse defective pixel with respect to the total pixel number of the sparse pixels so as to become higher than a ratio of a registration number of the pieces of defective pixel information on the dense defective pixel with respect to the total pixel number of the dense pixels, wherein the acquiring unit acquires the piece of defective pixel information from the defective pixel information memory unit.
  • the defective pixel information memory unit has the piece of defective pixel information on the defective pixel registered therein which occurs in any one of each photographing condition when photographing conditions have been changed, and the acquiring unit acquires a piece of defective pixel information which corresponds to the photographing condition, from the defective pixel information memory unit.
  • the photographing condition preferably includes at least one of a gain, an exposure time, and a temperature of the color imaging element.
  • the color filter array preferably has a square array in which color filters of one color are arranged so as to be adjacent to each other in an array pattern corresponding to 2 ⁇ 2 pixels, and an isolated array in which a color filter of one color is arranged so as to be adjacent to color filters of other colors different from the one color in the horizontal direction and the vertical direction.
  • the sparse filter and the dense filter are included in the color filter array.
  • the color filters of the one color are a first filter corresponding to a first color which contributes most to an acquisition of a luminance signal
  • the color filter array includes a basic array pattern in which the first filter and a second filter corresponding to a second color which includes two or more colors other than the first color are arrayed in an array pattern corresponding to N ⁇ N (N: 3 or larger odd number) pixels
  • the basic array pattern is preferably arranged repeatedly in the horizontal direction and the vertical direction.
  • the first filter is arranged on two diagonal lines in the basic array pattern
  • the color filter array preferably includes a square array that is an array pattern corresponding to 2 ⁇ 2 pixels or more, which are formed of the first filter.
  • the plurality of pixels include a plurality of first continuous pixels in which the sparse pixel and the dense pixel are adjacent to each other in any of each direction of the horizontal, vertical and oblique directions, and when the defective pixel includes first continuous defective pixels in which the sparse defective pixel and the dense defective pixel are adjacent to each other in any of each direction, based on the piece of defective pixel information, the interpolating unit preferably sets a third ratio of first continuous defective pixels to be interpolated with respect to a total number of the first continuous pixels so as to become higher than the second ratio.
  • the interpolation processing is preferentially performed for the first continuous defective pixels which have a strong influence on the quality of photographed image data. As a result, adequate photographed image data are obtained.
  • the plurality of pixels include a plurality of second continuous pixels in which the two sparse pixels are close to each other in any of each direction of the horizontal, vertical and oblique directions, and when the defective pixel includes the second continuous defective pixels in which the two sparse defective pixels are close to each other in any of the each direction, based on the piece of defective pixel information, the interpolating unit preferably sets a fourth ratio of second continuous defective pixels to be interpolated with respect to a total number of the second continuous pixels so as to become higher than the second ratio.
  • the interpolation processing is preferentially performed for the second continuous defective pixels which have a strong influence on the quality of the photographed image data. As a result, the adequate photographed image data are obtained.
  • the plurality of pixels include a plurality of third continuous pixels in which two of the dense pixels are adjacent or close to each other in any of each direction of the horizontal, vertical and oblique directions, and when the defective pixel includes third continuous defective pixels in which the two of the dense defective pixels are adjacent or close to each other in any of the each direction, based on the piece of defective pixel information, the interpolating unit sets a fifth ratio of the third continuous defective pixels to be interpolated with respect to the total number of the third continuous pixels so as to become higher than the second ratio.
  • the interpolation processing is preferentially performed for the third continuous defective pixels which have a strong influence on the quality of the photographed image data. As a result, the adequate photographed image data are obtained.
  • a plurality of pixels include the plurality of first continuous pixels in which the sparse pixel and the dense pixel are adjacent to each other in any of each direction of the horizontal, vertical and oblique directions, and a plurality of second continuous pixels in which two of the sparse pixels are close to each other in any of the each direction, and when the defective pixel includes the first continuous defective pixels in which the sparse defective pixel and the dense defective pixel are adjacent to each other in any of the each direction, and the second continuous defective pixels in which the two of the sparse defective pixels are close to each other in any of the each direction, based on the piece of defective pixel information, the interpolating unit preferably sets a fourth ratio of the second continuous defective pixels to be interpolated with respect to a total number of the second continuous pixels so as to become higher than a third ratio of the first continuous defective pixels to be interpolated with respect to a total number of the first continuous pixels.
  • the interpolation processing is preferential
  • a plurality of pixels include the plurality of third continuous pixels in which two of the dense pixels are adjacent or close to each other in any of each direction of the horizontal, vertical and oblique directions, and when the defective pixel includes the first continuous defective pixels, the second continuous defective pixels and the third continuous defective pixels in which the two of the dense defective pixels are adjacent or close to each other in any of the each direction, based on the piece of defective pixel information, the interpolating unit preferably sets a fifth ratio of the third continuous defective pixels to be interpolated with respect to a total number of the third continuous pixels so as to be lower than the third ratio and the fourth ratio.
  • a ratio of the sparse defective pixel to be interpolated with respect to the total pixel number of the sparse pixels is set to become higher than a ratio of the dense defective pixel to be interpolated with respect to the total pixel number of the dense pixels, and accordingly the sparse defective pixel which has a strong influence on the quality of the photographed image data is more preferentially interpolated than the dense defective pixel.
  • the influence of the sparse defective pixel giving on the photographed image data can be reduced even though all the defective pixels have not been subjected to interpolation, from the viewpoint of the upper limit of the memory capacity of the defective pixel information and the prevention of the increase in the processing period of time to be spent on the interpolation processing. As a result, the adequate photographed image data are obtained.
  • FIG. 1 is a block diagram illustrating an electric configuration of a digital camera of a first embodiment
  • FIG. 2 is a schematic diagram of a color imaging element of the first embodiment
  • FIG. 3 is a schematic diagram of a basic array pattern which constitutes a color filter array of the color imaging element
  • FIG. 4 is a block diagram illustrating a configuration concerning pixel interpolation processing of the digital camera
  • FIG. 5 is an explanatory drawing for describing an influence of a dense G defective pixel on a peripheral pixel
  • FIG. 6 is an explanatory drawing for describing an influence of a sparse G defective pixel on the peripheral pixel
  • FIG. 7 is a flow chart illustrating a flow of registration processing of defective pixel information to defective pixel information data
  • FIG. 8 is an explanatory drawing for describing interpolation processing of pixel values of the sparse G defective pixel and the dense G defective pixel;
  • FIG. 9 is a flowchart for describing an operation of the digital camera of the first embodiment
  • FIG. 10 is a schematic diagram of the color imaging element of Embodiment 1-1;
  • FIG. 11 is a schematic diagram of a color imaging element of another embodiment of the color imaging element illustrated in FIG. 10 ;
  • FIG. 12 is a schematic diagram of the color imaging element of Embodiment 1-2;
  • FIG. 13 is a schematic diagram of the color imaging element of Embodiment 1-3;
  • FIG. 14 is a block diagram illustrating an electric configuration of a digital camera of a second embodiment
  • FIG. 15 is an explanatory drawing for describing sparse-dense G defective pixels
  • FIG. 16 is an explanatory drawing for describing sparse-sparse G defective pixels
  • FIG. 17 is an explanatory drawing for describing dense-dense G defective pixels
  • FIG. 18 is a flowchart illustrating a flow of determination processing for a defective pixel of the second embodiment
  • FIG. 19 is a flowchart illustrating a flow of registration processing of defective pixel information of the second embodiment
  • FIG. 20 is a block diagram illustrating an electric configuration of a digital camera of a third embodiment
  • FIG. 21 is a flowchart illustrating a flow of registration processing of defective pixel information of the third embodiment
  • FIG. 22 is a flowchart for describing an operation of the digital camera of the third embodiment
  • FIG. 23 is a block diagram illustrating an electric configuration of a digital camera of another embodiment of the third embodiment.
  • FIG. 24 is a block diagram illustrating an electric configuration of a digital camera of further another embodiment of the third embodiment.
  • FIG. 25 is a block diagram illustrating an electric configuration of a digital camera of a fourth embodiment
  • FIG. 26 is an explanatory drawing for describing a first example of the calculation of an evaluation value
  • FIG. 27 is an explanatory drawing for describing a second example of the calculation of the evaluation value
  • FIG. 28 is an explanatory drawing for describing a third example of the calculation of the evaluation value
  • FIG. 29 is an explanatory drawing for describing a fourth example of the calculation of the evaluation value
  • FIG. 30 is an explanatory drawing for describing a fifth example of the calculation of the evaluation value
  • FIG. 31 is a block diagram illustrating an electric configuration of a digital camera of a fifth embodiment
  • FIG. 32 is a block diagram illustrating an electric configuration of a digital camera of further another embodiment of the third embodiment.
  • FIG. 33 is an explanatory drawing for describing an interpolation processing which is different from interpolation processing of pixel values of the sparse-dense G continuous defective pixels illustrated in FIG. 15 .
  • a CPU 11 of a digital camera (imaging device) 10 sequentially performs various programs and data which have been read out from a memory which is not illustrated, based on a control signal sent from an operation unit 12 which includes a shutter button or a shutter switch and various operation buttons, and collectively controls each unit of the digital camera 10 .
  • a zoom lens 14 In a lens unit 13 , a zoom lens 14 , a focus lens 15 , a mechanical shutter 16 and the like are incorporated.
  • the zoom lens 14 and the focus lens 15 are driven by a zoom mechanism 17 and a focus mechanism 18 , respectively, and are moved forward and backward along an optical axis of both the lenses 14 and 15 .
  • the mechanical shutter 16 has a movable unit (of which illustration is omitted) which moves between a closing position at which the light of an object is prevented from being incident on a color imaging element 20 and an open position at which the light of the object is permitted to be incident.
  • the mechanical shutter 16 opens/closes an optical path which reaches the color imaging element 20 from each of the lenses 14 and 15 , by moving the movable unit to each of the positions.
  • the mechanical shutter 16 includes a diaphragm which controls the light quantity of the light of the object, which is incident on the color imaging element 20 .
  • the operations of the mechanical shutter 16 , the zoom mechanism 17 and the focus mechanism 18 are controlled by the CPU 11 through a lens driver 21 .
  • a single-plate type of color imaging element 20 is arranged in the rear of the lens unit 13 .
  • the color imaging element 20 converts the light of the object, which is incident from each of the lenses 14 and 15 , into an electric output signal, and outputs the signal.
  • the color imaging element 20 may be any of various types of imaging elements such as a CCD (Charge Coupled Device) color imaging element and a CMOS (Complementary Metal Oxide Semiconductor) color imaging element.
  • An imaging element driver 23 controls the driving of the color imaging element 20 under the control of the CPU 11 .
  • a signal conditioning circuit 24 has a correlation double sampling processing circuit, an automatic gain correcting circuit and the like, and subjects a signal output from the color imaging element 20 to correlation double sampling processing and gain amplification processing.
  • An image processing circuit 25 subjects the output signal which is input from the signal conditioning circuit 24 , to various processes such as gradation conversion, white balance correction, ⁇ correction processing and pixel interpolation processing, and generates image data.
  • This image processing circuit 25 has an interpolation processing unit (acquiring unit and interpolating unit) 26 provided therein.
  • the interpolation processing unit 26 acquires information memorized in a defective pixel information memory unit (hereinafter abbreviated as memory unit) 27 , which corresponds to the defective pixel information memory unit of the presently disclosed subject matter, and subjects the pixel value (output value) of the defective pixel to the interpolation processing which uses a pixel value of a peripheral pixel that is positioned in the periphery.
  • memory unit 27 a defective pixel information memory unit
  • acquisition described here includes “referencing” to the information which is memorized in the memory unit 27 .
  • the interpolation processing unit 26 subjects the previously described pixel value of the missing pixel to the interpolation processing which uses the pixel value of the peripheral pixel.
  • a compression expansion processing circuit 29 subjects the image data which have been processed in the image processing circuit 25 , to compression processing.
  • the compression expansion processing circuit 29 also subjects the compressed image data which have been obtained from a memory card 31 , to expansion processing through a media I/F 30 .
  • the media I/F 30 records and reads out the image data in and from the memory card 31 .
  • a display unit 32 is a liquid crystal display or the like, and displays a through image, a reproduced image and the like.
  • the digital camera 10 has an AF detection circuit for autofocus, an AE detection circuit and the like provided therein, though the illustration is omitted.
  • the CPU 11 drives the focus mechanism 18 through the lens driver 21 based on the detection result of the AF detection circuit, and thereby performs AF processing.
  • the CPU 11 also drives the mechanical shutter 16 through the lens driver 21 based on the detection result of the AE detection circuit, and thereby performs AE processing.
  • the color imaging element 20 includes a plurality of pixels which have each a photoelectric conversion element 33 therein and are arrayed in a horizontal direction and a vertical direction (two-dimensional array), and color filters which are each arranged above a light-receiving surface of each of the pixels and in a predetermined color filter array.
  • the “above” means a direction in a side from which the light of the object is incident on an imaging surface of the color imaging element 20 .
  • the “below” is an opposite side to the “above”.
  • any of the color filters of trichromatic colors of RGB (hereinafter referred to as R filter, G filter and B filter) 34 R, 34 G and 34 B is arranged.
  • the G filter 34 G corresponds to the first filter of the presently disclosed subject matter
  • the R filter 34 R and the B filter 34 B correspond to the second filter of the presently disclosed subject matter.
  • a pixel having the R filter 34 R arranged thereon is referred to as “R pixel”
  • a pixel having the G filter 34 G arranged thereon is referred to as “G pixel”
  • a pixel having the B filter 34 B arranged thereon is referred to as “B pixel”.
  • “a, b, c, d, e, f, . . . ” and “1, 2, 3, 4, 5, 6, . . . ” represent an address of the RGB pixels.
  • a subscript (G “1” and G “2” ) of the G filter 34 G in the figure will be
  • the color filter array of the color imaging element 20 (hereinafter referred to simply as color filter array) has the following features (1), (2), (3), (4), (5) and (6).
  • the color filter array includes a basic array pattern P (pattern illustrated by thick frame in figure) formed of a square array pattern corresponding to 6 ⁇ 6 pixels, and this basic array pattern P is arranged so as to be repeated in a horizontal direction and a vertical direction.
  • the R filter 34 R, the G filter 34 G and the B filter 34 B are arrayed while having predetermined periodicity.
  • the R filter 34 R, the G filter 34 G and the B filter 34 B are thus arrayed while having the predetermined periodicity, when the R, G and B signals which are read out from the color imaging element 20 are subjected to synchronization processing (demosaic processing) and the like, the signals can be processed according to a repeated pattern, as compared to a conventionally known random array.
  • the color filter array which has been subjected to the thinning-out processing can be set at the same color filter array as that before the thinning-out processing, and a common processing circuit can be used.
  • one or more of the G filters 34 G corresponding to the color (in this embodiment, color of G) which contributes most to the acquisition of a luminance signal are arranged in each of the lines in the horizontal, vertical and oblique (NE and NW) directions of the color filter array.
  • NE means obliquely upper-right and obliquely lower-left directions
  • NW means obliquely lower-right and obliquely upper-left directions.
  • the oblique (NE and NW) directions become directions of 45 degrees with respect to the horizontal direction, respectively, but if the array is a rectangular array of pixels, the directions become directions of diagonal lines of the rectangle.
  • the angle can vary depending on the lengths of a long side and a short side.
  • the G filters 34 G corresponding to a luminance-based pixel are arranged in each of the lines in the horizontal, vertical and oblique (NE and NW) directions of the color filter array, and accordingly a reproduction accuracy of pixel interpolation processing (synchronization processing and the like) in a high frequency region can be enhanced regardless of a direction in which a high frequency occurs.
  • the pixel numbers of the R pixels, the G pixels and the B pixels are 8 pixels, 20 pixels and 8 pixels, respectively.
  • a ratio of each of the pixel numbers of the RGB pixels is 2:5:2, and a ratio of the pixel number of the G pixels becomes larger than ratios of each of the pixel numbers of the R pixels and the B pixels which have the other colors.
  • the ratio of the pixel number of the G pixels is different from the pixel numbers of the R and B pixels as has been described above, and the ratio of the pixel number particularly of the G pixel which contributes most to the acquisition of the luminance signal is set to be larger than the ratios of the pixel numbers of the R and B pixels. Because of this, aliasing in the pixel interpolation processing (synchronization processing and the like) can be suppressed, and high frequency reproducibility also can be enhanced.
  • one or more of the R filter 34 R and the B filter 34 B which correspond to other colors of two or more colors (in this embodiment, colors of R and B) except for the color of G are arranged in each of the lines in the horizontal and vertical directions of the color filter array, in the basic array pattern P.
  • the R filter 34 R and the B filter 34 B are arranged in the lines in the horizontal and vertical directions of the color filter array, respectively, and accordingly the occurrence of color moire (false color) can be reduced. Thereby, it can become unnecessary to arrange an optical low pass filter for suppressing the occurrence of the false color in an optical path between the incidence surface and the imaging surface of the optical system, and even when the optical low pass filter is applied, the optical low pass filter to be applied may have a weak function of shielding a high-frequency component for preventing the occurrence of the false color. Thereby, the resolution can be prevented from being impaired.
  • the basic array pattern P can be regarded as an array in which an A array 35 a of 3 ⁇ 3 pixels and a B array 35 b of 3 ⁇ 3 pixels are alternately arranged in the horizontal and vertical directions.
  • the G filters 34 G are arranged at four corners and the center, and are arranged on both of diagonal lines.
  • the R filter 34 R is arrayed in the horizontal direction and the B filter 34 B is arrayed in the vertical direction, so as to sandwich the G filter 34 G in the center.
  • the B array 35 b is an array in which the R filter 34 R and the B filter 34 B are arranged in a way reverse to the A array 35 a.
  • the A array 35 a and the B array 35 b are alternately arranged in the horizontal and vertical directions, and thereby the G filters 34 G at the four corners of the A array 35 a and the B array 35 b form the G filters 34 G of the square array corresponding to 2 ⁇ 2 pixels.
  • the G filters 34 G of the square array which correspond to 2 ⁇ 2 pixels, in other words, the G filter 34 G to which the other G filters 34 G are arranged so as to be adjacent in the horizontal and vertical directions is hereafter referred to as “dense G filter 34 G”, and is represented by “G 1 ” in the figure.
  • the G pixel corresponding to the dense G filter 34 G is referred to as “dense G pixel.”
  • the G filter 34 G in the center of the A array 35 a and the B array 35 b becomes an isolated array which is arranged so as to be adjacent to the R and B filters 34 R and 34 B of the different colors in the horizontal and vertical directions.
  • Such a G filter 34 G to which another G filter 34 G is not arranged so as to be adjacent in the horizontal and vertical directions is hereafter referred to as “sparse G filter 34 G”, and is represented by “G 2 ” in the figure.
  • the G pixel corresponding to the sparse G filter 34 G is referred to as “sparse G pixel”.
  • the R and B filters 34 R and 34 B each do not have the color filter of the same color arranged in the horizontal and vertical directions.
  • the color filter array includes a square array corresponding to 2 ⁇ 2 pixels in which the dense G filters 34 G are provided, as has been described above.
  • the 2 ⁇ 2 pixels in which such dense G filters 34 G are provided are taken out, and an absolute value of a difference between the pixel values of the G pixels in the horizontal direction, an absolute value of a difference between the pixel values of the G pixels in the vertical direction, and an absolute value of a difference between the pixel values of the G pixels in the oblique direction (NE and NW) are determined.
  • NE and NW absolute value of a difference between the pixel values of the G pixels in the oblique direction
  • this color filter array it can be discriminated which direction has a high correlation out of the horizontal direction, the vertical direction and the oblique direction, with the use of information on the G pixel having the smallest pixel spacing.
  • This direction discrimination result can be used in the interpolation processing (synchronization processing and the like) which interpolates the defective pixel from the peripheral pixel.
  • the basic array pattern P is point-symmetrical with respect to its center (center of four dense G filters 34 G).
  • the A array 35 a and the B array 35 b in the basic array pattern P are also point-symmetrical with respect to the central G filters 34 G, respectively.
  • Such a symmetry enables a processing circuit in the latter stage to be scaled down or to be simplified.
  • defective pixel information data 37 concerning the defective pixel in the color imaging element 20 are memorized.
  • “registration No”, “defect type”, “address” and “pixel value” are registered for each of the defective pixels as individual defective pixel information (hereinafter referred to simply as defective pixel information).
  • “Registration No” represents the order in which the data have been registered in the defective pixel information data 37 .
  • “defect type” represents the type of the defective pixel.
  • the defective pixel is a dense G pixel, the defective pixel is registered as the dense G defective pixel; when being a sparse G pixel, the defective pixel is registered as the sparse G defective pixel; when being an R pixel, the defective pixel is registered as the R defective pixel; and when being a B pixel, the defective pixel is registered as the B defective pixel.
  • the defective pixel of the G pixels including the dense G defective pixel and the sparse G defective pixel is referred to as “G defective pixel”.
  • “Address” is an address [coordinate (X, Y)] of the defective pixel on the imaging surface of the color imaging element 20 .
  • the X coordinate (x1, x2, . . . ) is represented by any of “1, 2, 3 . . . ” which are illustrated in FIG. 2 and FIG. 3
  • the Y coordinate (y1, y2, . . . ) is represented by any of “a, b, c . . . ”.
  • “pixel value” is a pixel value of the defective pixel which has been detected when the defective pixel is inspected, which will be described later.
  • the defective pixel information described above is registered in the defective pixel information data 37 , for instance, by a defective pixel inspection device (hereinafter abbreviated simply as inspection device) 40 in an inspection process in a manufacturing maker of a digital camera 10 .
  • the inspection device 40 inspects whether the pixel is a defective pixel or not for each of all the pixels in the color imaging element 20 , and registers the defective pixel information concerning the defective pixel in the defective pixel information data 37 .
  • “sparse G defective pixel” is more preferentially registered in the defective pixel information data 37 than “dense G defective pixel”.
  • “preferential” registration means that when a ratio of “registration number of dense G defective pixels” with respect to “total pixel number of dense G pixels” is represented by R1, and a ratio of “registration number of sparse G defective pixels” with respect to “total pixel number of sparse G pixels” is represented by R2, the defective pixels are registered so as to satisfy R1 ⁇ R2.
  • the G pixel in an address (3, d) is a dense G defective pixel (in the figure, pixel designated by x mark)
  • the G pixel (dense G pixel) which is arranged so as to be adjacent thereto in the horizontal and vertical directions does not become a missing pixel.
  • the pixel values of the G pixels (hereinafter referred to as missing G pixel) which correspond to the positions of two R and B pixels that are adjacent to the dense G defective pixel in the horizontal and vertical directions, (which are illustrated by hatching in the figure), are subjected to the interpolation processing which uses the pixel value of the G defective pixel. Because of this, the pixel values of pixels which are particularly strongly affected by the dense G defective pixel are the pixel values of the two missing G pixels. Therefore, the influence of the dense G defective pixel resists spreading.
  • the sparse G pixel in an address (2, e) is the sparse G defective pixel
  • four pixels adjacent in the horizontal and vertical directions are the R pixel and the B pixel, and accordingly the pixel values of the missing G pixels which correspond to the positions of these four adjacent pixels need to be subjected to the interpolation processing which uses the pixel value of the G defective pixel.
  • the pixel value which is calculated by the pixel interpolation is strongly affected by the pixel value of the pixels adjacent in the horizontal and vertical directions, and accordingly the sparse G defective pixel exerts an influence on the pixel values of the missing G pixels corresponding to the positions of the four adjacent pixels.
  • the influence of the sparse G defective pixel tends to more easily spread than that of the dense G defective pixel, the influence on the photographed image becomes larger, and accordingly the defective pixel information of the sparse G defective pixel is more preferentially registered than the defect information of the dense G defective pixel.
  • the inspection device 40 includes a determination processing unit 42 which determines whether each of the pixels in the color imaging element 20 is a defective pixel or not, and a registration processing unit 45 which registers pixel information 43 and threshold value information 44 which are used in this determination, and the defective pixel information in the defective pixel information data 37 .
  • the pixel information 43 includes address information of each of the pixels in the color imaging element 20 , and information concerning the type of the pixel (for instance, sparse G pixel, dense G pixel, R pixel, B pixel and the like), and the like.
  • the threshold value information 44 stores a threshold value A therein which is used for the determination of whether the sparse G pixel is the sparse G defective pixel or not, and a threshold value B therein which is used for the determination of whether the dense G pixel is the dense G defective pixel or not.
  • the threshold value B is set at a value larger than the threshold value A.
  • the inspection device 40 makes the color imaging element 20 take an image, for instance, under a light-shielded state in which the imaging surface of the color imaging element 20 is light-shielded by the mechanical shutter 16 , prior to the determination by the determination processing unit 42 .
  • the pixel value (output value) of each of the pixels in the color imaging element 20 under the light-shielded state is previously determined.
  • obtained pixel value of each of the pixels represents the level of the dark output of each of the pixels.
  • a method for determining the level of the dark output of each of the pixels is not limited to the above described method, and various known methods can be used.
  • the determination processing unit 42 determines whether the pixel value of each of the pixels, which has been obtained under the light-shielded state, is the threshold value or larger, or not, and when the pixel value is the threshold value or larger, the determination processing unit 42 determines that the pixel is the defective pixel. At this time, the determination processing unit 42 determines the pixel to be inspected by using “threshold value A” when the pixel to be inspected is the sparse G pixel, and determines the pixel to be inspected by using “threshold value B” when the pixel to be inspected is the dense G pixel, based on the pixel information 43 .
  • the determination processing unit 42 performs the determination processing by using, for instance, “threshold value A” (where value other than threshold value A is also acceptable), when the pixel to be inspected is the R pixel or the B pixel.
  • the registration processing unit 45 registers the defective pixel information concerning the pixel which has been determined to be the defective pixel by the determination processing unit 42 , within a range of the upper limit number of the registration, in the defective pixel information data 37 . At this time, there is the case where the total pixel number of the G defective pixels is larger than the upper limit number of the registration of the G defective pixels. In this case, the registration processing unit 45 registers the defective pixel information firstly on the sparse G defective pixel, for instance, in the defective pixel information data 37 .
  • the determination processing unit 42 in the inspection device 40 operates.
  • the determination processing unit 42 starts the determination processing for the first (for instance, address (1, a)) pixel.
  • the address of the pixel to be inspected can be discriminated, for instance, from the order of the pixel values output from the color imaging element 20 , and the like.
  • the determination processing unit 42 discriminates the type of the pixel with reference to the pixel information 43 , based on the address of the pixel to be inspected.
  • the determination processing unit 42 compares the threshold value A with the pixel value. Then, when pixel value ⁇ threshold value A holds, the determination processing unit 42 determines that the sparse G pixel is the sparse G defective pixel, and when pixel value ⁇ threshold value A holds, the determination processing unit 42 determines that the sparse G pixel is a normal pixel.
  • the determination processing unit 42 compares the sizes of the threshold value B and the pixel value. When pixel value ⁇ threshold value B holds, the determination processing unit 42 determines that the dense G pixel is the dense G defective pixel, and when pixel value ⁇ threshold value B holds, the determination processing unit 42 determines that the dense G pixel is a normal pixel.
  • the determination processing unit 42 determines whether the pixel is the defective pixel or not by using the threshold value A.
  • the determination processing unit 42 determines whether the pixel is the defective pixels or not, for the second and subsequent pixels as well, in a similar way to the determination processing for the first pixel.
  • the determination result of the determination processing unit 42 is sequentially input into the registration processing unit 45 .
  • the registration processing unit 45 registers the defective pixel information concerning each of the defective pixels (sparse G defective pixel, dense G defective pixel, and R and B defective pixels) in the defective pixel information data 37 in the digital camera 10 .
  • the defective pixel information on the sparse G defective pixel is firstly registered.
  • the threshold values are set so that threshold value A ⁇ threshold value B holds, and accordingly even when the pixel value of the sparse G pixel is smaller than the pixel value of the dense G pixel, in other words, even when the level of the dark output is low, the pixel is occasionally determined to be the sparse G defective pixel. Because of this, the sparse G pixel has higher probability of being determined to be the defective pixel than the dense G pixel. As a result, “ratio R2 of registration number of sparse G defective pixels”, which is registered in the defective pixel information data 37 , becomes larger than “ratio R1 of registration number of dense G defective pixels”. Thereby, the defective pixel information on the sparse G defective pixel is more preferentially registered in the defective pixel information data 37 than the defective pixel information on the dense G defective pixel.
  • the defective pixel information is collectively registered in the defective pixel information data 37 , but the defective pixel information may be sequentially registered in the defective pixel information data 37 .
  • the registration number of the G defective pixels which are registered in the defective pixel information data 37 reaches the upper limit number of the registration, new defective pixel information on the sparse G defective pixel, for instance, may be overwritten on the defective pixel information on the dense G defective pixels which have been previously registered in the defective pixel information data 37 .
  • the interpolation processing unit 26 acquires the defective pixel information data 37 from the memory unit 27 , and discriminates the address of the defective pixel based on the defective pixel information data 37 . Then, based on this discrimination result, the interpolation processing unit 26 subjects the pixel values of each of the defective pixels which are registered in the defective pixel information data 37 to the interpolation processing which uses the pixel values of the peripheral pixels having the same colors.
  • the interpolation processing unit 26 determines the pixel value of the dense G defective pixel by the interpolation processing that uses the pixel values, for instance, of each of the G pixels in addresses (3, c), (4, c), (4, d) and (2, e), which are adjacent thereto in the horizontal, vertical, and oblique (NE) directions.
  • the interpolation processing unit 26 determines the pixel value of the sparse G defective pixel by the interpolation processing that uses the pixel values, for instance, of each of the G pixels in addresses (4, a), (4, c), (6, a) and (6, c), which are adjacent in the oblique (NE and NW) directions.
  • the interpolation processing unit 26 performs the interpolation processing by using the pixel values of the pixels of the same colors positioned so as to be adjacent to the R and B pixels.
  • the peripheral pixel which is used for the interpolation processing of each of the defective pixels is not limited to the example illustrated in FIG. 8 , and may be appropriately changed.
  • a method (expression) for calculating the pixel value by the interpolation processing is not limited in particular. For instance, the optimal expression may be used which has been determined by simulation and the like.
  • the CPU 11 controls the operation of the mechanical shutter 16 through the lens driver 21 and also drives the color imaging element 20 through the imaging element driver 23 .
  • the mechanical shutter 16 is opened and closed at a predetermined shutter speed, and electric signal charges are accumulated in the RGB pixels in the color imaging element 20 .
  • the output signal is output from each of the RGB pixels to the signal conditioning circuit 24 under the control of the imaging element driver 23 .
  • the signal conditioning circuit 24 performs various processes such as correlation double sampling processing and gain amplification processing, for the output signal sent from each of the RGB pixels, and then outputs the processed output signal to the image processing circuit 25 .
  • the interpolation processing unit 26 in the image processing circuit 25 operates with predetermined timing when the operation mode of the digital camera 10 is set to the photographing mode and the like, and acquires (sees) the defective pixel information data 37 memorized in the memory unit 27 . Based on the defective pixel information data 37 , the interpolation processing unit 26 discriminates the address of the defective pixel to be a target of the interpolation processing.
  • the interpolation processing unit 26 determines the pixel value corresponding to the output signal of the defective pixel by the interpolation processing that uses the pixel values of the peripheral pixels as illustrated in FIG. 8 , in the order of the pixels which are registered, for instance, in the defective pixel information data 37 . Thereby, the interpolation processing is performed for all of the defective pixels which are registered in the defective pixel information data 37 .
  • a ratio (second ratio) of the sparse G defective pixel to be interpolated with respect to “total pixel number of sparse G pixels” becomes equal to “ratio R2 of registration number of sparse G defective pixels”, which is included in the defective pixel information data 37 .
  • a ratio (first ratio) of the dense G defective pixel to be interpolated with respect to “total pixel number of dense G pixels” becomes equal to “ratio R1 of registration number of dense G defective pixels”.
  • the interpolation processing unit 26 performs the interpolation processing of the defective pixel, and then performs the interpolation processing of the missing pixel.
  • the interpolation processing of the missing pixel is a well-known technique, and accordingly specific description is omitted.
  • the image processing circuit 25 performs various image processes such as gradation modulation, white balance correction and ⁇ correction processing, and photographed image data are generated.
  • the photographed image data which have been generated by the image processing circuit 25 are output to the display unit 32 with fixed timing. Thereby, a live-view image is displayed on the display unit 32 .
  • photographing preparation processing such as AF processing and AE processing is also simultaneously performed.
  • the image processing circuit 25 When a photographing instruction is given by the operation unit 12 , the image processing circuit 25 generates photographed image data corresponding to one frame. The photographed image data are compressed by the compression expansion processing circuit 29 , and then is recorded in the memory card 31 through the media I/F 30 .
  • the interpolation processing of the pixel value of the sparse G defective pixel which exerts a strong influence on the quality of the photographed image data is more preferentially performed than the interpolation processing of the pixel value of the dense G defective pixel. Because of this, even when the interpolation processing cannot be performed for all of the defective pixels, from the viewpoint of the upper limit of the memory capacity of the memory unit 27 and the prevention of the increase in the processing time period concerning the interpolation processing, the influence of the sparse G defective pixel exerting onto the photographed image data can be reduced. As a result, adequate photographed image data are obtained.
  • the G pixel (G filter 34 G) in the color imaging element 20 of the above described first embodiment includes two types of sparse and dense G pixels (G filter 34 G), but may include three types of sparse and dense G pixels (G filter 34 G).
  • the G pixel in the color imaging element 48 illustrated in FIG. 10 includes a G 1 pixel to which three pieces of other G pixels are adjacent in the horizontal and vertical directions, a G 2 pixel to which one piece of another G pixel is adjacent, and a G 3 pixel to which any pixel is not adjacent.
  • the G 2 pixel becomes “sparse G pixel” with respect to the G 1 pixel, but becomes “dense G pixel” with respect to the G 3 pixel.
  • the G 1 pixel and the G 3 pixel become “dense G pixel” and “sparse G pixel” with respect to each of the other G pixels, respectively.
  • the reference character and numeral “P1” in the figure is the basic array pattern which constitutes the color filter array of the color imaging element 48 .
  • the registration of the defective pixel information and the interpolation processing of the defective pixel are performed according to the priority of G 3 pixel>G 2 pixel>G 1 pixel, similarly to the first embodiment.
  • the color imaging element 49 illustrated in FIG. 11 is basically the same as the color imaging element 48 illustrated in FIG. 10 , except that two pieces of the G pixels are adjacent only in the horizontal direction (where vertical direction is also acceptable) of the G 1 pixel.
  • the reference character and numeral “P2” in the figure is the basic array pattern which constitutes the color filter array of the color imaging element 49 .
  • the G pixel having a relatively small number of the G pixels adjacent in the horizontal and vertical directions is determined to be “sparse G pixel”, and is more preferentially subjected to the registration of the defective pixel information and the interpolation processing of the defective pixel than “dense G pixel” having a larger number of the G pixels.
  • the G pixel includes three types of sparse and dense G pixels (G filter 34 G), but the presently disclosed subject matter can be applied also to the case where the G pixel includes four types or more of sparse and dense G pixels (G filter 34 G).
  • the G pixel having a smaller number of the G pixels adjacent in the horizontal and vertical directions is determined to be “sparse G pixel”, and the G pixel having a larger number of the G pixels is determined to be “dense G pixel”, but even when the number of the G pixels adjacent in the horizontal and vertical directions are the same, there is the case where the sparse and dense G pixels are formed.
  • the G pixel in the color imaging element 50 illustrated in FIG. 12 includes a G 1 pixel and a G 2 pixel which are different from those in each of the above described embodiments.
  • the illustration of the R and B pixels (R and B filters 34 R and 34 B) is omitted.
  • the reference character and numeral “P3” in the figure is the basic array pattern which constitutes the color filter array of the color imaging element 50 .
  • G pixels are not arranged so as to be adjacent thereto in the horizontal and vertical directions of the G 1 pixel, but one piece of another G pixel is adjacent thereto in an oblique (NE) direction.
  • NE oblique
  • even one piece of another G pixel is not adjacent in each direction of the horizontal, vertical and oblique (NE and NW) directions of the G 2 pixel.
  • the pixel value of the missing G pixel which is calculated from the interpolation processing is also affected by the G pixel adjacent in the oblique (NE and NW) directions, though being less affected by the G pixel adjacent in the horizontal and vertical directions. Because of this, it can be said that the influence having when the G 2 pixel is the defective pixel tends to more easily spread than the influence having when the G 1 pixel is the defective pixel, and exerts more influence on the photographed image data.
  • the G 2 pixel having a relatively small number of the G pixels (G filter 34 G) which are adjacent in the oblique (NE and NW) directions is determined to be “sparse G pixel”, and the G 1 pixel having a relatively large number of the G pixels is determined to be “dense G pixel”.
  • the registration and the interpolation processing of the sparse G defective pixel are preferentially performed similarly to each of the above described embodiments.
  • the number of other G pixels adjacent in the horizontal and vertical directions of the sparse G pixel and the dense G pixel is 0, but even though the number is 1 or more, the G pixel can be similarly determined to be the sparse and dense G pixels.
  • the G pixel (G filter 34 G) includes “sparse G pixel (sparse G filter 34 G)” and “dense G pixel (dense G filter 34 G)”, but the presently disclosed subject matter is not limited to the case.
  • the R pixel (R filter 34 R) may include “sparse R pixel (sparse R filter 34 R which is represented by “R 2 ” in the figure)” and “dense R pixel (dense R filter 34 R which is represented by “R 1 ” in the figure)”.
  • the registration and the interpolation processing of the sparse R defective pixel are preferentially performed similarly to the first embodiment.
  • the reference character and numeral “P4” in the figure is the basic array pattern which constitutes the color filter array of the color imaging element 52 .
  • the sparse-dense R pixels have been described, but the presently disclosed subject matter can be similarly applied also to the case where the B pixel (B filter 34 B) includes the sparse-dense B pixels (B filter 34 B).
  • the digital camera 10 of the above described first embodiment registers the defective pixel information on each of the defective pixels (sparse G defective pixel, dense G defective pixel and R/B defective pixel) in the defective pixel information data 37 , and subjects the defective pixels to the interpolation processing.
  • the digital camera 55 registers the defective information on continuous defective pixels in which each of the defective pixels is adjacent or close to each other, and subjects the continuous defective pixels to the interpolation processing.
  • the digital camera 55 basically has the same configuration as that in the first embodiment, except that defective pixel information data 57 which is different from that in the first embodiment is stored in the memory unit 27 .
  • units having the same function and configuration as those in the above described first embodiment are designated by the same reference characters and numerals, and the description is omitted.
  • the defect occurs only in the G pixel, in order to prevent complication of the description.
  • the defective pixel information data 57 includes the defective pixel information on sparse-dense G continuous defective pixels (first continuous defective pixels), sparse-sparse G continuous defective pixels (second continuous defective pixels), and dense-dense G continuous defective pixels (third continuous defective pixels), as the G defective pixel, in addition to the defective pixel information on the previously described sparse G defective pixel and dense G defective pixel.
  • the sparse-dense G continuous defective pixels are continuous defective pixels in which the sparse G defective pixel and the dense G defective pixel are adjacent to each other in any direction (in the figure, in NE direction) of each direction of the horizontal, vertical and oblique (NE and NW) directions.
  • pixels in which the sparse G pixel and the dense G pixel are adjacent to each other in any of each direction are referred to as “sparse-dense G pixels” (first continuous pixels), regardless of the presence or absence of the defect.
  • the sparse-sparse G continuous defective pixels are continuous defective pixels in which the two sparse G defective pixels are close to each other in any (in the figure, in horizontal direction) of each direction of the horizontal, vertical and oblique (NE and NW) directions.
  • “Close” described here means that the pixels are in positions at which the pixels are not adjacent but are close to each other (for instance, within several pixel pitches or less).
  • G pixels in which the two sparse G pixels are close to each other in any of each direction are referred to as “sparse-sparse G pixel” (second continuous pixels), regardless of the presence or absence of the defect.
  • the dense-dense G continuous defective pixels are continuous defective pixels in which the two dense G defective pixels are adjacent to each other in any (in the figure, in horizontal direction) of each direction of the horizontal, vertical and oblique (NE and NW) directions.
  • G pixels in which the two dense G pixels are adjacent to each other in any of each direction are referred to as “dense-dense G pixel” (third continuous pixels), regardless of the presence or absence of the defect.
  • the dense-dense G continuous defective pixels may include continuous defective pixels (which are illustrated by x mark of dotted line) in which the two dense G defective pixels are close to each other in any of each direction.
  • the defective pixel information on each of the defective pixels is registered in the defective pixel information data 57 , with the use of an inspection device 59 .
  • the inspection device 59 more preferentially registers the defective pixel information on each of the G continuous defective pixels than the defective pixel information on the sparse G defective pixel.
  • the inspection device 59 preferentially registers the defective pixel information in the defective pixel information data 57 , in the order of sparse-sparse G continuous defective pixels>sparse-dense G continuous defective pixels>dense-dense G continuous defective pixels.
  • the “preferential” registration described here means that when a ratio of “registration number of sparse-dense G continuous defective pixels” with respect to “total number of sparse-dense G pixels” is represented by R3, a ratio of “registration number of sparse-sparse G continuous defective pixels” with respect to “total number of sparse-sparse G pixels” is represented by R4, and a ratio of “registration number of dense-dense G continuous defective pixels” with respect to “total number of dense-dense G pixels” is represented by R5, the defective pixels are registered so as to satisfy R4>R3>R5>R2>R1.
  • each of the G continuous defective pixels tends to more easily spread than that of the sparse G defective pixel because two defective pixels are adjacent or close to each other, and accordingly the influence on the photographed image becomes larger. Accordingly, the defective pixel information on each of the G continuous defective pixels is more preferentially registered than the defective information on the sparse G defective pixel.
  • the sparse G defective pixels are not adjacent to each other, but the sparse-sparse G continuous defective pixels have a possibility of being recognized as one large linear defect if the defective pixels are not subjected to the interpolation processing.
  • the reason is also because in the case of the sparse-dense G continuous defective pixels, one defective pixel is the dense G defective pixel but the interpolation processing of the other sparse G defective pixel is performed by using the pixel value of the dense G defective pixel which has been subjected to the interpolation processing.
  • the inspection device 59 includes threshold value information 60 , a determination processing unit 61 , and a registration processing unit 62 , which are different from the inspection device 40 in the first embodiment, in addition to the previously described pixel information 43 .
  • the threshold value information 60 stores a threshold value. C therein which is used for the determination of whether the sparse-dense G pixels are the sparse-dense G continuous defective pixels or not, a threshold value D therein which is used for the determination of whether the sparse-sparse G pixels are the sparse-sparse G continuous defective pixels or not, and a threshold value E therein which is used for the determination of whether the dense-dense G pixels are the dense-dense G continuous defective pixels or not, in addition to the previously described threshold values A and B.
  • Each of the threshold values is set so that threshold value D ⁇ threshold value C ⁇ threshold value E ⁇ threshold value A ⁇ threshold value B holds, in order that the threshold value becomes smaller as the priority becomes higher, based on the previously described registration priority.
  • the determination processing unit 61 determines whether each of the pixels is the defective pixel or not, based on the pixel value of each of the pixels, which has been obtained under the light-shielding state, and the threshold values A to E, in a similar way to the previously described first embodiment, and when the pixel is the defective pixel, determines the type of the defective pixel.
  • the defective pixel determining processing by the determination processing unit 61 will be specifically described below.
  • the determination processing unit 61 firstly determines whether the pixel value of the G pixel to be inspected (hereinafter referred to simply as pixel to be inspected) is less than the smallest threshold value D out of the threshold values A to E, or not (S 1 ). In addition, when the pixel value is less than the threshold value D, the determination processing unit 61 determines that the pixel to be inspected is a normal pixel.
  • the determination processing unit 61 determines whether a G pixel (hereinafter referred to as peripheral pixel) in the periphery (in adjacent or close position) of the pixel to be inspected has a possibility of being the G defective pixel, or not, based on the pixel information 43 (S 2 ). Specifically, the determination processing unit 61 determines whether the pixel value of the peripheral pixel is the threshold value D or more, or not.
  • the determination processing unit 61 determines whether the pixel to be inspected is the sparse G pixel or not, based on the pixel information 43 (S 3 ). Then, in the case where the pixel to be inspected is the sparse G pixel, if the pixel value of this pixel to be inspected is the threshold value A or more, the determination processing unit 61 determines that the pixel to be inspected is the sparse G defective pixel; and on the contrary, if the pixel to be inspected is less than the threshold value A, the determination processing unit 61 determines that the pixel to be inspected is a normal pixel (S 4 ).
  • the determination processing unit 61 determines that the pixel to be inspected is the dense G pixel in the determination S 3 . if the pixel value of this pixel to be inspected is the threshold value B or more, the determination processing unit 61 determines that the pixel to be inspected is the dense G defective pixel; and on the other hand, if the pixel to be inspected is less than the threshold value B, the determination processing unit 61 determines that the pixel to be inspected is the normal pixel (S 5 ).
  • the determination processing unit 61 determines whether the pixel to be inspected (threshold value D or more: determination S 1 ) is the sparse G pixel or not, based on the pixel information 43 (S 6 ).
  • the determination processing unit 61 determines whether the peripheral pixel (threshold value D or more: determination S 2 ) is the sparse G pixel or not, based on the pixel information 43 (S 7 ).
  • the peripheral pixel (threshold value D or more) is the sparse G pixel
  • both the pixel to be inspected and the peripheral pixel are the sparse G pixels
  • the pixel values of both the pixels become the threshold value D or more. Because of this, the determination processing unit 61 determines that the pixel to be inspected and the peripheral pixel are the sparse-sparse G continuous defective pixels.
  • the determination processing unit 61 determines whether both the pixel values of the pixel to be inspected (sparse G pixel and threshold value D or more) and the peripheral pixel (dense G pixel and threshold value D or more) become the threshold value C or more, or not (S 8 ).
  • the determination processing unit 61 determines that the pixel to be inspected and the peripheral pixel are the sparse-dense G continuous defective pixels. In addition, when one of both the pixel values is less than the threshold value C, the procedure progresses to the previously described determination S 4 , and the determination processing unit 61 determines whether the pixel to be inspected (sparse G pixel and threshold value D or more) is the sparse G defective pixel or not.
  • the determination processing unit 61 determines whether the peripheral pixel (threshold value D or more) is the sparse G pixel or not, based on the pixel information 43 (S 9 ). In addition, when the peripheral pixel (threshold value D or more) is the sparse G pixel, the procedure progresses to the previously described determination S 8 .
  • the determination processing unit 61 determines whether both the pixel values of the pixel to be inspected (dense G pixel and threshold value D or more) and the peripheral pixel (dense G pixel and threshold value D or more) are the threshold value E or more, or not (S 10 ).
  • the determination processing unit 61 determines that the pixel to be inspected and the peripheral pixel are the dense-dense G continuous defective pixels. In addition, when one of the pixel values of both the pixels is less than the threshold value E, the procedure progresses to the previously described determination S 5 , and the determination processing unit 61 determines whether the pixel to be inspected (dense G pixel and threshold value D or more) is the dense G defective pixel or not. By the above described steps, the defective pixel determining processing by the determination processing unit 61 is wholly completed.
  • a registration processing unit 62 is basically the same as the registration processing unit 45 in the first embodiment, and the defective pixel information on the defective pixel which has been determined by the determination processing unit 61 is registered in the defective pixel information data 57 within a range of the upper limit number of the registration.
  • the registration processing unit 62 registers the defective pixel information so as to satisfy “ratio R4 of registration number of sparse-sparse G continuous defective pixels”>“ratio R3 of registration number of sparse-dense G continuous defective pixels”>“ratio R5 of registration number of dense-dense G continuous defective pixels”>“ratio R2 of registration number of sparse G defective pixels”>“ratio R1 of registration number of dense G defective pixels”.
  • the registration processing of the defective pixel information by the inspection device 59 is basically the same as the registration processing of the defective pixel information in the first embodiment, except that the defective pixel determining processing illustrated in FIG. 18 is performed, and accordingly the specific description is omitted.
  • the defective pixel information is registered in the priority of sparse-sparse G continuous defective pixels>sparse-dense G continuous defective pixels>dense-dense G continuous defective pixels>sparse G defective pixel>dense G defective pixel.
  • the defective pixel information may be sequentially registered in the defective pixel information data 57 , instead of the collective registration of registering each of the defective pixel information collectively in the defective pixel information data 57 .
  • the defective pixel information on the defective pixels having the relatively higher priority may be overwritten on the defective pixel information on the defective pixels having the relatively lower priority, which have been previously registered.
  • the interpolation processing unit 26 acquires the defective pixel information data 57 from the memory unit 27 , and performs the interpolation processing of each of the defective pixels, in a similar way to the first embodiment.
  • the pixel values of the dense G defective pixel and the sparse G defective pixel are determined by the interpolation processing, as is illustrated by the arrow in FIG. 15 .
  • the pixel value of the dense G defective pixel is determined by the interpolation processing which uses the pixel values of the three G pixels that are adjacent thereto in the horizontal, vertical and oblique directions (in the figure, upper, right, obliquely upper-right directions).
  • the pixel value of the sparse G defective pixel is determined by the interpolation processing which uses the pixel values of the three G pixels that are adjacent in the oblique directions (in the figure, obliquely upper-left, obliquely lower-left, and obliquely lower-right directions).
  • a ratio of the sparse-dense G continuous defective pixels to be interpolated with respect to the total number of the sparse-dense G pixels becomes equal to the previously described ratio R3 (third ratio).
  • a ratio of the sparse-sparse G continuous defective pixels to be interpolated with respect to the total number of the sparse-sparse G pixels becomes equal to the previously described ratio R4 (fourth ratio).
  • a ratio of the dense-dense G continuous defective pixels to be interpolated with respect to the total number of the dense-dense G pixels becomes equal to the previously described ratio R5 (fifth ratio).
  • the ratios of the sparse G defective pixels to be interpolated and the dense G defective pixels to be interpolated correspond to the previously described ratio R2 and ratio R1, respectively.
  • the operation of the digital camera 55 in the second embodiment is basically the same as that in the first embodiment illustrated in FIG. 9 , and accordingly the description is omitted here.
  • the previously described interpolation processing of the defective pixels having the relatively higher priority is more preferentially performed than the interpolation processing of the defective pixels having the relatively lower priority, and accordingly the adequate photographed image data are obtained.
  • a digital camera 65 of a third embodiment of the presently disclosed subject matter will be described with reference to FIG. 20 .
  • the above described digital cameras 10 and 55 of the first and second embodiments perform the pixel interpolation processing, by using the common defective pixel information data 37 and 57 , regardless of the height of a photographic gain (for instance, ISO sensitivity) of the color imaging element 20 , but the digital camera 65 performs the pixel interpolation processing by using different defective pixel information data according to the height of the photographic gain.
  • a photographic gain for instance, ISO sensitivity
  • the digital camera 65 has basically the same configuration as that in the second embodiment, except that three types of first, second and third defective pixel information data 57 a , 57 b and 57 c are stored in the memory unit 27 . For this reason, units having the same function and configuration as those in the above described second (first) embodiment are designated by the same reference characters and numerals, and the description is omitted.
  • the defective pixel information on the defective pixel is registered, which is set when the photographic gain is set, for instance, at ISO 100 or more and less than ISO 800.
  • the defective pixel information on the defective pixel is registered, which is set when the photographic gain is set, for instance, at ISO 800 or more and less than ISO 6400.
  • the defective pixel information on the defective pixel is registered, which is set when the photographic gain is set, for instance, at ISO 6400 or more.
  • the defective pixel information is registered in each of the defective pixel information data 57 a to 57 c , by an inspection device 67 .
  • the inspection device 67 has basically the same configuration as that in the inspection device 59 in the second embodiment, except that the inspection device 67 includes a threshold value information table 68 and a determination processing unit 69 .
  • the threshold values which are used in the previously described determination for each of the defective pixels are set according to each of ranges of the photographic gain (“ISO 100 or more and less than ISO 800, which is illustrated as ISO 100 in the figure”, “ISO 800 or more and less than ISO 6400, which is illustrated as ISO 800 or more in the figure”, and “ISO 6400 or more”).
  • each of the threshold values is set to become higher as the photographic gain is higher. Incidentally, as the photographic gain is higher, the defective pixel is buried more in noise, and accordingly each of the threshold values is set to be lower than gain times.
  • the determination processing unit 69 determines whether each of the pixels is the defective pixel or not within the range of each of the ISO sensitivities, based on the threshold value determined according to the range of each of the ISO sensitivities in the threshold value information table 68 , and the pixel value (dark output) of each of the pixels; and when the pixel is the defective pixel, the determination processing unit 69 determines the type.
  • the determination processing unit 69 firstly determines each of the threshold values which are set at “ISO 100 or more and less than ISO 800” in the threshold value information table 68 , as a threshold value which is used in the defective pixel determining processing. Then, the determination processing unit 69 performs the defective pixel determining processing for all the pixels as is illustrated in FIG. 18 , based on the determined threshold value and the pixel value (dark output) of each of the pixels.
  • the registration processing unit 62 registers the defective pixel information concerning the pixel which has been determined as the defective pixel by the determination processing unit 69 , in the first defective pixel information data 57 a , similarly to the second embodiment.
  • the determination processing unit 69 determines each of the threshold values which are set at “ISO 800 or more and less than ISO 6400” in the threshold value information table 68 , as the threshold value which is used in the next defective pixel determining processing. In the following procedures, similarly, the defective pixel determining processing is performed by the determination processing unit 69 , and the defective pixel information is registered in the second defective pixel information data 57 b.
  • the defective pixel information is registered in the second defective pixel information data 57 b , and then the defective pixel determining processing is performed based on the threshold value which is set at “ISO 6400 or more” in the threshold value information table 68 , and the defective pixel information is registered in the third defective pixel information data 57 c .
  • the defective pixel information is registered in each of the defective pixel information data 57 a , 57 b and 57 c so as to satisfy the previously described relation of ratio R4>ratio R3>ratio R5>ratio R2>ratio R1, similarly to the second embodiment.
  • the operation of the digital camera 65 of the third embodiment is basically the same as the operation in the second (first) embodiment.
  • the interpolation processing unit 26 of the digital camera 65 selects and acquires data corresponding to the photographic gain from each of the defective pixel information data 57 a to 57 c in the memory unit 27 , based on the information on the photographic gain (in the present embodiment, ISO sensitivity) which has been acquired, for instance, from the CPU 11 and the like, and performs the interpolation processing of the defective pixels.
  • the previously described interpolation processing of the defective pixels having the relatively higher priority is more preferentially performed than the interpolation processing of the defective pixels having the relatively lower priority, and accordingly the adequate photographed image data are obtained, similarly to the second embodiment.
  • the above described digital camera 65 of the third embodiment performs the pixel interpolation processing by using the different defective pixel information data according to the photographic gain, but, for instance, as is illustrated in FIG. 23 , may perform the interpolation processing by using the different defective pixel information data according to the exposure time of the color imaging element 20 .
  • This is because even when the exposure time is long, the dark output of each of the pixels results in increasing, similarly to the case where the photographic gain is high.
  • the specific registration processing of the defective pixel information data and the interpolation processing of the defective pixels are the same as those in the third embodiment, and accordingly the description is omitted.
  • the interpolation processing may be performed by using the different defective pixel information data according to a temperature of the color imaging element 20 (hereinafter referred to as element temperature). This is because the dark output of each of the pixels increases in the case as well where the element temperature is high, similarly to the case where the photographic gain is high.
  • the interpolation processing unit 26 in Embodiment 3-2 selects and acquires corresponding data from among each of the defective pixel information data 57 a to 57 c in the memory unit 27 , based on the element temperature information given from the temperature sensor 71 which measures the element temperature, and performs the interpolation processing of the defective pixel.
  • the registration processing of the defective pixel information and the interpolation processing of the defective pixel are the same as those in the third embodiment, and accordingly the description is omitted here.
  • the photographing conditions such as the photographic gain, the exposure time and the element temperature are divided into ranges of three stages, and the defective pixel information data corresponding to the respective ranges are provided, but the photographing conditions may be divided into ranges of two stages or four or more stages, and the defective pixel information data may be provided for each of the ranges.
  • each of the defective pixel information data memorized in the memory unit 27 may be collectively memorized as one data.
  • the photographic gain, the exposure time and the element temperature have been taken as the photographing conditions which exert an influence on the dark output of the pixel, as an example, but the different defective pixel information data corresponding to various types of the photographing conditions may be provided which exert an influence on the dark output of the pixel, other than those photographing conditions.
  • the threshold value which is used for the determination of the defective pixel is also similar to the defective pixel information data.
  • a digital camera 75 of a fourth embodiment of the presently disclosed subject matter will be described with reference to FIG. 25 .
  • the priority among the sparse G defective pixels is not provided in the interpolation processing and the registration processing of the defective pixel information, but in the digital camera 75 , the priority among each of the sparse G defective pixels is also provided in the interpolation processing and the registration processing.
  • the digital camera 75 has basically the same configuration as that in the first embodiment, except that defective pixel information data 76 which is different from that of the digital camera 10 in the first embodiment is stored in the memory unit 27 .
  • units having the same function and configuration as those in the above described first embodiment are designated by the same reference characters and numerals, and the description is omitted.
  • the type of the defective pixel to be described will be limited only to the sparse G defective pixel, so as to prevent the complication of the description.
  • the defective pixel information data 76 the defective pixel information on the sparse G defective pixel is registered preferentially in a descending order of an evaluation value which has been determined for each of the sparse G defective pixels.
  • This evaluation value is determined by an inspection device 78 .
  • the inspection device 78 determines the evaluation value according to the position and the number of G pixels (hereinafter referred to as close G pixel) which are further adjacent to the periphery of the R and B pixels that are adjacent to the periphery of the sparse G defective pixel.
  • the pixel value of this missing G pixel is more strongly affected by the close G pixel which is adjacent in the vertical direction (similarly to horizontal direction as well) than the sparse G defective pixel that is adjacent in the oblique direction. Because of this, if the horizontal and vertical directions are weighted so as to be twice as much as the oblique direction, the influence of the sparse G defective pixel on the missing G pixel becomes 1 ⁇ 3, and accordingly the missing G pixel in the address (2, d) is set to be “0.33”.
  • the missing G pixel in the address (3, d) is strongly affected by the sparse G defective pixel, and accordingly is set to be “0.67”.
  • the other missing G pixels are set to be “1”.
  • the missing G pixels in the addresses (2, d), (3, d) and (4, d) are set to be “0.25”, “0.4” and “0.5”, respectively, on a similar principle, and the other missing G pixels are set to be “1”.
  • the missing G pixels in the addresses (2, d), (3, d) and (4, d) are set to be “0.25”, “0.16” and “0.25”, respectively, on a similar principle, and the other missing G pixels are set to be “1”.
  • the evaluation value is determined according to the position and the number of the close pixels.
  • the weighting of the close G pixels which are adjacent in the horizontal and vertical directions is determined to be twice as much as the weighting of the close G pixels that are adjacent in the oblique direction, but the quantity of the weighting may be appropriately changed.
  • the inspection device 78 is basically the same as the inspection device 40 in the first embodiment, except that the inspection device 78 includes an evaluation value calculation unit 79 and a registration processing unit 80 .
  • the evaluation value calculation unit 79 calculates the evaluation value, as illustrated in the previously described FIG. 26 to FIG. 30 .
  • the registration processing unit 80 registers the defective pixel information on the sparse G defective pixel more preferentially than the defective pixel information on the dense G defective pixel, in the defective pixel information data 76 , in a similar way to the registration processing unit 45 in the first embodiment. Furthermore, when registering the defective pixel information concerning the sparse G defective pixel, the registration processing unit 80 preferentially registers the defective pixel information having a higher evaluation value therein which has been calculated by the evaluation value calculation unit 79 .
  • “preferential registration” means that the defective pixel information is registered so that a ratio of “registration number of sparse G defective pixel having relatively higher evaluation value” with respect to “total pixel number of sparse G pixels” becomes higher than a ratio of “registration number of sparse G defective pixels having relatively lower evaluation value” with respect to “total pixel number of sparse G pixels”.
  • the defective pixel information on the sparse G defective pixel having the relatively higher evaluation value may be registered in the defective pixel information data 76 , prior to the defective pixel information on the sparse G defective pixel having the relatively lower evaluation value.
  • the registration processing of the defective pixel information in the fourth embodiment is, as has been previously described, basically the same as that in the above described first embodiment, except that the defective pixel information on the sparse G defective pixel having the relatively higher evaluation value is preferentially registered in the defective pixel information data 76 , and accordingly the description is omitted here.
  • the operation of the digital camera 75 of the fourth embodiment is also basically the same as that in the first embodiment illustrated in FIG. 9 , and accordingly the description is omitted here.
  • the defective pixel information on the pixel which has a large influence (which has high evaluation value) on the pixel value of the missing G pixel in the periphery out of the sparse G defective pixels is preferentially registered in the defective pixel information data 76 and is preferentially subjected to the interpolation processing, and accordingly more adequate photographed image data are obtained.
  • the priority is provided on the pixel interpolation processing and the registration processing for the sparse G defective pixel, but the priority may be provided on the pixel interpolation processing and the registration processing also for other types of G defective pixels, similarly.
  • the above description can also be applied to defects of the R and B pixels similarly.
  • a digital camera 83 of a fifth embodiment of the presently disclosed subject matter will be described with reference to FIG. 31 .
  • the defective pixel information which has been obtained by an external inspection device is registered in the defective pixel information data, but the digital camera 83 has a function of performing the determination for the defective pixel and the registration for the defective pixel information.
  • the digital camera 83 has basically the same configuration as the digital camera 10 in the first embodiment except that the digital camera 83 has a defective pixel inspection circuit 84 , for instance, in the image processing circuit 25 .
  • the defective pixel inspection circuit 84 has a function equivalent to any of the inspection devices 40 , 59 , 67 and 78 in each of the above described embodiments.
  • the defective pixel inspection circuit 84 performs the previously described determination processing and registration processing for the defective pixel.
  • the digital camera 83 can cope with the defect of the pixel, which has newly occurred by a change with time, in other words, is a so-called later-occurring defect.
  • the digital camera 65 in the above described third embodiment as has been illustrated in FIG. 20 , different defective pixel information data according to the photographing conditions (for instance, photographic gain, exposure time and element temperature) are stored in the memory unit 27 , the defective pixel information data corresponding to the photographing conditions are acquired from this memory unit 27 , and the pixel interpolation processing is performed.
  • the presently disclosed subject matter is not limited to this method.
  • the defective pixel information data 57 may be provided as one data, and the defective pixel information corresponding to the photographing conditions may be taken out from this defective pixel information data 57 .
  • the defective pixel information on the defective pixel is registered which occurs in any of each of the photographing conditions (range of photographing condition illustrated in FIG. 20 and the like) when the photographing condition has been changed.
  • the interpolation processing unit 26 a acquires information on the defective pixels of which the pixel values become the previously determined threshold value or larger, for instance, for each of the photographing conditions (type and range of photographing condition) and for each of the types of the defective pixels, out of the defective pixel information which is registered in the defective pixel information data 57 , and performs the pixel interpolation processing.
  • the interpolation processing unit 26 a multiplies the pixel value of each of the defective pixel information which is registered in the defective pixel information data 57 , by a previously determined coefficient or function for each of the photographing conditions and for each of the types of the defective pixels, and acquires information on the defective pixels of which the pixel values after having been multiplied by the coefficient or the like becomes a predetermined value or larger.
  • the method for acquiring the defective image information corresponding to the photographing condition is not limited to the above described method, and various methods can be adopted.
  • the determination for the defective pixel and the registration of the defective pixel information may be performed in a similar way to that in the digital camera 65 in the fifth embodiment.
  • the digital camera 55 a may, for instance, previously memorize pixel values of all the pixels therein; determine a pixel of which the pixel value becomes the previously described threshold value or larger, or of which the pixel value multiplied by the previously described coefficient or the like becomes a predetermined value or larger, as the defective pixel; and acquire the defective pixel information concerning this defective pixel.
  • the processing time period concerning the interpolation processing is prevented from increasing.
  • the pixel values of the sparse-dense G continuous defective pixels are subjected to interpolation processing
  • the pixel values of the three G pixels which are adjacent to the sparse G defective pixel and the dense G defective pixel, respectively are used in the interpolation processing, as is illustrated in FIG. 15 , but the presently disclosed subject matter is not limited to this method. For instance, as is illustrated by an arrow in FIG.
  • the pixel value of the dense G defective pixel is previously determined by the interpolation processing, and then the pixel value of the sparse G defective pixel may be determined by the interpolation processing which uses this pixel value and the pixel value of other G pixels that are adjacent to the sparse G defective pixel in an oblique direction.
  • the color filter array of the color imaging element of the presently disclosed subject matter is not limited to the array pattern illustrated in FIG. 2 and the like, and may be such an array pattern that a color filter of at least one color includes “sparse filter” and “dense filter”.
  • the color filter array includes a basic array pattern that is an array pattern corresponding to N ⁇ N pixels (N is three or more) which are repeatedly arranged in the horizontal and vertical directions, and the G filter 34 G (filter of first color) may be arranged along two diagonal lines of this basic array pattern.
  • the color filter array includes a square array in which the G filters 34 G (filter of first color) are arranged so as to be adjacent to each other in the horizontal and vertical directions in an array pattern corresponding to 2 ⁇ 2 pixels, and an isolated array of the G filter 34 G (filter of first color).
  • the G pixel includes “sparse G pixel (sparse G filter 34 G)” and “dense G pixel (dense G filter 34 G)”
  • the R and B pixels may include “sparse R and B pixel (sparse R filter 34 R and 34 B)” and “dense R and B pixel (dense R filter 34 R and 34 B)”.
  • the pixels (color filter) of two or more colors may include “sparse pixel (sparse filter)” and “dense pixel (dense filter)”.
  • the interpolation processing and registration of the defective pixels having the relatively higher priority may be performed prior to the interpolation processing and registration of the defective pixels having the relatively lower priority.
  • the numbers may be set so that “interpolation processing number and registration number of defective pixels having relatively higher priority”>“interpolation processing number and registration number of defective pixels having relatively lower priority” holds.
  • the color filter array of color filters having trichromatic colors of RGB has been described, but the color filter array may be, for instance, an array of color filters having four colors of the trichromatic colors of RGB+another color (for instance, emerald (E)).
  • the type of the color filter is not limited in particular.
  • the presently disclosed subject matter can be applied also to the color filter array of color filters of C (cyan), M (magenta) and Y (yellow) which are complementary colors of the elementary colors of RGB.
  • the digital camera has been taken as an example of an imaging device provided with the color imaging element of the presently disclosed subject matter, and has been described, but the presently disclosed subject matter can be applied to various types of imaging devices such as an endoscope, for instance.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
US14/317,766 2011-12-28 2014-06-27 Imaging device Expired - Fee Related US8970747B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2011289365 2011-12-28
JP2011-289365 2011-12-28
PCT/JP2012/083595 WO2013099917A1 (fr) 2011-12-28 2012-12-26 Dispositif d'imagerie

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/083595 Continuation WO2013099917A1 (fr) 2011-12-28 2012-12-26 Dispositif d'imagerie

Publications (2)

Publication Number Publication Date
US20140307130A1 US20140307130A1 (en) 2014-10-16
US8970747B2 true US8970747B2 (en) 2015-03-03

Family

ID=48697401

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/317,766 Expired - Fee Related US8970747B2 (en) 2011-12-28 2014-06-27 Imaging device

Country Status (5)

Country Link
US (1) US8970747B2 (fr)
EP (1) EP2800377A4 (fr)
JP (1) JP5600812B2 (fr)
CN (1) CN104025581B (fr)
WO (1) WO2013099917A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9077941B2 (en) * 2013-09-03 2015-07-07 Himax Imaging Limited Image processing method and image processing device
DE112015005531T5 (de) * 2015-01-08 2017-09-21 Olympus Corporation Bildverarbeitungsvorrichtung, Verfahren zum Betreiben einer Bildverarbeitungsvorrichtung, Programm zum Betreiben einer Bildverarbeitungsvorrichtung und Endoskopeinrichtung
WO2018123174A1 (fr) * 2016-12-28 2018-07-05 オリンパス株式会社 Dispositif d'imagerie, endoscope et système d'endoscope
CN111201779B (zh) * 2017-10-19 2022-11-01 索尼公司 成像装置和信号处理装置
WO2020042083A1 (fr) * 2018-08-30 2020-03-05 深圳市大疆创新科技有限公司 Procédé et dispositif d'étalonnage d'image à pixels défectueux, et support d'enregistrement

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000244934A (ja) 1998-12-21 2000-09-08 Nikon Corp 補間処理装置および補間処理プログラムを記録した記録媒体
JP2001036821A (ja) 1999-07-22 2001-02-09 Olympus Optical Co Ltd 撮像装置
US20010048477A1 (en) * 2000-06-02 2001-12-06 Takeshi Misawa Solid-state electronic imaging device and method of controlling opertion thereof
JP2002330353A (ja) 2001-04-27 2002-11-15 Olympus Optical Co Ltd 撮像装置および画素欠陥補正方法
US20050151861A1 (en) * 2004-01-13 2005-07-14 International Business Machines Corporation Performance digital image sensing
US20080278609A1 (en) 2007-05-07 2008-11-13 Sony Corporation Imaging apparatus, defective pixel correcting apparatus, processing method in the apparatuses, and program
US20090027527A1 (en) 2007-07-23 2009-01-29 Visera Technologies Company Limited Color filter arrays and image sensors using the same
US20100245632A1 (en) * 2009-03-31 2010-09-30 Olympus Corporation Noise reduction method for video signal and image pickup apparatus
US8023017B2 (en) * 2007-01-08 2011-09-20 United Microelectronics Corp. Pattern of color filter array
US20120293695A1 (en) * 2011-02-28 2012-11-22 Seiji Tanaka Color imaging apparatus
US8456553B2 (en) * 2011-02-21 2013-06-04 Fujifilm Corporation Color imaging element
US8817141B2 (en) * 2011-09-29 2014-08-26 Fujifilm Corporation Image processing device and method, recording medium, and imaging device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7015961B2 (en) * 2002-08-16 2006-03-21 Ramakrishna Kakarala Digital image system and method for combining demosaicing and bad pixel correction
TWI228320B (en) * 2003-09-09 2005-02-21 Ind Tech Res Inst An avalanche photo-detector(APD) with high saturation power, high gain-bandwidth product
KR100915970B1 (ko) * 2007-09-10 2009-09-10 연세대학교 산학협력단 이미지 센서에 의해 획득된 영상의 컬러를 보정하는 방법및 장치

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000244934A (ja) 1998-12-21 2000-09-08 Nikon Corp 補間処理装置および補間処理プログラムを記録した記録媒体
JP2001036821A (ja) 1999-07-22 2001-02-09 Olympus Optical Co Ltd 撮像装置
US20010048477A1 (en) * 2000-06-02 2001-12-06 Takeshi Misawa Solid-state electronic imaging device and method of controlling opertion thereof
JP2002330353A (ja) 2001-04-27 2002-11-15 Olympus Optical Co Ltd 撮像装置および画素欠陥補正方法
US20050151861A1 (en) * 2004-01-13 2005-07-14 International Business Machines Corporation Performance digital image sensing
US8023017B2 (en) * 2007-01-08 2011-09-20 United Microelectronics Corp. Pattern of color filter array
JP2008278394A (ja) 2007-05-07 2008-11-13 Sony Corp 撮像装置、欠陥画素補正装置およびこれらにおける処理方法ならびにプログラム
US20080278609A1 (en) 2007-05-07 2008-11-13 Sony Corporation Imaging apparatus, defective pixel correcting apparatus, processing method in the apparatuses, and program
US20090027527A1 (en) 2007-07-23 2009-01-29 Visera Technologies Company Limited Color filter arrays and image sensors using the same
JP2009027684A (ja) 2007-07-23 2009-02-05 Visera Technologies Co Ltd カラーフィルタアレイとそれを用いたイメージセンサ
US20100245632A1 (en) * 2009-03-31 2010-09-30 Olympus Corporation Noise reduction method for video signal and image pickup apparatus
US8456553B2 (en) * 2011-02-21 2013-06-04 Fujifilm Corporation Color imaging element
US20120293695A1 (en) * 2011-02-28 2012-11-22 Seiji Tanaka Color imaging apparatus
US8817141B2 (en) * 2011-09-29 2014-08-26 Fujifilm Corporation Image processing device and method, recording medium, and imaging device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
International Search Report, mailed Feb. 5, 2013, issued in PCT/JP2012/083595.
Written Opinion of the International Searching Authority, mailed Feb. 5, 2013, issued in PCT/JP2012/083595.

Also Published As

Publication number Publication date
EP2800377A4 (fr) 2015-07-15
JPWO2013099917A1 (ja) 2015-05-07
CN104025581A (zh) 2014-09-03
CN104025581B (zh) 2015-06-03
JP5600812B2 (ja) 2014-10-01
EP2800377A1 (fr) 2014-11-05
WO2013099917A1 (fr) 2013-07-04
US20140307130A1 (en) 2014-10-16

Similar Documents

Publication Publication Date Title
US7626619B2 (en) Digital camera
US8976289B2 (en) Imaging device
US8730545B2 (en) Color imaging element, imaging device, and storage medium storing a control program for imaging device
JP5361535B2 (ja) 撮像装置
JP5572765B2 (ja) 固体撮像素子、撮像装置、及び合焦制御方法
JP5541718B2 (ja) 撮像装置及びその欠陥画素検出方法
US8982236B2 (en) Imaging apparatus
US8854511B2 (en) Apparatus and method for image processing and storage medium, and image pickup apparatus
CN103444183B (zh) 彩色摄像元件及摄像装置
JPWO2012073728A1 (ja) 撮像装置及びその合焦位置検出方法
US8970747B2 (en) Imaging device
JPWO2012073729A1 (ja) 撮像装置及びその合焦位置検出方法
JP5680797B2 (ja) 撮像装置、画像処理装置、及び画像処理方法
JP5608820B2 (ja) 撮像装置及び合焦制御方法
JP5539585B2 (ja) カラー撮像素子、撮像装置、及び撮像プログラム
JP5657184B2 (ja) 撮像装置及び信号処理方法
WO2012127701A1 (fr) Élément d'imagerie en couleur, dispositif d'imagerie, et programme d'imagerie
JP5033711B2 (ja) 撮像装置及び撮像装置の駆動方法
US20070269133A1 (en) Image-data noise reduction apparatus and method of controlling same
JP2007228152A (ja) 固体撮像装置および撮像方法
JPH06225204A (ja) スチルビデオカメラ
JP2005005924A (ja) 固体電子撮像装置およびその制御方法

Legal Events

Date Code Title Description
AS Assignment

Owner name: FUJIFILM CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FURUTA, YOSHINORI;KAWAI, TOMOYUKI;REEL/FRAME:033214/0011

Effective date: 20140605

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20230303