US8131111B2 - Device of processing dead pixel - Google Patents
Device of processing dead pixel Download PDFInfo
- Publication number
- US8131111B2 US8131111B2 US12/159,385 US15938506A US8131111B2 US 8131111 B2 US8131111 B2 US 8131111B2 US 15938506 A US15938506 A US 15938506A US 8131111 B2 US8131111 B2 US 8131111B2
- Authority
- US
- United States
- Prior art keywords
- pixel
- value
- threshold
- component data
- comparing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
- 238000005286 illumination Methods 0.000 claims description 8
- 238000000034 method Methods 0.000 claims description 4
- 238000003384 imaging method Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 10
- 238000003672 processing method Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
- H04N25/683—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects by defect estimation performed on the scene signal, e.g. real time or on the fly detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4015—Demosaicing, e.g. colour filter array [CFA], Bayer pattern
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration by the use of local operators
-
- G06T5/77—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
- H04N23/843—Demosaicing, e.g. interpolating colour pixel values
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
Definitions
- the present invention is related to a device of processing a dead pixel, more specifically to a device of processing a dead pixel for an image sensor.
- a plurality of pixels are arranged in a two-dimensional structure.
- Each pixel converts inputted light to an electrical signal according to the luminance of the inputted light.
- the amount of the light inputted into each pixel can be recognized by measuring the converted electrical signal.
- an image per unit pixel can be structured.
- the image sensor consists of a pixel array having several hundred thousand to million pixels, a device converting analog data to digital data and several hundred to thousand storing device. There can be possibility of having an error during each pertinent process due to a large number of devices. The error causes generating a dead pixel or a hot pixel of pixels. The dead pixel becomes an important factor in the grade and pricing of the image sensor. The pixel data generated by the dead pixel is too larger or too smaller than the pixel data generated by adjacent pixels.
- a conventional dead pixel processing method mainly compares a pixel with a reference pixel. If the difference between the pixel and the reference pixel is not within a predetermined range, the pixel is defined as the dead pixel and is corrected.
- the conventional dead pixel processing method uses a lot of hardware resources. In the case of a dense image or an image having high levels of the luminance difference, the difference between adjacent pixels has high levels. Accordingly, the conventional dead pixel processing method considers a proper pixel as the dead pixel in error and corrects the proper pixel. As a result, the recovered image has a lot of distortions as compared with a corresponding actual image.
- the present invention which is designed to solve the above problems, provides a dead pixel processing device in order to determine whether a pixel is a dead pixel or a hot pixel by comparing the patterns of a component having a center pixel and other components in a 6 ⁇ 6 mask.
- the present invention provides a dead pixel processing device in order to output one pixel value corrected with a pertinent dead pixel.
- the present invention provides a dead pixel processing device in order to output a 6 ⁇ 6 pixel value corrected with a pertinent dead pixel.
- a dead pixel processing device includes a separating unit, separating an inputted Bayer pattern image into corresponding component data; and a comparing unit, calculating the distribution (pattern) of pixels based on the median of each data, calculating a comparing value based on a component having a center pixel, outputting an external flag which informs whether there are a dead pixel and/or a hot pixel by using the comparing value, comparing the values of the center pixel and adjacent pixels in the component having the center pixel; calculating a measuring value based on the center pixel; and outputting an internal flag by using the measuring value.
- the dead pixel processing device can further include a correction unit outputting a pixel value corrected by using the external flag and the internal flag received from the comparing unit.
- the correction unit outputs the median of the component data having the center pixel referring to the external flag and the internal flag if it is determined that there is the dead pixel/hot pixel. Also, the correction unit outputs the center pixel referring to the external flag and the internal flag if it is determined that there is no dead pixel/hot pixel.
- the comparing unit has a center value detecting unit, detecting each of the medians of the component data; a first absolute value detecting unit, detecting the absolute value of a value of subtracting the median from each element; a difference detecting value, detecting a difference, that is, the absolute value of each value of subtracting the output data of the first absolute value detecting unit for component data, exclusive of the component data having the center pixel, from the output data of the first absolute value detecting unit for the component data having the center pixel; a comparing value detecting unit, summing the output of the difference detecting unit and detecting a comparing value of the component data per element; an external flag generation unit, comparing the comparing value with each of a dead pixel threshold and a hot pixel threshold and generating the external flag related to whether there are the dead pixel threshold and/or the hot pixel threshold; a second absolute value detecting unit, detecting the absolute value of a value of subtracting the center pixel value from each element of the component data having the center pixel; and an
- the external flag generating unit sets the external flag as there is the dead pixel/hot pixel, in case that the comparing value of the center pixel only is larger than the dead pixel threshold when comparing the comparing value per element with the dead pixel threshold and, and/or in case that the comparing value of the center pixel only is larger than the hot pixel threshold when comparing the comparing value per element with the hot pixel threshold.
- the internal flag generating unit sums the medians of each component data; sets a threshold for the internal flag depending on the threshold; and sets the internal flag as there is the dead pixel/hot pixel in case that all absolute values per element, calculated by the second absolute detecting unit, are larger than the threshold for the internal flag.
- an image processor for an imaging device which processes a dead pixel, includes a separating unit, separating an inputted Bayer pattern image into corresponding component data; a median detecting unit, detecting each median of the component data; a first absolute detecting unit, detecting the absolute value of subtracting the median from each element of the component data; a difference detecting value, detecting a difference, that is) the absolute value of each value of subtracting the output data of the first absolute value detecting unit for component data, exclusive of the component data having the center pixel, from the output data of the first absolute value detecting unit for the component data having the center pixel; a comparing value detecting unit, summing the output of the difference detecting unit and detecting a comparing value of the component data per element; an external flag generation unit, comparing the comparing value with each of a dead pixel threshold and a hot pixel threshold and generating the external flag related to whether there are the dead pixel threshold and/or the hot pixel threshold; a second absolute value
- a dead pixel processing device includes a separating unit, separating an inputted Bayer pattern image into corresponding component data; and a dead pixel detecting unit, calculating the distribution (pattern) of pixels based on the median of each data, comparing the patterns of other components; calculating a comparing value based on each component; comparing the comparing value with a dead pixel threshold; determining whether the corresponding pixel is the dead pixel; and outputting corrected component data
- the dead pixel detecting unit has a first center value detecting unit, detecting each of the medians of the component data; a first absolute value detecting unit, detecting the absolute value of a value of subtracting the median from each element; a first comparing unit, calculating each absolute value of a value of subtracting a first output from a second output of the first absolute value detecting unit; summing the absolute values; and detecting a comparing value per component and per data; a threshold setting unit, setting a threshold for the internal flag by using a threshold for the illumination classification and the median of the component data detected by the first median detecting unit; and a first output determining unit, comparing the comparing value, detected by the first comparing value detecting unit, with the dead pixel threshold and determining output data depending on whether there is the dead pixel.
- the first output determining unit compares the comparing value, detected by the first comparing value detecting unit, with the dead pixel threshold and outputs the component data if there is no comparing value that is larger than the dead pixel threshold.
- the first output determining unit compares the comparing value, detected by the first comparing value detecting unit, with the dead pixel threshold and determines each element of the component data if there is one comparing value threshold that is larger than the dead pixel threshold, whereas the first output determining unit compares the absolute value of a value of subtracting adjacent elements from a particular element with the threshold, determined by the threshold determining unit and determines the element as the median of the adjacent elements if all of the absolute values are larger than the threshold.
- the first output determining unit compares the comparing value, detected by the first comparing value detecting unit with the dead pixel threshold and determines each element of the component data if there is one comparing value that is larger than the dead pixel threshold, whereas the first output determining unit compares the absolute value of a value of subtracting adjacent elements from a particular element with the threshold, determined by the threshold determining unit and determines the pertinent element as the output if there is no absolute value that is larger than the threshold.
- the dead pixel processing device further has a hot pixel detecting unit calculating the distribution (pattern) from the component data received from the dead pixel detecting unit, calculating a comparing value based on each component; comparing the comparing value with a hot pixel threshold; determining whether the corresponding pixel is the hot pixel; and outputting corrected component data.
- a hot pixel detecting unit calculating the distribution (pattern) from the component data received from the dead pixel detecting unit, calculating a comparing value based on each component; comparing the comparing value with a hot pixel threshold; determining whether the corresponding pixel is the hot pixel; and outputting corrected component data.
- the hot pixel detecting unit haves a second center value detecting unit, detecting each of the medians of the component data received from the dead pixel detecting unit; a second absolute value detecting unit, detecting the absolute value of a value of subtracting the median, detected by the second median detecting unit, from each element; a second comparing unit, calculating each absolute value of a value of subtracting a first output from a second output of the second absolute value detecting unit; summing the absolute values; and detecting a comparing value per component and per data; and a second output determining unit, comparing the comparing value, detected by the second comparing value detecting unit, with the hot pixel threshold and determining output data depending on whether there is the hot pixel.
- the second output determining unit compares the comparing value, detected by the second comparing value detecting unit, with the hot pixel threshold and outputs the component data if there is no comparing that is larger than the hot pixel threshold.
- the second output determining unit compares the comparing value, detected by the second comparing value detecting unit, with the hot pixel threshold and determines each element of the component data if there is one comparing value threshold that is larger than the hot pixel threshold, whereas the second output determining unit compares the absolute value of a value of subtracting adjacent elements from a particular element with the threshold, determined by the threshold determining unit and determines the element as the median of the adjacent elements if all of the absolute values are larger than the threshold.
- the second output determining unit compares the comparing value, detected by the second comparing value detecting unit, with the hot pixel threshold and determines each element of the component data if there is one comparing value threshold that is larger than the hot pixel threshold, whereas the second output determining unit compares the absolute value of a value of subtracting adjacent elements from a particular element with the threshold, determined by the threshold determining unit and determines the pertinent element as the output if there is no absolute value that is larger than the threshold.
- FIG. 1 is a block diagram illustrating an embodiment of a dead pixel processing device in accordance with a first embodiment of the present invention
- FIG. 2 is an example illustrating the inputted 6 ⁇ 6 Bayer pattern image of FIG. 1 ;
- FIG. 3 is an example illustrating that the Bayer pattern image of FIG. 2 is separated into 3 ⁇ 3 components.
- FIG. 4 is a detailed block diagram illustrating an embodiment of the pattern comparing unit of FIG. 1 ;
- FIG. 5 is an example illustrating the operations of the median detecting unit, the first absolution value detecting unit, the difference detecting unit and the comparing value of FIG. 4 ;
- FIG. 6 is an example illustrating the operation of the second absolute value detecting unit of FIG. 4 ;
- FIG. 7 is an example illustrating an original image inputted into a dead pixel processing device of the present invention.
- FIG. 8 is an example illustrating an image corrected by detecting the pertinent dead pixel in FIG. 7 ;
- FIG. 9 is a block diagram illustrating an embodiment of a dead pixel processing device in accordance with a second embodiment of the present invention.
- FIG. 10 is a detailed block diagram illustrating the dead pixel detecting unit of FIG. 9 ;
- FIG. 11 is an example illustrating the operations of the median detecting unit, the absolute value detecting unit and the comparing value detecting value of FIG. 10 ;
- FIG. 12 is an example illustrating an image outputted from the dead pixel detecting unit of FIG. 9 ;
- FIG. 13 is a detailed block diagram illustrating an embodiment of the hot pixel detecting unit of FIG. 9 .
- first and second can be used in describing various elements, but the above elements shall not be restricted to the above terms. The above terms are used only to distinguish one element from the other. For instance, the first element can be named the second element, and vice versa, without departing the scope of claims of the present invention.
- the term “and/or” shall include the combination of a plurality of listed items or any of the plurality of listed items.
- FIG. is a block diagram illustrating an embodiment of a dead pixel processing device in accordance with a first embodiment of the present invention
- the dead pixel processing device can include a component separating unit 110 , a pattern comparing unit 120 and a correction unit 130 .
- the component separating unit 110 separates an inputted 6 ⁇ 6 Bayer pattern image into four 3 ⁇ 3 components as illustrated in FIG. 3 .
- FIG. 2 is an example illustrating the inputted 6 ⁇ 6 Bayer pattern image of FIG. 1
- FIG. 3 is an example illustrating that the Bayer pattern image of FIG. 2 is separated into the 3 ⁇ 3 components.
- the component separating unit 110 of the present invention separates the 6 ⁇ 6 Bayer pattern image into 3 ⁇ 3 data having only identical components, for example, red (R), green (G) of a GR line (Gr), G of a GB line (Gb) and blue (B) respectively.
- the pattern comparing unit 120 calculates a pattern (the distribution of pixel values based on a median, hereinafter) of each component data; compares the patterns of a component having the center pixel and other components; calculates a measuring value based on the component having the center pixel; compares the center pixel and the corresponding adjacent pixel values; and calculates another measuring value based on the center pixel. This will be described in detail with reference to the pertinent drawings.
- FIG. 4 is a detailed block diagram illustrating an embodiment of the pattern comparing unit of FIG. 1 .
- the pattern comparing unit 120 can include a median detecting unit 121 , a first absolute value detecting unit 122 , a difference detecting unit 123 , a comparing value detecting unit 124 , an external flag generating unit 125 , a second absolute value detecting unit 126 and an internal flag generating unit 127 .
- a median detecting unit 121 the pattern comparing unit 120 can include a median detecting unit 121 , a first absolute value detecting unit 122 , a difference detecting unit 123 , a comparing value detecting unit 124 , an external flag generating unit 125 , a second absolute value detecting unit 126 and an internal flag generating unit 127 .
- the median detecting unit 121 determines each median of the inputted 3 ⁇ 3 signals Gr, R, B and Gb, which refer to M 1 , M 2 , M 3 and M 4 .
- the Abs_Gri, Abs_Ri, Abs_Bi and Abs_Gbi are calculated by the following formula 1.
- the difference detecting unit 123 detects the absolute values Diff 1 _i, Diff 2 _i and Diff 3 _i of values of subtracting the Abs_Gri, Abs_Ri and Abs_Gbi from the Abs_Bi,
- the Abs_Bi is output data of the first absolute value detecting unit 122 for the data B having the center pixel B 5 .
- the Abs_Gri, Abs_Ri and Abs_Gbi are output data of the first absolute value detecting unit 122 for the remaining data. This is represented by the following formula 2.
- FIG. 5 illustrates the aforementioned processes.
- FIG. 5 is an example illustrating the operations of the median detecting unit, the first absolution value detecting unit, the difference detecting unit and the comparing value of FIG. 4 .
- the external flag generating unit 125 compares the above-detected comparing value with a dead_threshold and a hot_threshold and generates a flag related to whether there are the dead pixel and the hot pixel. At this time, the dead_threshold and the hot_threshold are adjustable.
- the external flag generating unit 125 compares the comparing value for each element with the dead_threshold. In case that there is a comparing value that is larger than the dead_threshold, if the i is 5 (that is, the comparing value for the center pixel is larger than the dead_threshold), the external flag generating unit 125 sets the flag dead_flag related to whether there are the dead pixel as 1. Otherwise, the flag dead_flag is zero.
- the external flag generating unit 125 compares the comparing value for each element with the hot_ ⁇ threshold. In case that there is a comparing value that is larger than the hot_threshold, if the i is 5 (that is, the comparing value for the center pixel is larger than the dead_threshold), the external flag generating unit 125 sets the flag hot_flag related to whether there are the hot pixel as 1. Otherwise, the flag hot_flag is zero.
- the external flag generating unit 125 sets the external flag external flag as 1. Otherwise (that is, in case that the dead_flag and the hot_flag are zero), the external flag generating unit 125 sets the external flag external_flag as zero to output it to the correction unit 130 of FIG. 1 .
- the second absolute value detecting unit 126 detects the absolute value Abs_Ci of a value of subtracting the center pixel value from each element (exclusive of B 5 ) of the data B having the center pixel B 5 . This is represented by the following formula 4. Also, this is illustrated with FIG. 6 .
- the internal flag generating unit 127 sets a threshold thr for the internal flag by using a threshold Y_threshold for classifying the illumination applied thereto and the medians M 1 , M 2 , M 3 and M 4 of the 3 ⁇ 3 data.
- the internal flag generating unit 127 generates the internal flag by use of the threshold thr.
- the threshold Y_threshold is adjustable depending on the system.
- each component is defined as Y_m
- the internal flag generating unit 127 sets the thr as zero. Otherwise, the internal flag generating unit 127 sets the thr as 50. However, this is not limited to this case and the values are adjustable depending on the system.
- the internal flag generating unit 127 compares the set thr with the absolute value of each element, generated by the second absolute value detecting unit 126 . If even any one of 8 values is smaller than the thr, the internal flag generating unit 127 sets the internal flag as zero. Otherwise, (i.e. each absolute values of all elements is larger than the thr), the internal flag generating unit 127 sets the internal flag as 1 to transfer it to the correction unit 130
- the correction unit 130 If both the external flag and the internal flag are 1, the correction unit 130 outputs the median of the 3 ⁇ 3 data B. Otherwise, the correction unit 130 outputs the B 5 as it is.
- the present invention can be applied to the cases that the center pixel is any component.
- FIG. 7 is an example illustrating an original image inputted into the dead pixel processing device of the present invention
- FIG. 8 is an example illustrating an image corrected by detecting the pertinent dead pixel in FIG. 7 .
- the dead pixel and the hot pixel are detected and corrected.
- FIG. 9 is a block diagram illustrating an embodiment of the dead pixel processing device in accordance with a second embodiment of the present invention.
- the dead pixel processing device of the present invention can include a component separating unit 910 , a dead pixel detecting unit 920 and a hot pixel detecting unit 930 .
- the component separating unit 910 separates an inputted 3 ⁇ 3 Bayer pattern image into four 3 ⁇ 3 components as illustrated in FIG. 3 .
- FIG. 2 can be an embodiment of a 6 ⁇ 6 Bayer pattern image inputted into FIG. 9
- FIG. 3 is the example illustrating that the Bayer pattern image of FIG. 2 is separated into 3 ⁇ 3 components.
- the component separating unit 910 of the present invention separates the 6 ⁇ 6 Bayer pattern image into 3 ⁇ 3 data having only identical components, for example, red (R), green (G) of a GR line (Gr), G of a GB line (Gb) and blue (B) respectively.
- red (R), green (G) of a GR line (Gr), G of a GB line (Gb) and blue (B) respectively.
- the 3 ⁇ 3 components of Gr, R, B and Gb refer to C 1 , C 2 , C 3 and C 4 , respectively.
- the dead pixel detecting unit 920 calculates a pattern (the distribution of pixel values based on a median, hereinafter) of each component data; compares the patterns other components; calculates a measuring value based on each component; and determines whether the pertinent pixel is the dead pixel by using the measuring value. This will be described in detail with reference to the pertinent drawings.
- FIG. 10 is a detailed block diagram illustrating the dead pixel detecting unit of FIG. 9 .
- the dead pixel detecting unit 920 can include a median detecting unit 921 , an absolute value detecting unit 922 , a comparing value detecting unit 923 , a threshold setting unit 924 and an output determining unit 925 .
- a median detecting unit 921 an absolute value detecting unit 922 , a comparing value detecting unit 923 , a threshold setting unit 924 and an output determining unit 925 .
- the pertinent drawings represent the flow of signals as a line excluding input signals C 1 , C 2 , C 3 and C 4 , it is evident to those of ordinary skill in the art that various other data are included.
- the median detecting unit 921 determines each median of the inputted 3 ⁇ 3 data C 1 , C 2 , C 3 and C 4 , which refer to M 1 , M 2 , M 3 and M 4 .
- i is a natural number between 1 and 9, inclusive.
- the comparing value detecting unit 923 calculates the absolute value of a value of subtracting from one, the others of each output data, calculated from the absolute value detecting unit 922 , and sums the absolute values to calculate the comparing value. In other words, the comparing value detecting unit 923 calculates each absolute value of a value of subtracting the Abs_ 2 i , Abs_ 3 i and Abs_ 4 i from the Abs_ 1 i and sums the absolute values. Similarly, the comparing value detecting unit 923 calculates COMP_ 2 i , COMP_ 3 i and COMP_ 4 i . This is represented by the following formula 6.
- FIG. 11 is an example illustrating the operations of the median detecting unit, the absolute value detecting unit and the comparing value detecting value of FIG. 10 .
- the threshold setting unit 924 sets a threshold thr for the internal flag by using a threshold Y_threshold for classifying the illumination applied thereto and the medians M 1 , M 2 , M 3 and M 4 of the 3 ⁇ 3 data.
- the threshold setting unit 924 generates the internal flag by use of the threshold thr.
- the threshold Y_threshold is adjustable depending on the system. When the arithmetic mean of the median id each component is defined as Y_m
- the threshold setting unit 924 sets the thr as zero. Otherwise, the threshold setting unit 924 sets the thr as 50.
- this is not limited to this case and the values are adjustable depending on the system.
- “size3 ⁇ 3_Cj 1 ” refers to a first element of 3 ⁇ 3 data Cj. The below description will use the 3 ⁇ 3 data Cj.
- the output determining unit 925 If there is one element only that is larger than the dead_threshold, the output determining unit 925 generates the image again by making up the pixels per element.
- the output determining unit 925 compares each absolute value of a value of subtracting adjacent elements (i.e. other data Size3 ⁇ 3_Cj 2 , Size3 ⁇ 3_Cj 5 and Size3 ⁇ 3_Cj 4 in FIG. 12 ) from the data Size3 ⁇ 3_Cj 1 (i.e. the first element) with the threshold thr. If there is even any one that is smaller than the thr, the data Size3 ⁇ 3_Cj 1 is outputted. Otherwise, the medians of the other data Size3 ⁇ 3_Cj 2 , Size3 ⁇ 3_Cj 5 and Size3 ⁇ 3_Cj 4 are outputted.
- the output determining unit 925 compares each absolute value of a value of subtracting adjacent elements (i.e. other data Size3 ⁇ 3_Cj 1 , Size3 ⁇ 3_Cj 3 , Size3 ⁇ 3_Cj 4 , Size3 ⁇ 3_Cj 5 and Size3 ⁇ 3_Cj 6 in FIG. 12 ) from the data Size3 ⁇ 3_Cj 2 (i.e. the second element) with the threshold thr. If there is even any one that is smaller than the thr, the data Size3 ⁇ 3_Cj 2 is outputted.
- the hot pixel determining unit 930 calculates the pattern of each component and then calculates a measuring value based on comparing the patterns of other components. The hot pixel determining unit 930 determines whether the corresponding pixel is the hot pixel by using this measuring value.
- the hot pixel determining unit 930 will be described in detail with reference to the pertinent drawing.
- FIG. 13 is a detailed block diagram illustrating an embodiment of the hot pixel detecting unit of FIG. 9 .
- the hot pixel detecting unit 930 can include a median detecting unit 931 , an absolute value detecting unit 932 , a comparing value detecting unit 933 and an output determining unit 934 .
- the pertinent drawings represent the flow of signals as a line excluding input signals Size3 ⁇ 3C 1 , Size3 ⁇ 3C 2 , Size3 ⁇ 3C 3 and Size3 ⁇ 3C 4 , it is evident to those of ordinary skill in the art that various other data are included.
- the median detecting unit 931 determines each median of the inputted 3 ⁇ 3 data C 1 , C 2 , C 3 and C 4 , which refer to M 5 , M 6 , M 7 and M 8 .
- the medians M 5 , M 6 , M 7 and M 8 detected by the median detecting unit 931 can be the same as the medians detected by the median detecting unit 921 of the dead pixel detecting unit 920 of FIG. 10 .
- Abs_ 5 i , Abs_ 6 i , Abs_ 7 i and Abs_ 8 i are calculated by the following formula 7.
- Abs — 5 i abs (Size3 ⁇ 3 C 1 i ⁇ M 5)
- Abs — 6 i abs (Size3 ⁇ 3 C 1 i ⁇ M 6)
- Abs — 7 i abs (Size3 ⁇ 3 C 1 i ⁇ M 7)
- Abs — 8 i abs (Size3 ⁇ 3 C 1 i ⁇ M 8) [Formula 7]
- i is a natural number between 1 and 9, inclusive.
- the comparing value detecting unit 933 calculates the absolute value of a value of subtracting from one, the others of each output data, calculated from the absolute value detecting unit 932 , and sums the absolute values to calculate the comparing value. In other words, the comparing value detecting unit 933 calculates each absolute value of a value of subtracting the Abs_ 6 i , Abs_ 7 i and Abs_ 8 i from the Abs_ 5 i and sums the absolute values. Similarly, the comparing value detecting unit 933 calculates COMP_ 6 i , COMP_ 7 i and COMP_ 8 i . This is represented by the following formula 8.
- i is a natural number between 1 and 9, inclusive.
- the output determining unit 934 If there is one element only that is larger than the dead_threshold, the output determining unit 934 generates the image again by making up the pixels per element.
- the output determining unit 934 compares each absolute value of a value of subtracting adjacent elements (i.e. other data Size3 ⁇ 3_Cj 2 , Size3 ⁇ 3_Cj 5 and Size3 ⁇ 3_Cj 4 in FIG. 12 ) from the data Size3 ⁇ 3_Cj 1 (i.e. the first element) with the threshold thr, determined and transferred by the threshold determining unit 924 of the threshold unit 920 . If there is even any one that is smaller than the thr, the data Size3 ⁇ 3_Cj 1 is outputted. Otherwise, the medians of the other data Size3 ⁇ 3_Cj 2 , Size3 ⁇ 3_Cj 5 and Size3 ⁇ 3_Cj 4 are outputted.
- the output determining unit 925 compares each absolute value of a value of subtracting adjacent elements (i.e. other data Size3 ⁇ 3_Cj 1 , Size3 ⁇ 3_Cj 3 , Size3 ⁇ 3_Cj 4 , Size3 ⁇ 3_Cj 5 and Size3 ⁇ 3_Cj 6 in FIG. 12 ) from the data Size3 ⁇ 3_Cj 2 (i.e. the second element) with the threshold thr. If there is even any one that is smaller than the thr, the data Size3 ⁇ 3_Cj 2 is outputted.
- the medians of the other data Size3 ⁇ 3_Cj 1 , Size3 ⁇ 3_Cj 3 , Size3 ⁇ 3_Cj 4 , Size3 ⁇ 3_Cj 5 and Size3 ⁇ 3_Cj 6 are outputted.
- FIG. 7 can be the example illustrating an original image inputted into the dead pixel processing device of the present invention
- FIG. 8 can be the example illustrating an image corrected by detecting the pertinent dead pixel in FIG. 7 . Since the second embodiment can provide the same or similar image as the first embodiment of the present invention, the pertinent description or drawings will be omitted.
- an image can be corrected by detecting a corresponding dead pixel and hot pixel.
- the present invention can exactly determine whether a pixel is a dead pixel or a hot pixel by comparing the patterns of a component having a center pixel and other components in a 6 ⁇ 6 mask and output a corresponding corrected image of 1 pixel.
- the present invention can exactly determine whether a pixel is a dead pixel or a hot pixel by comparing the patterns of a component having a center pixel and other components in a 6 ⁇ 6 mask and output a 6 ⁇ 6 pixel value corrected with a pertinent dead pixel.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Image Processing (AREA)
Abstract
Description
Abs — Gri=abs(Gri−M1)
Abs — Ri=abs(Ri−M2)
Abs — Bi=abs(Bi−M3)
Abs — Gbi=abs(Gbi−M4) i=1˜9 [Formula 1]
Diff1— i=abs(Abs — Bi−Abs — Gri)
Diff2— i=abs(Abs — Bi−Abs — Ri)
Diff3— i=abs(Abs — Bi−Abs — Gbi) [Formula 2]
COMP — i=Diff1— i+Diff2— i+Diff3— i i=1˜9 [Formula 3]
Abs — Ci=abs(Bi−B5) (i=1˜9. exclusive of 5) [Formula 4]
if the Y_m is smaller than the Y_threshold, the internal
Abs —1i=abs(Gri−M1)
Abs —2i=abs(Ri−M2)
Abs —3i=abs(Bi−M3)
Abs —4i=abs(Gbi−M4) [Formula 5]
COMP —1i=abs(Abs —1i−Abs —2i)−abs(Abs —1i−Abs —3i)+abs(Abs —1i−Abs —4i)
COMP —2i=abs(Abs —2i−Abs —1i)−abs(Abs —2i−Abs —3i)+abs(Abs —2i−Abs —4i)
COMP —3i=abs(Abs —3i−Abs —1i)−abs(Abs —3i−Abs —2i)+abs(Abs —3i−Abs —4i)
COMP —4i=abs(Abs —4i−Abs —1i)−abs(Abs —4i−Abs —2i)+abs(Abs —4i−Abs —3i) [Formula 6]
if the Y_m is smaller than the Y_threshold, the
Abs —5i=abs(Size3×3C1i−M5)
Abs —6i=abs(Size3×3C1i−M6)
Abs —7i=abs(Size3×3C1i−M7)
Abs —8i=abs(Size3×3C1i−M8) [Formula 7]
COMP —5i=abs(Abs —5i−Abs —6i)+abs(Abs —5i−Abs —7i)−abs(Abs —5i−Abs —8i)
COMP —6i=abs(Abs —6i−Abs —5i)+abs(Abs —6i−Abs —7i)+abs(Abs —6i−Abs —8i)
COMP —7i=abs(Abs —7i−Abs —5i)+abs(Abs —7i−Abs —6i)+abs(Abs —7i−Abs —8i)
COMP —8i=abs(Abs —8i−Abs —5i)+abs(Abs —8i−Abs —6i)+abs(Abs —8i−Abs —7i) [Formula 8]
Claims (16)
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2005-0133602 | 2005-12-29 | ||
KR1020050133602A KR100683415B1 (en) | 2005-12-29 | 2005-12-29 | Method for processing dead pixel |
KR1020050133563A KR100696167B1 (en) | 2005-12-29 | 2005-12-29 | Method for processing dead pixel |
KR10-2005-0133563 | 2005-12-29 | ||
PCT/KR2006/005844 WO2007075065A1 (en) | 2005-12-29 | 2006-12-28 | Device of processing dead pixel |
Publications (2)
Publication Number | Publication Date |
---|---|
US20080298717A1 US20080298717A1 (en) | 2008-12-04 |
US8131111B2 true US8131111B2 (en) | 2012-03-06 |
Family
ID=38218248
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/159,385 Expired - Fee Related US8131111B2 (en) | 2005-12-29 | 2006-12-28 | Device of processing dead pixel |
Country Status (2)
Country | Link |
---|---|
US (1) | US8131111B2 (en) |
WO (1) | WO2007075065A1 (en) |
Families Citing this family (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2009188822A (en) * | 2008-02-07 | 2009-08-20 | Olympus Corp | Image processor and image processing program |
CN101242542B (en) * | 2008-02-26 | 2010-04-21 | 北京中星微电子有限公司 | An image detection method and device |
US8660335B2 (en) * | 2010-03-24 | 2014-02-25 | Varian Medical Systems, Inc. | Transient pixel defect detection and correction |
US8446481B1 (en) | 2012-09-11 | 2013-05-21 | Google Inc. | Interleaved capture for high dynamic range image acquisition and synthesis |
US8866927B2 (en) | 2012-12-13 | 2014-10-21 | Google Inc. | Determining an image capture payload burst structure based on a metering image capture sweep |
US9087391B2 (en) | 2012-12-13 | 2015-07-21 | Google Inc. | Determining an image capture payload burst structure |
US8866928B2 (en) | 2012-12-18 | 2014-10-21 | Google Inc. | Determining exposure times using split paxels |
US9247152B2 (en) | 2012-12-20 | 2016-01-26 | Google Inc. | Determining image alignment failure |
US8995784B2 (en) | 2013-01-17 | 2015-03-31 | Google Inc. | Structure descriptors for image processing |
US9686537B2 (en) | 2013-02-05 | 2017-06-20 | Google Inc. | Noise models for image processing |
US9117134B1 (en) | 2013-03-19 | 2015-08-25 | Google Inc. | Image merging with blending |
US9066017B2 (en) | 2013-03-25 | 2015-06-23 | Google Inc. | Viewfinder display based on metering images |
US9131201B1 (en) | 2013-05-24 | 2015-09-08 | Google Inc. | Color correcting virtual long exposures with true long exposures |
US9077913B2 (en) | 2013-05-24 | 2015-07-07 | Google Inc. | Simulating high dynamic range imaging with virtual long-exposure images |
US9615012B2 (en) | 2013-09-30 | 2017-04-04 | Google Inc. | Using a second camera to adjust settings of first camera |
CN104104945B (en) * | 2014-07-22 | 2015-12-09 | 西北工业大学 | Starry sky image bad point Robust Detection Method |
CN104535827A (en) * | 2015-01-12 | 2015-04-22 | 航天科工深圳(集团)有限公司 | Defective point removing method and system used in AD sampling |
CN108765306A (en) * | 2018-04-17 | 2018-11-06 | 浙江华睿科技有限公司 | A kind of dead pixel points of images antidote, device, electronic equipment and medium |
GB2583509B (en) | 2019-05-01 | 2023-02-22 | Advanced Risc Mach Ltd | System and method for fault detection and correction |
CN116886894B (en) * | 2023-08-04 | 2024-03-15 | 上海宇勘科技有限公司 | Picture dead pixel detection and correction method for adjacent internal column dead pixels |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000217039A (en) | 1999-01-21 | 2000-08-04 | Sanyo Electric Co Ltd | Point defect detection method and point defect pixel value correction method |
US6683643B1 (en) * | 1997-03-19 | 2004-01-27 | Konica Minolta Holdings, Inc. | Electronic camera capable of detecting defective pixel |
US20040150846A1 (en) | 2003-02-05 | 2004-08-05 | Samsung Electronics Co., Ltd. | Color image halftoning apparatus and method, and mask generation apparatus and method used therein |
JP2005123946A (en) | 2003-10-17 | 2005-05-12 | Sony Corp | Defective pixel detection method, detector and imaging apparatus |
JP2005341020A (en) | 2004-05-25 | 2005-12-08 | Matsushita Electric Ind Co Ltd | Pixel defect detector and pixel defect correction device |
US20050276510A1 (en) * | 2004-06-08 | 2005-12-15 | Stmicroelectronics S.R.I. | Filtering of noisy images |
US20110079705A1 (en) * | 2004-08-05 | 2011-04-07 | Life Technologies Corporation | Signal Noise Reduction for Imaging in Biological Analysis |
-
2006
- 2006-12-28 WO PCT/KR2006/005844 patent/WO2007075065A1/en active Application Filing
- 2006-12-28 US US12/159,385 patent/US8131111B2/en not_active Expired - Fee Related
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6683643B1 (en) * | 1997-03-19 | 2004-01-27 | Konica Minolta Holdings, Inc. | Electronic camera capable of detecting defective pixel |
JP2000217039A (en) | 1999-01-21 | 2000-08-04 | Sanyo Electric Co Ltd | Point defect detection method and point defect pixel value correction method |
US20040150846A1 (en) | 2003-02-05 | 2004-08-05 | Samsung Electronics Co., Ltd. | Color image halftoning apparatus and method, and mask generation apparatus and method used therein |
JP2005123946A (en) | 2003-10-17 | 2005-05-12 | Sony Corp | Defective pixel detection method, detector and imaging apparatus |
JP2005341020A (en) | 2004-05-25 | 2005-12-08 | Matsushita Electric Ind Co Ltd | Pixel defect detector and pixel defect correction device |
US20050276510A1 (en) * | 2004-06-08 | 2005-12-15 | Stmicroelectronics S.R.I. | Filtering of noisy images |
US20110079705A1 (en) * | 2004-08-05 | 2011-04-07 | Life Technologies Corporation | Signal Noise Reduction for Imaging in Biological Analysis |
Also Published As
Publication number | Publication date |
---|---|
WO2007075065A1 (en) | 2007-07-05 |
US20080298717A1 (en) | 2008-12-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8131111B2 (en) | Device of processing dead pixel | |
US7667738B2 (en) | Image processing device for detecting chromatic difference of magnification from raw data, image processing program, and electronic camera | |
US7477781B1 (en) | Method and apparatus for adaptive pixel correction of multi-color matrix | |
KR100683415B1 (en) | Method for processing dead pixel | |
US7649555B2 (en) | Apparatus for processing dead pixel | |
US8036457B2 (en) | Image processing apparatus with noise reduction capabilities and a method for removing noise from a captured image | |
US6842536B2 (en) | Image processing apparatus, image processing method and computer program product for correcting image obtained by shooting subject | |
US9131174B2 (en) | Image processing device, image processing method, and program for detecting and correcting defective pixel in image | |
US7570288B2 (en) | Image processor | |
JP2004112736A (en) | Semiconductor integrated circuit, defective pixel correction method, and image processor | |
JP2016048815A (en) | Image processor, image processing method and image processing system | |
US8379977B2 (en) | Method for removing color fringe in digital image | |
KR100906606B1 (en) | Method and apparatus for processing dead pixel | |
JPH03131173A (en) | Picture processing system | |
US20100295975A1 (en) | Image processing device and image processing program | |
US6667766B2 (en) | Method of removing noise from image signal | |
KR20020033766A (en) | Image sensor signal defect correction | |
JP4605582B2 (en) | Stereo image recognition apparatus and method | |
KR100595747B1 (en) | Apparatus for processing dead pixel | |
KR100696167B1 (en) | Method for processing dead pixel | |
US11748852B2 (en) | Pixel interpolation device and pixel interpolation method, and image processing device, and program and recording medium | |
KR100575444B1 (en) | Apparatus for compensating defect pixel existing in image sensor and method thereof | |
KR100648131B1 (en) | Apparatus for processing dead pixel | |
JPH06245148A (en) | Picture element defect correction device | |
KR20200081192A (en) | Method for detecting soft defective pixels in infrared camera for detection of acquired bad pixels |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MTEKVISION CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LEE, HO-YOUNG;REEL/FRAME:021241/0223 Effective date: 20080620 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20200306 |