US20180176495A1 - Image Sensor and Sensing Method Thereof - Google Patents
Image Sensor and Sensing Method Thereof Download PDFInfo
- Publication number
- US20180176495A1 US20180176495A1 US15/665,866 US201715665866A US2018176495A1 US 20180176495 A1 US20180176495 A1 US 20180176495A1 US 201715665866 A US201715665866 A US 201715665866A US 2018176495 A1 US2018176495 A1 US 2018176495A1
- Authority
- US
- United States
- Prior art keywords
- pixel data
- dark
- code
- data code
- offset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims description 10
- 238000006243 chemical reaction Methods 0.000 claims abstract description 39
- 230000015654 memory Effects 0.000 claims description 36
- 238000012937 correction Methods 0.000 abstract description 21
- 239000000284 extract Substances 0.000 description 25
- 238000010586 diagram Methods 0.000 description 16
- 230000000875 corresponding effect Effects 0.000 description 10
- 230000007547 defect Effects 0.000 description 8
- 230000008901 benefit Effects 0.000 description 4
- 239000011159 matrix material Substances 0.000 description 4
- 238000012935 Averaging Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 3
- 239000003990 capacitor Substances 0.000 description 3
- 230000007423 decrease Effects 0.000 description 3
- 101100328883 Arabidopsis thaliana COL1 gene Proteins 0.000 description 2
- 101100328892 Arabidopsis thaliana COL4 gene Proteins 0.000 description 2
- 101100237842 Xenopus laevis mmp18 gene Proteins 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 101100328890 Arabidopsis thaliana COL3 gene Proteins 0.000 description 1
- 101100328886 Caenorhabditis elegans col-2 gene Proteins 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 108091008695 photoreceptors Proteins 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- H04N5/3655—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/67—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
- H04N25/671—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction
- H04N25/673—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction by using reference sources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/616—Noise processing, e.g. detecting, correcting, reducing or removing noise involving a correlated sampling function, e.g. correlated double sampling [CDS] or triple sampling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/63—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/63—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
- H04N25/633—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current by using optical black pixels
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/67—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response
- H04N25/671—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction
- H04N25/677—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to fixed-pattern noise, e.g. non-uniformity of response for non-uniformity detection or correction for reducing the column or line fixed pattern noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/68—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to defects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
- H04N25/75—Circuitry for providing, modifying or processing image signals from the pixel array
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N25/771—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising storage means other than floating diffusion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N25/772—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising A/D, V/T, V/F, I/T or I/F converters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/78—Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters
-
- H04N5/3575—
-
- H04N5/361—
-
- H04N5/37455—
-
- H04N5/378—
Definitions
- Embodiments of the present invention relate to an image sensor and a sensing method thereof.
- An image sensor is a semiconductor device that converts an optical image into an electrical signal and that has been used in digital cameras, mobile communication terminals, etc.
- Such an image sensor may include a plurality of unit pixels.
- characteristics of an active device may adversely affect an image signal.
- the deviation may have a fixed value with respect to each pixel, and may cause fixed pattern noise (FPN) in the image displayed on a screen or monitor.
- FPN fixed pattern noise
- an abnormal output image may be generated due to column fixed pattern noise (CFPN) that is generated due to an offset of the pixels or in a processing circuit in one or more columns (e.g., each column) upon implementing an image.
- CFPN column fixed pattern noise
- embodiments of the present invention are directed to an image sensor capable of reducing or preventing column fixed pattern noise by an offset correction in a bright area of a subject, and a sensing method thereof.
- an image sensor may include a pixel array including an active pixel area including active pixels and a dark pixel area including dark pixels, an analog-to-digital conversion unit configured to generate a dark pixel data code by converting an analog output of each of the dark pixels and an active pixel data code by converting an analog output of each of the active pixels, an offset extractor configured to extract a final offset using the dark pixel data code, and a corrector configured to correct the active pixel data code using the final offset.
- the corrector outputs one of a correction pixel data code and a reference code as a corrected result from the active pixel data code and the reference code, and the correction pixel data code is obtained by correcting the active pixel data code using the final offset.
- the dark pixel data code and the active pixel data code may each comprise digital data, and the corrector may compare the actor pixel data code and the reference code to determine whether the correction pixel data code or the reference code is output.
- the reference code may be a full code of resolution of from the analog-to-digital conversion (ADC) unit.
- ADC analog-to-digital conversion
- the reference code may have the same number of bits as the maximum number of digital bits output by the ADC unit, and the value of each bit is 1.
- the corrector may be configured to convert the active pixel data code into the reference code and/or output the reference code if the active pixel data code is greater than the reference code.
- the corrector may be configured to output the correction pixel data code if the active pixel data code is less than or equal to the reference code.
- the offset extractor may be configured to extract (i) a per-column dark offset, a global dark offset and per-row noise using the dark pixel data code and (ii) the final offset using at least one of the extracted per-column dark offset, global dark offset and per-row noise.
- the analog-to-digital conversion unit may be configured to generate a (n+m)-bit digital code, where n is a natural number greater than 1 and m is a rational number satisfying 0 ⁇ m ⁇ 1.
- the image sensor may further include a memory configured to store the dark pixel data code and the active pixel data code from the analog-to-digital conversion unit.
- the memory may include an (n+1)-bit storage space configured to store the active pixel data code.
- the corrector may include a comparator configured to (i) compare the active pixel data code and the reference code and (ii) output a first signal and a second signal, a code converter configured to convert the active pixel data code into the reference code based on the first signal and output the reference code, and an offset corrector configured to correct the active pixel data code based on the second signal and output the corrected result.
- a comparator configured to (i) compare the active pixel data code and the reference code and (ii) output a first signal and a second signal
- a code converter configured to convert the active pixel data code into the reference code based on the first signal and output the reference code
- an offset corrector configured to correct the active pixel data code based on the second signal and output the corrected result.
- an image sensor includes a pixel array including an active pixel area including active pixels and a dark pixel area including dark pixels, an analog-to-digital conversion unit configured to generate a dark pixel data code by converting an analog output of each of the dark pixels and an active pixel data code by converting an analog output of each of the active pixels, a memory configured to store the dark pixel data code and the active pixel data code from the analog-to-digital conversion unit, and a digital signal processor configured to extract a final offset using the dark pixel data code and correct the active pixel data code using the final offset.
- the digital signal processor is configured to output one of a correction pixel data code and a reference code as a corrected result based on a comparison of the active pixel data code and the reference code.
- the correction pixel data code is obtained by correcting the active pixel data code using the final offset, and the reference code is a full code of resolution of the analog-to-digital conversion (ADC) unit.
- the image sensor may further include a column scanner configured to generate control signals to control the memory, and, based on the control signals from the column scanner, the memory may transmit the active pixel data code and the dark pixel data code to the digital signal processor.
- the digital signal processor may include an offset extractor configured to extract the final offset using the dark pixel data code and a corrector configured to output one of the correction pixel data code and the reference code as the corrected result based on a comparison of the active pixel data code and the reference code.
- the offset extractor may be configured to extract (i) a per-column dark offset, a global dark offset and per-row noise using the dark pixel data code and (ii) the final offset using at least one of the extracted per-column dark offset, global dark offset and per-row noise.
- a method of sensing an image using an image sensor including a pixel array including active pixels and dark pixels includes acquiring analog outputs of the dark pixels and analog outputs of the active pixels, generating a digital dark pixel data code by converting each of the dark pixels, generating a digital active pixel data code by converting each of the active pixels, extracting a final offset using the dark pixel data code, and correcting the active pixel data code using the final offset.
- Correcting the active pixel data code includes outputting one of a correction pixel data code and a reference code as a corrected result based on a comparison of the active pixel data codes and the reference code.
- the reference code is a full code of resolution from the analog-to-digital conversion (ADC) unit (e.g., having the same number of bits as the maximum number of digital bits output by the ADC unit, in which the value of each bit is 1).
- the correction pixel data code is obtained by correcting the active pixel data code using the final offset.
- Correcting the active pixel code may include converting the active pixel data code into the reference code and/or outputting the reference code when the active pixel data code is greater than the reference code.
- Correcting the active pixel code may include outputting the correction pixel data code when the active pixel data code is less than or equal to the reference code.
- Generating the dark pixel data code may include generating an (n+m)-bit digital code, where n is a natural number greater than 1 and m is a rational number satisfying 0 ⁇ m ⁇ 1.
- FIG. 1 is a diagram showing an exemplary configuration of an image sensor according to one or more embodiments
- FIG. 2 is a diagram showing an exemplary embodiment of the pixel array shown in FIG. 1 ;
- FIG. 3 is a diagram showing another exemplary embodiment of the pixel array shown in FIG. 1 ;
- FIG. 4 is a diagram showing an exemplary embodiment of the analog-to-digital conversion unit and the memory shown in FIG. 1 ;
- FIG. 5 is a diagram showing an exemplary configuration of an embodiment of the digital signal processor shown in FIG. 1 ;
- FIG. 6 is a diagram showing an exemplary embodiment of the offset extractor shown in FIG. 5 ;
- FIG. 7 is a diagram showing an exemplary configuration of an embodiment of the corrector shown in FIG. 5 ;
- FIG. 8 is a schematic diagram illustrating causes of column fixed pattern noise in a bright area of a subject.
- FIG. 1 is a diagram showing the configuration of an image sensor 100 according to one or more embodiments of the present invention.
- the image sensor 100 includes a controller 110 , a pixel array 120 , an analog-to-digital conversion unit 130 , a memory 140 and a column scanner 150 .
- the controller 110 outputs a first control signal S d configured to control the pixel array 120 , a second control signal S c configured to control the analog-to-digital conversion unit, and a third control signal CS configured to control the column scanner 150 .
- the first control signal S d may include a reset signal RX, a transmission signal TX and a selection signal SX configured to control reset, transmit and pixel selection operations in the pixels of the pixel array 120 .
- the controller 110 may include (i) a timing controller configured to generate a timing signal and/or a control signal, and (ii) a row driver configured to generate the first control signal S d configured to drive a plurality of unit pixels based on the timing signal from the timing controller, without being limited thereto.
- the first control signal Sd may be implemented in various manners capable of driving the plurality of unit pixels of the pixel array 120 .
- the row driver may generate the drive signal S d configured to drive the pixel array 120 and output the generated drive signal to the pixel array 120 .
- the row driver may output the drive signal S d configured to drive an active pixel area 205 (see FIGS. 2-3 ) and a dark area of the pixel array 120 .
- the pixel array 120 may include a plurality of unit pixels, and the plurality of unit pixels may be in a matrix including rows and columns.
- Each unit pixel may be a photoelectric transformation element configured to sense light and transform the sensed light into an electrical signal.
- the pixel array 120 may include sensing lines L 1 to Lm (m being a natural number greater than 1) connected to the unit pixels and configured to output sensing signals a 1 to am (m being a natural number greater than 1).
- each of the sensing lines L 1 to Lm may be connected to output terminals of the unit pixels in a corresponding one of the columns.
- the pixel array 120 may include an active pixel area, a first dark area (black area) at one or more sides of the active pixel area in a first (e.g., column) direction and a second dark area at one or more sides of the active pixel area in a second (e.g., row) direction orthogonal to the first direction.
- the analog-to-digital conversion unit 130 converts the analog sensing signals from the pixel array 120 on the sensing lines L 1 to Lm into digital signals and outputs a digital data code.
- the analog-to-digital conversion unit 130 may also perform correlated double sampling (CDS).
- CDS may refer to a difference between first digital data and second digital data that is obtained.
- the first digital data is a digital signal that may be obtained by converting a first sensing signal output from a unit pixel, upon resetting the unit pixel and second digital data is a digital signal that may be obtained by converting a second sensing signal from the unit pixel corresponding to an external image signal.
- the analog-to-digital conversion unit 130 may include (i) a CDS processor configured to perform CDS and (ii) an analog-to-digital converter configured to convert an output of the CDS processor into a digital signal.
- the CDS processor may include a switch, a capacitor and a differential amplifier, embodiments of the present invention are not limited thereto and may be variously implemented.
- analog-to-digital converter may include a ramp signal generator, a comparator and a counter
- embodiments of the present invention are not limited thereto and may be variously implemented.
- the analog-to-digital conversion unit 130 may generate dark pixel data codes by converting the analog outputs of the dark pixels of the dark area to digital data, and may generate active pixel data codes by converting to the analog outputs of the active pixels of the active area.
- the memory 140 may store outputs from the analog-to-digital conversion unit 130 and transmit the stored outputs of the analog-to-digital conversion unit 130 to a digital signal processor 160 in response to control signals C 1 to C m of the column scanner 150 .
- the memory 140 may include a plurality of latches (e.g., static random access memory cells) or a plurality of capacitors (e.g., one transistor-one capacitor random access memory cells, such as are typically found in dynamic random access memories).
- a plurality of latches e.g., static random access memory cells
- a plurality of capacitors e.g., one transistor-one capacitor random access memory cells, such as are typically found in dynamic random access memories.
- the column scanner 150 may output the control signals C 1 to C m to control the memory 140 based on the control signal CS received from the controller 110 .
- the dark pixel data codes and the active pixel data codes stored in the memory 140 may be read and transmitted to the digital signal processor 160 in response to the first control signals C 1 to C m from the column scanner 150 .
- the digital signal processor 160 processes the digital signals from the memory 140 .
- the digital signal processor 160 outputs one of a correction pixel data code and a reference code as a corrected result based on a comparison of the active pixel data code and a reference code.
- the correction pixel data code is the active pixel data code that is corrected using a final offset.
- the digital signal processor 160 as shown is independent of the controller 110 in FIG. 1 , embodiments of the present invention are not limited thereto. In other embodiments, the controller 110 may control and/or include the digital signal processor 160 .
- FIG. 2 is a diagram showing an embodiment 120 - 1 of the pixel array 120 shown in FIG. 1 .
- the pixel array 120 - 1 includes an active pixel area 205 , a first dark area 212 and a second dark area 222 .
- first dark area 212 may be spaced apart from the active pixel area 205 and located adjacent to the active pixel area 205 (e.g., parallel with rows of the active pixel areas 205 ), embodiments of the present invention are not limited thereto. In another embodiment, the first dark area 212 may be spaced apart from the active pixel area 205 and located on an opposite side of the active pixel area 205 .
- the second dark area 222 may be spaced apart from the active pixel area 205 and located at a side of the active pixel area 205 adjacent to the side along which the active pixel area 205 is located (e.g., parallel with columns of the active pixel area 205 ), embodiments of the present invention are not limited thereto. In another embodiment, the second dark area 222 may be spaced apart from the active pixel area 205 and located on an opposite side of the active pixel area 205 .
- the active pixel area 205 may include a plurality of first pixels configured to convert incident light into an electrical signal using the photoelectric conversion properties of a photoreceptor (e.g., a photodiode).
- the plurality of pixels (hereinafter, referred to as “active pixels”) may be arranged in a matrix.
- the first and second dark areas 212 and 222 may be areas in which incident light is blocked.
- each of the first and second dark areas 212 and 222 may be areas in which incident light is shielded by a metal layer or a reflective film.
- the first dark area 212 may include a plurality of pixels (hereinafter, referred to as “first dark pixels”), and the plurality of first dark pixels may be arranged in a matrix (e.g., where the number of columns is greater than the number of rows).
- the second dark area 222 may include a plurality of pixels (hereinafter, referred to as “second dark pixels”), and the plurality of second dark pixels may be arranged in a matrix (e.g., where the number of rows is greater than the number of columns).
- Each column of the first dark area 212 may correspond to or be aligned with a corresponding one of the columns of the active pixel area 205 .
- Each row of the second dark area 222 may correspond to or be aligned with a corresponding one of the rows of the first dark area 212 and the active pixel area 205 .
- each row of the second dark area 222 may be aligned with a corresponding one of the rows of the active pixel area
- each column of the first dark area 212 may be aligned with a corresponding one of the columns of the active pixel area and the second dark area.
- FIG. 3 is a diagram showing another embodiment 120 - 2 of the pixel array 120 shown in FIG. 1 .
- the pixel array 120 - 2 includes an active pixel area 205 , first dark areas 212 a and 212 b on first and third sides of (e.g., above and below) the active pixel area 205 and second dark areas 222 a and 222 b on second and fourth sides (e.g., at the left and right sides) of the active pixel area 205 .
- the pixel array 120 - 2 may further include dummy (e.g., inactive) pixel areas between the first and second dark areas 212 a , 212 b , 222 a and 222 b and the active pixel area.
- dummy e.g., inactive
- FIG. 4 is a diagram showing one or more embodiments of the analog-to-digital conversion unit 130 and the memory 140 shown in FIG. 1 .
- the analog-to-digital conversion unit 130 may receive a sensing signal A 1 (e.g., from the pixel array 120 ) as an analog signal and output a digital data signal Dig based on a value of the received analog signal.
- a sensing signal A 1 e.g., from the pixel array 120
- a digital data signal Dig based on a value of the received analog signal.
- the analog-to-digital conversion unit 130 may generate an (m+n)-bit digital code, in which n may be a natural number greater than 1, and m may be a rational number satisfying 0 ⁇ m ⁇ 1.
- n may equal 0 and m may equal 0.3, without being limited thereto.
- n may be related to the digital resolution of the analog-to-digital conversion unit 130 for the signal from the pixel array 120 .
- n 1024
- the memory 140 may include an (n+1)-bit unit storage space.
- one digital code Dig generated and/or output by the analog-to-digital conversion unit 130 may be stored in one unit storage space of the memory 140 .
- the memory 140 may comprise a line memory or register comprising (n+1) bits of data storage configured to store one active pixel data code.
- FIG. 5 is a diagram showing an exemplary configuration of an embodiment of the digital signal processor 160 shown in FIG. 1 .
- the digital signal processor 110 may include an offset extractor 114 and a corrector 116 .
- the offset extractor 114 may extract an offset using data codes (hereinafter, referred to as “dark pixel data codes”) of dark pixels of the dark area.
- the offset extractor 114 may extract a final offset value S F configured to compensate for a dark level based on the output S D of the dark area 212 or 222 (or, alternatively, one or more of the dark areas 212 a and 212 b , or one or more of the dark areas 222 a or 222 b ), as shown in FIG. 2 or FIG. 3 , respectively.
- the offset extractor 114 may extract a final offset value S F configured to compensate for the dark level based on at least one of a first output S C of the first dark area 212 (or one or both of the first dark areas 212 a and 212 b ) and a second output S R of the second dark area 222 (or one or both of the second dark areas 222 a and 222 b ).
- the offset extractor 114 may extract dark pixel data codes of the first and second dark areas, in which light may be blocked, and extract the final offset value S F configured to compensate for the dark level(s) (e.g., corresponding to the amount of light in the dark pixel[s]) using the extracted dark pixel data codes, in order to extract an offset configured to cancel noise due to the dark current of the pixel array 120 .
- the dark current is generated regardless of the presence, absence or value(s) of an optical image.
- the offset extractor 114 may extract a per-column dark offset value S C2 , a global dark offset value S G , a per-row average S R2 , and a per-row noise value RN using the dark pixel data codes and may extract the final offset value S F using at least one of the per-column dark offset value S C2 , the global dark offset value S G , the per-row average S R2 and/or the per-row noise value RN.
- FIG. 6 The description of FIG. 6 is applicable to the definition of the per-column dark offset value S C2 , the global dark offset value S G , the per-row average S R2 and the per-row noise value RN.
- the offset extractor 114 may extract a per-column dark offset, a global dark offset, a per-row average and a per-row noise value.
- the offset extractor 114 may select one of the extracted per-column dark offset and the global dark offset, and extract the final dark offset by adding the selected dark offset to the per-row noise value.
- the first dark pixels of the first dark area 212 may be driven by the controller 110 , and the per-column dark offset value S C and the global dark offset value S G may be extracted using the outputs of the first dark pixels acquired from the driven pixels.
- the second dark pixels of the second dark area 222 may be driven by the controller 110 , and the per-row noise value RN may be extracted using the outputs of the second dark pixels acquired from the driven pixels.
- FIG. 6 is a diagram showing an embodiment of the offset extractor 114 shown in FIG. 5 .
- the offset extractor 114 may include a first offset extractor 501 , a second offset extractor 502 , and a calculator (e.g., an adder or subtractor) 503 .
- the first offset extractor 501 may extract the per-column dark offset and the global dark offset from or based on the first output S C of the first dark area 212 (or of one or both of the first dark areas 212 a and 212 b ) and select and output one of the per-column dark offset value SC 2 and the global dark offset value S G .
- the first offset extractor 501 may include a first filter 210 , a first average extractor 220 , a memory 230 , a second average extractor 240 and a selector 250 .
- the first filter 210 may filter the output S C of the first dark pixels of the first dark area 212 (or one or both of the first dark areas 212 a and 212 b ), remove any outlier(s) from the output S C of the first dark pixels, and output filtered first dark pixels S C1 (e.g., the first dark pixels with any outlier[s] removed).
- the first dark area 212 may include a first dark pixel having a defect, which may generate an abnormal output or an outlier due to the defect.
- the first dark area 212 (or the first dark areas 212 a and 212 b ) may include a first dark pixel having an abnormally large output value due to a defect (e.g., a white defect) or a first dark pixel having an abnormally small output value due to a defect (e.g., a black defect).
- a defect may be generated in the semiconductor manufacturing process.
- the outlier(s) may be a value outside a predetermined range, where the predetermined range has a lower limit and an upper limit.
- the first filter 210 may remove a value of a first dark pixel that is less than the lower limit and/or a value of the first dark pixel that is greater than the upper limit from the output S C of the first dark pixels.
- the first filter 210 is responsible for removing abnormal outputs (e.g., outliers) of the first dark area 212 (or the first dark areas 212 a and 212 b ) that may be due to a defect.
- the first filter 210 may comprise or be implemented by an outlier removal filter. By removing the outputs of the defective pixels, it is possible to improve dark level compensation accuracy. In other embodiments, the first filter 210 may be omitted.
- the first average extractor 220 extracts an average S C2 of the first dark pixels of each column of the first dark area 212 (or one or both of the first dark areas 212 a and 212 b ) using the output S C1 of the first filter 210 .
- the memory 230 may store the extracted average S C2 . If the first filter 210 is omitted, the average S C2 of the first dark pixels of each column may be extracted directly from the first dark pixels. Hereinafter, the average S C2 of the first dark pixels of each column may be referred to as a “per-column dark offset”.
- the first average extractor 220 may extract the per-column dark offset value of the first dark pixels in each column of the first dark area 212 (or in one or both of the first dark areas 212 a and 212 b ).
- the per-column dark offset value is extracted by averaging the first dark pixels in each column of the first dark area(s).
- the per-column dark offset value is extracted by weight-averaging the first dark pixels in each column of the first dark area(s).
- the first average extractor 220 may extract a weighted average of the first dark pixels of a k-th row (e.g., by weight-averaging the first dark pixels of a [k ⁇ 1]-th row, k being a natural number satisfying 1 ⁇ k ⁇ n) row in each column of the first dark area 212 (or one or both of the first dark areas 212 a and 212 b ) and the first dark pixels of the k-th row.
- a weighted average of the first dark pixels of a k-th row e.g., by weight-averaging the first dark pixels of a [k ⁇ 1]-th row, k being a natural number satisfying 1 ⁇ k ⁇ n
- a larger weighted value may be given to the weighted average of the first dark pixels of the (k ⁇ 1)-th (k being a natural number satisfying 1 ⁇ k ⁇ n) row than the first dark pixels of the k-th row.
- the weighted average of the first dark pixels of the first row of each column of the first dark area 212 (or the first dark areas 212 a and 212 b ) of a current frame may be a weighted average of the first dark pixels of the last row of each column of a previous frame.
- the memory 230 may store the weighted average of the first dark pixels of the (k ⁇ 1)-th (k being a natural number satisfying 1 ⁇ k ⁇ n) row in each column.
- the second average extractor 240 extracts an average S G of all of the first dark pixels in the first dark area 212 (or one or both of the first dark areas 212 a and 212 b ) using the output of the first filter 210 .
- the second average extractor 240 may extract the average S G of all of the first dark pixels in the first dark area 212 (or the first dark areas 212 a and 212 b ) of one frame from which the outlier(s) are removed by the first filter.
- the average S G output from the second average extractor 240 is referred to as a “global dark offset value”.
- the average S G may be extracted directly using the first dark pixels.
- the selector 250 selects and outputs the per-column dark offset value S C2 or the global dark offset value S G based on or upon the occurrence of one or more predetermined operational conditions.
- the predetermined operational conditions may include the illuminance and temperature of the environment surrounding the image sensor.
- the selector 250 may select and output the global dark offset value S G , because the sensed signal components in the high-illuminance environment are large, and thus the influence of column fixed pattern noise is low.
- the global dark offset value S G when the global dark offset value S G is selected, at least the first average extractor 220 may be turned off, making it possible to reduce power consumption in the image sensor.
- the selector 250 may select and output the global dark offset value S G when the temperature of the surrounding environment is higher than the predetermined threshold temperature.
- estimating and removing column fixed pattern noise may be sufficiently accurate and/or useful, and the selector 250 may select and output the per-column dark offset value S C2 .
- the first filter 210 may be omitted, the first average extractor 220 may extract the average S C2 using the output S C of the first dark pixels instead of the output S C1 of the first filter 210 , and the second average extractor 240 may extract the global dark offset value S G using the outputs S C of the first dark pixels instead of the output S C1 of the first filter 210 .
- the second offset extractor 502 extracts a per-row average based on an output S R of the second dark area 222 (or of one or both of the second dark areas 222 a and 222 b ) and extracts a per-row noise value from the per-row average and the global dark offset value S C (e.g., by subtracting the global dark offset value S G from the extracted per-row average).
- the second offset extractor 502 may include a second filter 260 , a third average extractor 270 and a calculator or mathematical operator (e.g., an adder or subtractor) 280 .
- the second filter 260 filters the second dark pixels in each row of the second dark area 222 (or one or both of the second dark areas 222 a and 222 b ) to obtain a median value of the second dark pixels in each row of the second dark area 222 (or one or both of the second dark areas 222 a and 222 b ).
- the second filter 260 may be or comprise a median filter.
- the second filter 260 may select a median (or representative) value from among the second dark pixels in each row (e.g., two or more second dark pixels adjacent to any one second dark pixel in each row) and output the median (or representative) value S R1 of the second dark pixels in each row.
- a median (or representative) value from among the second dark pixels in each row (e.g., two or more second dark pixels adjacent to any one second dark pixel in each row) and output the median (or representative) value S R1 of the second dark pixels in each row.
- the second filter 260 may select an output (e.g., Y 1 ) of one second dark pixel (e.g., X[ 1 ]) of a group of dark pixels in each row, or of each row as a whole, as follows.
- the number of selected adjacent second dark pixels may be two or more.
- the median value is simply a filtered value, in which the value of a first dark pixel represents the value of each of a group of three or more contiguous dark pixels.
- the value of a second dark pixel e.g., X[ 2 ]
- the extracted median value e.g., 2 may be the median value of the second dark pixels (e.g., X[ 2 ]).
- Such median filtering operations can be performed on a row of second dark pixels or all dark pixels in a dark area (e.g., second dark area 222 ). Thus, there may be one or more median or representative second dark pixel values for each row of second dark pixels in a second dark area.
- the second filter 260 may also remove any outliers from the second dark pixels in each row of the second dark area 222 (or one or both of the second dark areas 222 a and 222 b ) and maintain the average, median or representative value of the second dark pixels in each row.
- the second filter 260 may serve to cancel random noise in the second dark pixels in each row of the second dark area 222 (or of the second dark areas 222 a and 222 b ).
- the third average extractor 270 may extract the per-row average S R2 of the second dark pixels in each row of the second dark area 222 (or of the second dark areas 222 a and 222 b ) from the output(s) S R1 of the second filter 260 .
- the outputs S R of the second dark pixels in each row may be filtered by the second filter 260 to provide the median values S R1 , and the third average extractor 270 may extract a per-row average S R2 of the median values S R1 of the second dark pixels in each row. Accordingly, the third average extractor 270 may extract the per-row average S R2 corresponding to each of the rows of the second dark area 222 (or of one or both of the second dark areas 222 a and 222 b ).
- the second filter 260 may be omitted. If the second filter 260 is omitted, the third average extractor 270 may extract the per-row average S R2 directly using the outputs S R of the second dark pixels in each row.
- the calculator 280 extracts the per-row noise value (RN) by adding the per-row average S R2 and the inverse of the global dark offset value S G .
- the calculator 503 outputs a final dark offset value S F from the per-row noise value RN and the output of the selector 250 (i.e., either the per-column dark offset value S C2 or the global dark offset value S G ).
- the calculator 503 may add the output of the selector 250 (i.e., either per-column dark offset value S C2 or the global dark offset value S G ) to the per-row noise value RN, and output the final dark offset value S F as the sum of the per-row noise value RN and either per-column dark offset value S C2 or the global dark offset value S G .
- the final dark offset value S F may be a sum of the per-column dark offset value S C2 and the per-row noise value RN, or a sum of the global dark offset value S G and the per-row noise value RN.
- the final dark offset value S F may be the output S R2 of the third average extractor 270 .
- the corrector 116 reads and compares raw data (D-raw; hereinafter, referred to as “active pixel data code”) of the active pixel area 205 with a reference code.
- the corrector 116 converts the active pixel data code of the active pixel area 205 into the reference code S K and/or outputs the reference code S K .
- the reference code S K may be a full code of resolution of the analog-to-digital conversion for the output of the pixel array 120 .
- the reference code S K may be a full code of resolution of the analog-to-digital conversion of the analog-to-digital conversion unit 130 .
- the corrector 116 corrects the active pixel data code based on the final dark offset value S F and outputs the active pixel data code S M (hereinafter, referred to as “corrected pixel data code”), from which noise is cancelled.
- the active data code may be a digital data code from converting the analog outputs of the active pixel area 205 using the analog-to-digital conversion unit 130 .
- FIG. 7 is a diagram showing the configuration of an embodiment of the corrector 116 shown in FIG. 5 .
- the corrector 116 may include a comparator 610 , a code converter 620 and an offset corrector 620 .
- the comparator 610 reads the active pixel data code D-raw from in the memory 140 , compares the active pixel data code D-raw with the reference code S K , and outputs a first signal CS 1 and a second signal CS 2 based on the comparison.
- the comparator 610 outputs the first signal CS 1 or enables the first signal CS 1 when the active pixel data code D-raw is greater than the reference code S K (D-raw>S K ).
- the comparator 610 outputs the second signal CS 2 or enables the second signal CS 2 when the active pixel data code D-raw is less than or equal to the reference code S K (D-raw ⁇ S K ).
- the code converter 620 receives the active pixel data code D-raw from the memory 140 , and either converts the active pixel data code D-raw into the reference code S K based on the value of D-raw and outputs the reference code S K , or simply passes through the reference code S k .
- the corrector 116 When D-raw>S K , the corrector 116 outputs the reference code S K from the code converter 620 as the correction pixel data code of each active pixel without performing offset correction. Thus, it is possible to cancel the column fixed pattern noise (CFPN) and/or omit or disable its associated circuitry.
- CFPN column fixed pattern noise
- the offset corrector 630 receives the active pixel data code D-raw from the memory 140 , corrects the active pixel data code D-raw based on the second signal CS 2 , and outputs the corrected data.
- the offset corrector 630 may correct the active pixel data code D-raw using the final dark offset value S F .
- the corrector 116 When D-raw ⁇ S K , the corrector 116 performs offset correction through the offset corrector 630 and outputs the corrected data. For example, the corrector 116 may output a value obtained by subtracting the final dark offset from the active pixel data code D-raw as the corrected pixel data code.
- the active pixel data code when the active pixel data code is corrected based on the dark offset, it is possible to cancel column fixed pattern noise and/or omit or disable its associated circuitry.
- the column fixed pattern noise may be generated in an area in which the screen of the image sensor is saturated by a bright subject.
- FIG. 8 is a schematic diagram illustrating causes of column fixed pattern noise in a bright area of a subject.
- the memory 140 may include a first memory area 141 configured to store dark pixel data codes and a second memory area 142 configured to store active pixel data codes.
- the dark pixel data codes Code 1 to Code 4 (e.g., Code 1 , Code 2 , Code 3 , and Code 4 ) of the dark pixels of first to fourth columns COL 1 to COL 4 (e.g., COL 1 , COL 2 , COL 3 , and COL 4 ) may be stored in the first memory area 141 of the memory 140 .
- the dark pixel data codes Code 1 to Code 4 may have independent and different values due to an independent offset of each column, and thus the final dark offsets of the columns may have different values.
- the active pixel data codes of the active pixels in a plurality of columns of the image sensor that has sensed a bright area of a subject may be full codes (F-codes) and may be stored in the second memory area 142 . As shown in FIG. 8 , the per-column offsets of the active pixel data codes of the bright area of the subject may disappear.
- the average dark pixel data codes may have a value of several tens (e.g., 10, 20, 30, 40, 50, 60, 70, 80, 90, etc.), which may vary according to column.
- Offset connection comprises subtracting the dark pixel data code (or the final dark offset) from the active pixel data code.
- analog-to-digital conversion unit 130 having (n+m)-bit resolution may be included to implement n-bit resolution.
- the active pixel data code exceeding the full code may be converted into the full code.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
Description
- This application claims the benefit of Korean Patent Application No. 10-2016-0172673, filed on Dec. 16, 2016, which is hereby incorporated by reference as if fully set forth herein.
- Embodiments of the present invention relate to an image sensor and a sensing method thereof.
- An image sensor is a semiconductor device that converts an optical image into an electrical signal and that has been used in digital cameras, mobile communication terminals, etc. Such an image sensor may include a plurality of unit pixels.
- As the number of pixels of an image sensor increases and the size of the image sensor decreases, the size of the pixel decreases. Thus, influence of dark current, noise generated by the dark current, photon shot noise, and MOS device noise increases.
- In a CMOS type image sensor, characteristics of an active device (for example, the deviation in a transistor threshold voltage Vth) may adversely affect an image signal. The deviation may have a fixed value with respect to each pixel, and may cause fixed pattern noise (FPN) in the image displayed on a screen or monitor. In particular, as the distance between adjacent pixels decreases, an abnormal output image may be generated due to column fixed pattern noise (CFPN) that is generated due to an offset of the pixels or in a processing circuit in one or more columns (e.g., each column) upon implementing an image.
- Accordingly, embodiments of the present invention are directed to an image sensor capable of reducing or preventing column fixed pattern noise by an offset correction in a bright area of a subject, and a sensing method thereof.
- Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those skilled in the art upon examination of the following or may be learned from practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
- To achieve these objects and other advantages and in accordance with the purpose(s) of embodiments of the invention, as embodied and broadly described herein, an image sensor may include a pixel array including an active pixel area including active pixels and a dark pixel area including dark pixels, an analog-to-digital conversion unit configured to generate a dark pixel data code by converting an analog output of each of the dark pixels and an active pixel data code by converting an analog output of each of the active pixels, an offset extractor configured to extract a final offset using the dark pixel data code, and a corrector configured to correct the active pixel data code using the final offset. The corrector outputs one of a correction pixel data code and a reference code as a corrected result from the active pixel data code and the reference code, and the correction pixel data code is obtained by correcting the active pixel data code using the final offset. The dark pixel data code and the active pixel data code may each comprise digital data, and the corrector may compare the actor pixel data code and the reference code to determine whether the correction pixel data code or the reference code is output.
- The reference code may be a full code of resolution of from the analog-to-digital conversion (ADC) unit. For example, the reference code may have the same number of bits as the maximum number of digital bits output by the ADC unit, and the value of each bit is 1.
- The corrector may be configured to convert the active pixel data code into the reference code and/or output the reference code if the active pixel data code is greater than the reference code.
- The corrector may be configured to output the correction pixel data code if the active pixel data code is less than or equal to the reference code.
- The offset extractor may be configured to extract (i) a per-column dark offset, a global dark offset and per-row noise using the dark pixel data code and (ii) the final offset using at least one of the extracted per-column dark offset, global dark offset and per-row noise.
- The analog-to-digital conversion unit may be configured to generate a (n+m)-bit digital code, where n is a natural number greater than 1 and m is a rational number satisfying 0<m<1.
- The image sensor may further include a memory configured to store the dark pixel data code and the active pixel data code from the analog-to-digital conversion unit.
- The memory may include an (n+1)-bit storage space configured to store the active pixel data code.
- The corrector may include a comparator configured to (i) compare the active pixel data code and the reference code and (ii) output a first signal and a second signal, a code converter configured to convert the active pixel data code into the reference code based on the first signal and output the reference code, and an offset corrector configured to correct the active pixel data code based on the second signal and output the corrected result.
- According to another aspect of the present invention, an image sensor includes a pixel array including an active pixel area including active pixels and a dark pixel area including dark pixels, an analog-to-digital conversion unit configured to generate a dark pixel data code by converting an analog output of each of the dark pixels and an active pixel data code by converting an analog output of each of the active pixels, a memory configured to store the dark pixel data code and the active pixel data code from the analog-to-digital conversion unit, and a digital signal processor configured to extract a final offset using the dark pixel data code and correct the active pixel data code using the final offset. The digital signal processor is configured to output one of a correction pixel data code and a reference code as a corrected result based on a comparison of the active pixel data code and the reference code. The correction pixel data code is obtained by correcting the active pixel data code using the final offset, and the reference code is a full code of resolution of the analog-to-digital conversion (ADC) unit.
- The image sensor may further include a column scanner configured to generate control signals to control the memory, and, based on the control signals from the column scanner, the memory may transmit the active pixel data code and the dark pixel data code to the digital signal processor.
- The digital signal processor may include an offset extractor configured to extract the final offset using the dark pixel data code and a corrector configured to output one of the correction pixel data code and the reference code as the corrected result based on a comparison of the active pixel data code and the reference code.
- The offset extractor may be configured to extract (i) a per-column dark offset, a global dark offset and per-row noise using the dark pixel data code and (ii) the final offset using at least one of the extracted per-column dark offset, global dark offset and per-row noise.
- According to another aspect of the present invention, a method of sensing an image using an image sensor including a pixel array including active pixels and dark pixels includes acquiring analog outputs of the dark pixels and analog outputs of the active pixels, generating a digital dark pixel data code by converting each of the dark pixels, generating a digital active pixel data code by converting each of the active pixels, extracting a final offset using the dark pixel data code, and correcting the active pixel data code using the final offset. Correcting the active pixel data code includes outputting one of a correction pixel data code and a reference code as a corrected result based on a comparison of the active pixel data codes and the reference code. The reference code is a full code of resolution from the analog-to-digital conversion (ADC) unit (e.g., having the same number of bits as the maximum number of digital bits output by the ADC unit, in which the value of each bit is 1). The correction pixel data code is obtained by correcting the active pixel data code using the final offset.
- Correcting the active pixel code may include converting the active pixel data code into the reference code and/or outputting the reference code when the active pixel data code is greater than the reference code.
- Correcting the active pixel code may include outputting the correction pixel data code when the active pixel data code is less than or equal to the reference code.
- Generating the dark pixel data code may include generating an (n+m)-bit digital code, where n is a natural number greater than 1 and m is a rational number satisfying 0<m<1.
- It is to be understood that both the foregoing general description and the following detailed description of various embodiments are exemplary and explanatory and are intended to provide further explanation of the invention as claimed.
- The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principle(s) of the invention. In the drawings:
-
FIG. 1 is a diagram showing an exemplary configuration of an image sensor according to one or more embodiments; -
FIG. 2 is a diagram showing an exemplary embodiment of the pixel array shown inFIG. 1 ; -
FIG. 3 is a diagram showing another exemplary embodiment of the pixel array shown inFIG. 1 ; -
FIG. 4 is a diagram showing an exemplary embodiment of the analog-to-digital conversion unit and the memory shown inFIG. 1 ; -
FIG. 5 is a diagram showing an exemplary configuration of an embodiment of the digital signal processor shown inFIG. 1 ; -
FIG. 6 is a diagram showing an exemplary embodiment of the offset extractor shown inFIG. 5 ; -
FIG. 7 is a diagram showing an exemplary configuration of an embodiment of the corrector shown inFIG. 5 ; and -
FIG. 8 is a schematic diagram illustrating causes of column fixed pattern noise in a bright area of a subject. - Hereinafter, embodiments of the present invention will be clearly appreciated through the accompanying drawings and the following description thereof. In description of the embodiments, it will be understood that, when an element such as a layer, film, region, pattern or structure is referred to as being formed “on” or “under” another element, such as a substrate, layer, film, region, pad or pattern, it can be directly “on” or “under” the other element or be indirectly “on” or “under” the other element with intervening elements therebetween. It will also be understood that “on” and “under” the element is described relative to the drawings. In addition, the same reference numerals designate the same constituent elements throughout the description of the drawings.
-
FIG. 1 is a diagram showing the configuration of animage sensor 100 according to one or more embodiments of the present invention. - Referring to
FIG. 1 , theimage sensor 100 includes acontroller 110, apixel array 120, an analog-to-digital conversion unit 130, amemory 140 and acolumn scanner 150. - The
controller 110 outputs a first control signal Sd configured to control thepixel array 120, a second control signal Sc configured to control the analog-to-digital conversion unit, and a third control signal CS configured to control thecolumn scanner 150. - For example, the first control signal Sd may include a reset signal RX, a transmission signal TX and a selection signal SX configured to control reset, transmit and pixel selection operations in the pixels of the
pixel array 120. - The
controller 110 may include (i) a timing controller configured to generate a timing signal and/or a control signal, and (ii) a row driver configured to generate the first control signal Sd configured to drive a plurality of unit pixels based on the timing signal from the timing controller, without being limited thereto. The first control signal Sd may be implemented in various manners capable of driving the plurality of unit pixels of thepixel array 120. - For example, the row driver may generate the drive signal Sd configured to drive the
pixel array 120 and output the generated drive signal to thepixel array 120. - For example, the row driver may output the drive signal Sd configured to drive an active pixel area 205 (see
FIGS. 2-3 ) and a dark area of thepixel array 120. - The
pixel array 120 may include a plurality of unit pixels, and the plurality of unit pixels may be in a matrix including rows and columns. Each unit pixel may be a photoelectric transformation element configured to sense light and transform the sensed light into an electrical signal. - The
pixel array 120 may include sensing lines L1 to Lm (m being a natural number greater than 1) connected to the unit pixels and configured to output sensing signals a1 to am (m being a natural number greater than 1). For example, each of the sensing lines L1 to Lm may be connected to output terminals of the unit pixels in a corresponding one of the columns. - The
pixel array 120 may include an active pixel area, a first dark area (black area) at one or more sides of the active pixel area in a first (e.g., column) direction and a second dark area at one or more sides of the active pixel area in a second (e.g., row) direction orthogonal to the first direction. - The analog-to-
digital conversion unit 130 converts the analog sensing signals from thepixel array 120 on the sensing lines L1 to Lm into digital signals and outputs a digital data code. - The analog-to-
digital conversion unit 130 may also perform correlated double sampling (CDS). In one example, CDS may refer to a difference between first digital data and second digital data that is obtained. The first digital data is a digital signal that may be obtained by converting a first sensing signal output from a unit pixel, upon resetting the unit pixel and second digital data is a digital signal that may be obtained by converting a second sensing signal from the unit pixel corresponding to an external image signal. - For example, the analog-to-
digital conversion unit 130 may include (i) a CDS processor configured to perform CDS and (ii) an analog-to-digital converter configured to convert an output of the CDS processor into a digital signal. - For example, although the CDS processor may include a switch, a capacitor and a differential amplifier, embodiments of the present invention are not limited thereto and may be variously implemented.
- For example, although the analog-to-digital converter may include a ramp signal generator, a comparator and a counter, embodiments of the present invention are not limited thereto and may be variously implemented.
- The analog-to-
digital conversion unit 130 may generate dark pixel data codes by converting the analog outputs of the dark pixels of the dark area to digital data, and may generate active pixel data codes by converting to the analog outputs of the active pixels of the active area. - The
memory 140 may store outputs from the analog-to-digital conversion unit 130 and transmit the stored outputs of the analog-to-digital conversion unit 130 to adigital signal processor 160 in response to control signals C1 to Cm of thecolumn scanner 150. - For example, the
memory 140 may include a plurality of latches (e.g., static random access memory cells) or a plurality of capacitors (e.g., one transistor-one capacitor random access memory cells, such as are typically found in dynamic random access memories). - The
column scanner 150 may output the control signals C1 to Cm to control thememory 140 based on the control signal CS received from thecontroller 110. The dark pixel data codes and the active pixel data codes stored in thememory 140 may be read and transmitted to thedigital signal processor 160 in response to the first control signals C1 to Cm from thecolumn scanner 150. - The
digital signal processor 160 processes the digital signals from thememory 140. - The
digital signal processor 160 outputs one of a correction pixel data code and a reference code as a corrected result based on a comparison of the active pixel data code and a reference code. The correction pixel data code is the active pixel data code that is corrected using a final offset. - Although the
digital signal processor 160 as shown is independent of thecontroller 110 inFIG. 1 , embodiments of the present invention are not limited thereto. In other embodiments, thecontroller 110 may control and/or include thedigital signal processor 160. -
FIG. 2 is a diagram showing an embodiment 120-1 of thepixel array 120 shown inFIG. 1 . - Referring to
FIG. 2 , the pixel array 120-1 includes an active pixel area 205, a firstdark area 212 and a seconddark area 222. - Although the first
dark area 212 may be spaced apart from the active pixel area 205 and located adjacent to the active pixel area 205 (e.g., parallel with rows of the active pixel areas 205), embodiments of the present invention are not limited thereto. In another embodiment, the firstdark area 212 may be spaced apart from the active pixel area 205 and located on an opposite side of the active pixel area 205. - Although the second
dark area 222 may be spaced apart from the active pixel area 205 and located at a side of the active pixel area 205 adjacent to the side along which the active pixel area 205 is located (e.g., parallel with columns of the active pixel area 205), embodiments of the present invention are not limited thereto. In another embodiment, the seconddark area 222 may be spaced apart from the active pixel area 205 and located on an opposite side of the active pixel area 205. - The active pixel area 205 may include a plurality of first pixels configured to convert incident light into an electrical signal using the photoelectric conversion properties of a photoreceptor (e.g., a photodiode). The plurality of pixels (hereinafter, referred to as “active pixels”) may be arranged in a matrix.
- The first and second
dark areas dark areas - For example, the first
dark area 212 may include a plurality of pixels (hereinafter, referred to as “first dark pixels”), and the plurality of first dark pixels may be arranged in a matrix (e.g., where the number of columns is greater than the number of rows). In addition, the seconddark area 222 may include a plurality of pixels (hereinafter, referred to as “second dark pixels”), and the plurality of second dark pixels may be arranged in a matrix (e.g., where the number of rows is greater than the number of columns). - Each column of the first
dark area 212 may correspond to or be aligned with a corresponding one of the columns of the active pixel area 205. Each row of the seconddark area 222 may correspond to or be aligned with a corresponding one of the rows of the firstdark area 212 and the active pixel area 205. - In another embodiment, each row of the second
dark area 222 may be aligned with a corresponding one of the rows of the active pixel area, and each column of the firstdark area 212 may be aligned with a corresponding one of the columns of the active pixel area and the second dark area. -
FIG. 3 is a diagram showing another embodiment 120-2 of thepixel array 120 shown inFIG. 1 . - Referring to
FIG. 3 , the pixel array 120-2 includes an active pixel area 205, firstdark areas dark areas - The pixel array 120-2 may further include dummy (e.g., inactive) pixel areas between the first and second
dark areas -
FIG. 4 is a diagram showing one or more embodiments of the analog-to-digital conversion unit 130 and thememory 140 shown inFIG. 1 . - Referring to
FIG. 4 , the analog-to-digital conversion unit 130 may receive a sensing signal A1 (e.g., from the pixel array 120) as an analog signal and output a digital data signal Dig based on a value of the received analog signal. - The analog-to-
digital conversion unit 130 may generate an (m+n)-bit digital code, in which n may be a natural number greater than 1, and m may be a rational number satisfying 0<m<1. - For example, n may equal 0 and m may equal 0.3, without being limited thereto.
- Referring to
FIG. 4 , n may be related to the digital resolution of the analog-to-digital conversion unit 130 for the signal from thepixel array 120. For example, when the full code value of the digital resolution of thepixel array 120 is set to 1024, n=10. - In various embodiments, m may be determined based on the digital code value corresponding to the analog signal from the dark area. For example, when n=10 and the digital code value corresponding to the dark area is in a range of 1 to 36, m may be 0.3.
- The digital code Dig generated and/or output by the analog-to-
digital conversion unit 130 may be expressed as a 2(n+m) binary code (e.g., a gray code). For example, when n=10 and m=0.3, the digital code Dig may have 1260 possible values, and the full code value of the digital code Dig may be 1260. - To store the digital code Dig expressed by the (n+m)-bit binary code (e.g., the active pixel data code), the
memory 140 may include an (n+1)-bit unit storage space. For example, one digital code Dig generated and/or output by the analog-to-digital conversion unit 130 may be stored in one unit storage space of thememory 140. - For example, the
memory 140 may comprise a line memory or register comprising (n+1) bits of data storage configured to store one active pixel data code. -
FIG. 5 is a diagram showing an exemplary configuration of an embodiment of thedigital signal processor 160 shown inFIG. 1 . - Referring to
FIG. 5 , thedigital signal processor 110 may include an offsetextractor 114 and acorrector 116. - The offset
extractor 114 may extract an offset using data codes (hereinafter, referred to as “dark pixel data codes”) of dark pixels of the dark area. - For example, the offset
extractor 114 may extract a final offset value SF configured to compensate for a dark level based on the output SD of thedark area 212 or 222 (or, alternatively, one or more of thedark areas dark areas FIG. 2 orFIG. 3 , respectively. - For example, the offset
extractor 114 may extract a final offset value SF configured to compensate for the dark level based on at least one of a first output SC of the first dark area 212 (or one or both of the firstdark areas dark areas - The offset
extractor 114 may extract dark pixel data codes of the first and second dark areas, in which light may be blocked, and extract the final offset value SF configured to compensate for the dark level(s) (e.g., corresponding to the amount of light in the dark pixel[s]) using the extracted dark pixel data codes, in order to extract an offset configured to cancel noise due to the dark current of thepixel array 120. The dark current is generated regardless of the presence, absence or value(s) of an optical image. - The offset
extractor 114 may extract a per-column dark offset value SC2, a global dark offset value SG, a per-row average SR2, and a per-row noise value RN using the dark pixel data codes and may extract the final offset value SF using at least one of the per-column dark offset value SC2, the global dark offset value SG, the per-row average SR2 and/or the per-row noise value RN. - The description of
FIG. 6 is applicable to the definition of the per-column dark offset value SC2, the global dark offset value SG, the per-row average SR2 and the per-row noise value RN. - For example, the offset
extractor 114 may extract a per-column dark offset, a global dark offset, a per-row average and a per-row noise value. In addition, the offsetextractor 114 may select one of the extracted per-column dark offset and the global dark offset, and extract the final dark offset by adding the selected dark offset to the per-row noise value. - For example, the first dark pixels of the first dark area 212 (or one or both of the first
dark areas controller 110, and the per-column dark offset value SC and the global dark offset value SG may be extracted using the outputs of the first dark pixels acquired from the driven pixels. - Next, the second dark pixels of the second dark area 222 (or one or both of the second
dark areas controller 110, and the per-row noise value RN may be extracted using the outputs of the second dark pixels acquired from the driven pixels. -
FIG. 6 is a diagram showing an embodiment of the offsetextractor 114 shown inFIG. 5 . - Referring to
FIG. 6 , the offsetextractor 114 may include a first offsetextractor 501, a second offsetextractor 502, and a calculator (e.g., an adder or subtractor) 503. - The first offset
extractor 501 may extract the per-column dark offset and the global dark offset from or based on the first output SC of the first dark area 212 (or of one or both of the firstdark areas - The first offset
extractor 501 may include afirst filter 210, a firstaverage extractor 220, amemory 230, a secondaverage extractor 240 and aselector 250. - The
first filter 210 may filter the output SC of the first dark pixels of the first dark area 212 (or one or both of the firstdark areas - The first dark area 212 (or the first
dark areas dark areas - Here, the outlier(s) may be a value outside a predetermined range, where the predetermined range has a lower limit and an upper limit. For example, the
first filter 210 may remove a value of a first dark pixel that is less than the lower limit and/or a value of the first dark pixel that is greater than the upper limit from the output SC of the first dark pixels. - The
first filter 210 is responsible for removing abnormal outputs (e.g., outliers) of the first dark area 212 (or the firstdark areas first filter 210 may comprise or be implemented by an outlier removal filter. By removing the outputs of the defective pixels, it is possible to improve dark level compensation accuracy. In other embodiments, thefirst filter 210 may be omitted. - The first
average extractor 220 extracts an average SC2 of the first dark pixels of each column of the first dark area 212 (or one or both of the firstdark areas first filter 210. - The
memory 230 may store the extracted average SC2. If thefirst filter 210 is omitted, the average SC2 of the first dark pixels of each column may be extracted directly from the first dark pixels. Hereinafter, the average SC2 of the first dark pixels of each column may be referred to as a “per-column dark offset”. - The first
average extractor 220 may extract the per-column dark offset value of the first dark pixels in each column of the first dark area 212 (or in one or both of the firstdark areas - The first
average extractor 220 may extract a weighted average of the first dark pixels of a k-th row (e.g., by weight-averaging the first dark pixels of a [k−1]-th row, k being a natural number satisfying 1<k<n) row in each column of the first dark area 212 (or one or both of the firstdark areas - When the weighted average of the first dark pixels of the k-th row is extracted, a larger weighted value may be given to the weighted average of the first dark pixels of the (k−1)-th (k being a natural number satisfying 1<k<n) row than the first dark pixels of the k-th row.
- The weighted average of the first dark pixels of the first row of each column of the first dark area 212 (or the first
dark areas - The
memory 230 may store the weighted average of the first dark pixels of the (k−1)-th (k being a natural number satisfying 1<k<n) row in each column. - The second
average extractor 240 extracts an average SG of all of the first dark pixels in the first dark area 212 (or one or both of the firstdark areas first filter 210. For example, the secondaverage extractor 240 may extract the average SG of all of the first dark pixels in the first dark area 212 (or the firstdark areas average extractor 240 is referred to as a “global dark offset value”. - If the
first filter 210 is omitted, the average SG may be extracted directly using the first dark pixels. - The
selector 250 selects and outputs the per-column dark offset value SC2 or the global dark offset value SG based on or upon the occurrence of one or more predetermined operational conditions. - Here, the predetermined operational conditions may include the illuminance and temperature of the environment surrounding the image sensor.
- For example, if the illuminance of the environment surrounding the image sensor is higher than a predetermined threshold illuminance, the
selector 250 may select and output the global dark offset value SG, because the sensed signal components in the high-illuminance environment are large, and thus the influence of column fixed pattern noise is low. In this case, when the global dark offset value SG is selected, at least the firstaverage extractor 220 may be turned off, making it possible to reduce power consumption in the image sensor. - In addition, when the temperature of the surrounding environment is higher than a predetermined temperature, variation in the dark current is relatively large, and thus the error from the estimated column fixed pattern noise may increase or be relatively large. Therefore, the
selector 250 may select and output the global dark offset value SG when the temperature of the surrounding environment is higher than the predetermined threshold temperature. - In contrast, when the illuminance of the environment surrounding the image sensor does not exceed the threshold illuminance and/or the temperature of the surrounding environment does not exceed the threshold temperature, estimating and removing column fixed pattern noise may be sufficiently accurate and/or useful, and the
selector 250 may select and output the per-column dark offset value SC2. - In a first offset extractor according to one or more other embodiments, the
first filter 210 may be omitted, the firstaverage extractor 220 may extract the average SC2 using the output SC of the first dark pixels instead of the output SC1 of thefirst filter 210, and the secondaverage extractor 240 may extract the global dark offset value SG using the outputs SC of the first dark pixels instead of the output SC1 of thefirst filter 210. - The second offset
extractor 502 extracts a per-row average based on an output SR of the second dark area 222 (or of one or both of the seconddark areas - The second offset
extractor 502 may include asecond filter 260, a thirdaverage extractor 270 and a calculator or mathematical operator (e.g., an adder or subtractor) 280. - The
second filter 260 filters the second dark pixels in each row of the second dark area 222 (or one or both of the seconddark areas dark areas second filter 260 may be or comprise a median filter. - For example, the
second filter 260 may select a median (or representative) value from among the second dark pixels in each row (e.g., two or more second dark pixels adjacent to any one second dark pixel in each row) and output the median (or representative) value SR1 of the second dark pixels in each row. - For example, the
second filter 260 may select an output (e.g., Y1) of one second dark pixel (e.g., X[1]) of a group of dark pixels in each row, or of each row as a whole, as follows. - For example, the median value (e.g., 2) may be extracted from among the outputs (X[1]=1, X[2]=2, X[3]=3) of the second dark pixel (e.g., X[1]) and the next two second dark pixels (e.g., X[2] and X[3]) adjacent thereto, and the extracted median value (e.g., 2) may be changed to the output of the second dark pixel (e.g., X[1]). The number of selected adjacent second dark pixels may be two or more. In such a case, the median value is simply a filtered value, in which the value of a first dark pixel represents the value of each of a group of three or more contiguous dark pixels. Alternatively, the value of a second dark pixel (e.g., X[2]) may be compared to the values of the second dark pixels adjacent thereto (e.g., X[1] and X[3], where X[1]=1, X[2]=2 and X[3]=3 for example), and the extracted median value (e.g., 2) may be the median value of the second dark pixels (e.g., X[2]). Such median filtering operations can be performed on a row of second dark pixels or all dark pixels in a dark area (e.g., second dark area 222). Thus, there may be one or more median or representative second dark pixel values for each row of second dark pixels in a second dark area.
- The
second filter 260 may also remove any outliers from the second dark pixels in each row of the second dark area 222 (or one or both of the seconddark areas - That is, the
second filter 260 may serve to cancel random noise in the second dark pixels in each row of the second dark area 222 (or of the seconddark areas - The third
average extractor 270 may extract the per-row average SR2 of the second dark pixels in each row of the second dark area 222 (or of the seconddark areas second filter 260. - For example, the outputs SR of the second dark pixels in each row may be filtered by the
second filter 260 to provide the median values SR1, and the thirdaverage extractor 270 may extract a per-row average SR2 of the median values SR1 of the second dark pixels in each row. Accordingly, the thirdaverage extractor 270 may extract the per-row average SR2 corresponding to each of the rows of the second dark area 222 (or of one or both of the seconddark areas - In another embodiment, the
second filter 260 may be omitted. If thesecond filter 260 is omitted, the thirdaverage extractor 270 may extract the per-row average SR2 directly using the outputs SR of the second dark pixels in each row. - The calculator (e.g., the adder or subtractor) 280 extracts a per-row noise value (RN) from the global dark offset value SG and the per-row average=SR2 (e.g., by subtracting the global dark offset value SG from the per-row average SR2 [RN=SR2−SG]). Alternatively, the
calculator 280 extracts the per-row noise value (RN) by adding the per-row average SR2 and the inverse of the global dark offset value SG. - The
calculator 503 outputs a final dark offset value SF from the per-row noise value RN and the output of the selector 250 (i.e., either the per-column dark offset value SC2 or the global dark offset value SG). - For example, the
calculator 503 may add the output of the selector 250 (i.e., either per-column dark offset value SC2 or the global dark offset value SG) to the per-row noise value RN, and output the final dark offset value SF as the sum of the per-row noise value RN and either per-column dark offset value SC2 or the global dark offset value SG. - For example, depending upon the value output from the selector 250 (which may depend on one or more operational conditions of the image sensor, as described herein), the final dark offset value SF may be a sum of the per-column dark offset value SC2 and the per-row noise value RN, or a sum of the global dark offset value SG and the per-row noise value RN.
- For example, if the output of the
selector 250 is the global dark offset value SG, the final dark offset value SF may be the output SR2 of the thirdaverage extractor 270. - The corrector 116 (see
FIG. 5 ) reads and compares raw data (D-raw; hereinafter, referred to as “active pixel data code”) of the active pixel area 205 with a reference code. - When the active pixel data code is greater than the reference code SK, the
corrector 116 converts the active pixel data code of the active pixel area 205 into the reference code SK and/or outputs the reference code SK. - For example, the reference code SK may be a full code of resolution of the analog-to-digital conversion for the output of the
pixel array 120. - In another example, the reference code SK may be a full code of resolution of the analog-to-digital conversion of the analog-to-
digital conversion unit 130. - For example, the reference code SK may have a code value of 2n and, if n=10, the value of the reference code SK may be 1024 (e.g., 1111111111).
- If the active pixel data code is less than or equal to the reference code, the
corrector 116 corrects the active pixel data code based on the final dark offset value SF and outputs the active pixel data code SM (hereinafter, referred to as “corrected pixel data code”), from which noise is cancelled. - Here, the active data code may be a digital data code from converting the analog outputs of the active pixel area 205 using the analog-to-
digital conversion unit 130. -
FIG. 7 is a diagram showing the configuration of an embodiment of thecorrector 116 shown inFIG. 5 . - Referring to
FIG. 7 , thecorrector 116 may include acomparator 610, acode converter 620 and an offsetcorrector 620. - The
comparator 610 reads the active pixel data code D-raw from in thememory 140, compares the active pixel data code D-raw with the reference code SK, and outputs a first signal CS1 and a second signal CS2 based on the comparison. - The
comparator 610 outputs the first signal CS1 or enables the first signal CS1 when the active pixel data code D-raw is greater than the reference code SK (D-raw>SK). - The
comparator 610 outputs the second signal CS2 or enables the second signal CS2 when the active pixel data code D-raw is less than or equal to the reference code SK (D-raw≤SK). - The
code converter 620 receives the active pixel data code D-raw from thememory 140, and either converts the active pixel data code D-raw into the reference code SK based on the value of D-raw and outputs the reference code SK, or simply passes through the reference code Sk. - When D-raw>SK, the
corrector 116 outputs the reference code SK from thecode converter 620 as the correction pixel data code of each active pixel without performing offset correction. Thus, it is possible to cancel the column fixed pattern noise (CFPN) and/or omit or disable its associated circuitry. - The offset
corrector 630 receives the active pixel data code D-raw from thememory 140, corrects the active pixel data code D-raw based on the second signal CS2, and outputs the corrected data. - For example, the offset
corrector 630 may correct the active pixel data code D-raw using the final dark offset value SF. - When D-raw≤SK, the
corrector 116 performs offset correction through the offsetcorrector 630 and outputs the corrected data. For example, thecorrector 116 may output a value obtained by subtracting the final dark offset from the active pixel data code D-raw as the corrected pixel data code. - In general, when the active pixel data code is corrected based on the dark offset, it is possible to cancel column fixed pattern noise and/or omit or disable its associated circuitry. However, the column fixed pattern noise may be generated in an area in which the screen of the image sensor is saturated by a bright subject.
-
FIG. 8 is a schematic diagram illustrating causes of column fixed pattern noise in a bright area of a subject. - Referring to
FIG. 8 , thememory 140 may include a first memory area 141 configured to store dark pixel data codes and asecond memory area 142 configured to store active pixel data codes. - The dark pixel data codes Code1 to Code4 (e.g., Code1, Code2, Code3, and Code4) of the dark pixels of first to fourth columns COL1 to COL4 (e.g., COL1, COL2, COL3, and COL4) may be stored in the first memory area 141 of the
memory 140. The dark pixel data codes Code1 to Code4 may have independent and different values due to an independent offset of each column, and thus the final dark offsets of the columns may have different values. - The active pixel data codes of the active pixels in a plurality of columns of the image sensor that has sensed a bright area of a subject may be full codes (F-codes) and may be stored in the
second memory area 142. As shown inFIG. 8 , the per-column offsets of the active pixel data codes of the bright area of the subject may disappear. - The average dark pixel data codes may have a value of several tens (e.g., 10, 20, 30, 40, 50, 60, 70, 80, 90, etc.), which may vary according to column.
- As a result, a difference between the active pixel data code and the dark pixel data code does not reach the full code, and column fixed pattern noise may be generated even when offset correction is performed. Offset connection comprises subtracting the dark pixel data code (or the final dark offset) from the active pixel data code.
- In one embodiment, the analog-to-
digital conversion unit 130 having (n+m)-bit resolution may be included to implement n-bit resolution. - In various embodiment, if the value of the active pixel data code of the active pixels exceeds the value of the full code generated by the analog-to-digital conversion unit having n-bit resolution, the active pixel data code exceeding the full code may be converted into the full code.
- For example, in a 10.3-bit single slope analog-to-digital conversion unit, since the value of the full code of the active pixel is 1260, and the average of the dark pixel data codes of the dark pixels has a value of about several tens (e.g., 10 to 90), even when the value of the dark pixel data code varies according to the column, the column fixed pattern noise is not generated by the offset correction.
- According to embodiments of the present invention, it may be possible to prevent column fixed pattern noise from being generated by an offset correction in the bright area of the subject.
- Features, structures, effects, and the like as described above in the embodiments are included in at least one embodiment of the present invention and should not be limited to only one embodiment. In addition, the features, structures, effects, and the like described in the respective embodiments may be combined or modified even with respect to the other embodiments by those skilled in the art. Accordingly, contents related to these combinations and modifications should be construed as within the scope of the present invention.
Claims (20)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160172673A KR102169308B1 (en) | 2016-12-16 | 2016-12-16 | Image sensor and method of sensing the same |
KR10-2016-0172673 | 2016-12-16 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20180176495A1 true US20180176495A1 (en) | 2018-06-21 |
US10009562B1 US10009562B1 (en) | 2018-06-26 |
Family
ID=62562244
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/665,866 Active US10009562B1 (en) | 2016-12-16 | 2017-08-01 | Image sensor including active pixel area and dark pixel area correction |
Country Status (2)
Country | Link |
---|---|
US (1) | US10009562B1 (en) |
KR (1) | KR102169308B1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021042231A1 (en) * | 2019-09-02 | 2021-03-11 | 深圳市汇顶科技股份有限公司 | Signal processing circuit and method for use in pixel array, and image sensor |
US11317041B1 (en) * | 2020-12-31 | 2022-04-26 | Silicon Optronics, Inc. | Image-sensing device and method of black-level calibration thereof |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050051627A1 (en) * | 2003-09-08 | 2005-03-10 | Takeshi Matushima | Optical information reading apparatus and related information reading method |
US20070139729A1 (en) * | 2005-12-16 | 2007-06-21 | Gi-Doo Lee | Image sensor and test system and method therefor |
US20080075383A1 (en) * | 2006-09-22 | 2008-03-27 | Peng Wu | Methods And Systems For Identifying An Ill-Exposed Image |
US20110032391A1 (en) * | 2009-08-04 | 2011-02-10 | Himax Imaging, Inc. | Image Sensor with Peripheral Dummy Pixels |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6864916B1 (en) * | 1999-06-04 | 2005-03-08 | The Trustees Of Columbia University In The City Of New York | Apparatus and method for high dynamic range imaging using spatially varying exposures |
KR20140028938A (en) * | 2012-08-31 | 2014-03-10 | 에스케이하이닉스 주식회사 | Image sensor and method for processing noise thereof |
KR20140067408A (en) * | 2012-11-26 | 2014-06-05 | 삼성전자주식회사 | Solid state pick-up device and control method therefore |
-
2016
- 2016-12-16 KR KR1020160172673A patent/KR102169308B1/en active IP Right Grant
-
2017
- 2017-08-01 US US15/665,866 patent/US10009562B1/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050051627A1 (en) * | 2003-09-08 | 2005-03-10 | Takeshi Matushima | Optical information reading apparatus and related information reading method |
US20070139729A1 (en) * | 2005-12-16 | 2007-06-21 | Gi-Doo Lee | Image sensor and test system and method therefor |
US20080075383A1 (en) * | 2006-09-22 | 2008-03-27 | Peng Wu | Methods And Systems For Identifying An Ill-Exposed Image |
US20110032391A1 (en) * | 2009-08-04 | 2011-02-10 | Himax Imaging, Inc. | Image Sensor with Peripheral Dummy Pixels |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021042231A1 (en) * | 2019-09-02 | 2021-03-11 | 深圳市汇顶科技股份有限公司 | Signal processing circuit and method for use in pixel array, and image sensor |
US11317041B1 (en) * | 2020-12-31 | 2022-04-26 | Silicon Optronics, Inc. | Image-sensing device and method of black-level calibration thereof |
CN114697576A (en) * | 2020-12-31 | 2022-07-01 | 晶相光电股份有限公司 | Image sensing device and black level correction method thereof |
Also Published As
Publication number | Publication date |
---|---|
US10009562B1 (en) | 2018-06-26 |
KR102169308B1 (en) | 2020-10-23 |
KR20180070224A (en) | 2018-06-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8462243B2 (en) | Solid-state image sensing device, method for reading signal of solid-state image sensing device, and image pickup apparatus | |
CN100426849C (en) | Solid-state image pickup apparatus | |
KR100639642B1 (en) | Imaging device, control method thereof and cmos image sensor | |
US7366347B2 (en) | Edge detecting method | |
US20050243193A1 (en) | Suppression of row-wise noise in an imager | |
US9894300B2 (en) | Image sensing device for measuring temperature without temperature sensor and method for driving the same | |
US8275213B2 (en) | Apparatus and method for gain correction | |
US20090278963A1 (en) | Apparatus and method for column fixed pattern noise (FPN) correction | |
US8902336B2 (en) | Dynamic, local edge preserving defect pixel correction for image sensors with spatially arranged exposures | |
US9124832B2 (en) | Dynamic, local edge preserving defect pixel correction for image sensors | |
US8411175B2 (en) | Solid-state imaging device and image defect correction processing circuit | |
US20030184666A1 (en) | Image sensor having pixel array and method for automatically compensating black level of the same | |
US9832400B2 (en) | Image sensor and method of sensing image | |
US10009562B1 (en) | Image sensor including active pixel area and dark pixel area correction | |
US9106853B2 (en) | Solid-state imaging device | |
EP1872572B1 (en) | Generation and strorage of column offsets for a column parallel image sensor | |
US8134769B2 (en) | Imaging apparatus | |
JP2007335991A (en) | Signal processing circuit | |
CN207677872U (en) | Imaging sensor | |
JP2005176061A (en) | Solid-state image pickup device, image input device and noise elimination method for solid-state image pickup device | |
US20220141404A1 (en) | Cmos image sensor with image black level compensation and method | |
JP2018133685A (en) | Imaging device, control method of the same, control program, and imaging apparatus | |
KR100411733B1 (en) | Smart readout circuit including background suppression, non-uniformity compensation, and dead pixel correction | |
JP2019186817A (en) | Solid state image sensor, imaging apparatus, and control method of solid state image sensor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: DONGBU HITEK CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SHIM, HEE SUNG;REEL/FRAME:043402/0109 Effective date: 20170801 |
|
AS | Assignment |
Owner name: DB HITEK CO., LTD., KOREA, REPUBLIC OF Free format text: CHANGE OF NAME;ASSIGNOR:DONGBU HITEK CO., LTD.;REEL/FRAME:044559/0819 Effective date: 20171101 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |
|
AS | Assignment |
Owner name: DB GLOBALCHIP CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DB HITEK CO., LTD.;REEL/FRAME:067800/0572 Effective date: 20230803 |