WO2017099308A1 - Color filter array and image sensor using same - Google Patents

Color filter array and image sensor using same Download PDF

Info

Publication number
WO2017099308A1
WO2017099308A1 PCT/KR2016/004363 KR2016004363W WO2017099308A1 WO 2017099308 A1 WO2017099308 A1 WO 2017099308A1 KR 2016004363 W KR2016004363 W KR 2016004363W WO 2017099308 A1 WO2017099308 A1 WO 2017099308A1
Authority
WO
WIPO (PCT)
Prior art keywords
color filter
filter
infrared
array
color
Prior art date
Application number
PCT/KR2016/004363
Other languages
French (fr)
Korean (ko)
Inventor
예창희
장현식
민대성
Original Assignee
(주) 픽셀플러스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주) 픽셀플러스 filed Critical (주) 픽셀플러스
Priority to KR1020167012784A priority Critical patent/KR101806956B1/en
Priority to CN201680072580.2A priority patent/CN108370421B/en
Publication of WO2017099308A1 publication Critical patent/WO2017099308A1/en

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/20Filters
    • G02B5/22Absorbing filters
    • G02B5/223Absorbing filters containing organic substances, e.g. dyes, inks or pigments
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/10Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
    • H04N25/11Arrangement of colour filter arrays [CFA]; Filter mosaics
    • H04N25/13Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
    • H04N25/131Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements including elements passing infrared wavelengths
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/20Filters
    • G02B5/28Interference filters
    • G02B5/281Interference filters designed for the infrared light
    • G02B5/282Interference filters designed for the infrared light reflecting for infrared and transparent for visible light, e.g. heat reflectors, laser protection
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/20Filters
    • G02B5/28Interference filters
    • G02B5/285Interference filters comprising deposited thin solid films
    • G02B5/286Interference filters comprising deposited thin solid films having four or fewer layers, e.g. for achieving a colour effect
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof

Definitions

  • the present invention relates to a color filter array having a novel structure and an image sensor using the same.
  • an image sensor is a semiconductor device that converts an optical image into an electrical signal, and a charge couple device (CCD) image sensor and a complementary metal-oxide semiconductor (CMOS) image sensor are widely used. It is utilized.
  • the image sensor uses a color filter array (CFA) implemented in red, green, blue, and the like to realize color.
  • CFA color filter array
  • 1 exemplarily illustrates a Bayer pattern of a commonly used color filter array.
  • the minimum repeating unit of the Bayer pattern shown in FIG. 1 commonly includes two rows and two columns, that is, an array structure of 2 ⁇ 2.
  • the red filter (R), the green filter (G), and the blue filter (B) have a ratio of 1: 2: 1.
  • a red filter (R) and a blue filter (B) are disposed in a diagonal direction
  • two green filters (G) are disposed in a diagonal direction crossing the blue filter (R) and a blue filter (B).
  • the infrared light input to the color filter array to which the Bayer pattern as shown in FIG. 1 is applied may be utilized as important image information when photographing a night camera. However, when photographing the daytime camera, infrared light must be blocked because color information is distorted by infrared light.
  • a filter that passes infrared rays or a filter that blocks infrared rays is selectively added between the camera lens and the image sensor.
  • adding components such as an infrared pass filter or an infrared cut filter, has the disadvantage of complicated camera manufacturing process and increased production cost.
  • An embodiment of the present invention provides a color filter array capable of selectively and easily generating color signals including an infrared signal and color signals from which infrared signals have been removed without an additional infrared pass filter or an infrared cut filter in addition to the color filter array, and a color thereof.
  • An image sensor using a filter array is provided.
  • the color filter array includes color filters and infrared filters (infrared pass filter, infrared cut-off filter) and appropriately arranges them so that the infrared rays in the color signals can be removed without additional infrared pass filter or infrared cut filter in addition to the color filter array. Allows you to selectively remove the signal.
  • infrared filters infrared pass filter, infrared cut-off filter
  • the present invention can selectively remove infrared signals from color signals without additional infrared pass filter or infrared cut filter in addition to the color filter array.
  • FIG. 1 illustrates a pixel array of a commonly used Bayer pattern.
  • FIG. 2 is a configuration diagram illustrating a configuration of an image sensor according to a first embodiment of the present invention.
  • FIG. 3 is a diagram illustrating a configuration of a color filter array in the color filter unit of FIG. 1.
  • FIG. 4 is a conceptual diagram schematically showing a configuration for separating infrared signals according to a first embodiment of the present invention.
  • FIG. 5 is a configuration diagram illustrating a configuration of an image sensor according to a second exemplary embodiment of the present invention.
  • 6A and 6B are diagrams exemplarily illustrating configurations of a color filter array in the color filter unit of FIG. 5.
  • 7A and 7B are exemplary views illustrating cross-sectional views of a color filter array cut along AA ′ in FIG. 6A.
  • FIG. 8 is a conceptual diagram schematically illustrating a configuration of separating infrared signals according to a second embodiment of the present invention.
  • FIG. 9 is a configuration diagram illustrating a configuration of an image sensor according to a third embodiment of the present invention.
  • 10A through 10C are diagrams exemplarily illustrating configurations of a color filter array in the color filter unit of FIG. 9.
  • FIG. 11A and 11B are diagrams illustrating cross-sectional views of a color filter array cut along AA ′ in FIG. 10A.
  • FIG. 12 is a diagram illustrating a configuration of a color filter array according to another embodiment of the present invention.
  • a color filter array includes a first unit pixel array in which a first color filter, a second color filter, and a third color filter are arranged in an array form; And a second unit pixel array in which the fourth color filter, the fifth color filter, and the infrared pass filter are arranged in an array form.
  • a first unit, a second unit, a second unit, a third unit, and a fourth unit are arranged in a repeating arrangement.
  • the second color filter and the infrared cut filter is characterized in that overlapping.
  • a color filter array includes: a first unit pixel array in which a first color filter, a second color filter, and a first infrared light pass filter are arranged in an array; And a second unit pixel array in which the third color filter, the fourth color filter, and the second infrared pass filter are arranged in an array form.
  • An image sensor includes a color filter and an infrared pass filter arranged in an array, and a color filter array for filtering incident light to output color signals and infrared signals including infrared rays; And an image processor for selectively removing infrared components from the color signals using the infrared signal.
  • an image sensor includes: a color filter array configured to filter incident light to output a red signal, a green signal, a blue signal, and an infrared cut green signal; And an image processor extracting an infrared signal using the green signal and the infrared cut green signal, and selectively removing infrared components from the red signal and the blue signal using the extracted infrared signal.
  • An image sensor includes a color filter array that filters incident light to output a red signal, an infrared cut green signal, a blue signal, and an infrared signal; And an image processor for selectively removing infrared components from the red signal and the blue signal using the infrared signal, or selectively adding infrared components to the infrared cut green signal.
  • FIG. 2 is a configuration diagram illustrating a configuration of an image sensor according to a first embodiment of the present invention.
  • the image sensor of FIG. 2 includes a color filter unit 100 and an image processor 200.
  • the color filter unit 100 filters the optical signal input through the lens to filter the color signals Rs + IRs, Gs + IRs, Bs + IRs and infrared signals IRs having wavelengths corresponding to the respective color filters.
  • the color filter unit 100 may include a color filter array CFA in which color filters and IR pass filters are arranged in an array.
  • the color filter filters the optical signal to be input, and is a red signal (Rs + IRs), a green signal (Gs + IRs), and a blue signal, which are color signals including visible light (Rs, Gs, Bs) and infrared signals (IRs).
  • An IR pass filter passes light of 650 nm or more, which is an infrared region, from an input optical signal. That is, the infrared pass filter filters the input optical signal and outputs only the infrared signals IRs.
  • the image sensor by placing an infrared pass filter on a portion of the color filter array, the image sensor extracts infrared signals (IRs) in addition to the color signals (Rs + IRs, Gs + IRs, Bs + IRs) from the optical signals received. To print.
  • IRs infrared signals
  • the image processor 200 converts the color signals (Rs + IRs, Gs + IRs, Bs + IRs) and infrared signals (IRs) output from the color filter unit 100 into digital signals, and then processes them by processing the respective colors.
  • the visible light signals Rs, Gs and Bs are selectively recovered from the signals Rs + IRs, Gs + IRs and Bs + IRs.
  • the image processor 200 removes the infrared signals IRs from the color signals Rs + IRs, Gs + IRs, and Bs + IRs according to the infrared selection signal IRsel, thereby displaying the visible light signals Rs, Gs, Bs) is restored and output, or high-sensitivity color signals Rs + IRs, Gs + IRs, and Bs + IRs including both infrared signals IRs and visible light signals Rs, Gs, and Bs are output.
  • the infrared selection signal IRsel is a control signal for determining whether or not to include an infrared component in the signal output from the image processor 200.
  • the infrared selection signal IRsel is off during the day to remove the infrared component from the color signals, and on at night to include the infrared component in the color signals.
  • FIG. 3 is a diagram illustrating a configuration of a color filter array in the color filter unit 100 of FIG. 1 and exemplarily illustrating a structure of a minimum unit array repeatedly arranged in an array form.
  • the color filter array of the color filter unit 100 may include a blue filter in the first unit pixel array 110 and the 2 ⁇ 2 Bayer pattern having the same structure as the 2 ⁇ 2 Bayer pattern (see FIG. 1). And a second unit pixel array 120 in which an infrared pass filter IR is disposed at the position B).
  • the first unit pixel array 110 includes a red filter (R) and a blue filter (B) disposed in a diagonal direction, and a 2 ⁇ 2 pixel array in which two green filters (G) are disposed in a diagonal direction crossing the red filter (R) and a blue filter (B). It may have a structure.
  • the second unit pixel array 120 has a 2 ⁇ 2 pixel array structure in which a red filter R and an infrared ray passing filter IR are disposed in a diagonal direction, and two green filters G are disposed in a diagonal direction crossing the red filter R and an infrared ray passing filter IR. It can have
  • the array structure of FIG. 3 shows the structure of the smallest unit array of the color filter array used in the color filter unit 100.
  • Two first unit pixel arrays 110 are arranged in a diagonal direction and cross the diagonal direction. As a result, it has a 4 ⁇ 4 pixel array structure in which two second unit pixel arrays 120 are arranged. That is, the color filter array of the color filter unit 100 has a structure in which the unit array of FIG. 3 is repeatedly arranged.
  • two of the four blue filters B may be infrared ray passing filters (IR). ), These two infrared pass filters (IR) are arranged diagonally.
  • the light passing through the blue filter is light having a relatively short wavelength, and has a relatively small number of photons. Therefore, the light passing through the blue filter has a small ratio of being electronicized and thus the signal strength is weak (see Equation 1 below).
  • some of the blue filters are replaced with an infrared pass filter.
  • E is the energy of one photon
  • h Planck's constant
  • c is the velocity of the photon
  • the number of photons of light passing through the red filter is greater than the number of photons of light passing through the blue filter, and in a dark environment with low illumination, the light passing through the red filter is more likely to have a greater signal intensity than the light passing through the blue filter. That is, a lot of light energy can be received from the light which passed the red filter.
  • the red filter is arranged in the same way as in the reference Bayer pattern.
  • blue cones with shorter wavelengths are distributed in human eye cells than red cones with longer wavelengths, so the blue signal is less sensitive than the red signal at resolution. Therefore, even when considering the human recognition characteristics, it is more effective to reduce the distribution ratio of the blue filter than the red filter.
  • FIG. 4 is a conceptual diagram schematically illustrating a configuration of reconstructing a color signal according to a first embodiment of the present invention.
  • the color filter unit 100 When light is input to the color filter unit 100, the color filter unit 100 filters the color signals A including the infrared signals IRs and the visible light signals Rs, Gs, and Bs and the infrared signals ( Output B). That is, the color filter unit 100 separately outputs the infrared signal B as well as the color signals A including the infrared signal.
  • the image processor 200 restores the visible light signal C by converting the color signals A and the infrared signal B into a digital signal, and then calculates a difference between each color signal value and the infrared signal value. That is, the image processor 200 restores the visible light signal C by removing the infrared signal IRs component from each of the color signals Rs + IRs, Gs + IRs, and Bs + IRs.
  • the color filter unit 100 replaces some of the color filters (preferably, blue filters) of the color filters in the color filter array by using an infrared pass filter. Rs + IRs, Gs + IRs, Bs + IRs) while outputting additional infrared signals (IRs). Therefore, a circuit for processing color signals in the image processor 200 may use a circuit that has been used for a conventional Bayer pattern.
  • FIG. 5 is a configuration diagram illustrating a configuration of an image sensor according to a second exemplary embodiment of the present invention.
  • the image sensor of FIG. 5 includes a color filter unit 300 and an image processor 400.
  • the color filter unit 300 filters the optical signal input through the lens to color signals having a wavelength corresponding to each color filter (Rs + IRs, Gs + IRs, Bs + IRs) and color signals in which infrared rays are blocked.
  • RGB Red, Green, Blue
  • Gs Green visible light signal
  • the color filter unit 300 includes a color filter array CFA, and the color filter array CFA includes infrared cut-off filters disposed at the rear of some of the color filters and color filters arranged in an array form. IR cut filters). At this time, the color filter filters the input optical signal and outputs a red signal (Rs + IRs), a green signal (Gs + IRs), and a blue signal (Bs + IRs), which are color signals including visible and infrared signals.
  • Rs + IRs red signal
  • Gs + IRs green signal
  • Bs + IRs blue signal
  • the infrared cut-off filter outputs the green visible light signal Gs that cuts the infrared signals (IRs) from some of the green signals (Gs + IRs) of the color signals (Rs + IRs, Gs + IRs, and Bs + IRs) passing through the color filter.
  • the infrared cut filter filters light of 650 nm or more, which is an infrared region, from the input light.
  • the infrared cut filter may block all wavelengths of infrared rays, or may block only some wavelengths of infrared rays.
  • the image processor 400 converts the color signals (Rs + IRs, Gs + IRs, Bs + IRs) and the infrared cut-off color signal (visible light signal) Gs output from the color filter unit 300 into digital signals. These are subjected to signal processing to selectively recover visible light signals Rs, Gs, and Bs. For example, the image processor 400 extracts the infrared signals IRs according to the infrared selection signal IRsel, and uses the same to extract the infrared signals IRs from the color signals Rs + IRs, Gs + IRs, and Bs + IRs.
  • the image processor 400 removes the infrared component from the color signals Rs + IRs and Bs + IRs using the infrared signals IRs, and then the signals Rs and Bs and the infrared cut-off color signal Gs. Outputs When the image processor 400 intends to output color signals Rs + IRs, Gs + IRs, and Bs + IRs including both an infrared signal and a visible light signal, the color signals output from the color filter unit 300 ( Rs + IRs, Gs + IRs, Bs + IRs) are output as is.
  • the infrared selection signal IRsel is a control signal for determining whether or not to include an infrared component in the signal output from the image processor 400.
  • the infrared selection signal IRsel is off during the day to remove the infrared component from the color signals, and on at night to include the infrared component in the color signals.
  • 6A and 6B are diagrams exemplarily illustrating configurations of a color filter array in the color filter unit 300 of FIG. 5.
  • the color filter array of the color filter unit 300 includes an infrared cut filter (sIR) at the rear of any one of the green filters G of the 2 ⁇ 2 Bayer pattern (see FIG. 1).
  • the unit pixel array 310 is disposed. That is, in the unit pixel arrays 310 and 320, the red filter R and the blue filter B are disposed in a diagonal direction, and the green filter G and the infrared cut green filter G + sIR are disposed in a diagonal direction crossing the red filter R and the blue filter B.
  • the infrared cut green filter G + sIR is a filter in which the green filter G and the infrared cut filter sIR overlap.
  • the color filter array of the color filter unit 300 may have a structure in which the unit pixel array 310 of FIG. 6A or the unit pixel array 320 of FIG. 6B is repeatedly arranged.
  • the color filter array of the color filter unit 300 may have a structure in which the unit pixel array 310 of FIG. 6A and the unit pixel array 320 of FIG. 6B are alternately arranged.
  • FIG. 7A and 7B illustrate cross-sectional views of color filter arrays cut along lines A-A 'and B-B' in FIG. 6A.
  • the color filter array of the color filter unit 300 includes a substrate 350, a first filter layer 360, and a second filter layer 370.
  • the first filter layer 360 is positioned on the substrate 350 and includes an infrared cut filter sIR and a buffer layer 360a.
  • the infrared cut filter sIR is disposed below some of the green filters G among the green filters G of the second filter layer 370.
  • the infrared cut filter sIR is positioned under one of the two green filters G in each unit pixel array 310.
  • the buffer layer 360a is disposed in the remaining area in which the infrared cut filter sIR is not disposed in the first filter layer 360.
  • the second filter layer 370 is positioned above the first filter layer 360 and includes color filters R, G, and B.
  • the color filters R, G, and B are arranged in the same structure as the Bayer pattern of FIG. 1.
  • the top surface of the second filter layer 370 is flattened, but some color filters may be formed to protrude.
  • the color filter array of FIG. 7B has no buffer layer 360a. That is, in the color filter array of FIG. 7B, the color filter G and the infrared cut filter sIR overlap the upper portion of the substrate 350 only at the position where the infrared cut filter sIR is disposed. Only corresponding color filters are formed on the 350.
  • FIG. 8 is a conceptual diagram schematically illustrating a configuration of restoring an infrared signal according to a second embodiment of the present invention.
  • the color filter unit 300 When light is input to the color filter unit 300, the color filter unit 300 filters the color signals A and the infrared signals including the infrared signals IRs and the visible light signals Rs, Gs, and Bs.
  • the blocked visible light signal C is output.
  • the color signals A are signals passing only the color filter
  • the visible light signal C is signals passing through the color filter and the infrared cut filter.
  • the image processor 400 restores the infrared signals IRs by calculating a difference between the value of the green signal Gs + IRs and the value of the visible light signal C among the color signals A.
  • the image processor 400 may have a color filter G having the same color as that of the color filter G in which the infrared cut filter sIR is superimposed among the color signals A (Rs + IRs, Gs + IRs, and Bs + IRs).
  • the value of the infrared signal IRs is determined by calculating the difference between the color signal (Gs + IRs) transmitted through) and the visible light signal (C) (Gs) transmitted through the infrared cut filter (IR).
  • the image processor 400 calculates a difference between the values of the color signals Rs + IRs and Bs + IRs and the values of the infrared signals IRs, thereby displaying the visible light signal C transmitted through the infrared cut filter sIR ( Visible light signals Rs and Bs for color signals other than Gs) may be recovered.
  • the infrared cut filter is disposed to overlap with any one of the green filters G having two identical color filters in the unit pixel array.
  • both the infrared information and the visible light information can be obtained while making the unit pixel array smaller.
  • the unit pixel array of the present exemplary embodiment may have a similar resolution to that of the Bayer pattern because the structure of the unit pixel array is similar to the Bayer pattern.
  • FIG. 9 is a configuration diagram illustrating a configuration of an image sensor according to a third embodiment of the present invention.
  • the image sensor of FIG. 9 includes a color filter unit 500 and an image processor 600.
  • the color filter unit 500 filters the optical signal input through the lens to color signals including infrared signals (Rs + IRs and Bs + IRs), infrared signals (IRs), and color signals from which infrared signals are blocked (visible light). Signal) (Gs) is output.
  • the color filter unit 500 includes a color filter array CFA, and the color filter array CFA includes a color filter arranged in an array form, an IR pass filter, and a specific color among the color filters.
  • Infrared cut filters IR cut filters
  • the color filter filters the input optical signal and outputs a red signal (Rs + IRs), a green signal (Gs + IRs), and a blue signal (Bs + IRs), which are color signals including visible and infrared signals.
  • the infrared pass filter outputs only infrared signals IRs from the input optical signal.
  • the infrared cut filter filters the infrared signals (IRs) in specific color signals (Rs + IRs, Gs + IRs, Bs + IRs) that pass through the color filter (in this embodiment, all green signals (Gs + IRs)). ), A color signal (visible light signal) Gs is cut out.
  • the image processor 600 converts the color signals (Rs + IRs, Bs + IRs), infrared signals (IRs), and infrared cut-off color signals (visible light signals) (Gs) output from the color filter unit 500 into digital signals. These are then subjected to signal processing to selectively recover visible light signals Rs, Gs, and Bs.
  • the image processor 600 outputs only visible light signals Rs, Gs, and Bs from which infrared components have been removed, or high sensitivity color signals including both an infrared signal and a visible light signal according to the infrared selection signal IRsel. Outputs (Rs + IRs, Gs + IRs, Bs + IRs).
  • the infrared signal is removed from the color signals Rs + IRs and Bs + IRs using the infrared signals IRs, and then the signal is removed.
  • (Rs, Bs) and infrared cut-off color signal (Gs) are output.
  • the image processing unit 600 intends to output color signals Rs + IRs, Gs + IRs, and Bs + IRs including both an infrared signal and a visible light signal, the infrared cut-off color using infrared signals IRs. After adding the infrared components IRs to the signal Gs, the signals Gs + IRs and the color signals Rs + IRs and Bs + IRs are output.
  • 10A to 10C are diagrams exemplarily illustrating configurations of a color filter array used in the color filter unit 500 of FIG. 9, and exemplarily illustrating an arrangement structure of a minimum unit repeatedly arranged in an array form. to be.
  • the color filter arrays of FIGS. 10A to 10C include color filters R and B, infrared cut color filters G + sIR, and infrared pass filters IR arranged in an array.
  • the infrared cut-off color filter G + sIR is a filter in which the color filter and the infrared cut-off filter are overlapped.
  • all the green filters G overlap the infrared cut-off filter sIR.
  • infrared pass filters IR are disposed in a portion of the color filter array.
  • the color filter array includes a first unit pixel array 510 and a first unit in which an infrared cut green filter G + sIR is formed at positions of all green filters G in a 2 ⁇ 2 Bayer pattern.
  • the pixel array 510 includes a second unit pixel array 520 in which an infrared pass filter IR is disposed at a position of the blue filter B.
  • FIG. 10A the infrared cut green filter G + sIR is a filter in which the green filter G and the infrared cut filter sIR overlap.
  • the first unit pixel array 510 has a 2 ⁇ 2 pixel in which a red filter R and a blue filter B are disposed in a diagonal direction, and two infrared blocking green filters G + sIR are disposed in a diagonal direction intersecting the red filter R and a blue filter B. It may have an array structure.
  • the second unit pixel array 520 has a red filter (R) and an infrared ray passing filter (IR) arranged in a diagonal direction, and 2 x 2 in which two infrared blocking green filters (G + sIR) are arranged in a diagonal direction crossing the red filter (R) and an infrared ray passing filter (IR). It may have a pixel array structure.
  • the array structure of FIG. 10A is an exemplary minimum unit array structure of the color filter array used in the color filter unit 500, wherein two first unit pixel arrays 510 are disposed in a diagonal direction and cross diagonally. Has a 4 ⁇ 4 pixel array structure in which two second unit pixel arrays 520 are disposed.
  • the color filter array of the color filter unit 500 may have a structure in which the unit arrays of FIG. 10A are repeatedly arranged.
  • the color filter array may include a third unit pixel in which a blue filter B is formed at a red filter R position in the second unit pixel array 520 and the second unit pixel array 520 of FIG. 10A.
  • Array 530 The third unit pixel array 530 has a blue filter B and an infrared ray passing filter IR arranged in a diagonal direction, and 2 X 2 in which two infrared blocking green filters G + sIR are arranged in a diagonal direction crossing the blue filter B and an infrared ray passing filter IR. It may have a pixel array structure.
  • the array structure of FIG. 10B is another exemplary minimum unit array structure of the color filter array used in the color filter unit 500, wherein two second unit pixel arrays 520 are disposed in a diagonal direction and cross diagonally. Has a 4 ⁇ 4 pixel array structure in which two third unit pixel arrays 530 are disposed.
  • the color filter array of the color filter unit 500 may have a structure in which the unit arrays of FIG. 10B are repeatedly arranged.
  • the color filter array of FIG. 10C like the color filter array of FIG. 10B, includes a second unit pixel array 520 and a third unit pixel array 530. However, in the color filter array of FIG. 10C, the positions of the second unit pixel array 520 and the third unit pixel array 530 are opposite to the color filter array of FIG. 10B.
  • the array structure of FIG. 10C may be another exemplary minimum unit array structure of the color filter array used in the color filter unit 500.
  • FIG. 11A and 11B are diagrams illustrating cross-sectional views of a color filter array cut along AA ′ in FIG. 10A.
  • the color filter array of the color filter unit 500 includes a substrate 550, a first filter layer 560, and a second filter layer 570.
  • the first filter layer 560 is positioned on the substrate 550 and includes an infrared cut filter sIR and a buffer layer 560a.
  • the infrared cut filter sIR and the buffer layer 560a are alternately arranged.
  • the infrared cut filter sIR is disposed under all of the green filters G of the second filter layer 570.
  • the buffer layer 560a is disposed in the remaining area of the first filter layer 560 where the infrared cut filter sIR is not disposed.
  • the second filter layer 570 is positioned above the first filter layer 560 and includes color filters R, G, and B and infrared pass filters IR.
  • 11A illustrates a case where the top surface of the second filter layer 570 is flattened, some color filters may be formed to protrude.
  • the color filter array of FIG. 11B has no buffer layer 560a compared to the color filter array of FIG. 11A. That is, in the color filter array of FIG. 11B, the color filter G and the infrared cut filter sIR overlap the upper portion of the substrate 550 only at the position where the infrared cut filter sIR is disposed. Only corresponding color filters are formed on the 550.
  • the image sensor according to the third embodiment of the present invention has an advantage that the visible light signal for the green filter G can be reproduced in the same manner as the conventional commercial image sensor.
  • the infrared signals IRs are applied to the color signals Rs + IRs and Bs + IRs transmitted through the red filter R and the blue filter B. You have to go through the process of removing it. However, when an error occurs when removing the infrared signals IRs, there is a problem that image quality characteristics may be degraded than conventional commercial image sensors. However, in the color filter array illustrated in FIGS. 10A to 10C, since the green filter G is disposed more than the red filter R and the blue filter B, the portion where the green filter G contributes to the overall resolution is large. In addition, resolution degradation that may occur in the process of separating the IR signals may be minimized.
  • FIG. 12 is a diagram illustrating a configuration of a color filter array according to another embodiment of the present invention.
  • a white filter W is disposed at a position of the green filter G in the color filter array of FIG. 3. That is, in this embodiment, the green filter G is not used, and the white filter W is used instead.
  • the first unit pixel array 130 has a red filter R and a blue filter B disposed in a diagonal direction, and two white filters W in a diagonal direction intersecting with the red filter R and the blue filter B.
  • FIG. Have a 2 x 2 pixel array structure in which they are arranged.
  • the second unit filter array 140 has a red filter (R) and an infrared ray passing filter (IR) disposed in a diagonal direction, and 2 x 2 pixels in which two white filters (W) are disposed in a diagonal direction crossing the filter. It has an array structure.
  • the reason why the white filter is used instead of the green filter is that the white filter has up to three times more light than the green filter. Therefore, the image may be captured more brightly and clearly even at night.
  • the color filter units 100, 300, and 500 have been described as including a color filter array, but the color filter unit and the color filter array may have the same configuration. That is, a color filter array can be used as the color filter portion.
  • the present invention can selectively remove the infrared signal from the color signals without the addition of an infrared pass filter or an infrared cut filter in addition to the color filter array, it is possible to simplify the camera configuration and reduce the manufacturing cost using the same .

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Color Television Image Signal Generators (AREA)
  • Optical Filters (AREA)

Abstract

The present technology provides a new structure of a color filter array. A color filter array according to an embodiment of the present technology may comprise: a first unit pixel array in which a first color filter, a second color filter, and a third color filter are arranged in an array form; and a second unit pixel array in which a forth color filter, a fifth color filter, and an infrared light-pass filter are arranged in an array form.

Description

컬러 필터 어레이 및 이를 이용한 이미지 센서Color Filter Arrays and Image Sensors Using the Same
본 발명은 새로운 구조의 컬러 필터 어레이 및 이를 이용한 이미지 센서에 관한 것이다.The present invention relates to a color filter array having a novel structure and an image sensor using the same.
일반적으로, 이미지 센서는 광학 영상(Optical image)을 전기 신호로 변환시키는 반도체 소자로서, 전하결합소자(CCD : charge couple device) 이미지 센서와 씨모스(CMOS : Complementary Metal-Oxide Semiconductor) 이미지 센서가 널리 활용되고 있다. 이러한 이미지 센서는 컬러 구현을 위해 적색(Red), 녹색(Green), 청색(Blue) 등으로 구현된 컬러 필터 어레이(color filter array : CFA)를 사용하고 있다.In general, an image sensor is a semiconductor device that converts an optical image into an electrical signal, and a charge couple device (CCD) image sensor and a complementary metal-oxide semiconductor (CMOS) image sensor are widely used. It is utilized. The image sensor uses a color filter array (CFA) implemented in red, green, blue, and the like to realize color.
도 1은 일반적으로 사용되는 컬러 필터 어레이의 베이어 패턴(Bayer Pattern)을 예시적으로 나타낸 것이다.1 exemplarily illustrates a Bayer pattern of a commonly used color filter array.
도 1에 도시된 베이어 패턴의 최소 반복 단위는 공통적으로 2개의 행(Row) 및 2개의 열(Column) 즉, 2 X 2의 어레이 구조를 포함한다.The minimum repeating unit of the Bayer pattern shown in FIG. 1 commonly includes two rows and two columns, that is, an array structure of 2 × 2.
베이어 패턴은 적색 필터(R), 녹색 필터(G) 및 청색 필터(B)가 1:2:1의 비율을 가진다. 이러한 베이어 패턴은 적색 필터(R)와 청색 필터(B)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 녹색 필터(G)들이 배치된다. In the Bayer pattern, the red filter (R), the green filter (G), and the blue filter (B) have a ratio of 1: 2: 1. In the Bayer pattern, a red filter (R) and a blue filter (B) are disposed in a diagonal direction, and two green filters (G) are disposed in a diagonal direction crossing the blue filter (R) and a blue filter (B).
도 1과 같은 베이어 패턴이 적용되는 컬러 필터 어레이에 입력되는 적외선 광은 야간 카메라 촬영 시에는 중요한 이미지 정보로 활용이 가능하다. 그러나, 주간 카메라 촬영 시에는 적외선 광에 의해 컬러 정보가 왜곡되기 때문에 적외선 광을 차단해야만 한다.The infrared light input to the color filter array to which the Bayer pattern as shown in FIG. 1 is applied may be utilized as important image information when photographing a night camera. However, when photographing the daytime camera, infrared light must be blocked because color information is distorted by infrared light.
이러한 문제를 해결하기 위해 종래에는 카메라 렌즈와 이미지 센서 사이에 적외선을 통과시키는 필터 또는 적외선을 차단시키는 필터 등을 선택적으로 추가하였다.In order to solve this problem, conventionally, a filter that passes infrared rays or a filter that blocks infrared rays is selectively added between the camera lens and the image sensor.
그러나, 적외선 통과 필터 또는 적외선 차단 필터와 같은 구성 요소를 추가하게 되면 카메라 제조 공정이 복잡해지고 생산 비용이 증가되는 단점이 있다.However, adding components, such as an infrared pass filter or an infrared cut filter, has the disadvantage of complicated camera manufacturing process and increased production cost.
본 발명의 실시 예는 컬러 필터 어레이 이외에 추가적인 적외선 통과 필터 또는 적외선 차단 필터 없이 적외선 신호가 제거된 컬러 신호들과 적외선 신호가 포함된 컬러 신호들을 선택적으로 용이하게 생성할 수 있는 컬러 필터 어레이 및 그 컬러 필터 어레이를 이용한 이미지 센서를 제공하고자 한다.An embodiment of the present invention provides a color filter array capable of selectively and easily generating color signals including an infrared signal and color signals from which infrared signals have been removed without an additional infrared pass filter or an infrared cut filter in addition to the color filter array, and a color thereof. An image sensor using a filter array is provided.
본 발명에서는 컬러 필터 어레이에 컬러 필터들과 적외선 필터(적외선 통과 필터, 적외선 차단 필터)들을 포함시키고 이들을 적절히 배치함으로써 컬러 필터 어레이 이외에 적외선 통과 필터 또는 적외선 차단 필터를 추가적인 구비하지 않고도 컬러 신호들에서 적외선 신호를 선택적으로 제거할 수 있도록 한다. In the present invention, the color filter array includes color filters and infrared filters (infrared pass filter, infrared cut-off filter) and appropriately arranges them so that the infrared rays in the color signals can be removed without additional infrared pass filter or infrared cut filter in addition to the color filter array. Allows you to selectively remove the signal.
본 발명은 컬러 필터 어레이 이외에 적외선 통과 필터 또는 적외선 차단 필터를 추가적인 구비하지 않고도 컬러 신호들에서 적외선 신호를 선택적으로 제거할 수 있다.The present invention can selectively remove infrared signals from color signals without additional infrared pass filter or infrared cut filter in addition to the color filter array.
도 1은 일반적으로 사용되는 베이어 패턴(Bayer Pattern)의 픽셀 어레이를 도시한 것이다.1 illustrates a pixel array of a commonly used Bayer pattern.
도 2는 본 발명의 제 1 실시 예에 따른 이미지 센서의 구성을 나타내는 구성도이다.2 is a configuration diagram illustrating a configuration of an image sensor according to a first embodiment of the present invention.
도 3은 도 1의 컬러 필터부에서 컬러 필터 어레이의 구성을 도시한 도면이다.3 is a diagram illustrating a configuration of a color filter array in the color filter unit of FIG. 1.
도 4는 본 발명의 제 1 실시 예에 따라 적외선 신호를 분리하는 구성을 개략적으로 도시한 개념도이다.4 is a conceptual diagram schematically showing a configuration for separating infrared signals according to a first embodiment of the present invention.
도 5는 본 발명의 제 2 실시 예에 따른 이미지 센서의 구성을 나타내는 구성도이다. 5 is a configuration diagram illustrating a configuration of an image sensor according to a second exemplary embodiment of the present invention.
도 6a 및 도 6b는 도 5의 컬러 필터부에서 컬러 필터 어레이의 구성들을 예시적으로 도시한 도면들이다.6A and 6B are diagrams exemplarily illustrating configurations of a color filter array in the color filter unit of FIG. 5.
도 7a 및 도 7b는 도 6a에서 A-A'에 따라 절단된 컬러 필터 어레이의 단면 모습들을 예시적으로 보여주는 도면들이다.7A and 7B are exemplary views illustrating cross-sectional views of a color filter array cut along AA ′ in FIG. 6A.
도 8은 본 발명의 제 2 실시 예에 따라 적외선 신호를 분리하는 구성을 개략적으로 도시한 개념도이다.8 is a conceptual diagram schematically illustrating a configuration of separating infrared signals according to a second embodiment of the present invention.
도 9는 본 발명의 제 3 실시 예에 따른 이미지 센서의 구성을 나타내는 구성도이다. 9 is a configuration diagram illustrating a configuration of an image sensor according to a third embodiment of the present invention.
도 10a 내지 도 10c는 도 9의 컬러 필터부에서 컬러 필터 어레이의 구성들을 예시적으로 도시한 도면들이다.10A through 10C are diagrams exemplarily illustrating configurations of a color filter array in the color filter unit of FIG. 9.
도 11a 및 도 11b는 도 10a에서 A-A'에 따라 절단된 컬러 필터 어레이의 단면 모습들을 예시적으로 보여주는 도면들이다.11A and 11B are diagrams illustrating cross-sectional views of a color filter array cut along AA ′ in FIG. 10A.
도 12는 본 발명의 다른 실시 예에 따른 컬러 필터 어레이의 구성을 예시적으로 나타내는 도면이다.12 is a diagram illustrating a configuration of a color filter array according to another embodiment of the present invention.
본 발명의 일 실시 예에 따른 컬러 필터 어레이는 제 1 컬러 필터, 제 2 컬러 필터 및 제 3 컬러 필터가 어레이 형태로 배치된 제 1 단위 픽셀 어레이; 및 제 4 컬러 필터, 제 5 컬러 필터 및 적외선 통과 필터가 어레이 형태로 배치된 제 2 단위 픽셀 어레이를 포함할 수 있다.A color filter array according to an embodiment of the present invention includes a first unit pixel array in which a first color filter, a second color filter, and a third color filter are arranged in an array form; And a second unit pixel array in which the fourth color filter, the fifth color filter, and the infrared pass filter are arranged in an array form.
본 발명의 다른 실시 예에 따른 컬러 필터 어레이는 제 1 컬러 필터, 제 2 컬러 필터, 제 3 컬러 필터 및 제 4 컬러 필터가 어레이 형태로 배치된 최소 단위 어레이가 반복 배치되되, 상기 제 3 컬러 필터는 상기 제 2 컬러 필터와 적외선 차단 필터가 중첩된 것을 특징으로 한다.In the color filter array according to another embodiment of the present invention, a first unit, a second unit, a second unit, a second unit, a third unit, and a fourth unit are arranged in a repeating arrangement. The second color filter and the infrared cut filter is characterized in that overlapping.
본 발명의 다른 실시 예에 따른 컬러 필터 어레이는 제 1 컬러 필터, 제 2 컬러 필터 및 제 1 적외선 통과 필터가 어레이 형태로 배치된 제 1 단위 픽셀 어레이; 및 제 3 컬러 필터, 제 4 컬러 필터 및 제 2 적외선 통과 필터가 어레이 형태로 배치된 제 2 단위 픽셀 어레이를 포함할 수 있다.According to another exemplary embodiment, a color filter array includes: a first unit pixel array in which a first color filter, a second color filter, and a first infrared light pass filter are arranged in an array; And a second unit pixel array in which the third color filter, the fourth color filter, and the second infrared pass filter are arranged in an array form.
본 발명의 일 실시 예에 따른 이미지 센서는 컬러 필터들 및 적외선 통과 필터가 어레이 형태로 배치되며, 입사된 광을 필터링하여 적외선이 포함된 컬러 신호들과 적외선 신호를 출력하는 컬러 필터 어레이; 및 상기 적외선 신호를 이용하여 상기 컬러 신호들에서 적외선 성분을 선택적으로 제거하는 영상처리기를 포함할 수 있다.An image sensor according to an embodiment of the present invention includes a color filter and an infrared pass filter arranged in an array, and a color filter array for filtering incident light to output color signals and infrared signals including infrared rays; And an image processor for selectively removing infrared components from the color signals using the infrared signal.
본 발명의 다른 실시 예에 따른 이미지 센서는 입사된 광을 필터링하여 적색 신호, 녹색 신호, 청색 신호 및 적외선 차단 녹색 신호를 출력하는 컬러 필터 어레이; 및 상기 녹색 신호와 상기 적외선 차단 녹색 신호를 이용하여 적외선 신호를 추출한 후 추출된 적외선 신호를 이용하여 상기 적색 신호와 상기 청색 신호에서 적외선 성분을 선택적으로 제거하는 영상처리기를 포함할 수 있다.According to another aspect of the present invention, an image sensor includes: a color filter array configured to filter incident light to output a red signal, a green signal, a blue signal, and an infrared cut green signal; And an image processor extracting an infrared signal using the green signal and the infrared cut green signal, and selectively removing infrared components from the red signal and the blue signal using the extracted infrared signal.
본 발명의 일 실시 예에 따른 이미지 센서는 입사된 광을 필터링하여 적색 신호, 적외선 차단 녹색 신호, 청색 신호 및 적외선 신호를 출력하는 컬러 필터 어레이; 및 상기 적외선 신호를 이용하여 상기 적색 신호와 상기 청색 신호에서 적외선 성분을 선택적으로 제거하거나 상기 적외선 차단 녹색 신호에 적외선 성분을 선택적으로 부가하는 영상처리기를 포함할 수 있다.An image sensor according to an embodiment of the present invention includes a color filter array that filters incident light to output a red signal, an infrared cut green signal, a blue signal, and an infrared signal; And an image processor for selectively removing infrared components from the red signal and the blue signal using the infrared signal, or selectively adding infrared components to the infrared cut green signal.
이하, 본 발명의 일부 실시 예들을 첨부된 예시적인 도면을 이용하여 상세하게 설명한다. 각 도면의 구성요소들에 참조부호를 부가함에 있어서, 동일한 구성요소들에 대해서는 비록 다른 도면상에 표시되더라도 가능한 한 동일한 부호를 가지도록 하고 있음에 유의해야 한다. 또한, 본 출원의 일 실시예를 설명함에 있어, 관련된 공지 구성 또는 기능에 대한 구체적인 설명이 본 출원의 일 실시예에 대한 이해를 방해한다고 판단되는 경우에는 그 상세한 설명은 생략한다.Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings. In adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are assigned to the same components as much as possible even though they are shown in different drawings. In addition, in describing an embodiment of the present application, when it is determined that a detailed description of a related known configuration or function is to interfere with the understanding of an embodiment of the present application, a detailed description thereof will be omitted.
도 2는 본 발명의 제 1 실시 예에 따른 이미지 센서의 구성을 나타내는 구성도이다.2 is a configuration diagram illustrating a configuration of an image sensor according to a first embodiment of the present invention.
도 2의 이미지 센서는 컬러 필터부(100) 및 영상 처리부(200)를 포함한다.The image sensor of FIG. 2 includes a color filter unit 100 and an image processor 200.
컬러 필터부(100)는 렌즈를 통해 입력되는 광학 신호를 필터링하여 각각의 컬러 필터에 해당되는 파장을 갖는 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs) 및 적외선 신호(IRs)를 출력한다.The color filter unit 100 filters the optical signal input through the lens to filter the color signals Rs + IRs, Gs + IRs, Bs + IRs and infrared signals IRs having wavelengths corresponding to the respective color filters. Output
컬러 필터부(100)는 컬러 필터들 및 적외선 통과 필터들(IR Pass Filters)이 어레이 형태로 배열된 컬러 필터 어레이(CFA)를 포함할 수 있다. 이때, 컬러 필터는 입력되는 광학 신호를 필터링하여 가시광(Rs, Gs, Bs)과 적외선 신호(IRs)를 포함하는 컬러 신호인 적색 신호(Rs+IRs), 녹색 신호(Gs+IRs), 청색 신호(Bs+IRs)를 출력한다. 적외선 통과 필터(IR Pass Filter)는 입력된 광학 신호에서 적외선 영역인 650nm 이상의 빛을 통과시킨다. 즉, 적외선 통과 필터는 입력되는 광학 신호를 필터링하여 적외선 신호(IRs)만을 출력한다.The color filter unit 100 may include a color filter array CFA in which color filters and IR pass filters are arranged in an array. In this case, the color filter filters the optical signal to be input, and is a red signal (Rs + IRs), a green signal (Gs + IRs), and a blue signal, which are color signals including visible light (Rs, Gs, Bs) and infrared signals (IRs). Output (Bs + IRs). An IR pass filter passes light of 650 nm or more, which is an infrared region, from an input optical signal. That is, the infrared pass filter filters the input optical signal and outputs only the infrared signals IRs.
본 실시 예에서는 컬러 필터 어레이의 일정 부분에 적외선 통과 필터를 배치함으로써, 이미지 센서는 입력받는 광학 신호에서 컬러 신호(Rs+IRs, Gs+IRs, Bs+IRs) 이외에 추가적으로 적외선 신호(IRs)를 추출하여 출력한다.In this embodiment, by placing an infrared pass filter on a portion of the color filter array, the image sensor extracts infrared signals (IRs) in addition to the color signals (Rs + IRs, Gs + IRs, Bs + IRs) from the optical signals received. To print.
영상 처리부(200)는 컬러 필터부(100)에서 출력된 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs) 및 적외선 신호(IRs)를 디지털 신호로 변환한 후 이들을 신호 처리하여 각 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)로부터 가시광 신호들(Rs, Gs, Bs)을 선택적으로 복원한다. 예컨대, 영상처리부(200)는 적외선 선택신호(IRsel)에 따라, 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)에서 적외선 신호(IRs)를 제거하여 가시광 신호들(Rs, Gs, Bs)을 복원하여 출력하거나, 적외선 신호(IRs)와 가시광 신호(Rs, Gs, Bs)가 모두 포함된 고감도의 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)을 출력한다.The image processor 200 converts the color signals (Rs + IRs, Gs + IRs, Bs + IRs) and infrared signals (IRs) output from the color filter unit 100 into digital signals, and then processes them by processing the respective colors. The visible light signals Rs, Gs and Bs are selectively recovered from the signals Rs + IRs, Gs + IRs and Bs + IRs. For example, the image processor 200 removes the infrared signals IRs from the color signals Rs + IRs, Gs + IRs, and Bs + IRs according to the infrared selection signal IRsel, thereby displaying the visible light signals Rs, Gs, Bs) is restored and output, or high-sensitivity color signals Rs + IRs, Gs + IRs, and Bs + IRs including both infrared signals IRs and visible light signals Rs, Gs, and Bs are output.
이때, 적외선 선택신호(IRsel)는 영상 처리부(200)에서 출력되는 신호에 적외선 성분을 포함시킬 것인지 그렇지 않을 것인지를 결정하는 제어 신호이다. 예컨대, 적외선 선택신호(IRsel)는 주간에는 오프(off)되어 컬러 신호들에서 적외선 성분을 제거시키고, 야간에는 온(on)되어 컬러 신호들에 적외선 성분을 포함시킨다.In this case, the infrared selection signal IRsel is a control signal for determining whether or not to include an infrared component in the signal output from the image processor 200. For example, the infrared selection signal IRsel is off during the day to remove the infrared component from the color signals, and on at night to include the infrared component in the color signals.
도 3은 도 1의 컬러 필터부(100)에서 컬러 필터 어레이의 구성을 도시한 도면으로, 어레이 형태로 반복 배열되는 최소 단위 어레이의 구조를 예시적으로 나타낸 도면이다.FIG. 3 is a diagram illustrating a configuration of a color filter array in the color filter unit 100 of FIG. 1 and exemplarily illustrating a structure of a minimum unit array repeatedly arranged in an array form.
도 3을 참조하면, 컬러 필터부(100)의 컬러 필터 어레이는 2 X 2 베이어 패턴(도 1 참조)과 같은 구조를 갖는 제 1 단위 픽셀 어레이(110) 및 2 X 2 베이어 패턴에서 청색 필터(B)의 위치에 적외선 통과 필터(IR)가 배치된 제 2 단위 픽셀 어레이(120)를 포함한다. 이때, 제 1 단위 픽셀 어레이(110)는 적색 필터(R)와 청색 필터(B)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 녹색 필터(G)들이 배치되는 2 X 2 픽셀 어레이 구조를 가질 수 있다. 제 2 단위 픽셀 어레이(120)는 적색 필터(R)와 적외선 통과 필터(IR)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 녹색 필터(G)들이 배치되는 2 X 2 픽셀 어레이 구조를 가질 수 있다.Referring to FIG. 3, the color filter array of the color filter unit 100 may include a blue filter in the first unit pixel array 110 and the 2 × 2 Bayer pattern having the same structure as the 2 × 2 Bayer pattern (see FIG. 1). And a second unit pixel array 120 in which an infrared pass filter IR is disposed at the position B). In this case, the first unit pixel array 110 includes a red filter (R) and a blue filter (B) disposed in a diagonal direction, and a 2 × 2 pixel array in which two green filters (G) are disposed in a diagonal direction crossing the red filter (R) and a blue filter (B). It may have a structure. The second unit pixel array 120 has a 2 × 2 pixel array structure in which a red filter R and an infrared ray passing filter IR are disposed in a diagonal direction, and two green filters G are disposed in a diagonal direction crossing the red filter R and an infrared ray passing filter IR. It can have
도 3의 어레이 구조는 컬러 필터부(100)에서 사용되는 컬러 필터 어레이의 최소 단위 어레이의 구조를 나타내는 것으로, 두 개의 제 1 단위 픽셀 어레이(110)들이 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 제 2 단위 픽셀 어레이(120)들이 배치되는 4 X 4 픽셀 어레이 구조를 갖는다. 즉, 컬러 필터부(100)의 컬러 필터 어레이는 도 3의 단위 어레이가 반복 배치되는 구조를 갖는다. 도 3의 어레이 구조를 2 X 2 구조의 베이어 패턴들이 반복 배치된 4 X 4 구조의 베이어 패턴과 비교하면, 도 3의 어레이 구조는 4개의 청색 필터(B)들 중 2개가 적외선 통과 필터(IR)들로 대체되었으며, 이 2개의 적외선 통과 필터(IR)들은 대각선 방향으로 배치된다.The array structure of FIG. 3 shows the structure of the smallest unit array of the color filter array used in the color filter unit 100. Two first unit pixel arrays 110 are arranged in a diagonal direction and cross the diagonal direction. As a result, it has a 4 × 4 pixel array structure in which two second unit pixel arrays 120 are arranged. That is, the color filter array of the color filter unit 100 has a structure in which the unit array of FIG. 3 is repeatedly arranged. Comparing the array structure of FIG. 3 to the Bayer pattern of 4 × 4 structure in which Bayer patterns of 2 × 2 structures are repeatedly arranged, in the array structure of FIG. 3, two of the four blue filters B may be infrared ray passing filters (IR). ), These two infrared pass filters (IR) are arranged diagonally.
동일한 세기로 입력된 광들 중 청색 필터를 통과한 광은 파장이 비교적 짧은 광으로서, 광자수가 상대적으로 적다. 따라서, 청색 필터를 통과한 광은 전자화되는 비율이 적어 신호의 세기가 약하다(아래의 식 1 참조). 이러한 문제를 해결하기 위해, 본 실시에에서는 청색 필터들 중 일부를 적외선 통과 필터로 대체한다.Among the light input with the same intensity, the light passing through the blue filter is light having a relatively short wavelength, and has a relatively small number of photons. Therefore, the light passing through the blue filter has a small ratio of being electronicized and thus the signal strength is weak (see Equation 1 below). In order to solve this problem, in the present embodiment, some of the blue filters are replaced with an infrared pass filter.
Figure PCTKR2016004363-appb-I000001
<식 1>
Figure PCTKR2016004363-appb-I000001
<Equation 1>
여기서, E는 광자 1개의 에너지, h는 플랑크 상수, c는 광자의 속도,
Figure PCTKR2016004363-appb-I000002
는 광자의 파장을 나타낸다.
Where E is the energy of one photon, h is Planck's constant, c is the velocity of the photon,
Figure PCTKR2016004363-appb-I000002
Represents the wavelength of the photon.
적색 필터를 통과한 광의 광자들의 수가 청색 필터를 통과한 광의 광자들의 수보다 많으며, 조도가 낮은 어두운 환경에서는 적색 필터를 통과한 광이 청색 필터를 통과한 광보다 신호의 세기가 클 가능성이 높다. 즉, 적색 필터를 통과한 광으로부터는 많은 광 에너지를 받아들일 수 있다. 따라서, 적색 필터는 기준 베이어 패턴에서와 동일하게 배치된다.The number of photons of light passing through the red filter is greater than the number of photons of light passing through the blue filter, and in a dark environment with low illumination, the light passing through the red filter is more likely to have a greater signal intensity than the light passing through the blue filter. That is, a lot of light energy can be received from the light which passed the red filter. Thus, the red filter is arranged in the same way as in the reference Bayer pattern.
이와 유사하게, 인간의 시세포에서도 파장이 짧은 청색의 원추세포가 파장이 긴 적색의 원추세포 보다 적게 분포되어 있어서, 청색 신호는 해상도에서 적색 신호에 비해 덜 민감하게 받아들여진다. 따라서, 인간의 인식특성을 고려하였을 때도 적색 필터보다 청색 필터의 분포 비율을 줄이는 것이 더 효과적이다. Similarly, blue cones with shorter wavelengths are distributed in human eye cells than red cones with longer wavelengths, so the blue signal is less sensitive than the red signal at resolution. Therefore, even when considering the human recognition characteristics, it is more effective to reduce the distribution ratio of the blue filter than the red filter.
도 4는 본 발명의 제 1 실시 예에 따라 컬러 신호를 복원하는 구성을 개략적으로 도시한 개념도이다.4 is a conceptual diagram schematically illustrating a configuration of reconstructing a color signal according to a first embodiment of the present invention.
광이 컬러 필터부(100)에 입력되면, 컬러 필터부(100)는 이를 필터링하여 적외선 신호(IRs)와 가시광 신호(Rs, Gs, Bs)가 포함된 컬러 신호들(A) 및 적외선 신호(B)를 출력한다. 즉, 컬러 필터부(100)는 적외선 신호를 포함하는 컬러 신호들(A) 뿐만 아니라 별도로 적외선 신호(B)를 출력한다.When light is input to the color filter unit 100, the color filter unit 100 filters the color signals A including the infrared signals IRs and the visible light signals Rs, Gs, and Bs and the infrared signals ( Output B). That is, the color filter unit 100 separately outputs the infrared signal B as well as the color signals A including the infrared signal.
영상 처리부는(200)는 컬러 신호들(A)과 적외선 신호(B)를 디지털 신호로 변환한 후 각 컬러 신호의 값과 적외선 신호 값의 차를 계산함으로써 가시광 신호(C)를 복원한다. 즉, 영상 처리부는(200)는 각 컬러 신호(Rs+IRs, Gs+IRs, Bs+IRs)에서 적외선 신호(IRs) 성분을 제거함으로써 가시광 신호(C)를 복원한다.The image processor 200 restores the visible light signal C by converting the color signals A and the infrared signal B into a digital signal, and then calculates a difference between each color signal value and the infrared signal value. That is, the image processor 200 restores the visible light signal C by removing the infrared signal IRs component from each of the color signals Rs + IRs, Gs + IRs, and Bs + IRs.
상술한 바와 같이, 본 발명의 제 1 실시예에 따른 컬러 필터부(100)는 컬러 필터 어레이에서 컬러 필터들 중 일부 필터(바람직하게는, 청색 필터)가 적외선 통과 필터로 대체됨으로써 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)을 출력하면서 추가적으로 적외선 신호(IRs)를 출력한다. 따라서, 영상 처리부(200)에서 컬러 신호들을 처리하기 위한 회로는 기존의 베이어 패턴용으로 사용되었던 회로를 그대로 이용할 수 있다.As described above, the color filter unit 100 according to the first exemplary embodiment of the present invention replaces some of the color filters (preferably, blue filters) of the color filters in the color filter array by using an infrared pass filter. Rs + IRs, Gs + IRs, Bs + IRs) while outputting additional infrared signals (IRs). Therefore, a circuit for processing color signals in the image processor 200 may use a circuit that has been used for a conventional Bayer pattern.
도 5는 본 발명의 제 2 실시 예에 따른 이미지 센서의 구성을 나타내는 구성도이다.5 is a configuration diagram illustrating a configuration of an image sensor according to a second exemplary embodiment of the present invention.
도 5의 이미지 센서는 컬러 필터부(300) 및 영상 처리부(400)를 포함한다.The image sensor of FIG. 5 includes a color filter unit 300 and an image processor 400.
컬러 필터부(300)는 렌즈를 통해 입력되는 광학 신호를 필터링하여 각각의 컬러 필터에 해당되는 파장을 갖는 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs) 및 적외선이 차단된 컬러 신호(가시광 신호)(본 실시 예에서는, 녹색 가시광 신호, Gs)를 출력한다.The color filter unit 300 filters the optical signal input through the lens to color signals having a wavelength corresponding to each color filter (Rs + IRs, Gs + IRs, Bs + IRs) and color signals in which infrared rays are blocked. (Visible Light Signal) (In this embodiment, the green visible light signal, Gs) is output.
컬러 필터부(300)는 컬러 필터 어레이(CFA)를 포함하며, 컬러 필터 어레이(CFA)는 어레이 형태로 배열된 컬러 필터들 및 컬러 필터들 중 일부 컬러 필터의 후면에 배치되는 적외선 차단 필터들(IR cut filters)을 포함한다. 이때, 컬러 필터는 입력되는 광학 신호를 필터링하여 가시광과 적외선 신호가 포함된 컬러 신호인 적색 신호(Rs+IRs), 녹색 신호(Gs+IRs), 청색 신호(Bs+IRs)를 출력한다. 적외선 차단 필터는 컬러 필터를 통과한 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs) 중 일부 녹색 신호(Gs+IRs)에서 적외선 신호(IRs)를 차단한 녹색 가시광 신호 Gs를 출력한다. 예컨대, 적외선 차단 필터는 입력된 광에서 적외선 영역인 650nm 이상의 빛을 차단한다. 이때, 적외선 차단 필터는 적외선의 모든 파장을 차단할 수도 있고, 적외선의 일부 파장만 차단할 수 도 있다.The color filter unit 300 includes a color filter array CFA, and the color filter array CFA includes infrared cut-off filters disposed at the rear of some of the color filters and color filters arranged in an array form. IR cut filters). At this time, the color filter filters the input optical signal and outputs a red signal (Rs + IRs), a green signal (Gs + IRs), and a blue signal (Bs + IRs), which are color signals including visible and infrared signals. The infrared cut-off filter outputs the green visible light signal Gs that cuts the infrared signals (IRs) from some of the green signals (Gs + IRs) of the color signals (Rs + IRs, Gs + IRs, and Bs + IRs) passing through the color filter. . For example, the infrared cut filter filters light of 650 nm or more, which is an infrared region, from the input light. In this case, the infrared cut filter may block all wavelengths of infrared rays, or may block only some wavelengths of infrared rays.
영상 처리부(400)는 컬러 필터부(300)에서 출력된 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs) 및 적외선 차단 컬러 신호(가시광 신호)(Gs)를 디지털 신호로 변환한 후 이들을 신호 처리하여 가시광 신호들(Rs, Gs, Bs)을 선택적으로 복원한다. 예컨대, 영상 처리부(400)는 적외선 선택신호(IRsel)에 따라, 적외선 신호(IRs)를 추출한 후 이를 이용하여 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)에서 적외선 신호(IRs)를 제거함으로써 가시광 신호들(Rs, Gs, Bs)을 복원하여 출력하거나, 적외선 신호(IRs)와 가시광 신호(Rs, Gs, Bs)가 모두 포함된 고감도의 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)을 출력한다. 영상 처리부(400)는 가시광 신호들(Rs, Gs, Bs)만을 출력하고자 하는 경우, 컬러 신호(Gs+IRs)와 적외선 차단 컬러 신호(Gs)를 이용하여 적외선 신호(IRs)를 추출한다. 이어서, 영상 처리부(400)는 적외선 신호(IRs)를 이용하여 컬러 신호들(Rs+IRs, Bs+IRs)에서 적외선 성분을 제거한 후 그 신호들(Rs, Bs)과 적외선 차단 컬러 신호(Gs)를 출력한다. 영상 처리부(400)는 적외선 신호와 가시광 신호가 모두 포함된 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)을 출력하고자 하는 경우에는 컬러 필터부(300)에서 출력된 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)을 그대로 출력한다.The image processor 400 converts the color signals (Rs + IRs, Gs + IRs, Bs + IRs) and the infrared cut-off color signal (visible light signal) Gs output from the color filter unit 300 into digital signals. These are subjected to signal processing to selectively recover visible light signals Rs, Gs, and Bs. For example, the image processor 400 extracts the infrared signals IRs according to the infrared selection signal IRsel, and uses the same to extract the infrared signals IRs from the color signals Rs + IRs, Gs + IRs, and Bs + IRs. Reconstructing and outputting visible light signals Rs, Gs, and Bs, or high-sensitivity color signals Rs + IRs and Gs + including both infrared signals IRs and visible light signals Rs, Gs, and Bs. IRs, Bs + IRs). When the image processor 400 intends to output only the visible light signals Rs, Gs, and Bs, the image processor 400 extracts the infrared signals IRs using the color signals Gs + IRs and the infrared cut-off color signal Gs. Subsequently, the image processor 400 removes the infrared component from the color signals Rs + IRs and Bs + IRs using the infrared signals IRs, and then the signals Rs and Bs and the infrared cut-off color signal Gs. Outputs When the image processor 400 intends to output color signals Rs + IRs, Gs + IRs, and Bs + IRs including both an infrared signal and a visible light signal, the color signals output from the color filter unit 300 ( Rs + IRs, Gs + IRs, Bs + IRs) are output as is.
이때, 적외선 선택신호(IRsel)는 영상 처리부(400)에서 출력되는 신호에 적외선 성분을 포함시킬 것인지 그렇지 않을 것인지를 결정하는 제어 신호이다. 예컨대, 적외선 선택신호(IRsel)는 주간에는 오프(off)되어 컬러 신호들에서 적외선 성분을 제거시키고, 야간에는 온(on)되어 컬러 신호들에 적외선 성분을 포함시킨다.In this case, the infrared selection signal IRsel is a control signal for determining whether or not to include an infrared component in the signal output from the image processor 400. For example, the infrared selection signal IRsel is off during the day to remove the infrared component from the color signals, and on at night to include the infrared component in the color signals.
도 6a 및 도 6b는 도 5의 컬러 필터부(300)에서 컬러 필터 어레이의 구성들을 예시적으로 도시한 도면들이다.6A and 6B are diagrams exemplarily illustrating configurations of a color filter array in the color filter unit 300 of FIG. 5.
도 6a와 도 6b를 참조하면, 컬러 필터부(300)의 컬러 필터 어레이는 2 X 2 베이어 패턴(도 1 참조)의 녹색 필터(G)들 중 어느 하나의 후면에 적외선 차단 필터(sIR)가 배치된 단위 픽셀 어레이(310)를 포함한다. 즉, 단위 픽셀 어레이(310, 320)는 적색 필터(R)와 청색 필터(B)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 녹색 필터(G)와 적외선 차단 녹색 필터(G+sIR)가 배치되는 2 X 2 픽셀 어레이 구조를 갖는다. 이때, 적외선 차단 녹색 필터(G+sIR)는 녹색 필터(G)와 적외선 차단 필터(sIR)가 중첩된 필터이다.6A and 6B, the color filter array of the color filter unit 300 includes an infrared cut filter (sIR) at the rear of any one of the green filters G of the 2 × 2 Bayer pattern (see FIG. 1). The unit pixel array 310 is disposed. That is, in the unit pixel arrays 310 and 320, the red filter R and the blue filter B are disposed in a diagonal direction, and the green filter G and the infrared cut green filter G + sIR are disposed in a diagonal direction crossing the red filter R and the blue filter B. Has a 2 x 2 pixel array structure in which is placed. In this case, the infrared cut green filter G + sIR is a filter in which the green filter G and the infrared cut filter sIR overlap.
컬러 필터부(300)의 컬러 필터 어레이는 도 6a의 단위 픽셀 어레이(310) 또는 도 6b의 단위 픽셀 어레이(320)가 반복 배치되는 구조를 가질 수 있다. 또는 컬러 필터부(300)의 컬러 필터 어레이는 도 6a의 단위 픽셀 어레이(310)와 도 6b의 단위 픽셀 어레이(320)가 교번되게 반복 배치되는 구조를 가질 수도 있다.The color filter array of the color filter unit 300 may have a structure in which the unit pixel array 310 of FIG. 6A or the unit pixel array 320 of FIG. 6B is repeatedly arranged. Alternatively, the color filter array of the color filter unit 300 may have a structure in which the unit pixel array 310 of FIG. 6A and the unit pixel array 320 of FIG. 6B are alternately arranged.
도 7a 및 도 7b는 도 6a에서 A-A', B-B'에 따라 절단된 컬러 필터 어레이의 단면 모습들을 예시적으로 보여주는 도면들이다.7A and 7B illustrate cross-sectional views of color filter arrays cut along lines A-A 'and B-B' in FIG. 6A.
도 7a를 참조하면, 컬러 필터부(300)의 컬러 필터 어레이는 기판(350), 제 1 필터층(360) 및 제 2 필터층(370)을 포함한다.Referring to FIG. 7A, the color filter array of the color filter unit 300 includes a substrate 350, a first filter layer 360, and a second filter layer 370.
제 1 필터층(360)은 기판(350)의 상부에 위치하며, 적외선 차단 필터(sIR)와 버퍼층(360a)을 포함한다. 여기에서, 적외선 차단 필터(sIR)는 제 2 필터층(370)의 녹색 필터(G)들 중 일부 녹색 필터(G)들의 하부에 배치된다. 예컨대, 적외선 차단 필터(sIR)는 각 단위 픽셀 어레이(310)에서 두 녹색 필터(G)들 중 어느 하나의 하부에 위치한다. 버퍼층(360a)은 제 1 필터층(360)에서 적외선 차단 필터(sIR)들이 배치되지 않은 나머지 영역에 배치된다.The first filter layer 360 is positioned on the substrate 350 and includes an infrared cut filter sIR and a buffer layer 360a. Here, the infrared cut filter sIR is disposed below some of the green filters G among the green filters G of the second filter layer 370. For example, the infrared cut filter sIR is positioned under one of the two green filters G in each unit pixel array 310. The buffer layer 360a is disposed in the remaining area in which the infrared cut filter sIR is not disposed in the first filter layer 360.
제 2 필터층(370)은 제 1 필터층(360)의 상부에 위치하며, 컬러 필터들(R, G, B)을 포함한다. 이때, 컬러 필터들(R, G, B)은 도 1의 베이어 패턴과 같은 구조로 배치된다.The second filter layer 370 is positioned above the first filter layer 360 and includes color filters R, G, and B. In this case, the color filters R, G, and B are arranged in the same structure as the Bayer pattern of FIG. 1.
도 7a에서는 제 2 필터층(370)의 상부면이 평탄화된 경우를 도시하고 있으나, 일부 컬러 필터가 돌출된 형태로 형성되어도 무방하다.In FIG. 7A, the top surface of the second filter layer 370 is flattened, but some color filters may be formed to protrude.
도 7b의 컬러 필터 어레이는 도 7a의 컬러 필터 어레이와 비교하여, 버퍼층(360a)이 존재하지 않는다. 즉, 도 7b의 컬러 필터 어레이에서는 적외선 차단 필터(sIR)가 배치되는 위치에서만 기판(350) 상부에 해당 컬러 필터(G)와 적외선 차단 필터(sIR)가 중첩되게 형성되고, 나머지 위치들에서는 기판(350) 상부에 해당 컬러 필터들만 형성된다.Compared to the color filter array of FIG. 7A, the color filter array of FIG. 7B has no buffer layer 360a. That is, in the color filter array of FIG. 7B, the color filter G and the infrared cut filter sIR overlap the upper portion of the substrate 350 only at the position where the infrared cut filter sIR is disposed. Only corresponding color filters are formed on the 350.
도 8은 본 발명의 제 2 실시예에 따라 적외선 신호를 복원하는 구성을 개략적으로 도시한 개념도이다.8 is a conceptual diagram schematically illustrating a configuration of restoring an infrared signal according to a second embodiment of the present invention.
광이 컬러 필터부(300)에 입력되면, 컬러 필터부(300)는 이를 필터링하여 적외선 신호(IRs)와 가시광 신호(Rs, Gs, Bs)가 포함된 컬러 신호들(A) 및 적외선 신호가 차단된 가시광 신호(C)를 출력한다. 이때, 컬러 신호들(A)은 컬러 필터만을 통과한 신호이며, 가시광 신호(C)는 컬러 필터와 적외선 차단 필터를 통과한 신호이다.When light is input to the color filter unit 300, the color filter unit 300 filters the color signals A and the infrared signals including the infrared signals IRs and the visible light signals Rs, Gs, and Bs. The blocked visible light signal C is output. In this case, the color signals A are signals passing only the color filter, and the visible light signal C is signals passing through the color filter and the infrared cut filter.
영상 처리부(400)는 컬러 신호들(A) 중 녹색 신호(Gs+IRs)의 값과 가시광 신호(C) 값의 차를 계산함으로써 적외선 신호(IRs)를 복원한다. 즉, 영상 처리부(400)는 컬러 신호들(A)(Rs+IRs, Gs+IRs, Bs+IRs) 중 적외선 차단 필터(sIR)가 중첩된 컬러 필터(G)와 같은 색상의 컬러 필터(G)를 투과한 컬러 신호(Gs+IRs)와 적외선 차단 필터(IR)를 투과한 가시광 신호(C)(Gs)의 차를 계산하여 적외선 신호(IRs)의 값을 알아낸다. 이 후, 영상 처리부(400)는 컬러 신호들(Rs+IRs, Bs+IRs)의 값과 적외선 신호(IRs) 값의 차를 계산함으로써 적외선 차단 필터(sIR)를 투과한 가시광 신호(C)(Gs) 이외의 다른 컬러 신호들에 대한 가시광 신호들(Rs, Bs)을 복원할 수 있다.The image processor 400 restores the infrared signals IRs by calculating a difference between the value of the green signal Gs + IRs and the value of the visible light signal C among the color signals A. FIG. That is, the image processor 400 may have a color filter G having the same color as that of the color filter G in which the infrared cut filter sIR is superimposed among the color signals A (Rs + IRs, Gs + IRs, and Bs + IRs). The value of the infrared signal IRs is determined by calculating the difference between the color signal (Gs + IRs) transmitted through) and the visible light signal (C) (Gs) transmitted through the infrared cut filter (IR). Thereafter, the image processor 400 calculates a difference between the values of the color signals Rs + IRs and Bs + IRs and the values of the infrared signals IRs, thereby displaying the visible light signal C transmitted through the infrared cut filter sIR ( Visible light signals Rs and Bs for color signals other than Gs) may be recovered.
이처럼, 본 실시 예에서는 동일한 색상의 두 컬러 필터들을 투과한 컬러 신호들 중 어느 하나만 적외선 차단 필터를 다시 투과시킨 후 그 신호들의 차를 이용하여 적외선 신호를 추출한다. 따라서, 적외선 차단 필터는 단위 픽셀 어레이에서 동일한 컬러 필터가 두 개 구비된 녹색 필터(G)들 중 어느 하나와 중첩되게 배치된다.As such, in the present embodiment, only one of the color signals transmitted through the two color filters of the same color passes through the infrared cut filter again, and then extracts the infrared signal using the difference between the signals. Therefore, the infrared cut filter is disposed to overlap with any one of the green filters G having two identical color filters in the unit pixel array.
본 실시 예에서는 상술한 제 1 실시 예와 비교하여, 단위 픽셀 어레이의 크기를 보다 작게 하면서 적외선 정보와 가시광 정보를 모두 얻을 수 있다는 장점이 있다. 또한, 본 실시 예의 단위 픽셀 어레이는 베이어 패턴과 구조가 유사하여 베이어 패턴과 유사한 해상도 특성을 가질 수 있다.In this embodiment, compared to the above-described first embodiment, both the infrared information and the visible light information can be obtained while making the unit pixel array smaller. In addition, the unit pixel array of the present exemplary embodiment may have a similar resolution to that of the Bayer pattern because the structure of the unit pixel array is similar to the Bayer pattern.
도 9는 본 발명의 제 3 실시 예에 따른 이미지 센서의 구성을 나타내는 구성도이다.9 is a configuration diagram illustrating a configuration of an image sensor according to a third embodiment of the present invention.
도 9의 이미지 센서는 컬러 필터부(500) 및 영상 처리부(600)를 포함한다.The image sensor of FIG. 9 includes a color filter unit 500 and an image processor 600.
컬러 필터부(500)는 렌즈를 통해 입력되는 광학 신호를 필터링하여 적외선 신호가 포함된 컬러 신호들(Rs+IRs, Bs+IRs), 적외선 신호(IRs) 및 적외선 신호가 차단된 컬러 신호(가시광 신호)(Gs)를 출력한다.The color filter unit 500 filters the optical signal input through the lens to color signals including infrared signals (Rs + IRs and Bs + IRs), infrared signals (IRs), and color signals from which infrared signals are blocked (visible light). Signal) (Gs) is output.
컬러 필터부(500)는 컬러 필터 어레이(CFA)를 포함하며, 컬러 필터 어레이(CFA)는 어레이 형태로 배열된 컬러 필터들과 적외선 통과 필터들(IR Pass Filter), 및 컬러 필터들 중 특정 컬러 필터(본 실시 예에서는 녹색 필터)들의 후면에 배치되는 적외선 차단 필터들(IR cut filters)을 포함한다. 이때, 컬러 필터는 입력되는 광학 신호를 필터링하여 가시광과 적외선 신호가 포함된 컬러 신호인 적색 신호(Rs+IRs), 녹색 신호(Gs+IRs), 청색 신호(Bs+IRs)를 출력한다. 적외선 통과 필터는 입력된 광학 신호에서 적외선 신호(IRs)만을 출력한다. 적외선 차단 필터는 컬러 필터를 통과한 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs) 중 특정 컬러 신호들(본 실시 예에서는 모든 녹색 신호들(Gs+IRs))에서 적외선 신호(IRs)를 차단한 컬러 신호(가시광 신호)(Gs)를 출력한다.The color filter unit 500 includes a color filter array CFA, and the color filter array CFA includes a color filter arranged in an array form, an IR pass filter, and a specific color among the color filters. Infrared cut filters (IR cut filters) disposed behind the filters (in this embodiment, green filters). At this time, the color filter filters the input optical signal and outputs a red signal (Rs + IRs), a green signal (Gs + IRs), and a blue signal (Bs + IRs), which are color signals including visible and infrared signals. The infrared pass filter outputs only infrared signals IRs from the input optical signal. The infrared cut filter filters the infrared signals (IRs) in specific color signals (Rs + IRs, Gs + IRs, Bs + IRs) that pass through the color filter (in this embodiment, all green signals (Gs + IRs)). ), A color signal (visible light signal) Gs is cut out.
영상 처리부(600)는 컬러 필터부(500)에서 출력된 컬러 신호(Rs+IRs, Bs+IRs), 적외선 신호(IRs) 및 적외선 차단 컬러 신호(가시광 신호)(Gs)를 디지털 신호로 변환한 후 이들을 신호 처리하여 가시광 신호들(Rs, Gs, Bs)을 선택적으로 복원한다. The image processor 600 converts the color signals (Rs + IRs, Bs + IRs), infrared signals (IRs), and infrared cut-off color signals (visible light signals) (Gs) output from the color filter unit 500 into digital signals. These are then subjected to signal processing to selectively recover visible light signals Rs, Gs, and Bs.
예컨대, 영상 처리부(600)는 적외선 선택신호(IRsel)에 따라, 적외선 성분이 제거된 가시광 신호들(Rs, Gs, Bs)만을 출력하거나, 적외선 신호와 가시광 신호가 모두 포함된 고감도의 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)을 출력한다. 영상 처리부(600)는 가시광 신호들(Rs, Gs, Bs)만을 출력하고자 하는 경우, 적외선 신호(IRs)를 이용하여 컬러 신호들(Rs+IRs, Bs+IRs)에서 적외선 성분을 제거한 후 그 신호들(Rs, Bs)과 적외선 차단 컬러 신호(Gs)를 출력한다. 또한, 영상 처리부(600)는 적외선 신호와 가시광 신호가 모두 포함된 컬러 신호들(Rs+IRs, Gs+IRs, Bs+IRs)을 출력하고자 하는 경우, 적외선 신호(IRs)를 이용하여 적외선 차단 컬러 신호(Gs)에 적외선 성분(IRs)을 부가한 후 그 신호(Gs+IRs)와 컬러 신호들(Rs+IRs, Bs+IRs)을 출력한다.For example, the image processor 600 outputs only visible light signals Rs, Gs, and Bs from which infrared components have been removed, or high sensitivity color signals including both an infrared signal and a visible light signal according to the infrared selection signal IRsel. Outputs (Rs + IRs, Gs + IRs, Bs + IRs). When the image processor 600 intends to output only the visible light signals Rs, Gs, and Bs, the infrared signal is removed from the color signals Rs + IRs and Bs + IRs using the infrared signals IRs, and then the signal is removed. (Rs, Bs) and infrared cut-off color signal (Gs) are output. In addition, when the image processing unit 600 intends to output color signals Rs + IRs, Gs + IRs, and Bs + IRs including both an infrared signal and a visible light signal, the infrared cut-off color using infrared signals IRs. After adding the infrared components IRs to the signal Gs, the signals Gs + IRs and the color signals Rs + IRs and Bs + IRs are output.
도 10a 내지 도 10c는 도 9의 컬러 필터부(500)에 사용되는 컬러 필터 어레이의 구성들을 예시적으로 도시한 도면들로, 어레이 형태로 반복 배열되는 최소 단위의 배열 구조를 예시적으로 나타낸 도면이다.10A to 10C are diagrams exemplarily illustrating configurations of a color filter array used in the color filter unit 500 of FIG. 9, and exemplarily illustrating an arrangement structure of a minimum unit repeatedly arranged in an array form. to be.
도 10a 내지 도 10c의 컬러 필터 어레이들은 어레이 형태로 배열된 컬러 필터들(R, B), 적외선 차단 컬러 필터들(G+sIR) 및 적외선 통과 필터(IR)들을 포함한다. 이때, 적외선 차단 컬러 필터(G+sIR)는 컬러 필터와 적외선 차단 필터가 중첩된 필터로서, 본 실시 예들에서는 모든 녹색 필터(G)들이 적외선 차단 필터(sIR)와 중첩된다. 그리고 컬러 필터 어레이의 일부 영역에는 적외선 통과 필터(IR)들이 배치된다.The color filter arrays of FIGS. 10A to 10C include color filters R and B, infrared cut color filters G + sIR, and infrared pass filters IR arranged in an array. In this case, the infrared cut-off color filter G + sIR is a filter in which the color filter and the infrared cut-off filter are overlapped. In the present exemplary embodiment, all the green filters G overlap the infrared cut-off filter sIR. In addition, infrared pass filters IR are disposed in a portion of the color filter array.
도 10a 내지 도 10c의 컬러 필터 어레이들의 구성을 보다 상세하게 설명하면 다음과 같다.The configuration of the color filter arrays of FIGS. 10A to 10C will be described in more detail as follows.
먼저, 도 10a를 참조하면, 컬러 필터 어레이는 2 X 2 베이어 패턴에서 모든 녹색 필터(G)들의 위치에 적외선 차단 녹색 필터(G+sIR)가 형성된 제 1 단위 픽셀 어레이(510) 및 제 1 단위 픽셀 어레이(510)에서 청색 필터(B)의 위치에 적외선 통과 필터(IR)가 배치된 제 2 단위 픽셀 어레이(520)를 포함한다. 이때, 적외선 차단 녹색 필터(G+sIR)는 녹색 필터(G)와 적외선 차단 필터(sIR)가 중첩된 필터이다. 제 1 단위 픽셀 어레이(510)는 적색 필터(R)와 청색 필터(B)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 적외선 차단 녹색 필터(G+sIR)들이 배치되는 2 X 2 픽셀 어레이 구조를 가질 수 있다. 제 2 단위 픽셀 어레이(520)는 적색 필터(R)와 적외선 통과 필터(IR)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 적외선 차단 녹색 필터(G+sIR)들이 배치되는 2 X 2 픽셀 어레이 구조를 가질 수 있다.First, referring to FIG. 10A, the color filter array includes a first unit pixel array 510 and a first unit in which an infrared cut green filter G + sIR is formed at positions of all green filters G in a 2 × 2 Bayer pattern. The pixel array 510 includes a second unit pixel array 520 in which an infrared pass filter IR is disposed at a position of the blue filter B. FIG. In this case, the infrared cut green filter G + sIR is a filter in which the green filter G and the infrared cut filter sIR overlap. The first unit pixel array 510 has a 2 × 2 pixel in which a red filter R and a blue filter B are disposed in a diagonal direction, and two infrared blocking green filters G + sIR are disposed in a diagonal direction intersecting the red filter R and a blue filter B. It may have an array structure. The second unit pixel array 520 has a red filter (R) and an infrared ray passing filter (IR) arranged in a diagonal direction, and 2 x 2 in which two infrared blocking green filters (G + sIR) are arranged in a diagonal direction crossing the red filter (R) and an infrared ray passing filter (IR). It may have a pixel array structure.
이러한 도 10a의 어레이 구조는 컬러 필터부(500)에 사용되는 컬러 필터 어레이의 한 예시적 최소 단위 어레이 구조로서, 두 개의 제 1 단위 픽셀 어레이(510)들이 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 제 2 단위 픽셀 어레이(520)들이 배치되는 4 X 4 픽셀 어레이 구조를 갖는다. 컬러 필터부(500)의 컬러 필터 어레이는 도 10a의 단위 어레이들이 반복 배치되는 구조를 가질 수 있다.The array structure of FIG. 10A is an exemplary minimum unit array structure of the color filter array used in the color filter unit 500, wherein two first unit pixel arrays 510 are disposed in a diagonal direction and cross diagonally. Has a 4 × 4 pixel array structure in which two second unit pixel arrays 520 are disposed. The color filter array of the color filter unit 500 may have a structure in which the unit arrays of FIG. 10A are repeatedly arranged.
도 10b를 참조하면, 컬러 필터 어레이는 도 10a에서의 제 2 단위 픽셀 어레이(520) 및 제 2 단위 픽셀 어레이(520)에서 적색 필터(R) 위치에 청색 필터(B)가 형성된 제 3 단위 픽셀 어레이(530)를 포함한다. 제 3 단위 픽셀 어레이(530)는 청색 필터(B)와 적외선 통과 필터(IR)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 적외선 차단 녹색 필터(G+sIR)들이 배치되는 2 X 2 픽셀 어레이 구조를 가질 수 있다.Referring to FIG. 10B, the color filter array may include a third unit pixel in which a blue filter B is formed at a red filter R position in the second unit pixel array 520 and the second unit pixel array 520 of FIG. 10A. Array 530. The third unit pixel array 530 has a blue filter B and an infrared ray passing filter IR arranged in a diagonal direction, and 2 X 2 in which two infrared blocking green filters G + sIR are arranged in a diagonal direction crossing the blue filter B and an infrared ray passing filter IR. It may have a pixel array structure.
이러한 도 10b의 어레이 구조는 컬러 필터부(500)에 사용되는 컬러 필터 어레이의 다른 예시적 최소 단위 어레이 구조로서, 두 개의 제 2 단위 픽셀 어레이(520)들이 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 제 3 단위 픽셀 어레이(530)들이 배치되는 4 X 4 픽셀 어레이 구조를 갖는다. 컬러 필터부(500)의 컬러 필터 어레이는 도 10b의 단위 어레이들이 반복 배치되는 구조를 가질 수 있다.The array structure of FIG. 10B is another exemplary minimum unit array structure of the color filter array used in the color filter unit 500, wherein two second unit pixel arrays 520 are disposed in a diagonal direction and cross diagonally. Has a 4 × 4 pixel array structure in which two third unit pixel arrays 530 are disposed. The color filter array of the color filter unit 500 may have a structure in which the unit arrays of FIG. 10B are repeatedly arranged.
도 10c의 컬러 필터 어레이는, 도 10b의 컬러 필터 어레이와 같이, 제 2 단위 픽셀 어레이(520) 및 제 3 단위 픽셀 어레이(530)를 포함한다. 다만, 도 10c의 컬러 필터 어레이는 제 2 단위 픽셀 어레이(520)와 제 3 단위 픽셀 어레이(530)의 위치가 도 10b의 컬러 필터 어레이와 반대가 된다.The color filter array of FIG. 10C, like the color filter array of FIG. 10B, includes a second unit pixel array 520 and a third unit pixel array 530. However, in the color filter array of FIG. 10C, the positions of the second unit pixel array 520 and the third unit pixel array 530 are opposite to the color filter array of FIG. 10B.
이러한 도 10c의 어레이 구조는 컬러 필터부(500)에 사용되는 컬러 필터 어레이의 또 다른 예시적 최소 단위 어레이 구조가 될 수 있다.The array structure of FIG. 10C may be another exemplary minimum unit array structure of the color filter array used in the color filter unit 500.
도 11a 및 도 11b는 도 10a에서 A-A'에 따라 절단된 컬러 필터 어레이의 단면 모습들을 예시적으로 보여주는 도면들이다.11A and 11B are diagrams illustrating cross-sectional views of a color filter array cut along AA ′ in FIG. 10A.
도 11a를 참조하면, 컬러 필터부(500)의 컬러 필터 어레이는 기판(550), 제 1 필터층(560) 및 제 2 필터층(570)을 포함한다.Referring to FIG. 11A, the color filter array of the color filter unit 500 includes a substrate 550, a first filter layer 560, and a second filter layer 570.
제 1 필터층(560)은 기판(550)의 상부에 위치하며, 적외선 차단 필터(sIR)와 버퍼층(560a)을 포함한다. 여기에서, 적외선 차단 필터(sIR)와 버퍼층(560a)은 교번되게 배치된다. 적외선 차단 필터(sIR)는 제 2 필터층(570)의 모든 녹색 필터(G)들의 하부에 배치된다. 버퍼층(560a)은 제 1 필터층(560)에서 적외선 차단 필터(sIR)들이 배치되지 않은 나머지 영역에 배치된다.The first filter layer 560 is positioned on the substrate 550 and includes an infrared cut filter sIR and a buffer layer 560a. Here, the infrared cut filter sIR and the buffer layer 560a are alternately arranged. The infrared cut filter sIR is disposed under all of the green filters G of the second filter layer 570. The buffer layer 560a is disposed in the remaining area of the first filter layer 560 where the infrared cut filter sIR is not disposed.
제 2 필터층(570)은 제 1 필터층(560)의 상부에 위치하며, 컬러 필터들(R, G, B)과 적외선 통과 필터(IR)들을 포함한다.The second filter layer 570 is positioned above the first filter layer 560 and includes color filters R, G, and B and infrared pass filters IR.
도 11a에서는 제 2 필터층(570)의 상부면이 평탄화된 경우를 도시하고 있으나, 일부 컬러 필터가 돌출된 형태로 형성되어도 무방하다.11A illustrates a case where the top surface of the second filter layer 570 is flattened, some color filters may be formed to protrude.
도 11b의 컬러 필터 어레이는 도 11a의 컬러 필터 어레이와 비교하여, 버퍼층(560a)이 존재하지 않는다. 즉, 도 11b의 컬러 필터 어레이에서는 적외선 차단 필터(sIR)가 배치되는 위치에서만 기판(550) 상부에 해당 컬러 필터(G)와 적외선 차단 필터(sIR)가 중첩되게 형성되고, 나머지 위치들에서는 기판(550) 상부에 해당 컬러 필터들만 형성된다.The color filter array of FIG. 11B has no buffer layer 560a compared to the color filter array of FIG. 11A. That is, in the color filter array of FIG. 11B, the color filter G and the infrared cut filter sIR overlap the upper portion of the substrate 550 only at the position where the infrared cut filter sIR is disposed. Only corresponding color filters are formed on the 550.
본 발명의 제 3 실시예에 따른 이미지 센서는 녹색 필터(G)에 대한 가시광 신호를 기존 상용 이미지 센서와 동일하게 재현할 수 있다는 장점이 있다.The image sensor according to the third embodiment of the present invention has an advantage that the visible light signal for the green filter G can be reproduced in the same manner as the conventional commercial image sensor.
또한, 적색 가시광 신호(Rs)와 청색 가시광 신호(Bs)를 얻기 위해서는, 적색 필터(R)와 청색 필터(B)를 투과한 컬러 신호(Rs+IRs, Bs+IRs)에서 적외선 신호(IRs)를 제거하는 과정을 거쳐야 한다. 그런데, 적외선 신호(IRs)를 제거시 에러가 발생하면, 기존 상용 이미지 센서 보다 화질 특성이 열화될 수 있는 문제가 있다. 그러나, 도 10a 내지 도 10c에 도시된 컬러 필터 어레이에서는 녹색 필터(G)가 적색 필터(R) 및 청색 필터(B)보다 많이 배치되어 녹색 필터(G)들이 전체 해상도에 기여하는 부분이 크기 때문에, 적외선 신호(IRs)를 분리하는 과정에서 발생될 수 있는 해상도 열화를 최소화 할 수 있다.In addition, in order to obtain the red visible light signal Rs and the blue visible light signal Bs, the infrared signals IRs are applied to the color signals Rs + IRs and Bs + IRs transmitted through the red filter R and the blue filter B. You have to go through the process of removing it. However, when an error occurs when removing the infrared signals IRs, there is a problem that image quality characteristics may be degraded than conventional commercial image sensors. However, in the color filter array illustrated in FIGS. 10A to 10C, since the green filter G is disposed more than the red filter R and the blue filter B, the portion where the green filter G contributes to the overall resolution is large. In addition, resolution degradation that may occur in the process of separating the IR signals may be minimized.
도 12는 본 발명의 다른 실시 예에 따른 컬러 필터 어레이의 구성을 예시적으로 나타내는 도면이다.12 is a diagram illustrating a configuration of a color filter array according to another embodiment of the present invention.
도 12의 컬러 필터 어레이에서는 도 3의 컬러 필터 어레이에서 녹색 필터(G)의 위치에 흰색(White) 필터(W)가 배치된다. 즉, 본 실시 예에서는 녹색 필터(G)가 사용되지 않고 대신에 흰색 필터(W)가 사용된다.In the color filter array of FIG. 12, a white filter W is disposed at a position of the green filter G in the color filter array of FIG. 3. That is, in this embodiment, the green filter G is not used, and the white filter W is used instead.
즉, 도 12의 컬러 필터 어레이에서, 제 1 단위 픽셀 어레이(130)는 적색 필터(R)와 청색 필터(B)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 흰색 필터(W)들이 배치되는 2 X 2 픽셀 어레이 구조를 가진다. 또한, 제 2 단위 필터 어레이(140)는 적색 필터(R)와 적외선 통과 필터(IR)가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 흰색 필터(W)들이 배치되는 2 X 2 픽셀 어레이 구조를 가진다.That is, in the color filter array of FIG. 12, the first unit pixel array 130 has a red filter R and a blue filter B disposed in a diagonal direction, and two white filters W in a diagonal direction intersecting with the red filter R and the blue filter B. FIG. Have a 2 x 2 pixel array structure in which they are arranged. In addition, the second unit filter array 140 has a red filter (R) and an infrared ray passing filter (IR) disposed in a diagonal direction, and 2 x 2 pixels in which two white filters (W) are disposed in a diagonal direction crossing the filter. It has an array structure.
이미지를 만들기 위해서는 적색 신호, 녹색 신호 및 청색 신호가 필요한데, 본 실시 예에서는 녹색 필터가 사용되지 않으므로, 흰색 필터(W)를 투과한 흰색 신호로부터 녹색 신호(G)를 추출한다. 즉, 흰색 신호는 적색 신호, 녹색 신호 및 청색 신호가 결합(흰색 신호 = 적색 신호 + 녹색 신호 + 청색 신호)된 것이므로, 흰색 신호에 적색 신호와 청색 신호를 제거(녹색 신호 = 흰색 신호 ?? 적색 신호 ?? 청색 신호)함으로써 녹색 신호를 얻을 수 있다. 이때, 적색 신호와 청색 신호는 각각 적색 필터(R)와 청색 필터(B)를 투과한 컬러 신호가 이용된다.In order to produce an image, a red signal, a green signal, and a blue signal are required. Since the green filter is not used in this embodiment, the green signal G is extracted from the white signal passing through the white filter W. That is, the white signal is a combination of the red signal, the green signal, and the blue signal (white signal = red signal + green signal + blue signal), so the red and blue signals are removed from the white signal (green signal = white signal-red). Signal to blue signal) to obtain a green signal. At this time, the red signal and the blue signal use the color signal transmitted through the red filter (R) and the blue filter (B), respectively.
이처럼, 녹색 필터 대신에 흰색 필터를 사용하는 이유는 흰색 필터가 녹색 필터보다 광량이 최대 3배가량 많기 때문이다. 따라서, 야간 촬영시에도 이미지가 더욱 밝고 뚜렷하게 촬영될 수 있다.As such, the reason why the white filter is used instead of the green filter is that the white filter has up to three times more light than the green filter. Therefore, the image may be captured more brightly and clearly even at night.
상술한 실시 예들에서는 컬러 필터부들(100, 300, 500)이 컬러 필터 어레이를 포함하는 것으로 설명되었으나, 컬러 필터부와 컬러 필터 어레이는 동일한 구성일 수 있다. 즉, 컬러 필터 어레이가 컬러 필터부로서 사용될 수 있다. In the above-described embodiments, the color filter units 100, 300, and 500 have been described as including a color filter array, but the color filter unit and the color filter array may have the same configuration. That is, a color filter array can be used as the color filter portion.
이상의 설명은 본 출원의 기술 사상을 예시적으로 설명한 것에 불과한 것으로서, 본 출원이 속하는 기술 분야에서 통상의 지식을 가진 자라면 본 출원의 본질적인 특성에서 벗어나지 않는 범위에서 다양한 수정 및 변형이 가능할 것이다. The above description is merely illustrative of the technical idea of the present application, and those skilled in the art to which the present application pertains may various modifications and variations without departing from the essential characteristics of the present application.
따라서, 본 출원에 개시된 실시예들은 본 출원의 기술 사상을 한정하기 위한 것이 아니라 설명하기 위한 것이고, 이러한 실시예에 의하여 본 출원의 기술 사상의 범위가 한정되는 것은 아니다. Therefore, the embodiments disclosed in the present application are not intended to limit the technical spirit of the present application but to describe the present invention, and the scope of the technical spirit of the present application is not limited by these embodiments.
본 출원의 보호 범위는 아래의 청구범위에 의하여 해석되어야 하며, 그와 동등한 범위 내에 있는 모든 기술 사상은 본 발명의 권리범위에 포함되는 것으로 해석되어야 할 것이다.The scope of protection of the present application should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.
본 발명은 컬러 필터 어레이 이외에 적외선 통과 필터 또는 적외선 차단 필터를 추가적인 구비하지 않고도 컬러 신호들에서 적외선 신호를 선택적으로 제거할 수 있어, 이를 이용한 카메라 구성을 간단하게 할 수 있으며 제조 비용을 절감할 수 있다.The present invention can selectively remove the infrared signal from the color signals without the addition of an infrared pass filter or an infrared cut filter in addition to the color filter array, it is possible to simplify the camera configuration and reduce the manufacturing cost using the same .

Claims (19)

  1. 제 1 컬러 필터, 제 2 컬러 필터 및 제 3 컬러 필터가 어레이 형태로 배치된 제 1 단위 픽셀 어레이; 및A first unit pixel array in which the first color filter, the second color filter, and the third color filter are arranged in an array; And
    제 4 컬러 필터, 제 5 컬러 필터 및 적외선 통과 필터가 어레이 형태로 배치된 제 2 단위 픽셀 어레이를 포함하는 컬러 필터 어레이.And a second unit pixel array in which the fourth color filter, the fifth color filter, and the infrared pass filter are arranged in an array form.
  2. 제 1항에 있어서, 상기 제 1 단위 픽셀 어레이는The method of claim 1, wherein the first unit pixel array
    상기 제 1 컬러 필터와 상기 제 3 컬러 필터가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 상기 제 2 컬러 필터들이 배치되는 2 X 2 픽셀 어레이 구조를 가지며,The first color filter and the third color filter are disposed in a diagonal direction, and have a 2 × 2 pixel array structure in which the two second color filters are disposed in a diagonal direction crossing the color filter;
    상기 제 2 단위 픽셀 어레이는The second unit pixel array
    상기 제 4 컬러 필터와 상기 적외선 통과 필터가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 상기 제 5 컬러 필터들이 배치되는 2 X 2 픽셀 어레이 구조를 갖는 것을 특징으로 하는 컬러 필터 어레이.And a second X 2 pixel array structure in which the fourth color filter and the infrared ray pass filter are disposed in a diagonal direction and two fifth color filters are arranged in a diagonal direction crossing the fourth color filter and the infrared ray passing filter.
  3. 제 2항에 있어서,The method of claim 2,
    상기 제 1 컬러 필터와 상기 제 4 컬러 필터는 적색 필터이며,The first color filter and the fourth color filter are red filters,
    상기 제 2 컬러 필터와 상기 제 5 컬러 필터는 녹색 필터이며,The second color filter and the fifth color filter are green filters,
    상기 제 3 컬러 필터는 청색 필터인 것을 특징으로 하는 컬러 필터 어레이.And the third color filter is a blue filter.
  4. 제 2항에 있어서,The method of claim 2,
    상기 제 1 컬러 필터와 상기 제 4 컬러 필터는 적색 필터이며,The first color filter and the fourth color filter are red filters,
    상기 제 2 컬러 필터와 상기 제 5 컬러 필터는 흰색 필터이며,The second color filter and the fifth color filter are white filters,
    상기 제 3 컬러 필터는 청색 필터인 것을 특징으로 하는 컬러 필터 어레이.And the third color filter is a blue filter.
  5. 제 2항에 있어서,The method of claim 2,
    상기 제 1 컬러 필터와 상기 제 4 컬러 필터는 적색 필터이며,The first color filter and the fourth color filter are red filters,
    상기 제 2 컬러 필터와 상기 제 5 컬러 필터는 적외선 차단 녹색 필터이며,The second color filter and the fifth color filter are infrared cut green filters,
    상기 제 3 컬러 필터는 청색 필터인 것을 특징으로 하는 컬러 필터 어레이.And the third color filter is a blue filter.
  6. 제 5항에 있어서, 상기 적외선 차단 녹색 필터는The method of claim 5, wherein the infrared cut green filter
    녹색 필터와 적외선 차단 필터가 중첩되게 형성된 것을 특징으로 하는 컬러 필터 어레이.Color filter array, characterized in that the green filter and the infrared cut filter formed to overlap.
  7. 제 1항에 있어서,The method of claim 1,
    상기 제 1 단위 픽셀 어레이와 상기 제 2 단위 픽셀 어레이는 교번되게 반복 배치되는 것을 특징으로 하는 컬러 필터 어레이.And the first unit pixel array and the second unit pixel array are alternately and repeatedly arranged.
  8. 제 1항에 있어서,The method of claim 1,
    두 개의 상기 제 1 단위 픽셀 어레이들이 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 상기 제 2 단위 픽셀 어레이들이 배치되는 4 X 4 픽셀 어레이 구조를 갖는 최소 단위 어레이가 반복 배치되는 것을 특징으로 하는 컬러 필터 어레이.Characterized in that the minimum unit array having a 4 × 4 pixel array structure in which two first unit pixel arrays are arranged in a diagonal direction and two second unit pixel arrays are arranged in a diagonal direction that intersects the first unit pixel arrays is arranged repeatedly. Color filter array.
  9. 제 1 컬러 필터, 제 2 컬러 필터, 제 3 컬러 필터 및 제 4 컬러 필터가 어레이 형태로 배치된 최소 단위 어레이가 반복 배치되되,The minimum unit array in which the first color filter, the second color filter, the third color filter and the fourth color filter are arranged in an array form is repeatedly arranged,
    상기 제 3 컬러 필터는 상기 제 2 컬러 필터와 적외선 차단 필터가 중첩된 것을 특징으로 하는 컬러 필터 어레이.The third color filter is the color filter array, characterized in that the second color filter and the infrared cut filter overlap.
  10. 제 9항에 있어서, 상기 제 1 컬러 필터 내지 상기 제 4 컬러 필터는The method of claim 9, wherein the first color filter to the fourth color filter
    상기 제 1 컬러 필터와 상기 제 4 컬러 필터가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 상기 제 2 컬러 필터와 상기 제 3 컬러 필터가 배치되는 2 X 2 픽셀 어레이 구조로 배치되는 것을 특징으로 하는 컬러 필터 어레이.The first color filter and the fourth color filter are arranged in a diagonal direction, and the second color filter and the third color filter are arranged in a diagonal direction that intersects the second color filter and the fourth color filter. Color filter array.
  11. 제 1 컬러 필터, 제 2 컬러 필터 및 제 1 적외선 통과 필터가 어레이 형태로 배치된 제 1 단위 픽셀 어레이; 및A first unit pixel array in which the first color filter, the second color filter, and the first infrared pass filter are arranged in an array; And
    제 3 컬러 필터, 제 4 컬러 필터 및 제 2 적외선 통과 필터가 어레이 형태로 배치된 제 2 단위 픽셀 어레이를 포함하는 컬러 필터 어레이.And a second unit pixel array in which the third color filter, the fourth color filter, and the second infrared pass filter are arranged in an array.
  12. 제 11항에 있어서, 상기 제 1 단위 픽셀 어레이는The method of claim 11, wherein the first unit pixel array
    상기 제 1 컬러 필터와 상기 제 1 적외선 통과 필터가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 상기 제 2 컬러 필터들이 배치되는 2 X 2 픽셀 어레이 구조를 가지며,The first color filter and the first infrared filter is disposed in a diagonal direction, and has a 2 X 2 pixel array structure in which the two second color filters are arranged in a diagonal direction crossing the first color filter and the first infrared filter,
    상기 제 2 단위 픽셀 어레이는The second unit pixel array
    상기 제 3 컬러 필터와 상기 제 2 적외선 통과 필터가 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 상기 제 4 컬러 필터들이 배치되는 2 X 2 픽셀 어레이 구조를 갖는 것을 특징으로 하는 컬러 필터 어레이.The color filter array having a 2 × 2 pixel array structure in which the third color filter and the second infrared ray pass filter are disposed in a diagonal direction and two fourth color filters are arranged in a diagonal direction crossing the second color filter and the second infrared filter. .
  13. 제 12항에 있어서,The method of claim 12,
    상기 제 1 컬러 필터는 적색 필터이며,The first color filter is a red filter,
    상기 제 2 컬러 필터와 상기 제 4 컬러 필터는 적외선 차단 녹색 필터이며,The second color filter and the fourth color filter are infrared cut green filters,
    상기 제 3 컬러 필터는 청색 필터인 것을 특징으로 하는 컬러 필터 어레이.And the third color filter is a blue filter.
  14. 제 13항에 있어서, 상기 적외선 차단 녹색 필터는The method of claim 13, wherein the infrared cut green filter
    녹색 필터와 적외선 차단 필터가 중첩되게 형성된 것을 특징으로 하는 컬러 필터 어레이.Color filter array, characterized in that the green filter and the infrared cut filter formed to overlap.
  15. 제 11항에 있어서, The method of claim 11,
    상기 제 1 단위 픽셀 어레이와 상기 제 2 단위 픽셀 어레이는 교번되게 반복 배치되는 것을 특징으로 하는 컬러 필터 어레이.And the first unit pixel array and the second unit pixel array are alternately and repeatedly arranged.
  16. 제 11항에 있어서,The method of claim 11,
    두 개의 상기 제 1 단위 픽셀 어레이들이 대각선 방향으로 배치되고, 이와 교차되는 대각선 방향으로 두 개의 상기 제 2 단위 픽셀 어레이들이 배치되는 4 X 4 픽셀 어레이 구조를 갖는 최소 단위 어레이가 반복 배치되는 것을 특징으로 하는 컬러 필터 어레이.Characterized in that the minimum unit array having a 4 × 4 pixel array structure in which two first unit pixel arrays are arranged in a diagonal direction and two second unit pixel arrays are arranged in a diagonal direction that intersects the first unit pixel arrays is arranged repeatedly. Color filter array.
  17. 컬러 필터들 및 적외선 통과 필터가 어레이 형태로 배치되며, 입사된 광을 필터링하여 적외선이 포함된 컬러 신호들과 적외선 신호를 출력하는 컬러 필터 어레이; 및A color filter array in which color filters and an infrared pass filter are arranged in an array form and filter incident light to output color signals and infrared signals including infrared rays; And
    상기 적외선 신호를 이용하여 상기 컬러 신호들에서 적외선 성분을 선택적으로 제거하는 영상처리기를 포함하는 이미지 센서.And an image processor configured to selectively remove infrared components from the color signals using the infrared signal.
  18. 입사된 광을 필터링하여 적색 신호, 녹색 신호, 청색 신호 및 적외선 차단 녹색 신호를 출력하는 컬러 필터 어레이; 및A color filter array filtering the incident light to output a red signal, a green signal, a blue signal, and an infrared cut green signal; And
    상기 녹색 신호와 상기 적외선 차단 녹색 신호를 이용하여 적외선 신호를 추출한 후 추출된 적외선 신호를 이용하여 상기 적색 신호와 상기 청색 신호에서 적외선 성분을 선택적으로 제거하는 영상처리기를 포함하는 이미지 센서.And an image processor configured to extract an infrared signal using the green signal and the infrared cut green signal, and then selectively remove infrared components from the red signal and the blue signal using the extracted infrared signal.
  19. 입사된 광을 필터링하여 적색 신호, 적외선 차단 녹색 신호, 청색 신호 및 적외선 신호를 출력하는 컬러 필터 어레이; 및A color filter array which filters the incident light to output a red signal, an infrared cut green signal, a blue signal, and an infrared signal; And
    상기 적외선 신호를 이용하여 상기 적색 신호와 상기 청색 신호에서 적외선 성분을 선택적으로 제거하거나 상기 적외선 차단 녹색 신호에 적외선 성분을 선택적으로 부가하는 영상처리기를 포함하는 이미지 센서.And an image processor configured to selectively remove infrared components from the red signal and the blue signal using the infrared signal, or selectively add infrared components to the infrared cut green signal.
PCT/KR2016/004363 2015-12-09 2016-04-26 Color filter array and image sensor using same WO2017099308A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
KR1020167012784A KR101806956B1 (en) 2015-12-09 2016-04-26 Color filter array and image sensor using the same
CN201680072580.2A CN108370421B (en) 2015-12-09 2016-04-26 Color filter array and image sensor using same

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR20150175289 2015-12-09
KR10-2015-0175289 2015-12-09

Publications (1)

Publication Number Publication Date
WO2017099308A1 true WO2017099308A1 (en) 2017-06-15

Family

ID=59013330

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/004363 WO2017099308A1 (en) 2015-12-09 2016-04-26 Color filter array and image sensor using same

Country Status (3)

Country Link
KR (1) KR101806956B1 (en)
CN (1) CN108370421B (en)
WO (1) WO2017099308A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111601022B (en) * 2020-05-11 2022-07-08 展谱光电科技(上海)有限公司 Image sensor and signal processing method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070113912A (en) * 2006-05-26 2007-11-29 삼성전자주식회사 Apparatus for photographing image and operating method for the same
US20100289885A1 (en) * 2007-10-04 2010-11-18 Yuesheng Lu Combined RGB and IR Imaging Sensor
KR20110040402A (en) * 2009-10-14 2011-04-20 삼성전자주식회사 Color filter array, image sensor having the same, and interpolation method thereof
KR20130090599A (en) * 2012-02-06 2013-08-14 하이브모션 주식회사 A complex filter array, and an image sensor using thereof
KR20150003687A (en) * 2013-07-01 2015-01-09 옴니비전 테크놀러지즈 인코포레이티드 Color and infrared filter array patterns to reduce color aliasing

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101736330B1 (en) * 2010-09-03 2017-05-30 삼성전자주식회사 Pixel, image sensor having the pixel, and image processing device having the image sensor
CN104735427B (en) * 2013-12-24 2016-07-06 浙江大华技术股份有限公司 A kind of imageing sensor

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070113912A (en) * 2006-05-26 2007-11-29 삼성전자주식회사 Apparatus for photographing image and operating method for the same
US20100289885A1 (en) * 2007-10-04 2010-11-18 Yuesheng Lu Combined RGB and IR Imaging Sensor
KR20110040402A (en) * 2009-10-14 2011-04-20 삼성전자주식회사 Color filter array, image sensor having the same, and interpolation method thereof
KR20130090599A (en) * 2012-02-06 2013-08-14 하이브모션 주식회사 A complex filter array, and an image sensor using thereof
KR20150003687A (en) * 2013-07-01 2015-01-09 옴니비전 테크놀러지즈 인코포레이티드 Color and infrared filter array patterns to reduce color aliasing

Also Published As

Publication number Publication date
KR101806956B1 (en) 2017-12-08
CN108370421B (en) 2020-10-23
CN108370421A (en) 2018-08-03

Similar Documents

Publication Publication Date Title
CN1177467C (en) Color imaging system with infrared correction
JP4139641B2 (en) Solid-state image sensor
KR100830587B1 (en) Image sensor and method of displaying a image using the same
WO2014189232A1 (en) Electronic sensor and method for controlling the same
WO2016099128A1 (en) Camera module and image sensing method therefor, and recording medium having recorded therein program for implementing method
US8878969B2 (en) Imaging systems with color filter barriers
WO2021179805A1 (en) Image sensor, camera assembly, mobile terminal, and image acquisition method
US20080079828A1 (en) Solid-state image sensor
JP2017076769A (en) Image sensor with yellow filter unit
TW201027728A (en) Solid-state image capture device and image capture apparatus
WO2014189332A1 (en) Imaging sensor capable of phase difference focus detection cross-reference to related patent application
WO2015005672A1 (en) Image generating apparatus and method and non-transitory recordable medium
WO2015178509A1 (en) Image sensor having heterogeneous pixel structures
WO2017099308A1 (en) Color filter array and image sensor using same
JP4253943B2 (en) Solid-state imaging device
CN113824906B (en) Image sensing device
WO2020111369A1 (en) Image sensor and control method therefor
WO2022111015A1 (en) Image sensor and imaging apparatus
WO2019031802A1 (en) System and method for compensating for image quality for each brightness section
WO2017034076A1 (en) Image sensor, digital image processing apparatus using same, and image signal processing method therefor
JP2008016862A (en) Solid state imaging apparatus
WO2016186222A1 (en) Image sensor for improving depth of field of image, and method for operating same
JP4935290B2 (en) Solid-state imaging device, driving method of solid-state imaging device, and imaging device
WO2018216937A1 (en) Method and device for image processing using dual image sensor
JPH0794694A (en) Solid state image sensor

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 1020167012784

Country of ref document: KR

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16873174

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16873174

Country of ref document: EP

Kind code of ref document: A1