CN102801984B - The method of color image sensor and acquisition color digital image - Google Patents
The method of color image sensor and acquisition color digital image Download PDFInfo
- Publication number
- CN102801984B CN102801984B CN201210267082.7A CN201210267082A CN102801984B CN 102801984 B CN102801984 B CN 102801984B CN 201210267082 A CN201210267082 A CN 201210267082A CN 102801984 B CN102801984 B CN 102801984B
- Authority
- CN
- China
- Prior art keywords
- color filter
- color
- element array
- filter unit
- colour
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 15
- 239000003086 colorant Substances 0.000 claims description 14
- 239000000203 mixture Substances 0.000 claims description 9
- 238000000205 computational method Methods 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 8
- 210000001525 retina Anatomy 0.000 description 4
- 241000196324 Embryophyta Species 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 230000004456 color vision Effects 0.000 description 1
- 238000004040 coloring Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4015—Image demosaicing, e.g. colour filter arrays [CFA] or Bayer patterns
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Optical Filters (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The present invention relates to a kind of method of color image sensor and acquisition color digital image, particularly relate to a kind of color filter element array; Color image sensor comprises imageing sensor and chromatic color filter, and described chromatic color filter is covered in described image sensor surface, and described imageing sensor is arranged as sensing element array by multiple sensing element and forms; Described chromatic color filter is that color filter element array is formed by multiple color filter identical permutation; A corresponding sensing element of color filter unit, exports a pixel in coloured image.Obtain the method for color digital image, obtained the pixel value of any color filter unit by specific formulae discovery.A color filter unit in color filter element array exports a pixel in coloured image.Present invention greatly enhances the utilance of transducer; The RGB tristimulus values of same position can be reconstructed from multiple color filter unit, improve the accuracy of color reduction.
Description
Technical field
The present invention relates to a kind of method of transducer and acquisition image, particularly relate to a kind of method of color image sensor and acquisition color digital image, particularly relate to a kind of color filter element array.Color image sensor based on this color filter element array can be used for digital picture, the video equipments such as various digital camera, Digital Video.
Background technology
Digital color image transducer is the parts of the most critical in the digital image device such as digital camera, Digital Video, for the optical imagery of lens focus is converted to digital color image.Color digital image equipment can be divided into two kinds according to the quantity of the imageing sensor of its inside: (1) single image sensor color digital image device, comprise most Digital Video and digital camera, be characterized in these digital color image equipment, only having an imageing sensor (CCD or cmos image sensor), the brightness transition of the visible ray be irradiated on transducer is the signal of telecommunication by this imageing sensor, and digitlization in follow-up process, produce gray scale (black and white) image.In order to the colouring information obtaining occurring in nature produces coloured image, the surface being typically employed in imageing sensor needs the method covering one deck chromatic color filter, jointly forms color image sensor by chromatic color filter and imageing sensor two parts.(2) the color digital image equipment of multiple image sensor, as the Digital Video of 3CCD, the Digital Video etc. of 3CMOS, its device interior has an optical splitter, the visible ray injected in the external world is divided into red, green, blue three beams, respectively by three independently imageing sensor (CCD or cmos image sensor) receive, and be quantified as color digital image; In addition, in color digital image equipment, also have a kind of employing X3 (Japanese Sigma house journal) color image sensor, this transducer adopts three layer of three look structure, the i.e. imageing sensor of three plies, is respectively blue, green, red, transparent imageing sensor.In extraneous incident light, blue portion is first absorbed and digitlization by ground floor blue image transducer, second layer green image transducer absorbs green portion in incident light and digitlization, the red image transducer of third layer absorbs remaining light and digitlization, thus produces color digital image.
As mentioned above, the effect of digital image sensor is by the luma digit of the visible ray be irradiated on transducer, produces gray scale (black and white) image.Because a width digital picture is the pel array arranged by multiple pixel, correspondingly, imageing sensor is the sensing element array be arranged in by multiple sensing element, wherein each sensing element carries out digitlization to the intensity (brightness) of the light received independently, produces a pixel in digital picture.
Color image sensor is the surface coverage chromatic color filter at imageing sensor, makes imageing sensor can carry out digitlization to the light intensity of different colours in visible ray (brightness), produces coloured image.Imageing sensor in color image sensor, the same with above-mentioned gray level image transducer, be the sensing element array arranged by multiple sensing element; Chromatic color filter in color image sensor forms color filter unit group pattern by color filter tuple repeated arrangement.Each color filter tuple is corresponding with the pixel in a coloured image.Therefore, different with gray level image transducer, in color image sensor, the quantity of sensing element is much larger than the quantity of pixel in coloured image.
Generally have three kinds or four kinds of colors in color filter tuple, as red color filter unit, green color is first, blue color is first.A color filter tuple is corresponding to a pixel in color digital image, and its output valve is the tristimulus values of a pixel in digital picture.Therefore, the chromatic color filter in color image sensor is made up of the colour filter tuple of repeated arrangement, and one of them color filter tuple exports the redgreenblue value of a pixel, both one_to_one corresponding.
Shown in the color filter tuple following table of prior art:
In sum, the color filter tuple of prior art has following two features:
1) in a color filter tuple, there is 2x2,2x4,4x4 etc. three look or four look colour filters unit;
2) the colour filter unit in color filter tuple has the arrangement mode determined, and this arrangement mode is by patent protection.
Below for the color digital image transducer of a mega pixel, color digital image transducer and color filter tuple, relation between colour filter unit and the first three of transducer are described.
Suppose the digital camera having a mega pixel, the color digital image transducer namely in camera exports the color digital image of a mega pixel (1,000x1,000 pixel); And suppose that this imageing sensor adopts three look Bayer colour filter tuples, as shown in Figure 1, then this transducer has:
1000000 Bayer colour filter tuples, export 1,000,000 pixels, wherein each color filter tuple exports a pixel;
The colour filter element array of 4000000 (2,000x2,000) colour filter unit compositions.Wherein there are 1,000,000 red color filter units, 1,000,000 blue color units, 2,000,000 green color units;
The sensing element array of 4000000 (2,000x2,000) sensing element compositions, it is covered with colour filter element array, between the two one_to_one corresponding.Every four sensing elements export a pixel.
In sum, mainly there are the following problems for existing color image sensor: one is that four sensing elements export a pixel, and the utilance of sensing element is low, there is serious wasting phenomenon; Two is that four sensing elements are in different positions, and namely in same pixel, RGB tristimulus values are not come from same position, there is small difference, therefore, correctly can not reflect the real color of occurring in nature.
Summary of the invention
Goal of the invention of the present invention is according to structure amphiblestroid in human eye, a kind of method of color image sensor and acquisition color digital image is provided, a kind of color filter element array (Tao Shi colour filter element array) is especially provided, a corresponding sensing element of color filter unit exports a colour element, drastically increases the utilance of transducer; The RGB tristimulus values of same position can be reconstructed from multiple color filter unit, improve the accuracy of color reduction.
For solving the problems of the technologies described above, the technical solution used in the present invention is:
A kind of color image sensor, comprise imageing sensor and chromatic color filter, described chromatic color filter is covered in described image sensor surface, and described imageing sensor is arranged as sensing element array by multiple sensing element and forms; Described chromatic color filter is that color filter element array is formed by multiple color filter identical permutation, and described color filter element array at least comprises the color filter unit of three kinds of colors, and a corresponding sensing element of color filter unit, exports a pixel in coloured image.
Preferably, described color filter element array at least comprises red color filter unit, green color is first and blue color is first.
Preferably, the color filter unit random alignment in described color filter element array, forms random code book.
Preferably, the color filter unit of the wherein a kind of color in described color filter element array is according to regularly arranged, and the color filter unit then random alignment of other color, forms accurate random code book.
A kind of color image sensor obtains the method for color digital image, it is characterized in that, according to code book and following color filter element array computational methods, calculate the redgreenblue value obtaining in described color filter element array a pixel in any one digital picture corresponding to color filter unit:
The computational methods of color filter element array:
The first, the total n (n >=3) of color filter unit plants the colour filter unit of different colours, is respectively C
1, C
2..., C
n.
The second, color coefficient Λ
ri, Λ
gi, Λ
bi(0 <=Λ <=1) represents the color C of colour filter unit
1, C
2..., C
nin containing redgreenblue composition, that is:
Λ
RiC
i=R
Λ
GiC
i=G
Λ
BiC
i=B
Wherein i represents the kind of colour filter unit in colour filter element array, i.e. i=1,2,3 ..., n.If n=3, then have:
3rd, the ratio shared by colour filter unit being located at shades of colour in color filter element array is respectively Ω
1, Ω
2, Ω
3..., Ω
n, then have:
Ω
1+Ω
2+Ω
3+...+Ω
n=1。
4th, in color filter element array, the color filter unit of shades of colour forms color filter element array according to regular Ψ arrangement, the arrangement mode of all color filter units in this colour filter element array, be called the code book (Codebook) of colour filter element array, there is various ways, as all colour filter units random alignment, accurate random alignment, or repeated arrangement.
5th, according to the code book of colour filter element array, any position in colour filter element array, its color filter unit
color be
its neighborhood colour filter metaset
be defined as: establish
it is colour filter unit
a neighbouring color filter unit, its color is
with
between distance be
then have
wherein
represent
namely
colour filter unit itself.Definition is all
the colour filter unit of (D is a constant)
the set of composition is
neighborhood colour filter metaset
total M colour filter unit, wherein
represent set
in various colour filter unit subset, have M respectively
c1, M
c2, M
c3..., M
cnindividual color filter unit, then have: M=M
c1+ M
c2+ M
c3+ ...+M
cn.
6th, according to colour filter unit in colour filter element array
with
between distance
definition distance coefficient
as follows:
Wherein function
there is various ways, as the inverse of square distance, exponential function, or constant.
7th, according to code book, any position in colour filter element array
the signal value that corresponding sensing element obtains is
its color is
its neighborhood
middle any position
the signal value that corresponding sensing element obtains is
its color is
then in corresponding color digital image, colour filter unit
the RGB tristimulus values of the pixel of corresponding position can be obtained by following formulae discovery:
Wherein algorithm f
r, f
g, f
bthere is various ways, as addition.
For a color filter element array for color image sensor, described color filter element array at least comprises the color filter unit of three kinds of colors, a pixel in a color filter unit output coloured image.
Preferably, at least to comprise red color filter unit, green color unit and blue color first etc. for described color filter element array.
Preferably, the color filter unit random alignment in described color filter element array, forms random code book.
Preferably, the color filter unit of the wherein a kind of color in described color filter element array is according to regularly arranged, and the color filter unit then random alignment of other color, forms accurate random code book.
The method of a kind of color image sensor provided by the invention and acquisition color digital image, especially a kind of color filter element array, is formed by color filter identical permutation, there is not colour filter tuple, and namely a colour filter unit exports a pixel; There is the color filter unit of three kinds or more in colour filter element array, therefore, there is the problem how these color filter units arrange; A color filter unit exports the tristimulus values of a pixel, but a first value that can only obtain in tristimulus values of color filter, and therefore, two other value needs to be calculated by certain algorithm from the color filter unit around this color filter unit current; Its essence helps mutually between colour filter unit, and when namely exporting the tristimulus values of colour filter unit A, colour filter unit B, C, D help around it calculates; When exporting the tristimulus values of colour filter unit B, A, C, E around it help calculating.The value of each colour filter unit is obtained for recycling repeatedly.
Color filter unit of the present invention display has following feature:
1, color filter element array of the present invention to be regularly arrangedly made up of with certain according to certain ratio color filter unit, does not have colour filter tuple, neither form the first group pattern of colour filter by colour filter tuple repeated arrangement;
2, described color filter unit comprises three kinds or colour filter unit more than three kinds of colors, and the ratio between the colour filter unit of shades of colour can be shades of colour equal quantities, also can be there is different ratios between each color;
The color filter identical permutation of 3, described multiple color forms the queueing discipline of color filter unit display, can be certain repetitive structure, also can be that each colour filter is first in certain ratio, random alignment;
4, in described color filter element array, each color filter unit exports a pixel in coloured image, color filter unit, sensing element, pixel three one_to_one corresponding.
5, Fig. 9 shows the difference of two kinds of color image sensors and digital color image acquisition methods.As can be seen from the figure, the method that the present invention proposes comprises colour filter element array and digital image reconstruction algorithm two parts.
Accompanying drawing explanation
Below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation.
Fig. 1 is prior art color digital image sensor construction schematic diagram;
In figure, 101 is that Bayer colour filter element array, 102 is for sensing element array.
Fig. 2 is color digital image transducer schematic diagram of the present invention;
In figure, 201 is Tao Shi colour filter element array of the present invention; 202 is transducer element array
Fig. 3 is the schematic diagram of Tao Shi colour filter element array of the present invention.
Fig. 4 is the schematic diagram of Tao Shi colour filter element array of the present invention;
Wherein Figure 40 1 is colour filter unit
Fig. 5 is the schematic diagram of Tao Shi colour filter element array of the present invention.
Fig. 6 is the schematic diagram of Tao Shi colour filter element array of the present invention.
Fig. 7 is the neighborhood colour filter metaset example one of in Fig. 4 401;
Numeral in figure is for marking different colour filter units.
Fig. 8 is the neighborhood colour filter metaset example two of in Fig. 4 401;
Numeral in figure is for marking different colour filter units.
Fig. 9 a is that prior art digital picture obtains schematic diagram.
Fig. 9 b is that the digital picture that the present invention proposes obtains schematic diagram.
Embodiment
Embodiment 1
As shown in Figure 2, a kind of color image sensor, comprises imageing sensor and chromatic color filter, and described chromatic color filter is covered in described image sensor surface, and described imageing sensor is arranged as sensing element array by multiple sensing element and forms; Described chromatic color filter is that color filter element array is formed by multiple color filter identical permutation; Described color filter element array at least comprises the color filter unit of three kinds of colors; A corresponding sensing element of color filter unit, exports a pixel in coloured image.Preferably, it is first that described color filter element array comprises red color filter unit, green color unit and blue color, as shown in Fig. 2, Fig. 3, Fig. 4 and Fig. 5.Color filter unit random alignment in described color filter element array, as shown in Figure 2.Wherein a kind of color color filter in described color filter element array is first in regularly arranged, the color filter unit then random alignment of other color, as shown in Figure 4, Figure 5 and Figure 6.
Embodiment 2
Utilize above-mentioned color image sensor to obtain a method for color digital image, calculate the pixel value obtaining any color filter unit in the following manner
Colour vision research shows, the combination of multiple color photosensitive unit, all can produce redgreenblue coloured image.The present invention proposes the computational methods of color filter element array:
(1) the total n (n >=3) of color filter unit plants the colour filter unit of different colours, is respectively C
1, C
2..., C
n;
(2) color coefficient Λ
ri, Λ
gi, Λ
bi(0 <=Λ <=1) represents the color C of colour filter unit
1, C
2..., C
nin containing redgreenblue composition, that is:
Λ
RiC
i=R
Λ
GiC
i=G
Λ
BiC
i=B
Wherein i represents the kind of colour filter unit in colour filter element array, i.e. i=1,2,3 ..., n.If n=3, then have:
(3) ratio shared by colour filter unit being located at shades of colour in color filter element array is respectively Ω
1, Ω
2, Ω
3..., Ω
n, then have:
Ω
1+Ω
2+Ω
3+...+Ω
n=1;
(4) in color filter element array, the color filter unit of shades of colour forms color filter element array according to regular Ψ arrangement, the arrangement mode of all color filter units in this colour filter element array, be called the code book (Codebook) of colour filter element array, there is various ways, as all colour filter units random alignment, accurate random alignment, and repeated arrangement etc.
(5) according to the code book of colour filter element array, any position in colour filter element array, its color filter unit
color be
its neighborhood colour filter metaset
be defined as: establish
it is colour filter unit
a neighbouring color filter unit, its color is
with
between distance be
then have
wherein
represent
namely
colour filter unit itself.Definition is all
the colour filter unit of (D is a constant)
the set of composition is
neighborhood colour filter metaset
total M colour filter unit, wherein
represent set
in various colour filter unit subset, have M respectively
c1, M
c2, M
c3..., M
cnindividual color filter unit, then have: M=M
c1+ M
c2+ M
c3+ ...+M
cn;
(6) according to colour filter unit in colour filter element array
with
between distance
definition distance coefficient
as follows:
Wherein function
there is various ways, as the inverse of square distance, exponential function, and constant etc.
(7) according to code book, any position in colour filter element array
the signal value that corresponding sensing element obtains is
its color is
its neighborhood
middle any position
the signal value that corresponding sensing element obtains is
its color is
then in corresponding color digital image, colour filter unit
the pixel value of corresponding position
can be obtained by following formulae discovery:
Wherein algorithm f
r, f
g, f
bthere is various ways, as addition etc.
Color filter element array model one:
Fig. 2 illustrates the color filter element array color digital image transducer that a present invention proposes, and color filter unit display is wherein formed according to certain ratio random alignment by redgreenblue colour filter unit.
Color filter element array model two:
Human retina research shows, the variable-scale of redgreenblue photosensory cell in retina.Fig. 3 illustrates the color filter element array that a present invention proposes, and in color filter unit display wherein, blue color unit accounts for 1/9, and green and red color filter unit respectively accounts for 4/9, and each color filter unit is according to evenly distributed regularly arranged.
Color filter element array model three:
Human retina research shows, the variable-scale of redgreenblue photosensory cell in retina.Fig. 4 illustrates the color filter element array that a present invention proposes, in color filter unit display wherein, blue color unit accounts for 1/9, green and red color filter unit respectively accounts for 4/9, each color filter unit is regularly arranged according to accurate random alignment, namely blue color unit is regularly arranged in colour filter element array, red and green color unit random alignment in colour filter element array.
Color filter element array model four:
Computer vision research shows, the ratio of redgreenblue photosensitive unit close to time, in the coloured image of generation, color resolution is higher.Fig. 5 illustrates the color filter element array that a present invention proposes, in color filter unit display wherein, blue color unit accounts for 2/9, green and red color filter unit respectively accounts for 3.5/9, each color filter unit is regularly arranged according to accurate random alignment, namely blue color unit is regularly arranged in colour filter element array, red and green color unit random alignment in colour filter element array.
Color filter element array model five:
Computer vision research shows, the ratio of the blue or green four look photosensitive units of RGB close to time, in the coloured image of generation, well, image resolution ratio is high in the reduction of color.Fig. 6 illustrates the color filter element array that a present invention proposes, in color filter unit display wherein, blue color unit accounts for 1/9, cyan colour filter unit accounts for 1/9, green and red color filter unit respectively accounts for 3.5/9, each color filter unit is regularly arranged according to accurate random alignment, namely blue color unit is regularly arranged in colour filter element array, red, green, cyan colour filter unit random alignment in colour filter element array.
Based on above-mentioned color filter element array model, the algorithm being produced coloured image by color filter element array is as follows:
According to the code book of colour filter element array, any position in colour filter element array, its color filter unit
color be
its neighborhood colour filter metaset
be defined as: establish
it is colour filter unit
a neighbouring color filter unit, its color is
with
between distance be
then have
wherein
represent
namely
colour filter unit itself.Definition is all
the colour filter unit of (D is a constant)
the set of composition is
neighborhood colour filter metaset
total M colour filter unit, wherein
represent set
in various colour filter unit subset, have M respectively
c1, M
c2, M
c3..., M
cnindividual color filter unit, then have: M=M
c1+ M
c2+ M
c3+ ...+M
cn;
According to colour filter unit in colour filter element array
with
between distance
definition distance coefficient
as follows:
Wherein function
there is various ways, as the inverse of square distance, exponential function, and constant etc.
According to code book, any position in colour filter element array
the signal value that corresponding sensing element obtains is
its color is
its neighborhood
middle any position
the signal value that corresponding sensing element obtains is
its color is
then in corresponding color digital image, colour filter unit
the pixel value of corresponding position
can be obtained by following formulae discovery:
Wherein algorithm f
r, f
g, f
bthere is various ways, as addition etc.
Algorithm examples one: below for color filter element array model four, illustrate above-mentioned computational methods:
With the colour filter unit of 401 indications in Fig. 4 be
get its neighborhood colour filter metaset
as shown in Figure 7, and get:
Λ=1;
Then can calculate pixel in coloured image to correspond to
pixel
color value
for:
R in formula
y, G
y, B
yrepresent field set respectively
the colour filter metaset of middle redgreenblue, namely
Algorithm examples two: below for color filter element array model four, illustrate above-mentioned computational methods:
With the colour filter unit of 401 indications in Fig. 4 be
get its neighborhood colour filter metaset
as shown in Figure 8, according to colour filter unit
with
between distance, get respectively:
In above formula,
then
then
then
namely weight is with the increase index decreased of distance.Then can calculate pixel in coloured image to correspond to
pixel
color value
for:
R in formula
y, G
y, B
yrepresent field set respectively
the colour filter metaset of middle redgreenblue, namely
Embodiment 3
For a color filter element array for color image sensor, described color filter element array at least comprises the color filter unit of three kinds of colors, and a color filter unit in described color filter element array exports a pixel in coloured image.Preferably, it is first that described color filter element array comprises red color filter unit, green color unit and blue color, as shown in Fig. 2, Fig. 3, Fig. 4 and Fig. 5.Preferably, the color filter unit random alignment in described color filter element array, as shown in Figure 2.Preferred, one of them color filter in described color filter element array is first in regularly arranged, other color filter unit then random alignment, as shown in Figure 4, Figure 5 and Figure 6.
Above-described embodiment is not the exhaustive of embodiment; also can there is other embodiment; above-described embodiment object is the present invention is described, but not limits the scope of the invention, and all application come by simple change of the present invention all drop in protection scope of the present invention.
Claims (7)
1. a color image sensor, comprises imageing sensor and chromatic color filter, and described chromatic color filter is covered in described image sensor surface, and described imageing sensor is arranged as sensing element array by multiple sensing element and forms; It is characterized in that: described chromatic color filter is arranged as color filter element array by multiple color filter unit according to queueing discipline and forms, described color filter element array at least comprises the color filter unit of three kinds of colors, a corresponding sensing element of color filter unit, exports a pixel in coloured image; The queueing discipline of the color filter unit in described color filter element array is random alignment, forms random code book.
2. a color image sensor, comprises imageing sensor and chromatic color filter, and described chromatic color filter is covered in described image sensor surface, and described imageing sensor is arranged as sensing element array by multiple sensing element and forms; It is characterized in that: described chromatic color filter is arranged as color filter element array by multiple color filter unit according to queueing discipline and forms, described color filter element array at least comprises the color filter unit of three kinds of colors, a corresponding sensing element of color filter unit, exports a pixel in coloured image; The color filter unit of the wherein a kind of color in described color filter element array is according to regularly arranged, and the queueing discipline of the color filter unit of other color is random alignment, forms accurate random code book.
3. color image sensor according to claim 1 and 2, is characterized in that, it is first that described color filter element array at least comprises red color filter unit, green color unit and blue color; Ratio between the colour filter unit of shades of colour can be shades of colour equal quantities, also can be there is different ratios between each color.
4. the method utilizing the color image sensor described in any one of claim 1-3 to obtain color digital image, it is characterized in that, according to code book and following color filter element array computational methods, calculate the redgreenblue value obtaining in described color filter element array a pixel in any one digital picture corresponding to color filter unit:
The computational methods of color filter element array:
The first, the total n (n >=3) of color filter unit plants the colour filter unit of different colours, is respectively C
1, C
2..., C
n;
The second, color coefficient Λ
ri, Λ
gi, Λ
bi(0 <=Λ <=1) represents the color C of colour filter unit
1, C
2..., C
nin containing redgreenblue composition, that is:
Λ
RiC
i=R
Λ
GiC
i=G
Λ
BiC
i=B
Wherein i represents the kind of colour filter unit in colour filter element array, i.e. i=1,2,3 ..., n; If n=3, then have:
3rd, the ratio shared by colour filter unit being located at shades of colour in color filter element array is respectively Ω
1, Ω
2, Ω
3..., Ω
n, then have:
Ω
1+Ω
2+Ω
3+...+Ω
n=1;
4th, in color filter element array, the color filter unit of shades of colour forms color filter element array according to regular Ψ arrangement, the arrangement mode of all color filter units in this colour filter element array, be called the code book of colour filter element array, there is various ways, as all colour filter units random alignment, accurate random alignment, or repeated arrangement;
5th, according to the code book of colour filter element array, any position in colour filter element array, its color filter unit
color be
its neighborhood colour filter metaset
be defined as: establish
it is colour filter unit
a neighbouring color filter unit, its color is
with
between distance be
then have
wherein
represent
namely
colour filter unit itself.Definition is all
the colour filter unit of (D is a constant)
the set of composition is
neighborhood colour filter metaset
total M colour filter unit, wherein
represent set
in various colour filter unit subset, have M respectively
c1, M
c2, M
c3..., M
cnindividual color filter unit, then have: M=M
c1+ M
c2+ M
c3+ ...+M
cn;
6th, according to colour filter unit in colour filter element array
with
between distance
definition distance coefficient
as follows:
Wherein function
there is various ways, as the inverse of square distance, exponential function, or constant;
7th, according to code book, any position in colour filter element array
the signal value that corresponding sensing element obtains is
its color is
its neighborhood
middle any position
the signal value that corresponding sensing element obtains is
its color is
then in corresponding color digital image, colour filter unit
the RGB tristimulus values of the pixel of corresponding position can be obtained by following formulae discovery:
Wherein algorithm f
rf
g, f
bthere is various ways, as addition.
5. for a color filter element array for color image sensor, described color filter element array at least comprises the color filter unit of three kinds of colors, it is characterized in that: a pixel in a color filter unit output coloured image; Color filter unit random alignment in described color filter element array, forms random code book.
6. for a color filter element array for color image sensor, described color filter element array at least comprises the color filter unit of three kinds of colors, it is characterized in that: a pixel in a color filter unit output coloured image; The color filter unit of the wherein a kind of color in described color filter element array is according to regularly arranged, and the color filter unit then random alignment of other color, forms accurate random code book.
7. the color filter element array according to claim 5 or 6, is characterized in that, it is first that described color filter element array at least comprises red color filter unit, green color unit and blue color; Ratio between the colour filter unit of shades of colour can be shades of colour equal quantities, also can be there is different ratios between each color.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210267082.7A CN102801984B (en) | 2012-07-31 | 2012-07-31 | The method of color image sensor and acquisition color digital image |
PCT/CN2013/000898 WO2014019339A1 (en) | 2012-07-31 | 2013-07-30 | Colour image sensor and method for acquiring colour digital image |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201210267082.7A CN102801984B (en) | 2012-07-31 | 2012-07-31 | The method of color image sensor and acquisition color digital image |
Publications (2)
Publication Number | Publication Date |
---|---|
CN102801984A CN102801984A (en) | 2012-11-28 |
CN102801984B true CN102801984B (en) | 2016-04-20 |
Family
ID=47200939
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201210267082.7A Expired - Fee Related CN102801984B (en) | 2012-07-31 | 2012-07-31 | The method of color image sensor and acquisition color digital image |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN102801984B (en) |
WO (1) | WO2014019339A1 (en) |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102801984B (en) * | 2012-07-31 | 2016-04-20 | 陶霖密 | The method of color image sensor and acquisition color digital image |
CN103002292A (en) * | 2012-12-26 | 2013-03-27 | 陶霖密 | Colorful image sensor and colorful color-filtering cell array |
US9300865B2 (en) | 2014-01-24 | 2016-03-29 | Goodrich Corporation | Random imaging |
JP6595161B2 (en) * | 2014-07-31 | 2019-10-23 | ソニーセミコンダクタソリューションズ株式会社 | Image processing apparatus, image processing method, and imaging apparatus |
CN104394391B (en) * | 2014-11-25 | 2016-09-28 | 广东威创视讯科技股份有限公司 | The image processing method of the dot matrix image of collected by camera and system |
CN106231064B (en) * | 2016-06-21 | 2019-06-21 | 努比亚技术有限公司 | A kind of terminal and the three primary colours sensor based on virtual unit drive reconstructing method |
CN109900704B (en) * | 2019-03-12 | 2020-07-28 | 西安交通大学 | In-situ three-dimensional reconstruction method for microscopic morphology of worn surface of gear |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1571476A (en) * | 2004-04-29 | 2005-01-26 | 上海交通大学 | Method of color interpolation in digital camera |
CN1870282A (en) * | 2005-05-25 | 2006-11-29 | 三星电机株式会社 | Image sensor for semiconductor light-sensing device and image processing apparatus using the same |
US7570282B1 (en) * | 1998-12-09 | 2009-08-04 | Aptina Imaging Corporation | Color correction of multiple colors using a calibrated technique |
CN102376083A (en) * | 2010-07-14 | 2012-03-14 | 豪威科技有限公司 | Cross-color image processing systems and methods for sharpness enhancement |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1377191A (en) * | 2002-05-09 | 2002-10-30 | 北京长信嘉信息技术有限公司 | Colour reconstruction method for colour filter array in digital camera |
DE102005058415A1 (en) * | 2005-12-07 | 2007-06-14 | Olympus Soft Imaging Solutions Gmbh | Method for color correction calculation |
CN101939762A (en) * | 2008-02-07 | 2011-01-05 | Nxp股份有限公司 | Method and device for reconstructing a color image |
US20110013056A1 (en) * | 2009-07-17 | 2011-01-20 | Searete Llc, A Limited Liability Corporation Of The State Of Delaware | Color filters and demosaicing techniques for digital imaging |
KR20120106762A (en) * | 2009-11-20 | 2012-09-26 | 트리퓨라리 싱 | Method and system for compressive color image sampling and reconstruction |
CN102510450A (en) * | 2011-10-17 | 2012-06-20 | 北京瑞澜联合通信技术有限公司 | Image sensor, pick-up device and image data generation method |
CN102801984B (en) * | 2012-07-31 | 2016-04-20 | 陶霖密 | The method of color image sensor and acquisition color digital image |
CN103002292A (en) * | 2012-12-26 | 2013-03-27 | 陶霖密 | Colorful image sensor and colorful color-filtering cell array |
-
2012
- 2012-07-31 CN CN201210267082.7A patent/CN102801984B/en not_active Expired - Fee Related
-
2013
- 2013-07-30 WO PCT/CN2013/000898 patent/WO2014019339A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7570282B1 (en) * | 1998-12-09 | 2009-08-04 | Aptina Imaging Corporation | Color correction of multiple colors using a calibrated technique |
CN1571476A (en) * | 2004-04-29 | 2005-01-26 | 上海交通大学 | Method of color interpolation in digital camera |
CN1870282A (en) * | 2005-05-25 | 2006-11-29 | 三星电机株式会社 | Image sensor for semiconductor light-sensing device and image processing apparatus using the same |
CN102376083A (en) * | 2010-07-14 | 2012-03-14 | 豪威科技有限公司 | Cross-color image processing systems and methods for sharpness enhancement |
Also Published As
Publication number | Publication date |
---|---|
CN102801984A (en) | 2012-11-28 |
WO2014019339A1 (en) | 2014-02-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN102801984B (en) | The method of color image sensor and acquisition color digital image | |
CN101455075B (en) | System and method for a high performance color filter mosaic array | |
CN102768412B (en) | Infrared imaging system and operational approach | |
CN101779288B (en) | Solid-state imaging device | |
CN101881849A (en) | Color filter | |
CN105825479B (en) | A kind of image enchancing method under environment light | |
CN104933706B (en) | A kind of imaging system color information scaling method | |
CN211296854U (en) | Pixel array and bionic vision sensor | |
CN104581100A (en) | Color filter array and image processing method | |
CN103543548B (en) | A kind of dot structure, display floater and liquid crystal display | |
CN111818314A (en) | Filter array and image sensor | |
CN106911919A (en) | Color image sensor and coloured image imaging method | |
CN109979953A (en) | A kind of imaging sensor | |
CN110507283A (en) | Retina camera and its implementation | |
CN206559541U (en) | Color image sensor | |
EP4181509A1 (en) | Filtering array, mobile terminal, and device | |
CN110675792B (en) | Display device and display method thereof | |
CN103546729B (en) | Gray-color dual-mode TDI-CMOS image sensor and control method | |
CN101939762A (en) | Method and device for reconstructing a color image | |
CN103002292A (en) | Colorful image sensor and colorful color-filtering cell array | |
CN212785636U (en) | Filter array, image sensor and application equipment thereof | |
CN204392456U (en) | Colour filter array | |
CN206908722U (en) | Optimization color filter array for color image sensor | |
JP2011095386A (en) | Lookup table forming method | |
CN102667863B (en) | Colouring information is determined using binaryzation sensor |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160420 Termination date: 20180731 |