CN102065245B - Image sampling method and image processing method for image sensor - Google Patents
Image sampling method and image processing method for image sensor Download PDFInfo
- Publication number
- CN102065245B CN102065245B CN200910206458.1A CN200910206458A CN102065245B CN 102065245 B CN102065245 B CN 102065245B CN 200910206458 A CN200910206458 A CN 200910206458A CN 102065245 B CN102065245 B CN 102065245B
- Authority
- CN
- China
- Prior art keywords
- row
- pixel
- pixel cell
- variable
- integer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000005070 sampling Methods 0.000 title claims abstract description 50
- 238000000034 method Methods 0.000 title claims abstract description 28
- 238000003672 processing method Methods 0.000 title claims abstract description 24
- 241001269238 Data Species 0.000 claims description 13
- 239000011159 matrix material Substances 0.000 claims description 5
- 239000003086 colorant Substances 0.000 claims 2
- 230000000295 complement effect Effects 0.000 claims 1
- 239000000872 buffer Substances 0.000 abstract description 13
- 230000009286 beneficial effect Effects 0.000 abstract 1
- 230000000875 corresponding effect Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 12
- 230000003287 optical effect Effects 0.000 description 8
- 101100041125 Arabidopsis thaliana RST1 gene Proteins 0.000 description 2
- 241001062009 Indigofera Species 0.000 description 2
- 101100443250 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) DIG1 gene Proteins 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Landscapes
- Color Television Image Signal Generators (AREA)
Abstract
The invention relates to an image sampling method and an image processing method for an image sensor. The image sensor comprises a plurality of pixel units at cross points of multiple columns and rows. The image sampling method comprises the following steps of: sampling the pixel units at the cross points of odd columns and rows and the pixel units at the cross points of even columns and rows in an odd fields period or even field period; and sampling the pixel units at the cross points of the even columns and the odd rows and the pixel units at the cross points of the odd columns and the even rows in the rest even field or odd field periods. In the image processing method, a specific pixel is inserted into the specific block by utilizing a plurality of pixel data in a specific block, wherein the pixel data is the pixel data which are sampled from the pixel units in the odd field or the even field period. The image sampling method and the image processing method for the image sensor are suitable for interlaced scanning, and are beneficial to subsequent instant color interpolation without increasing the additional cost of picture buffers.
Description
Technical field
The present invention relates to a kind of image sampling and processing method, relate in particular to a kind of image sampling method and image processing method of the imageing sensor by interlacing scan (interlaced scanning) and sawtooth scan (serrated scanning) sampled picture in alternate configurations row.
Background technology
Imageing sensor is translated into electronic signal in order to the optical imagery that will focus on the transducer.Charge coupled cell (charge-coupled device, referred to as: CCD) be a kind of well-known imageing sensor.Owing to needing the specific fabrication process of CCD, the integrated circuit that therefore comprises CCD will be very expensive.In addition, CCD also causes large power consumption.Recently, a kind of active pixel sensor (Active-Pixel Sensor that produces by the CMOS processing procedure, referred to as: APS) obtain extensive concern, because it has the ability of integrated circuit, for example control circuit, drive circuit and signal processing circuit are integrated into single induction wafer.The benefit of CMOS APS is, compare CCD its have low power consumption and with the processing procedure tool compatibility of its peripheral relevant electronic wafer and lower production cost.
Yet the impact that the image quality of cmos image sensor is subject to noise will reduce its usefulness.These noises comprise thermal noise (being the KTC noise), 1/f noise and fixed pattern noise (fixed patternnoise).Thermal noise is the sampling relevant for view data, and 1/f noise is relevant for the circuit that is used for the enlarged image signal, and fixed pattern noise is then relevant for the inhomogeneities between the row in the pel array.These noises are to cause CMOS APS to have the principal element of the low-dynamic range of lower muting sensitivity or sampling compared to CCD.Improve a wherein method of sensitivity and dynamic range under fixed image speed, increasing as far as possible the time for exposure.
Fig. 1 is the structural representation of conventional images transducer.Please refer to Fig. 1, imageing sensor 100 comprises a plurality of pixel cells 110 that are arranged in row and row.Pixel cell 110 comprises optical diode Pd and transistor T 1～T3.Suppose that interlaced scanning system meets (the NationalTelevision Standards Committee of National Television System Committee, referred to as: the standard of NTSC) formulating, image can be divided into a strange figure (odd field) and show with a bigraph field (even field), and the sampling rate of interlaced scanning system is every figure field 1/60 second.For ease of the explanation, take pixel cell 110 at (X1, Y1) as example, the coordinate of pixel cell 110 is denoted as (X, Y).With reference to Fig. 1, under the control of transistor T 1, the node N1 of optical diode Pd is reset at first to reference voltage Vref, and wherein transistor T 1 is unlocked when alignment RST1 is active.After enough time for exposure, control line RD1 is turn-on transistor T3 initiatively, and so following the optical diode voltage that transistor T 2 translates at node N1 via source electrode can be read out via line RT1.Then, optical diode voltage is with sampled and remain on a correlated double sampling of following (correlateddoubled sampling is referred to as CDS) circuit (not shown).According to above-mentioned principle, the optical diode of every row is exposed to produce voltage signal to corresponding line, with state and the corresponding control line state of responding alignment.
About imageing sensor 100, typical Bayer pattern (Bayer pattern) colored filter is arranged on pixel cell 110, like this each pixel cell 110 sensing red, green, blue either party image information wherein only.In order to make each pixel show full-color image, a kind of algorithm calculations that is called color interpolation (colorinterpolation) must be used on the picture element matrix.Fig. 2 is the pel array schematic diagram from imageing sensor 100 samplings of Fig. 1.Please refer to Fig. 2, take 3X3 picture element matrix 210a as example, three continuous column datas must carry out color interpolation.For convenience of explanation, pixel is denoted as red data (R), green data (G) or blue data (B) in the view data of (X, Y), and wherein view data obtains by sampled picture information.When picture element matrix 210a showed, pixel data was in order to be inserted in the pixel of (X2, Y2) in the crosspoint of three row X1～X3 and three row Y1～Y3.For example, be pixel in the red data of (X1, Y2) and (X3, Y2) in the red data of the pixel of (X2, Y2) average.Green data in the pixel of (X2, Y2) are at (X1, Y1), (X1, Y3), (X2, Y2), the green data of the pixel of (X3, Y1) and (X3, Y3) average.Be average in the blue data of the pixel of (X2, Y1) and (X2, Y3) in the blue data of the pixel of (X2, Y2)
Please be simultaneously with reference to Fig. 1 and Fig. 2, by raster scan (raster scanning) and interlacing scan, pixel cell 110 at strange figure field interval according to X1, X3, X5 ... the order of X511 is scanned and is sampled, and corresponding view data can be obtained to show strange figure field.Then, pixel cell 110 at the bigraph field interval according to X2, X4, X6 ... the order of X512 is scanned and sampled, and corresponding view data can be obtained to show the bigraph field.Only oddly be listed in strange figure field interval and scanned, and only have idol to be listed in the bigraph field interval to be scanned.Significantly, need extra picture buffer to store strange figure field data or bigraph field data carrying out color interpolation, and it has occupied significant cost, and further, color interpolation needs at least three continuation column data, so color interpolation can not be performed immediately.
Please refer to Fig. 1, as for interlaced scanning system, because optical diode Pd can be exposed during time started of the time started of strange figure field interval strange figure field interval to next at every strange row, so the maximum exposure time of pixel cell 110 is 1/30 second.If in interlaced scanning system, use progressive scanning, pixel cell 110 at strange figure field interval and bigraph field interval according to X1, X2, X3 ... the order of X512 is sampled.Therefore, its needs not only at least three line buffers store pixel datas to carry out color interpolation, also need each pixel cell to reduce the time for exposure of half, and so the signal to noise ratio of image will be reduced in dark surrounds.How the maximum by keeping the time for exposure is strengthening the image quality of pixel cell, and the extra cost of getting rid of the picture buffer of interlaced scanning system has become the important topic that the cmos sensor wafer designer must be improved.
Summary of the invention
The invention provides a kind of image sampling method and image processing method of imageing sensor, imageing sensor is by the sawtooth scan pixels sampled unit in the alternate configurations row.This sampling method is applicable to interlaced scanning system and is of value to instant color interpolation then and need not spends the extra cost of picture buffer.
The embodiment of the invention provides a kind of image sampling method of imageing sensor.Imageing sensor is included in a plurality of pixel cells on the crosspoint of multiple row and multirow.At strange figure field interval or bigraph field interval, sampling at Qi Lie with the pixel cell in strange row crosspoint with at the pixel cell of idol row with idol row crosspoint.At remaining bigraph field interval or strange figure field interval, sampling is at the pixel cell in even row and strange row crosspoint with at the pixel cell of Qi Lie with idol row crosspoint.
The embodiment of the invention provides a kind of image processing method.At first, provide an imageing sensor, it is included in a plurality of pixel cells on the crosspoint of multiple row and multirow, and one of them of the image information of each pixel cell sensing red, green, blue.Then, at strange figure field interval or bigraph field interval, sampling at Qi Lie with the pixel cell in strange row crosspoint with at the pixel cell of idol row with idol row crosspoint.In addition, at remaining bigraph field interval or strange figure field interval, sampling is listed as with the pixel cell in strange row crosspoint with at the pixel cell of Qi Lie with even row crosspoint in idol.Then, utilize a plurality of pixel datas in particular block to insert specific pixel to particular block, wherein pixel data is for taking a sample in pixel cell at strange figure field interval or bigraph field interval.
Based on above-mentioned, the invention provides the image sampling method that is suitable for interlaced scanning system sampled picture transducer.In interlaced scanning system, the image of imageing sensor sensing can be divided into strange figure field and bigraph field.Strange figure field comprise sampling at Qi Lie with the pixel cell in strange row crosspoint with at the pixel data of idol row with the pixel cell in idol row crosspoint.Strange figure field comprise sampling at the idol row with the pixel cell in strange row crosspoint with at the pixel data of Qi Lie with the pixel cell in idol row crosspoint.Because the image information of one in the main color of each pixel cell light sensing, the invention provides image processing method and can utilize above-mentioned pixel data in Qi Tuchang or bigraph field is carried out color interpolation, to insert a full-color image at relatively less memory buffer
For above-mentioned feature and advantage of the present invention can be become apparent, embodiment cited below particularly, and be described in detail below by reference to the accompanying drawings.
Description of drawings
Fig. 1 is the structural representation of conventional images transducer.
Fig. 2 is the pel array schematic diagram from imageing sensor 100 samplings of Fig. 1.
Fig. 3 is the schematic diagram of the imageing sensor of one embodiment of the invention.
Fig. 4 A is the pel array schematic diagram that the imageing sensor 300 of Fig. 3 senses.
Fig. 4 B is the corresponding strange figure of the pel array of Fig. 3 schematic diagram.
Fig. 4 C is the schematic diagram of the corresponding bigraph of the pel array field of Fig. 3.
Fig. 5 is the schematic diagram of the element sensor of another embodiment of the present invention.
Fig. 6 is the flow chart of the image sampling method of one embodiment of the invention.
Fig. 7 is the flow chart of the image processing method of one embodiment of the invention.
The main element symbol description:
110,310,510: pixel cell; 100,300,500: imageing sensor;
T1～T3: transistor; Pd: optical diode;
RST1～RST512: alignment; RD1～RD512: control line;
RT1～RT512: line; N1: node;
Vref: reference voltage; 210a, 400: picture element matrix;
410a～410d: block; R1～R512: row;
C1～C512: OK;
S601～S602: the step of image sampling method;
S701～S705: the step of image processing method.
Embodiment
Fig. 3 is the schematic diagram of the imageing sensor of one embodiment of the invention.Please refer to Fig. 3, imageing sensor 300 is included in a plurality of pixel cells 310 in the capable crosspoint of m row and n.Have 512 row (row R1～row R512) at this hypothesis the present embodiment, and 512 row (capable C1～row 512), i.e. m=512, n=512, and imageing sensor 300 is realized by CMOS active pixel sensor (APS).In the content that the present embodiment discloses, R1, R3, R5 ... R511 refers to strange row, and R2, R4, R6 ... R512 refers to even row, and C1, C3, C5 ... C511 refers to strange row, C2, and C4, C6 ... C512 refers to even row.Pixel cell 310 in the imageing sensor 300 is electronic signal in order to translate a light image that focuses on thereon.In order to show image, the image information that pixel cell 310 senses must sampledly obtain corresponding pixel data, again pixel data is carried out post-processed afterwards.The image sampling method of the present embodiment is suitable for interlaced scanning system, and namely image is divided into a Qi Tuchang and a bigraph field and shows.
Please continue with reference to Fig. 3, shown in the dotted arrow among the figure, be positioned at strange row R1, R3, R5 ... R511 and strange row C1, C3, C5 ... the pixel cell 310 in C511 crosspoint, be listed as by chance R2 with being positioned at, R4, R6 ... R512 and idol row C2, C4, the pixel cell 310 in C6...C512 crosspoint is sampled at strange figure field interval.In the present embodiment, pixel cell 310 is sampled by the sawtooth scan in the alternate configurations row.For convenience of explanation, each pixel cell 310 is expressed as (i, j) at i row and the capable crosspoint of j.At the pixel cell 310 of (2x-1,2y-1) and sampled in order at strange figure field interval at the pixel cell 310 of (2x, 2y), wherein x is 1～(m/2) integer, and y is 1～(n/2) integer corresponding to each x variable.For instance, for article one line (being x=1) that forms strange figure field, at (R1, C1), (R2, C2), (R1, C3), (R2, C4) ... the pixel cell 310 of (R1, C511) and (R2, C512) is sampled.For the second line (being x=2) that forms strange figure field, at (R3, C1), (R4, C2), (R3, C3), (R4, C4), ... the pixel cell 310 of (R3, C511) and (R4, C512) is sampled, forms by that analogy strange figure x bar line.
In addition, shown in the solid line arrow, be positioned at idol row R2, R4, R6, ... R512 and strange row C1, C3, C5 ... the pixel cell 310 in C511 crosspoint, and be positioned at strange row R3, R5 ... R511 and idol row C2, C4, the pixel cell 310 in C6...C512 crosspoint is sampled at the bigraph field interval.In the present embodiment, be positioned at the pixel cell 310 of (2x, 2y-1) and to be positioned at the pixel cell 310 of (2x+1,2y) sampled at the bigraph field interval.For instance, for article one line (being x=1) that forms the bigraph field, at (R2, C1), (R3, C2), (R2, C3), (R3, C4) ... the pixel cell 310 of (R2, C511) and (R3, C512) is sampled.For the second line (being x=2) that forms the bigraph field, at (R4, C1), (R5, C2), (R4, C3), (R5, C4), ... the pixel cell 310 of (R4, C511) and (R5, C512) is sampled, forms by that analogy strange figure x bar line.
In the present embodiment, imageing sensor 300 meets Bayer pattern (Bayer pattern), it is one of them the image information of a plurality of main color of 310 light sensings of each pixel cell, for example red (R), green (G), blue (B), and the ratio of red, green, blue is 1: 2: 1 in Bayer pattern.Therefore, each pixel cell 310 can comprise that one arranges colored filter thereon.Fig. 4 A is the pel array schematic diagram that the imageing sensor 300 of Fig. 3 senses.Please be simultaneously with reference to Fig. 3 and Fig. 4 A, by arranging suitable colored filter, the green image informations of pixel cell 310 sensings (G) of the wherein delegation in multirow (for example capable C2), and the pixel cell 310 of per two vicinities, the alternately red image information of sensing (R) and blue images information (B) in the row (for example capable C1) of adjacent row C2.In addition, the pixel cell 310 of per two vicinities, alternately sensing blue images information (B) and red image information (R) in other row (for example capable C3) of contiguous C2.Therefore, one of them pixel data of every red (R), green (G) in the pel array 400, blue (B) is obtained by the corresponding pixel cell 310 of sampling.Generally speaking, often be called as original image by the image that forms such as pel array 400, so color interpolation can be used in suchlike original image to show a full-color image.
As previously mentioned, imageing sensor 300 is sampled by interlacing scan and the sawtooth scan in the alternate configurations row.Embodiment then provides a kind of image processing method of color interpolation.Fig. 4 B is the corresponding strange figure of the pel array of Fig. 3 schematic diagram.Please refer to Fig. 4 B, corresponding strange figure pixel data is by in strange figure field interval pixels sampled unit 310 and obtained.Suppose a specific block, for example 3 * 5 block is used to contain pixel data when color interpolation.At first, when the second line that obtains strange figure, color interpolation is used in the pixel data among 3 * 5 the block 410a.According to above-mentioned scanning sequency at Qi Tuchang, 3 * 5 block 410a is included in (R1, C1), (R2, C2), (R1, C3), (R2, C4), (R1, C5), (R3, C1), (R3, and these pixels are used to insert a specific pixel C3) and the pixel of (R3, C5),, for example in the pixel of (R2, C3), it is the pixel in 3 * 5 block 410a central authorities.For instance, at (R2, C3) the red data of the pixel that is inserted into are the mean value of the red data of pixel in 3 * 5 block 410a, at (R2, C3) the green data of the pixel that is inserted into are the mean value of the green data of pixel in 3 * 5 block 410a, at the mean value of the blue data of the pixel that (R2, C3) is inserted into for pixel indigo plant data among the block 410a 3 * 5.Therefore, the pixel at (R2, C3) comprises full color.
Then, with 3 * 5 block 410a toward moving right delegation and the pixel data among 3 * 5 the block 410b carried out color interpolation.According to above-mentioned scanning sequency at strange figure field interval, 3 * 5 block 410b is included in (R2, C2), (R1, C3), (R2, C4), (R1, C5), (R2, C6), (R3, and these pixel datas are used to be inserted in (R2 C3) and the pixel of (R3, C5),, C4) pixel, it is the pixel in 3 * 5 block 410b central authorities.At the mean value of the red data of the pixel that (R2, C4) is inserted into for the red data of pixel among the block 410b 3 * 5, and at the mean value of the red data of the pixel that (R2, C4) is inserted into for pixel indigo plant data among the block 410b 3 * 5.Can be the mean value of the green data of pixel in the green data of intrinsic pixel of (R2, C4) or the block 410b 3 * 5 in the green data of the pixel that (R2, C4) is inserted into.Therefore, the pixel at (R2, C4) comprises full color.It should be noted that two line buffers or line buffer add several buffer registers and will be enough to store pixel data and use when carrying out color interpolation, and color interpolation can be performed in time almost.
Fig. 4 C is the schematic diagram of the corresponding bigraph of the pel array field of Fig. 3.Please refer to Fig. 4 C, the pixel data corresponding to the bigraph field in pel array obtains by pixels sampled unit 310 at the bigraph field interval.When obtaining the second line of bigraph field, pixel interpolating is used to the pixel data among 3 * 5 the block 410c.According to above-mentioned scanning sequency at the bigraph field interval, 3 * 5 block 410c is included in (R2, C1), (R3, C2), (R2, C3), (R3, C4), (R2, C5), (R4, C1), (R4, C3) and (R4, C5) pixel, and these pixel datas are used to be inserted in the pixel of (R3, C3).After 3 * 5 block 410c was carried out pixel interpolating, the delegation that moves right of the block 410c with 3 * 5 was to obtain 3 * 5 block 410d.3 * 5 block 410d is included in (R3, C2), (R2, C3), (R3, C4), (R2, C5), (R3, C6), the pixel of (R4, C3) and (R4, C5), and these pixel datas are used to be inserted in the pixel of (R3, C4).The mode of pixel interpolating is identical with the embodiment of Fig. 4, therefore repeats no more.
In order to further specify technical scheme of the present invention, at this in addition for the embodiment of an image sampling method.Fig. 5 is the schematic diagram of the element sensor of another embodiment of the present invention.Please refer to Fig. 5, element sensor 500 is included in a plurality of pixel cells 510 (for example m=512, n=512) in the capable crosspoint of m row and n.Shown in the dotted arrow of Fig. 5, be positioned at idol row R2, R4, R6 ... R512 and strange row C1, C3, C5 ... the pixel cell 510 in C511 crosspoint, and be positioned at strange row R1, R3, R5 ... R511 and idol row C2, C4, the pixel cell 510 in C6...C512 crosspoint is sampled at strange figure field interval.Each pixel cell 510 is expressed as (i, j) at i row and the capable crosspoint of j.At (2x, pixel cell 510 2y-1) and at (2x-1, pixel cell 510 2y) is sampled in order at strange figure field interval, and wherein the x variable is 1～(m/2) integer, and the y variable is 1～(n/2) integer corresponding to each x variable.For instance, for article one line (being x=1) that forms strange figure field, at (R2, C1), (R1, C2), (R2, C3), (R1, C4) ... the pixel cell 510 of (R2,511) and (R1, C512) is sampled.For the second line (being x=2) that forms strange figure field, at (R4, C1), (R3, C2), (R4, C3), (R3, C4) ... (R4, C511) and the pixel cell 510 of (R3, C512) sampled, by that analogy, form strange figure x bar line.
In addition, shown in the solid arrow of Fig. 5, pixel cell 510 is positioned at strange row R3, R5, R7, ... R511 and strange row C1, C3, C5 ... the crosspoint of C511, and pixel cell 510 is positioned at idol row R2, R4, R6 ... R512 and idol row C2, C4, the crosspoint of C6...C512 is sampled at the bigraph field interval.In the present embodiment, be positioned at the pixel cell 510 of (2x+1,2y-1) and to be positioned at the pixel cell 510 of (2x, 2y) sampled at the bigraph field interval.For instance, for article one line (being x=1) that forms the bigraph field, at (R3, C1), (R2, C2), (R3, C3), (R2, C4) ... the pixel cell 510 of (R3,511) and (R4, C512) is sampled.For the second line (being x=2) that forms the bigraph field, at (R5, C1), (R4, C2), (R5, C3), (R4, C4) ... (R5, C511) and the pixel cell 510 of (R4, C512) sampled, by that analogy, form strange figure x bar line.
According to above-described embodiment, technical solution of the present invention can be summarized as the following step.Fig. 6 is the flow chart of the image sampling method of one embodiment of the invention.Please refer to Fig. 6, in step S601, at strange figure field interval or bigraph field interval, sampling is positioned at the pixel cell in Qi Lie and strange row crosspoint and is positioned at the pixel cell in idol row and idol row crosspoint.In step S602, at remaining strange figure field interval or bigraph field interval, sampling is at the pixel cell in even row and strange row crosspoint with at the pixel cell of Qi Lie with idol row crosspoint.DISPLAY ORDER that it should be noted that strange figure field and bigraph field is decided by interlaced scanning system.Above-described embodiment take strange figure field early than the bigraph field as example, but the present invention sequentially is not limited with this.
Fig. 7 is the flow chart of the image processing method of one embodiment of the invention.Please refer to Fig. 7, at first, provide an imageing sensor (step S701), wherein imageing sensor has a plurality of pixel cells in the crosspoint of multiple row and multirow.One of them image information of a plurality of main color of each pixel cell light sensing, for example red, green, blue.In step S702, at strange figure field interval or bigraph field interval, sampling at Qi Lie with the pixel cell in strange row crosspoint and at the pixel cell of idol row with idol row crosspoint.In step S703, utilize a plurality of pixel datas in particular block to insert a specific pixel to particular block, wherein these pixel datas are for to take a sample in the pixel data of pixel cell in step S702.In step S704, at a remaining strange figure field interval or bigraph field interval, sampling at the idol row with the pixel cell in strange row crosspoint with at the pixel cell of Qi Lie with idol row crosspoint.In step S705, utilize a plurality of pixel datas in particular block to insert specific pixel to particular block, wherein these pixel datas are for to take a sample in the pixel data of pixel cell in step S704.
In sum, above-described embodiment provides a kind of image sampling method that is applicable to interlaced scanning system, at strange figure field interval and bigraph field interval by the sawtooth scan sampled picture transducer in the alternate configurations row.In addition, in order to show full-color image, from the pixel cell sampling of imageing sensor and by the pixel data that particular block contained, be used in particular block, insert specific pixel at strange figure field interval (or bigraph field interval).Suppose that interlaced scanning system meets standard or phase transition line (Phase Alternating Line that National Television System Committee (NTSC) formulates in the above-described embodiments, referred to as: PAL) system, consequently strange figure field interval and bigraph field interval are 1/60 second (NTSC) or 1/50 second (PAL).Therefore, the time for exposure maximum of imageing sensor can reach 1/30 second (NTSC) or 1/25 second (PAL), namely the time between the time started to the time started of next strange figure field interval of strange figure field interval.In addition, because the pixel data in three continuation columns is for being used for carrying out color interpolation, need jumbo picture buffer to use for carrying out color interpolation to store strange figure field data or bigraph field data compared to the prior art of Fig. 1, above-described embodiment only needs two line buffers or line buffer to add several buffer registers just to be enough to store pixel data and to use when carrying out color interpolation.
It should be noted that at last: above embodiment is only in order to technical scheme of the present invention to be described but not limit it, although with reference to preferred embodiment the present invention is had been described in detail, those of ordinary skill in the art is to be understood that: it still can be made amendment or be equal to replacement technical scheme of the present invention, and these modifications or be equal to replacement and also can not make amended technical scheme break away from the spirit and scope of technical solution of the present invention.
Claims (17)
1. the image sampling method of an imageing sensor, wherein said imageing sensor are included in a plurality of pixel cells on the crosspoint of multiple row and multirow, and described image sampling method comprises:
(a) at strange figure field interval or a bigraph field interval, only only have sampling at Qi Lie with described a plurality of pixel cells in strange row crosspoint with at the described a plurality of pixel cells of idol row with idol row crosspoint; And
(b) at remaining described bigraph field interval or described strange figure field interval, only only have sampling at described a plurality of pixel cells in even row and strange row crosspoint with at the described a plurality of pixel cells of Qi Lie with idol row crosspoint, wherein the figure field interval of remaining described bigraph field interval and described strange figure field interval and step (a) is complementary.
2. the image sampling method of imageing sensor according to claim 1, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (a) also comprises:
Take a sample in order at (2x-1 at described strange figure field interval, pixel cell 2y-1) and at (2x, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
3. the image sampling method of imageing sensor according to claim 1, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (a) also comprises:
Take a sample in order at (2x+1 at described bigraph field interval, pixel cell 2y-1) and at (2x, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
4. the image sampling method of imageing sensor according to claim 1, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (b) also comprises:
Take a sample in order at (2x at described bigraph field interval, pixel cell 2y-1) and at (2x+1, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
5. the image sampling method of imageing sensor according to claim 1, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (b) also comprises:
Take a sample in order at (2x at described strange figure field interval, pixel cell 2y-1) and at (2x-1, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
6. the image sampling method of imageing sensor according to claim 1, wherein imageing sensor meets one of them image information of Bayer pattern and each described pixel cell sensing red, green, blue.
7. the image sampling method of imageing sensor according to claim 6, wherein
In the described multirow green image information of described a plurality of pixel cell sensings of delegation wherein, and the pixel cell of per two vicinities in the row of contiguous described row, the alternately red image information of sensing and blue images information; In addition, the pixel cell of per two vicinities in another row of contiguous described row, alternately sensing blue images information and red image information.
8. image processing method comprises:
(a) provide an imageing sensor, described imageing sensor is included in a plurality of pixel cells on the crosspoint of multiple row and multirow, the wherein image information of one of a plurality of main colors of each described pixel cell light sensing;
(b) at strange figure field interval or a bigraph field interval, only only have sampling at Qi Lie with described a plurality of pixel cells in strange row crosspoint with at the described a plurality of pixel cells of idol row with idol row crosspoint;
(c) at remaining described bigraph field interval or described strange figure field interval, only only have sampling to be listed as with described a plurality of pixel cells in strange row crosspoint with at the described a plurality of pixel cells of Qi Lie with even row crosspoint in idol; And
(d) utilize a plurality of pixel datas in a particular block to insert a specific pixel to described particular block, wherein said a plurality of pixel datas are for to take a sample in described a plurality of pixel cells at described strange figure field interval or described bigraph field interval.
9. image processing method according to claim 8, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (b) also comprises:
Take a sample in order at (2x-1 at described strange figure field interval, pixel cell 2y-1) and at (2x, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
10. image processing method according to claim 8, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (b) also comprises:
Take a sample in order at (2x+1 at described bigraph field interval, pixel cell 2y-1) and at (2x, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
11. image processing method according to claim 8, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (c) also comprises:
Take a sample in order at (2x at described bigraph field interval, pixel cell 2y-1) and at (2x+1, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
12. image processing method according to claim 8, wherein each described pixel cell is expressed as (i, j) at i row and the capable crosspoint of j, and step (c) also comprises:
Take a sample in order at (2x at described strange figure field interval, pixel cell 2y-1) and at (2x-1, pixel cell 2y), wherein the x variable sequentially one by one increases to an integer (m/2) by 1 beginning, and the y variable sequentially one by one increases to an integer (n/2) by 1 beginning corresponding to each x variable, the y variable is 1～(n/2) integer, and wherein m represents the number that is listed as and n represents the number of row.
13. it is red, green and blue that image processing method according to claim 8, wherein said imageing sensor meet described a plurality of main colors of Bayer pattern and light.
14. image processing method according to claim 13, in the described multirow green image information of described a plurality of pixel cell sensings of delegation wherein, and the pixel cell of per two vicinities in the row of contiguous described row, the alternately red image information of sensing and blue images information; In addition, the pixel cell of per two vicinities in another row of contiguous described row, alternately sensing blue images information and red image information.
15. image processing method according to claim 13, wherein step (d) also comprises:
The mean value of described a plurality of pixel datas of one of main color of compute ray is to insert color data as one of described specific pixel.
16. image processing method according to claim 8, wherein said particular block are one 3 * 5 picture element matrix.
17. image processing method according to claim 8, wherein said specific pixel are a center pixel of described particular block.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910206458.1A CN102065245B (en) | 2009-11-13 | 2009-11-13 | Image sampling method and image processing method for image sensor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910206458.1A CN102065245B (en) | 2009-11-13 | 2009-11-13 | Image sampling method and image processing method for image sensor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102065245A CN102065245A (en) | 2011-05-18 |
| CN102065245B true CN102065245B (en) | 2013-02-13 |
Family
ID=44000326
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910206458.1A Expired - Fee Related CN102065245B (en) | 2009-11-13 | 2009-11-13 | Image sampling method and image processing method for image sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102065245B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104243864B (en) * | 2013-06-24 | 2018-11-02 | 格科微电子（上海）有限公司 | The image data read method of imaging sensor |
| CN103714692A (en) * | 2014-01-15 | 2014-04-09 | 深圳市好通家实业有限公司 | User-side communication unit, user-side communication ring and meter-reading message processing method |
| CN111479083B (en) * | 2019-01-23 | 2021-06-25 | 瑞昱半导体股份有限公司 | Image processing method and image processing system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6229578B1 (en) * | 1997-12-08 | 2001-05-08 | Intel Corporation | Edge-detection based noise removal algorithm |
| US6876388B1 (en) * | 2000-02-02 | 2005-04-05 | Taiwan Advanced Sensors Corporation | Interlaced alternating pixel design for high sensitivity CMOS Image sensors |
| CN1783190A (en) * | 2004-11-26 | 2006-06-07 | 三星Sdi株式会社 | Scan driver and organic light emitting display for selectively performing progressive scanning and interlaced scanning |
| CN101266761A (en) * | 2007-03-16 | 2008-09-17 | 联发科技股份有限公司 | Memory buffer access method and image displaying method and system |
-
2009
- 2009-11-13 CN CN200910206458.1A patent/CN102065245B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6229578B1 (en) * | 1997-12-08 | 2001-05-08 | Intel Corporation | Edge-detection based noise removal algorithm |
| US6876388B1 (en) * | 2000-02-02 | 2005-04-05 | Taiwan Advanced Sensors Corporation | Interlaced alternating pixel design for high sensitivity CMOS Image sensors |
| CN1783190A (en) * | 2004-11-26 | 2006-06-07 | 三星Sdi株式会社 | Scan driver and organic light emitting display for selectively performing progressive scanning and interlaced scanning |
| CN101266761A (en) * | 2007-03-16 | 2008-09-17 | 联发科技股份有限公司 | Memory buffer access method and image displaying method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102065245A (en) | 2011-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104822034B (en) | Solid state image pickup device and imaging system | |
| US7193199B2 (en) | Solid-state image-sensing device that compensates for brightness at edges of a display area and a driving method thereof | |
| US7821547B2 (en) | Image sensing apparatus that use sensors capable of carrying out XY addressing type scanning and driving control method | |
| US8570416B2 (en) | Solid-state imaging apparatus with plural readout modes, and electronic equipment | |
| US7679657B2 (en) | Image sensing apparatus having electronic zoom function, and control method therefor | |
| US7399952B2 (en) | Image processing apparatus and image capturing apparatus | |
| US9609253B2 (en) | Solid state imaging device having a shared pixel structure and electronic apparatus | |
| US7821571B2 (en) | Solid-state imaging device, method of driving solid-state imaging device, and imaging apparatus | |
| US8896736B2 (en) | Solid-state imaging device, imaging apparatus and signal reading method having photoelectric conversion elements that are targets from which signals are read in the same group | |
| US10616509B2 (en) | Imaging device and control method thereof, and electronic apparatus | |
| US20100328505A1 (en) | Imaging device, imaging module and imaging system | |
| EP2590413A1 (en) | Solid-state image capture element and image capture device comprising said solid-state image capture element, and image capture control method and image capture control program | |
| JP2006217213A (en) | Method and device for physical information acquisition | |
| US20160205335A1 (en) | Solid-state imaging device | |
| CN102065245B (en) | Image sampling method and image processing method for image sensor | |
| US20150036033A1 (en) | Solid-state imaging device | |
| KR100871687B1 (en) | Solid state image sensing device improving display quality in sub-sampling mode and driving method thereof | |
| US7701498B2 (en) | Solid-state image pickup device, drive method therefor and camera | |
| US8169521B2 (en) | Image sampling method and image processing method thereof | |
| JP5404194B2 (en) | Solid-state imaging device, imaging system, and solid-state imaging device driving method | |
| US8194150B2 (en) | Moving image processing apparatus and video camera apparatus using the same | |
| JP3668604B2 (en) | Solid-state image sensor and image system using the same | |
| JP2009100381A (en) | Solid-state image sensor and method of driving the same, and camera system | |
| TWI423670B (en) | Image sampling method and image processing method thereof | |
| JP2013183439A (en) | Solid-state imaging apparatus and camera system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20130213 Termination date: 20181113 |