CA1175558A - Solid state color imaging apparatus - Google Patents

Abstract

Abstract of the Disclosure A solid state color imaging apparatus is con-structed by combining a solid state image sensor having a plurality of photoelectric elements disposed in two dimensional rows with parallel stripe type color filters having repetition of three or four color-filter-element stripes put in front of the image sensor.
The device is free from hitherto required severe registration between the filter and the solid state image sensor. This is accomplished by selecting relative spatial phase relation between the filtered picture elements of horizontal scanning lines in a manner that the phase relation changes for every horizon-tal lines which are scanned in sequence. The demodula-tion of the chrominance signal to produce NTSC signal is made by using synchronous demodulator.

Description

P44~9 US Ca EP

1 Title of the Invention Solid state color imaging apparatus Background of the Invention 1. Field of the Invention:
The present invention relates to an improvement in a solid state color imaging apparatus.

2. Descri~tion of the Prior Art:
A solid state image sensor is, as is well known, an apparatus for converting objective image to an electric signal. A single chip solid state color camera is an apparatus comprising color filters of different colors in front of the solid state color image sensor, thereby to obtain an objective image on the surface of the solid state image sensor, which produces spatially - modulated chro.minance signal and luminance signal, enabling to synthesize a composite color signal.
On the other hand, the solid state image sensor is a kind of a large scale integrated circuit (LSI), and therefore in order to obtain a high production yield, degree of-the integration of the device should be preferably low. Therefore, the number of the photo-electric el~ements, disposed in a two dimensional pattern on a substrate, that is the number of picture element, should be as small as possible under a condition for attaining a required resolution power of image.

' 1 Accordingly, the way of producing chrominance signal should be that which does not lower theoretical value - of the resolution attainable for the number of picture elements. Many proposals have been made for the modes of the pattern combination between the picture elements and the color filter thereof, and main stream thereof are those using mosaic color filter.
On the other hand, the solid state image sensor are on a stream of higher integration in order to meet a requirement of higher productivity and manufacturing yield, and according thereto the color filter to be combined therewith should also be of higher integrated pattern. This raises a hard problem that manufacture - of the color filter in more highly integrated mosaic pattern is very difficult; and a more hard problem is the registration between the highly integrated picture elements on the solid state image sensor and the highly integrated color filter, a defect of which hitherto has resulted in poor quality of picture signal.

In this respect, an improvement of the solid state color imaging apparatus,wherein the registration of the color filter to the solid state image sensor is easier than conventional system, has been waited for, The problems in the conventional type solid state color imaging apparatus are elucidated referring 1 to FIGs. 1 to 3. FIG. 1 shows a fundamental type appa-ratus which uses a color filter having filter pattern of vertical color stripes comprising repetition of three primary colors in a horizontal direction. The apparatus has a solid state image sensor having a number of photo-electric elements, i.e., picture elements 101 disposed forming vertical rows and horizontal rows, and a color filter having red filter stripes 102, green filter stripes 103 and blue filter stripes 104 disposed in turn.
In the signal produced based on sampling by the picture elements of the objective image which is spatially modu-lated by the color filter stripes, the chrominance signals for colors of the color filter are modulated by respective color filter stripes. The carrier frequency of the chrominance signal is one third (1/3) of the sampling frequency by the picture elements. In such apparatus,,for objective image of a low color purity~ all the picture elements on one horizontal line are sensi-tive, and therefore the sampling of the objective image is made by using all the picture elements on the horizon-tal line. In this case, the band-width of signal of the objective image sampled by picture elements is a half (1/2) of the sampling frequency of the picture elements.
Therefore, the carrier of the chrominance signal is included within the band width of the luminance signal.

1 1755~8 1 In order to avert the undesirable inclusion of the chrominance signal carrier in the luminance signal band, .the luminance signal band width has to be limited under 1/3 of the sampling frequency, resulting in a disadvantage of lowering of horizontal resolution.
In order to remove the above-mentioned shorting of the first conventional type apparatus elucidated in FIG. 1, the assignee corporation ~intended patentee) of the present invention has proposed another type apparatus lo shown by FIG. 2 (Japanese Patent Application No. Sho 51-126592, published in the Japanese Patent unexamined publication Sho 53-50923. In the apparatus of FIG. 2, nH designates an n-th horizontal scanning line of a first field of a frame, nH' designates an n-th horizontal scan-ning line of a second field of the frame, (n+l)H and (n+l)H' designate those of (n+l)-th, respectively, and so on. In this apparatus, by the n-th horizontal scannings a first color differential signal is produced, and by t-he (n+1)-th horizontal scannings a second color differ-ential signal is produced, and so on. Besides, in orderto make average values of liminancé signal of the horizon-tal scannings uniform, each picture elements are divided - into two parts which are covered by different color filters. For example, a picture element 201 of FIG. 2 is covered by red light passing filter element (hereinafter 1 referred as red filter element) 202 and red stopping filter element (hereinafter referred as cyan filter element) 203 and a picture element next thereto is covered by green filter element 202' and cyan filter 203. In this example of FIG. 2, frequency of repetition of the filter elements in the horizontal direction is a half (1/2) of the frequency of repetition of the picture elements in the horizontal direction. Accordingly, the carrier frequency of spatially modulated chrominance lo signal becomes half of sampling frequency sampling the image object, which sampling frequency is determined by number of the picture elements.
As elucidated above, the imaging apparatus of FIG. 2 has advantage of higher resolution than the apparatus of FIG. 1. However, the problem of the con-struction of-FIG. 2 is requiring a mosaic pattern (not of simple stripe pattern) filter and a high accuracy registration of the filter mosaic pattern and the mosaic picture element pattern. The latter requirement of registration the apparatus of FIG. 2 is elucidated in detail further referring to the figures of FIGs. 3(A),

3(B) and 3,(C) exemplifying a small part of the apparatus.
- FIG. 3(A) shows a normal or ideal state where the filter elements and the picture elements are of accurate registration, FIG. 3(B) shows a state where the registration 1 slips off in the horizontal direction and FIG. 3(C) shows a state where the registration slips off in the vertical direction. In these figures, the numerals 301, 302, 303 and 304 exemplify picture elements, wherein the picture elements 301 and 302 are those to be read out in an n-th horizontal scanning of a first field and the picture elements 303 and 304 are those to be read out in an n-th horizontal scanning of a second field of the same frame.

In the normal registration state of FIG. 3(A), the output signals S301~ S302' 303 304 picture elements 301, 302, 303 and 304, respectively are given as follows:

S301 = R + ~Cy~ S302 = G + ~Cy }

303 R + QCy~ S304 = G + ~Cy where R is electric signal based on red light lrradiated through the red filter element.
G is electric signal based on green light irradiated through the green filter element.
2~ ACy is electric signal based on cyan light irra-diated through the cyan filter element. Mark ~ is attached to indicate the electric signal based on cyan-filter which coveres only a small fraction of the picture element.

1 Accordingly, luminance signals YnH and YnH, and the color difference signals DnHand DnH, of resp ~ ive fields become as follows:
nH S301 + S302 = R + G + 2~Cy ~
D = S 1 - S = R - G_ _ l .................. (2).
YnH, S303 + S304 = R + G + 2~Cy ¦
nH' S303 S304 R G J
Thus the luminance signals of respective fields as well as color difference signals of respective fields are equivalent each other in the normal state of registration.
Next, the case of lateral slip off of the registration shown in FIG. 3(B) is elucidated. In this case, signal components dR and dG inherent to small part of different color filters on tXe picture elements appear as shown in FIG. 3(B), and therefore, the output 301h' 302h~ S303h and S304h of the picture elements 301, 302, 303 and 304, respectively, becomes as follows:
301h (R + dR) + dG + ~Cy S302h dR + (G - dG) + ~Cy 303h (R dR) + dG + ~Cy - S304h = dR + (C - dG) + ~Cy J
Accordingly, the luminance signals YnHh and YnH,h and the color difference signals D Hh and DnH,h of 1 respective fields become as follows:
YnHh S3olh S3o2h y DnHh S301h S302h= (R-2dR) - (G -2dG) ... (4).
YnH h S303h + S304h G Y
nH'h 303h S304h = (R -2dR) - (G -2dG
As shown in the above equations, the color difference signals D Hh and DnH,h have second terms -(G - 2dG), in - comparison with the counterparts DnH and DnH, of the equation (2), and this means that the colors differential signals are lowered as a result of the horizontal slip off of the registration.
Next, the case of vertical slip off of the registration shown in FIG. 3(C) is elucidated. In this case, signal components ~R, ~G and ~Cy inherent to small part of different color filter on the picture elements appear as shown in FIG. 3(C), and therefore, the output signals S301 ' S302v' S303V and S304V
elements 301, 302, 303 and 304, respectively, becomes as follows:
S301V R ~R ~Cy ~Cy S302V _ _ _ l --------- ( ) 303v R ~R + aCy + ~Cy ¦

Accordingly, the luminance signals YnHV and YnH,V andthe color difference signals DnHV and DnH, f 1 respective fields becomes as follows:

nHv S301V+S302V= (R+~R) + (G*~G) +2(~cy-~cy) nHv S301V S302v= (R+~R) - (G+~G) ... (6).
YnH'v S303v+S304v= (R-~R) + (G-~G) +2(~Cy-~Cy) DnH'v S303V S304v= (R-~R) - (G-~G) As shown in the above equations, the color difference signals DnHv and DnH,v have different send terms (G+~G) and (G-~G) from each other. And furthermore, the luminance signals YnHV and YnH,V of the equations (6) are different from each other. Such differences between the signals of the first field and the second field leads to consider-able flickering of luminance and chrominance. The same applies to the (n+l)-th scanning.
The above-mentioned lowering of the color - differential signal and occurrence of flickering are shortcomings which is likely to occur in the apparatus using a mosaic type composite filter.
Summary of the Invention In order to solve the above-mentioned problems of the conventional solid state color imaging apparatus, the present invention can provide a novel improved apparatus wherein rather simple stripe filter is used in combination with a mosaic pattern solid state image sensor, thereby-an improved manufacturing p~ductivity and yield are attainable. The invention is made by adopting a novel 1 ~75558 1 theory of analyzing the m~ated color differential signals, and devicing the novel demDdulation method and has been pr ~ d to be advantageous in actual use by experiments.
The present solid state color imaging apparatus comprises:
a solid state image sensor co~prising a plurality of picture elements regularly disposed in two dimensional patterns~the disposition comprising a row of a plurality of horizontal lines, each having a plurality of picture lo elements disposed at a predetermined pitch and order, a color filter comprising a row of plurality of substantially parallel stripes of color filter elements, the row having repetition of stripes of a predetermined number of color filter elements, characterized in that spatial relations between the phase of disposi-tion of the picture elements in the horizontal lines and the phase of disposition of the repetition of stripes of the color filters are changed for every horizontal lines which ar scanned in sequence.
Herein, for every horizontal lines which are scanned in~sequence means that, in an interlace scanning, lines of sequentially scanned fields, for example, n-th line of a first field, n-th line of a second field, (n+l)-th line of the next first field and (n+l)-th line 1 of the next second field,`and so on in such order. Therefore, on the solid state image sensor, the every horizontal lines which are scanned in sequence means every two horizontal lines.
Brief Explanation of the Drawing FIG. 1 is an enlarged front view showing a part of a solid state imaging apparatus of a first prior art using a color filter of vertical color stripes.
FIG. 2 is an enlarged front view showing a part of a solid state imaging apparatus of a second prior art using a color filter of mosaic color filter elements.
FIG. 3(A) is a further enlarged front view showing a part of a solid state imaging apparatus of the second prior art in normal registration state between its solid state image sensor and its color filter of mosaic color filter elements.
FIG. 3(B) is an enlarged front view showing the part of the solid state imaging apparatus of FIG.
3(A) in a misregistration state where its solid state image sensor horizontally slips of its color filter of mosaic color filter elements.
~ IG. 3(C) is an enlarged front view showing the part of the solid state imaging apparatus of FIG.
3(A) in another misregistration state where its solid state image sensor horizontally slips of its color ~ 17~S58 1 filter of mosaic filter elements.
FIG. 4 is an enlarged front view showing a part of a solid state imaging apparatus embodying the present invention.
FIG. 5 is a chart of the embodiment showing spatial relation among dispostion of color filter elements (in A) in a horizontal line, relative light amounts (in B), picture element sensitivities (in C), red chrominance signal (in D),and three chrominance signals (in E).
FIG. 6 is a vector diagram representing phases of three chrominance signals of the embodiment.
FIG. 7 is a block diagram of a signal processing - circuit of the solid state color imaging apparatus of the embodiment of FIG. 4.
FIG. 8 is an enlarged front view showing a part of another solid state imaging apparatus embodying the present invention.
FIG. 9 is a chart of the embodiment showing spatial relation among disposition of color filter elements (in A) in a horizontal line, relative light amounts (in B), picture element sensitivities (in C), resultant color differential signals (in D).
FIG. 10 is a diagram showing relation between 1 frequency spectrum of the luminance signal and phase of the carrier of the chrominance signal for various horizontal lines.
FIG. 11 is a vector diagram representing phases of three chrominance signals of the,embodiment.
FIG. 12 is a circuit block diagram of a signal processing circuit of the solld state color imaging apparatus of the embodiment of FIG. 8.
FIG. 13 is an enlarged front view showing lo a part of still another solid state imaging apparatus embodying tne present invention.
FIG. 14 is a chart of the embodiment showing spatial relation among disposition of color filter elements, relative light amounts picture elements.
FIG. 15 is a vector diagram representing phasès of chrominance signals of the embodiment.
FIG. 16 is an enlarged front view showing a part of st,ill another solid state imaging apparatus embcdying the present invention.
DescriptiGn of the Preferred Embodiments A first example of color filter and solid state image sensor is shown in FIG. 4. me filter ~prises red filter elements 401 which passes red li~ght, green filter elements 402 which passes gree~light and cyan filter elements 403 which stops red light or passes blue light and a bluish part of green light which are lights ~her than red light. mese filter elements 401, 402 and 403 are fo ~ d as ver~-cal stripes and disposed in row sequentially repeating 1 the color of filter elements in a predetermined order, for example, R, G, Cy, R, G, Cy ...... as shown in FIG. 4.
The solid state image sensor comprises a plurality of picture elements 404 on a single semiconductor substrate.
On the semiconductor substrate, the picture elements are disposed in horizontal lines each having picture elements at a predetermined pitch, and a plurality of the horizon-tal lines are disposed parallelly on the substrate.
The spatial phases of the disposition of the picture elements in horizontal lines are repeatingly shifted by 90 for every horizontal lines of sequential scannings.
That is, for the example apparatus, which is for use in ordinary interlace video signal, the spatial phases are shifted by 90 for every two horizontal lines as shown in FIG. 4. In FIG. 4, the lines nH, (n+l)H, (n+2)H ;...
designate horizontal lines to be scanned in the first-field, and nH', (n+l)H', (n+2)H' .... designate horizon-tal lines to be scanned in the second field. Therefore, in actual interlace scannings, the spatial phase of the disposition of scanned picture element shifts every scanning by 90.
The relation between spatial frequency fp of the repetition of the picture elements in the horizontal lines and spatial frequency fc of the repetition of the stripe shaped color filter elements of the color 1 filter is set in a relation of:
. . .
fc = 0 5 fp (7) That is a set of three color filter element stripes are disposed on a horizontal spatial period (i.e., length) of two picture elements, as shown in FIG. 4.
Accordingly, the spatial frequency of a color (for example, red) represented as spatial modulation of the output signal of the picture elements of the horizontal line is 1/2 of the spatial frequency of sampling by the lo picture elements. In other words, the spatial period (length of one repPtition) of a color information represented as the spatial modulation of the output signal of the picture elements of the horizontal line is two times as long as the spatial period of sampli~g by the picture elements. Therefore, there is no fear that the carrier of the chrominance signal is included within the bandwidth .
of the luminance signal, apart from the case of the prior art elucidated referring to FIG. 1. Accor ~ gly, in the apparatus in accordance with the present invention, a high horizontàl resolution is attainable upto the limit expected for the number of picture elements on one horizontal~line.
One wavelength of the carrierof the spatially m~ulated chn~nance signal issued from the solid state image sensor is sampled by two picture elements. Accordingly, the values of the l l755S8 1 chrominan oe signals included in the output signal of the solid state image æ nsor are represented by peak to peak value of the waveforms of spatially modulated chrominan oe signals. That is the values of the chu~¢Lnan oe signals are given as a differen oe of signals from each other neigboring i-th and (i+l)-th picture elements.
Therefore, for n-th horizontal line, the chrominance signal is produced as illustrated in FIGs. 5(A) to 5(E). FIG. 5(A) shows order of dispositions of color filter elemet stripes of red, green and cyan colors. FIG. 5(B) shows relative light amount of red light, green light and cyan light emanating through the color filter elements of respective colors onto the solid state image sensor under a premise that ccntents and amount of incident white light is uniform. FIG. 5(C) shows spatial distribution of sensitivities of the solid state image sensor, represented as an ~l~unt of [signal value/light amDunt]. FIG.
5(D) shows effective distribution of the sensitivity with respect to the chrominan oe signal for the picture elements. Since the chrominan oe signal is given by a differen oe between the output of i-th picture el~ e~-t and the output of (i+l)-th picture element, the efffective sensitivity distribution along the horiaontal line becomes as sown by the curve of FIG. 51D). Ihis distribution coincides with the dis-tribution of the output of the solid state image sensor, seen through a detector taking the frequency of repetition of the color filter as its referen oe frequency. Therefore, the inventors propose a novel doctorine of handling the color signal in the similar way to the synchronizing detector. According to this doctorine, . .

1 the chrominan oe signal is given as the output of the solid state image sensor having effective sensitivity distribution of FIG. 5(D) when the sensor re oe ives a light image having a distribution of spatial modula-tion produ oe d by the color filter element stripes of FIG. 5(A). FIG.
5(E) shows such result~t cwtputs of the sensor, wherein solid line curve R is for red chrl~mLn~n oe signal, dotted line curve G is for green lumanance signal and chain line curve Cy is for cyan chrxxn~3an oe sign~l. FTG. 5(E) shows a cbu~nl~anoe signal of n-th horizontal scanning (nH). m is will be understood by oonsidering the low frequency component of the FIG. 5(E). That is, the low frequency oomponents of FIG. 5(E) comprises positive red signal oomponents, negative green signal oomponents and negative cyan signal oomponents.
m erefoxe, the chrominan oe signal of Fl~. 5(E) is a color differential signal R~Y as will be elucidated later. In the similar way, by con-sidering the spatial relation between color filter elemets disposition and picture elements disposition in (n+l)H ((n+l)-th horizontal scan-ning), the chusmLnan oe signal beoomes B-Y color differential signal.
m e elucidation for FIG. 5 will be made more in detail as follows:
Spatial distributions L of light, which is spatially nodulated by the color filter elemets is given by the following equation:
L = R{aO+alcos(~X+~l)} + G{aO al ( 1 3 + Cy{(aO+alcos(~X+~l+ 23)} ..................... (8).
Fundamental wave component of the distribution of the sensitivity S of the picture elements is given by the following equation:

S = Sl COS(~X + ~2) 18 ll75558 1 Wherein:
R, G and Cy ..... are light amounts of red, greed and cyan lights, - aO and al ....... are constants, ~1 .............. is spatial phase of the color filters, ~2 .............. is spatial phase of the picture elements, ............. is a.spatial angular frequency, Sl .............. is an amplitude of fundamental wave component of the sensitivity S.

lo X ............... is a position on the horizontal line.
Chrominance signal Cs is given by L x Sl as follows:
Cs = L x Sl = aOtR + G + Cy)- Sl cos(~X + ~2) + al R cost~X + ~1) Sl cos(~X + ~2) + al G cos(~X + ~1 ~ 3 ) Sl ( . 2 + al Cy cos(~X + ~1 + 3 ~)- Sl cos( ~2 Since for the chrominance signal Cs Ja low frequency component only may be considered for practical usage, the chrominance signal may be represented as 2G C = 121~(R cos(~ 2)+G cos(~l ~2 3 ) Y 1 2 .3 .~ ... (10).

FIG. 6 shows the relation of the equation (10) in diagram expression, wherein vectors R, G and Cy has absolute value f ~(alSl) R~ 2(alSl) G and 2~alsl).cy~ respective-ly, and has phase difference ~ = ~2 -~1 for the 1 filter's phase ~1 and picture element's phase ~2. In this diagram, signals output from the n-th horizontal scanning are given by the values rl, gl and cyl, which are the lengths of arrows defined by projecting the ~, G and Cy to the reference line A representing the phase of modulation axis by perpendic~ar lines from the tips of the vectors to the line A representing the phase of n-th scanning. Signals out-put from the (n+l)-th horizontal scanning are given by rotating the reference line from A to B by rotating lo by -90, since in the (n+l)-th horizontal line the dispositions of the picture elements are shifted by 90 from spatial period of the n-th horizontal line.
That is, signals output from the (n+l)-th horizontal scanning are given by the values r2~ g2 and cy2, which are the length of arrows defined by projecting the tips of vectors R, G and Cy to the reference line B by perpen-dicular lines from the tips of the vectors to the line B.
From the above-mentio~ed, when ~=0, the vector color differential signals Cs(n+l) and Cs((n+l)H) to be produced by n-th and (n H)-th horizontal scannings are given ,as follows:

Cs(nH) = R 2 ,~ ....................... (11).
Cs((n+l)H) 2 In the doctrine of the present invention, the modulated 1 175~58 1 color differential signals are obtainable by modulating the two vector color signals Cs(nH) and Cs((n+l)H) at phases corresponding to the axis A and B of FIG. 6, respectively. Relation between the phases of vectors of the primary colors included in the modulated signal is that phases of the chrominance signal components (for example, rl and r2) on the modulation axis A and B and the modulation axis A and B is as shown in FIG. 6.
From this relation, according to the doctrine the phase of the vectors of primary color signals R, G and Cy are reproduced by using the phases of the vectors ~, ¢ and Cy, respectively. The above has been elucidation for the chrominance signal.
Hereafter, explanation will be made on the luminance signal.
Output signals rom the solid state image sensor is the signal produced by converting the color lights of FIG. 5(B) from the color filter elements of FIG. 5(A) by means of picture elements of the sensi-tivity of FIG. 5(C). By taking the fundamental wavecomponent of the sensitivity distribution of sensor, the sensitivity S is given by S = S0 + Sl cos(2~X + ~) ................... (12).
Then the output signal Y' of the sensor is given as follows:

1 17555~

1 Y' = LxS=~R(aO+al cos(~X+~l)) + G(aO+al cos(~X+~l- 3) +Cy(aO+al cos( X+~l+ 3)~
x{SO+Sl cos(2~X+~)}
The above equation is calculated as follows:
Y' = S0aO(R+G+Cy) + SOaltR cos(~X+~l)+ G cos(~X+~l- 23~) +Cy cos(~X+~l+ 3)}
+SlaO(R+G+Cy) cos(2~X+~) +Slal{R cos(~X+~l)+G cos(~X+~l- 23) lo + Cy cos(~X+~l+ 3)} cos(~X+~) .......... (13).

Then, by passing the above-mentioned output signal through a low-pass filter to remove the higher fre-quency components represent by the second terms and subsequent in the equation (13), the luminance signal Y is obtained as follows:
Y = S0aO(R+G+Cy) .............................. (14).
This relation holds regardless of the spatial relation between the picture elements and the color filter elements.
As has been elucidated for the example apparatus of FIG. 4 by referring to FIGs. 5 and 6, the inventor theoretically confirmed that by shifting the spatial phase of the horizontal line of the picture element every sequential horizontal scanning by an 1 spatial phase shift of 90, a pair of spatially modu-lated signals each consisting of a color differential signal and a luminance signal are obtained.
The above-mentioned constraction of the solid state imaging apparatus is especially advantageous for such solid state image sensor having very small gaps between picture elements in the horizontal direction, for instance, for an apparatus where nesa films are accumulated. Especially for such apparatus, the sensi-lo tivity distribution of the picture elements is closely analogous to the above-mentioned premises or simulation, and therefore, the theory is well exemplified, Experiments confirmed that the chrominance signals and the luminance signal of the example of the above-mentioned construction has fundamentally no dependence on the horizontal slip off of the horizontal color filter elements disposition against the horizon-tal picture elements disposition. Of course, for the vertical spatial siip of.f of the color filter to the solid state image sensor, there is no undesirable result since the filter has only vertical stripes of filter ele,ments. Therefore, manufacturing yield as well as manufacturing productivity is drastically improved.
The above-mentioned explanation has been 1 made for the color filter disposition shown in FIG. 4 where R, G and Cy color filter elements repeatedly disposed. Replacement of the filter element order, for example, to R, Cy and G may be made, then the above explanation applies only by replacing those for the colors Cy and G each other.
The color of the filter elements are not limited to R, G and Cy, but any other combination is possible, when the chrominance signal is spatially modulated with the 120 phase difference. For example, color filter elements of complementary color to these primary colors may be used. Furthermore, though not very excellent on the aspect of color reproduction, a blue filter in place of the cyan filter in the above-mentioned example may be usable.
In the above-mentioned example, the picture elements of the horizontal lines are disposed in a manner that their spatial phases are shifted by 90 every lines of actually sequential scanning line. In the solid state imaging apparatus, the chrominance signals are produced based on the relative spatial phase relat~on between the horizontal disposition of color filter elements and horizontal disposition of picture elements. Accordingly, by disposing the picture elements in a manner that their horizontal spatial 1 phases differ every horizontal lines, necessary two chrominance signals required to compose a composite color differential signal is obtainable therefrom.
Accordingly, the phase shifting angles between the subsequently scanned horizontal lines are not necessari-ly limited to 90, but other angles can be usable by suitably selecting the phase of the modulating axis for producing a modulated color difference signal from the chrominance signals.
lo Next referring to FIG. 7, which is a block diagram of an example of a signal processing circuit for processing the output signal of the solid state imaging apparatus of FIG. 4.
Solid state image sensor 701 is driven by a vertical driver circuit io2 and a horizontal driver cir-cuit 703 which are synchronized by horizontal and vertical synchronizing signals from a synchronizing signal gene-rator ( hereinafter synch. generator ) 717, respectively, and issues output signal Is. The output signal Is is led through a first low-pass filter ( hereinafter LPF(l) ) 705 and results in to issue luminance signal Y. And the'output signal Is is also led through a band-pass filter ( hereinafter BPF ) 707 and results in to issue a spatially modulated chrominance signal C. The chrominance signal C is detected by a synchronous 1 175~58 1 detector ( hereinafter DET(2) ) 710 and results in producing a low band signal. Since the chrominance signal C is given in the form of difference of chro-minance signal, the resultant detected signal becomes a color differential signal. That is, the chrominance signal is given in the form of color differential signal.
On the other hand the output signal of the BPF 707 is given to a lH delay circuit 708, whose out-put is then given to another synchronous detector (i.e. demodulator) ( DETtl)) 709.
The modulated color differential signal C
comprises two color difference signals R _ G 2 Cy and (G - Cy) which appear alternately every horizontal scanning. Therefore, at an instant during a horizontal scanning, at either one of the output signal (color differential signal) of the DET(l) 709 and the output signal of the DET(2) 710 is the first color differen-tial signal R _ G 2 Cy and the output signal of the other one is the second color differential signal (G - Cy); and in the next horizontal scanning the color differential signals are interchanged each other.
These two output signals are led to the switching circuit 711 which changes over the output signals of DET(l) 709 and DET(2) 710 at every gap period between l 175~5~

1 the horizongal scanning. By the interchanging switching action by the switching circuit 711, the first color differential signal CDl of R _ G 2 Cy and the second color differential signal CD2 of ~ (G - Cy) are isolated and issued from a first output terminal CDl and a second output terminal CD2, and they are given to a first color temperature compensation circuit 712 and a second color tempe~ature compensation circuit 713, respectively. The color temperature compensation circuits 712 and 713 are known circuits for compensating the color temperature so as to become zero output when the objective image is white. The output signals of . the first and the second color temperature compensation circuits are then given to an encoder 714. Th~e encoder circuit 71.4 composes known NTSC video signal by utilizing color-compensated two color differential signals and the luminance signal Y from the LPF(l) 705.
In the composite signal formed by the above-mentioned process, the output signal is produced from the scanning lines which alternately changes spatial phase every scanning lines, sincé the spatial phases .. , .. ,.. ._ ,_ .. _ . . . . _ . . _~ _ .. _ . . -._ . .. _ ... .

117~558 1 of disposition of the picture elements are shifted by 90 every scanning lines, with respect to the spatial phase of the frequency of a half(2) of the sampling frequency of the picture elements. Therefore, if such signal is used without spatial compensation for the phase shift every alternate horizontal scanning, the reproduced image therefrom will have zigzag image such that a straight vertical line will be deformed to a zigzag line by shifting of spatial position every horizontal scanning lines. In order to avoide such deforma-tion of the image to be reproduced, a horizontal drive circuit 703 gives shifts of the starting points for every two horizontal scannings. By such shifts of the horizontal scannings, the composed NTSC video signal becomes free from the zigzag deformation due to the spatial shifts of the picture elements.
Reference signal, a signal of a frequency, which is ~ of the horizontal driver output, to be given to the synch. DET(2) 710, is given from a first 2 frequency divider 704,- in synchronism to the hori-zontal scanning. That is, a signal of color filter repetition~ frequency in synchronism to the picture elements output signal is sent to the DET(2) 710.
Phase relation between the reference signal, modulated color differential signal C and delayed . . .. : .. . _ .. , . . _ .. . . . .

11755~8 1 modulated color differential signal DC from the lH
Delay circuit 708 are shown in the following table.
Table Phase of Phase of Phase difference Horizontal msdulated Phase of color- be = e signal sc~ng differential sig ~ bo differential to DET(l) and signal C DET(2) signal DC to DEr(2) F

nH 0 90 + 9oo 10(n+l)H 90 9oo 0 - 9oo (n+2)H 0 0 90 + 9oo . (n+3)H 90 9oo 0 - 90 The reference signal obtained by the frequency divider 704 for DET (2) 710 can not be used for the reference signal for DET (1) 709 as it is, but must be shifted of the phase so as to~ coincide with the phase of modulated color differential signal DC in order to be used for DET (1) 709. The shift is made by a phase shifter`716. Instead of using such phase shifter, the similar function is obtainable by shifting the phase,of the input carrier of DET(l) 709 or by shifting the phase of the output of the DET (1) 70g.
Since the phase shifter 716, the horizontal driver 703 and the encoder 713 are all alternatingly 1 switched every two horizontal scannings (that is the frequency of the switching of these circuits is 2 f the frequency of the horizontal scaninnings), the synchronizing signal for the switching is given by dividing the horizontal scanning frequency by the -frequency divider 715 which is synchronized by the synch, generator 717.
In the above-mentioned first example, spatial phase of the horizontal line of the picture elements is shifted by 90 every horizontal scanning line, in order to realize a mutual relation between the phase of disposition of the picture elements in the horizontal lines and the phase of disposition of the repetition of stripes of color filters, in such a manner that the relation is changed for every horizontal lines which are scanned in sequence.
In order to realize the above-mentioned mutual relationship, instead of the shifting of spatial phase of the horizontal line of picture elements, the other one, namely, the spatial phase of the filter elements may be shifted relative to that-of the picture elements. 'FIG. 8 shows such latter example of shifting the spatial phase of the filter elements with respect to the picture elements in the horizontal lines. As shown in FIG. 8, the stripe shaped color filter 1 175~58 1 comprises red filter elements 801, green filter elements 802 and cyan filter elements 803 forming parallel oblique stripes thereof repeating in the order. The parallel oblique stripes are disposed in such angle that the spatial phase relations with respect to the picture elements in horizontal line are shifted between *he n-th horizontal line and (n+l)-th horizontal line by 90, and also by 90 between the (n+l)-th and (n+2)-th. The spatial repetition frequency ff of the filter elements on a horizontal line is half the spatial frequency fp of the dispositions of the picture elements in horizontal lines, that is ff = 0.5 fp.
As a result of the above-mentioned construc-tion of the relation between the filter elements and the picture elements, for n-th line, the chromiance signal is produced as illustrated in FIGs. 9(A) to 9(E).
FIG. 9(A) shows order of dispositions of color filter element stripes of red, green and cyan colors.
FIG. 9(B) shows relative light amount of red light, green light and cyan light emanating through the color filter elements of respective colors onto the solid state image,sensor under a premise that contents and amount of incident white light is uniforrn. The three lights are spatially disposed with phase differences of 120 between each other. FIG. 5(C) shows distribution 1 of sensitivites of the solid state image sensor, represented as an amount of [signal value/light amount].
FIG. 9(D) schematically shows level and spatial phases of the chrominance signals ERj EG and Ecy for red, green and cyan colors in a way such that the height of the vertical arrows show value of output chrominance signal designated in the chart, position of the arrows represent center o spatial distribution of the chro-minance signal, and oblique lines connecting the arrow tops showing the change of the values for red signal (by solid lines), green signal (by dotted lines) and cyan signal (by chain lines).
The spatial phase relations of the color filter elements against the picture elements in hori-zontal lines are indicated by ~R~ ~G and ~Cy for red, green and cyan color filter elements. As has been stated, the three color filter elements are disposed in spatial phase differences of 120 each other, and therefore, when the ~R is selected as ~R=~O' other phases are represented as aG=~ Cy=~+3~ FIG. 5(D) shows the case where ~O=0 Signal Pl issued by the first picture element 804 and signal P2 issued by the second picture element 804' on the n-th horizontal line of the picture elements are, taking account of areas of the respective color - I ~75558 1 filter elements covering the picture elements 804 and 804', represented as follows:

Pl = ER + 4 EG 4 Cy P2 4 EG + 4 ECy } ......................... .(15).

For the picture elements disposed on the right hand of the picture elements 804' and subsequent, the above signals appear repeatingly.
- Therefore, by scanning the n-th horizontal line the following signal Sn is produced for the n-th horizontal line as a function of time t:
Sn-~ (l+cos ~t)+ G(1-21cos ~t)+ ~ (1-21cos ~t) = 2(ER+EG+Ecy)+(ER_ 2 ~ ~ )cos ~t. ........ (16).
From the above equation (16), it is understood that the picture element output signal contains,in the fundamen-tal component thereof"a iuminance signal part (ER+EG+ECy) and a chrominance signal part (ER~ 2 ~
The above-mentioned explanation has been for the case Of ~=r but, in general, the situation is as follows:
The spatial and spectral light distribution of light produced by the color filter elements can be represented as follows~
L(x)=R{aO+al cos(~X+~)J+G{aO+al cos(~X+~-3~)}

+Cy { aO+al cos (~ +e+31r ) }

1 =aO(R+G+Cy) +altR cos(~X+~)+G cos(~X+~-3~)+Cy COS(~X+~+3~)}
..... (17).
Hereafter, for the sake of simplicity of explanation, let us provide that the constants aO and al in the above-mentioned e~uation (17) are aO = al = 1. Then, the above-mentioned spatial distribution becomes:
L(x)=(R+G+Cy)+tR cos(~X+~)+G cos(~X+~-3~)+Cy cos(~X+~+3~)}
..... (18).
lo As a result of emanation by the above-mentioned light L(x)~ the electric output signal S of the solid state image sensor when scanning the line at a certain speed is given as:
S 2(ER EG Ecy~
+2-tER cos~+EG cos(0-3~)+Ecy cos(~+3-~)~ cos~t ..... (19).
Since the spatial interrelation between the color filter element disposition and the picture element disposition in every horizontal scanning lines is shifted by 90 every actual scanning lines, when the phase difference ~ in nH(n-th horizontal line) is ~=0, the phase difference of (n+l)H ((n+l)-th horizontal line) is 90, that for nH'(n-th horizontal line in the next fieldj is 45 and that for (n+l)H' ((n+l)-th horizontal line in said next field) is 135.
Furthermore, by the similar rule, the phase 1 difference in the (n+~)H ~(n+2)-th horizontal line) is 180, (n+3)H
((n+3)-th ho_izontal line in) is 270, and so on ...; and in the phase differences of 180 to 360, the signal becomes a repetition with inverse pol æ ity to the signal of 0 to 180, and accordingly the elucidation will ~e made only for the phase differences of 0 to 180 inclusive. Uhder the providing, the signals output fram the horizontal lines æ e those having ~ of 0 (for nH line), 45 (for nH' line), 90 (for (n+l)H' line) and 135 (for (n+l)H' line). FIG.10 is a diagram shDwing a relation between the spectral distribution of the lunL~L mce signal Y and phase differen oe of the carrier of the ct~IIuuYLnoe slgnals ER, EG and Ecy, for the ~lrrA?~oentioned various 6-angles. In the diagrams of FIG.10, for the curve Y representing the spectral distrubution of the l~n~Y~noe signal, the ordinate indicates - relative level and the abscissa indicates frequency, and the arrows ER, EG and EC ~ which represent spatial phase of the color filter elements, and arrows rn, gn, cyn, rn, gn, cyn, rn+l' gn+l and cyn+l, which are electric signal oomponents oontained in the modulated signals f m m the image sensor and based on the lights emanating through the color filters ER, EG and Ecy, the horizontal axes indicate 0 reference line. In FIG. 10, the points fc represent carrier fi~Y~l~n~y of the ch4ln~rnce signal. As has been elucidated, the fulxL~nental wave p æ t of the output signal of the picture ele-ments k~xlnes the signal of sum of the signals ER, EG and Ecy which æ e based on the lights emanated thereon through respective color fil~r elements, and accordingly, the fundamental wave part can be 1 17~558 1 used as the luminance signal.
As has been shown by the equation (19), the luminan oe part or the first term ER+EG+Ecy is free from the phase difference ~1' and in principle, the luminance signals are uniform when the same white uniform light emanate the apparatus. In case of ordinary objective image of low color purity, where the sampling is made in all the picture elements of horizontal lines, the luminance signal has a broad band width reaching to half of the sampling frequency.
In the mLdulated chlxlnLnance signal, as can be under-stood from the equation (19) the carrier appears at a frequencyhalf the sampling frequency of the picture elements, and acoordingly, the modulated chllm l-ance signal appears as follows with respect to the spatial phase difference e between the picture elements and the oolor filter elements.
For example, the mLdulated color chu~nLnance signal is represent by (nH) of FIG. 10, when the phase difference ~= 0, and the value of the respective chr~n¢Lnance signals rn~ gn and CYn are obtained as values defined by projecting with a horizontal lines tchain lines) from the tops of vecbor arr~ws ~ , EG and Ecy per-pPndicularly to the dotted vertical line which represent phase ofthe picture elements disposition. Values of the ~Ldulated oolor differential signal in FIG. lO(nH) became rn gn CYn~ tha {ER+EG oos(- ~)+ EC cos(~)}, which coincides with the 1 175~8 1 aforementioned explanation by equation (19).
In the similar way the modulated color differential signals for other horizontal line is as follows:
for nH' line ........... rn + cYn ~ gn for (n+l)H line ........ cyn+l gn+l for tn+l)H line ........ cyn+l gn+l rn+l As shown above, different modulated color differential signal is obtainable from respective horizontal scanning lines, and these signals are obtained in the form of color differential signals.
The modulated color differential signal obtained in the above-mentioned forms are obtained by synchronous demodulation by using reference signals of respective phases corresponding to the horizontal scanning lines shown in FIG. 11, so that the chrominance signals ER,-EG and Ecy with 120 phase difference each other is produced. The demodulation is made by using reference signal of a phase represented by the direction of nH of FIG. 11 for modulated color differential signal of nH scanning line, and by using reference signal of~a phase represented by the direction of (n+l)H for modulated color differential signal of (n+l)H. The phase of nH direction and (n+l)H direc-tion have right angle between each other, and a signal 1 175~58 1 of (rn-gn-cn) is produced by the demodulation by using the reference signal of nH phase shown in FIG. 11, and another Signal (CYn+l ~ gn+l) is produced by the demodu-lation by using the reference signal of (n+l)H phase shown in FIG. 11. The demodulated signal based on the light from the red filter is determined by rn and is reproduced at the position of ~'. Similarly, demodu-lated signal based on the light from the green filter . lo is determined by gn and gn+l and reproduced at the position of G"; and demodulated signal based on the light from the cyan filter is determined by CYn and cyn+l and reproduced at the position of Cy~. In the similar way, for the modulated color differential signal in the nH' line (n-th horizontal scanning in the next field), the demodulation can be made by using the reference signal of nH' phase shown in FIG. 11, for reproducing the signals of R", G~ and Cy"; and for the modulated color differential signal in the (n+l)H' line ((n+l)-th horizontal scanning in said next field), the demodulation can be made by using (n+l)H' phase shown in FIG. 11 to reproduce the signals R", G" and Cy~ . . .
In summarizing the example of the construc-tion of FIG. 8, as shown by FIG. 10, the solid state image sensor issues a luminance signal, having a band 1 width of half of the frequency of sampling of the picture elements, and two kinds of modulated color differential signals alternatingly every horizontal scanning. The two kinds of the modulated color dif-ferential signals become inversed of their polarity every two horizontal scannings. The modulation phase of the modulated color differential signals shifts by 45 every fields. Therefore, by changing the polarity of the above-mentioned two modulated color differential signals every two horizontal scannings, delaying the modulated color signals for one horizontal scanning period respectively and interpolating the modulated color signals with the delayed same kind signals to produce two kind of continuous modulated signals, and- by shifting the phase of the reference signal of the demodulator by 45 every field, then the luminance signal having the theoretical resolution determined by the number of picture elements, as well as two color differential signals are obtainable.
In the example, even when the color filter makes misregistration of horizontal or vertical slip to the picture elements, the video signal can be rightly produced as follows:

1 When the registration is lost, the spatial phase relation is changed due to the slip from the designed spatial relation. Accordingly, as can be seen from the foregoing elucidation, the phase change modifies the modulated color differential signals. Then, by shifting the phase of the whole phases of referenoe signal of the demodulator shown in FIG. 11 responding to the amount of the phase shlft, the demodulated vectors R", G" and Cy" of primary colors can be obtainable at the right position. There-lo fore, as a conclusion, there is fundamentally no needto align the color filters and solid state image sensors in vertical and horizontal directions.
In the actual solid state imaging apparatus, gap spaces around the picture element has a certain size, and excessive in-uniformity of the picture element sizes causes in-uniformity of the luminance signal.
However, in actual solid state imaging sensors, where the horizontal gaps between the picture elements are designed narrow, or where the horizontal gaps are negligibly small by adoption of photoconductive films accumulation, effects of such gaps are negligibly small.
FIG. 12 is a block diagram of an example circuit for processing output signal of the solid state image sensor of FIG. 8. In the circuit of FIG. 12, a solid state image sensor 1201 is driven by a vertical 1 driver 1202 and a horizontal driver 1203, which is synchronized by a synch. generator 1804, and issues out-put signalz which is synchronized by the horizontal and the vertical synchronizing signal. The sensor output signal is led through a low-pass filter (LPF(l)) 1205 having a cut-off frequency half of the frequency of the sampling of the picture elements (usually identical to the horizontal driving frequency), and issue the lumi-nance signal thereby. On the other hand the same sensor output signal Z is led through a band-pass filter (BPF) 1206 to issue the modulated color-differential signal thereby. The output modulated color-differential signal M is then demodulated by a first synchronous detector (DET(l)) i207 by using output signal H from a - horizontal driver 1203 and passed through a third phase shifter (3) 1226 as reference signal, thereby prcducing a oolor differ-ential signal Cl. Cn the other hand, ao~Ir referenoe signal is led from a synch. generator 1204 through a one-horizontal-scanning-time delay CiICUit (lH Delay) 1228 and through a f~h phase shifter (4) 1227 to a second synchronous detector (DET(2)) 1209.
Thereby, the outputs Cl and C2 of the demodulators 1207 and 1209 ch'ange their phases every two horizontal scan-nings, and is aligned of their phase inversions of color differential signals occurring every two horizontal scanning lines. Control signal Cp to be applied to the fourth phase shifter (4) 1227 has a phase lag of 1 17555~

one horizontal scar~ning li~le from that applied to the phase shifter (3) 1226, as a result of its passing through the lH delay circuit 1228, in order to meat the time differenoe between the modulated color differ-ential signals to be given to the deTr~dulators DET(l) 1207 and DET(2) 1209. Qn the other hand, n~dulated color differenoe signal M is led through a one-horizontal-scanning-period delay circuit (lH Delay) 1208 and fed to the synchronous detector (DET(2)) 1209 to produce color difference signal C2, which is the signal equivalent to but lags by one 10 horizontal scanning period from the other color differ-ential signal Cl.
The color differential signals comprise a pair of color differential signals appearing alternately for every horizontal scanning period (for example, ER-0.5(EG+ECy) and 0.75(ECy--EG) in the first field, as well as, 0.71ER+0.26ÉCy--0.97EG and 0.97ECy--0.71ER--0.26EG in the second field in the case of FIG. 10, and accordingly, by changing over these signals by a switching circuit 1210 (which changes over every horizontal line periods) 20 continuous two color differential signals C3 and C4 are produced. (For example, the color differential signal C3 ~s ER--0.5(EG+ECy) or 0.71ER+0.26EC --0.97EG and the other color differential signal C4 is 0.7(ECy--EG) or O . 97Ecy--O . 71ER~ . 26EG. ) The two color differential signals are led 1 through a color-temperature-compensation circuit 1211, the color-compensated outputs C5 and C6 from the circuit 1211 is modulated by a first modulator (MOD(l)) 1220 and a second modulator (MOD(2)) 1221, respectively, and further, the modulated signals are led to a mixer 1225, wherein an NTSC video signal is composed. Hereupon, the color differential signals C5 and C6 to be given to the modulator 1220 and 1221 are the color differen-tial signals which change every field, and in one field the two color differential signal therein C5 and C6 have two modulation signals having phases different by 90 from each other. In order to align the phase differenoe, the phases are shifted by the phase shifter (2) 1224 by 90 after every field and led to the modu-lators 1220. Further, the phases of the modulated signals are shifted by the other phase shifter (l) 1-223 by 45 after every field and led to the modulator (1).
By the above-mentioned phase compensations, the phases of the outputs of every fields included in the composed NTSC signal are made substantially uniform. In other words, differences between modulated color difference signals of'respective fields are substantially elimi-nated, by means of setting different phases of modulation signals for different modulated color differential signals C5 and C6 of respective fields.

1 The above-menti~ color-temperature ~D~ensation circuit 1211 modifies luminance signal YL prepared in a color tempera-ture c~rpensation circuit 1211, wherein the signal Z is led through a second low pass filter LPF(2) 1212 in order to give the same band-width to the modulated color differential signal, to produce the modulated color differential signals C3 and C4. Hereupon, the modulated color difference signals C3 and C4 are those alternately changes each other every field. Accordingly, the signal YL is changed to color-temperature-compensated signals actually to be added to the modulated color differential signals C3 and C4 having respective phases of modulation signals of respective fields. This is done by leading the signal YL to the gain control circuits nB(l) 1213, WB(2) 1214, WB(3) 1215, and WB(4) 1216 and further to the change over switching circuit (lH SW) 1210 ~7hich switches after every horizontal scannings, and to the adders (ADD(l)) 1218 and (ADD (2) ) 1219. The gain control circuits are those gains thereof can be adjusted from a small value, lower than 1 to a large value, higher than 1 and polarity thereof can be also changeable.
As has been elucidated referring to FIG. 8 through FIG. 12, the output signal of the solid state image sensor emanated through oblique-stripes color filter elements is processed by the circuit of FIG. 12, 1 175~58 1 and can produce ordinary NTSC video signal.
Another example utilizing complementary colors stripe filters on the mosaic-disposed picture elements on a solid state image sensor is elucidated referring to FIGs. 13 to 15.
FIG. 13 shows such example wherein spatial phases of the picture elements in horizontal lines are shifted alternately after every two lines.
In FIG. 13, the filter comprises vertical lo stripes of white (W) (or transparent) filter elements 1301 which passes substantially all spectral component of light, cyan (Cy) filter elements 1302 which stops red light component, green (G) filter elements 1303 which passes green light component and yellow (Ye) filter elements 1304 which stops blue light component in repeating order.
The solid state image sensor covered thereby comprises a number of mosaic-disposed picture elements 1306, 1307, 1308, 1309, 1310, 1311, 1312, 1313, .
The picture elements 1306 and 1310 are in the nH
scanning line which is n-th scanning line in the first horizontal'field. The picture elements 1307 and 1311 are in the nH' scanning line which is n-th horizontal scanning line in the second field. The picture elements 1308 and 1312 are in the (n+l)H scanning line which 1 is (n+l)-th horizontal scanning line in the first field. The picture elements 1309 and 1313 are in the (n+l)H' scanning line which is (n+l)-th horizontal scanning line in the second field. The spatial phases of the disposition of the picture elements in the horizontal lines are repeatingly shifted by 90 every horizontal lines of sequential scanning. That is, for the example apparatus, which is for use in ordinary interlace video signal, the spatial phases are shifted 90 -for every two horizontal lines as shown in FIG. 13.
In FIG. 13, the lines nH, (n+l)H, (n+2)H .... designate horizontal lines to be scanned in the first field, and nH', (n+l)H', (n+2)H' .... designate horizontal lines to be scanned in the second field. Therefore, in actual interlace scannings, the spatial phase of the disposition of scanned picture element shifts every scanning by 90.
The relation between a spatial frequency fp of the -repe*ition of the picture elements in the horizontal lines and spatial frequency ff of the repetition of -the stripe shaped color filter eléme~ts of the color filter is~set in a relation of:
ff = 0.5 fp ......................... (20).
That is a set of four kinds of color filter element stripes are disposed on a horizontal spatial period 1 17~558 1 (i.e., length) of two picture elements, as shown in FIG. 13. Accordingly, the spatial frequency of a color (for example, red) represented as spatial modulation of the output signal of the picture elements of the horizontal line is 1/2 of he spatial frequency of sampling by the picture elements. In other words, the spatial period (length of one repetition) of a color represented as the spatial-modulation of the output chrcminance signal of the picture elements of the horizontal line lo is two times as long as the spatial period of sampling by the picture elements.
FIG. 14 shows how the output signals of the solid state imaging apparatus of FIG. 13 is and its resultant signals.
FIG. 14(A) shows order of dispositions of color filter element stripes of white, cyan, green and yellow colors. FIG. 14(B) shows relative light amount of red light, green light and blue light emanating through the colQr filter elements onto the solid state image sensor under a premise that contents and amount of incident white light is uniform. For example, red light passes white filter elements and yellow filter elements and is stopped by the cyan filter elements and green filter elements. Therefore, the distribution of the red iight under the color filter elements ..... . , ... .. _ . . . .. ... . .. .. _ . . .

1 becomes as shown in FIG. 14(B), R, that is the spatial frequency of the red light is half the spatial frequency of the picture element disposition, and the duty of the signal based on the red light becomes 50%. Green light passes all the color filter element of the above-mentioned filter and blue light shows similar spatial dlstribution to that of the red light, but lagging from that of red light by 90. Under the above-mentioned condition, the output signals S406~ S410' S408 and S412 the picture elements 406, 410, 408 and 412, respectively are as follows:
S = lR + G + B

- + 1- ........ (21).

-- -- + lB

Therefore, the output signal SnH produced by nH (n-th horizontal scanning in the first field)` is given as follows:
SnH = S406 + S410 + (S406 - S41d) sin~t = (R + 2G + B) + B sin~t ............... (22).
In the same manner the output signal S(n+l)H produced by (n+l~H ((n+l)-th horizontal scanning in the first field) is given as follows:
S = S + S + (S - S ) sin~t = (R + 2G + B) + R sin (~t + 2) (23).

_ __ 1 As is shown in the equation (23), the output signal from the solid state imaging signal has a low frequency component (R+2G+B), to which R sin(~t+~2) or B sin~t alternately are superposed depending on the order of horizontal scanning of n-th (wherein the added signal is B sin~t) or (n+l)-th (wherein the added signal is R sin(~t+2)) line. In other words, by passing the sensor output signal through a low pass filter a luminance signal is produced, and by isolating the lo modulated chrominance signals, red and blue chrominance signal is produced in alternate horizontal scannings;
and by processlng and composing these signals, NTSC
video signal is obtainable.
In the case of a solid state color imaging apparatus using stripe-shaped filter having stripe shaped color filter elements, the relation between the spatial dispositions of solid state image sensor and the spatial distribution of the color filter elements is as follows:
When the registration between the color filter elements and the picture elements shifts in the vertical direction, there is no problem since the color filter has vertical stripes only. ~
When the registration between the color filter elements and the picture elements shift in the horizontal , . . . . . . . . ... .

~ 49 1 1755~8 1 direction, since the duties of the spatially modulated chrominance signals are 50% and the filter element's spatial frequency is half of the picture element's spatial frequency, low frequency component of the output signal is unchanged irrespective of the horizontal registration. In this horizontal shift, the spatially modulated chrominance signal components are considered as follows.
As shown by FIG. l5(A), the spatially modulated red signal R and blue signal B have phases different by 90 to each other. And, the phases of the picture elements of n-th horizontal line and (n+l)-th horizontal line have 90 angle inbetween. Therefore, the shift angle ~ between the color filter elements and the picture elements is compensated by a rotation of the phase of modulation signal as shown in FIG. 15(B).
For ex~ple, when an objective image ha ~.~ a color of a phase ~n by R vector, the vector R shown in FIG. 15(A) has the signal value rl and r2 for the nH and (n+l)H scannings, the corre-sponding original vector R can be found by selecting the phase of them~ation signal for modulation as shown in FIG. 15(B). As elucidated above, the spatial relation between the color filter elements and the picture elements can be freely shi-fted, or in other words, there is no need of paying hard effort in registration in the mass production.

.. . . .

1 17555~

1 The processing of the output signal of this example can be made, in principle, by means of the signal processing circuit of FIG. 7. In this case, the chrominance signals obtained from the synchronous demodulators DET~l) and DET(2) are red chrominance signal and blue chrominance signal. Therefore, the outputs CDl and CD2 are primary color signals. There-fore, by reducing the component of luminance signal to the encoder 714 by passing through the color temperature co~nsation circuits (1) (2), a pair of color differential signals R-YL and B-YL are produced, and NTSC signal is produced by the encoder (714).
Oblique stripe filters as elucidated in the example of FIG. 8 is applicable also to this example.
FIG. 16 shows such example which comprises stripes of repetition of four color elements filters W, Cy, G and Ye.
The circuit shown in FIG. 12 is fundamentally usable.
The present invention is applicable also for such example using a filter having repetition of filter element stripes of Cy, Mg and R which are complementary colors of -R, G and Cy of FIG. 4 or FIG. 8.

.

.. . .. .. . . . . .. . . . ~ . .. .. . . . - . . . .. .

Claims (21)

THE EMBODIMENTS OF THE INVENTION IN WHICH AN EXCLUSIVE PROPERTY OR
PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS:

1. A solid state color imaging apparatus comprising:

a solid state image sensor comprising a plu-rality of picture elements regularly disposed in two dimensional patterns,the disposition comprising a plurality of horizontal lines, each having a plu-rality of picture elements disposed in repetition at a predetermined pitch, a color filter comprising a row of a plurality of substantially parallel stripes of color filter elements, said row having repetition of stripes of a predetermined number of color filter elements, characterized in that spatial relations between the phases of repeti-tion of the picture elements in the horizontal lines and the phases of repetition of stripes of the color filters are changed for different horizontal lines which are scanned in sequence, wherein said phases of the repetition of the picture elements in the horizontal lines are changed for every one of said horizontal lines which are scanned in sequence, and said change of phase per one horizontal line is substantially 90°.

2. A solid state color imaging apparatus in accordance with claim 1, wherein said phases of repetition of the stripes of the color filter element in the horizontal lines are changed for every horizontal lines which are scanned

3. A solid state color imaging apparatus in accordance with claim 1, wherein spatial frequency fp of said repetition of the picture elements and spatial frequency ff of said repetition of the color filter elements has a relation of ff = ?fp .

4. A solid state color imaging apparatus in accordance with claim 1, wherein said color filter comprises stripes of color filter elements of red color for passing red light, green color for passing green light and cyan color for passing light other than red light.

5. A solid state color imaging apparatus in accordance with claim 1, wherein said color filter comprises stripes of color filter elements of transparent or translucent for passing light of all colors, cyan color for passing light other than red light, green color for passing light of green color, yellow color for passing light other than blue light.

6. A solid state color imaging apparatus comprising:
a solid state image sensor comprising a plurality of picture elements regularly disposed in two dimensional patterns, the disposition comprising a plurality of horizontal lines, each having a plurality of picture elements disposed in repetition at a predetermined pitch, a color filter comprising a row of a plurality of substantially parallel stripes of color filter elements, said row having repetition of stripes of a predetermined number of color filter elements, characterized in that spatial relations between the phases of repetition of the picture elements in the horizontal lines and the phases of repetition of stripes of the color filters are changed for different horizontal lines which are scanned in sequence, and spatial frequency fp of said repetition of the picture elements and spatial frequency ff of said repetition of the color filter elements has a relation of ff=?fp.

7. A solid state color imaging apparatus in accordance with claim 6, wherein said color filter comprises stripes of color filter elements of red color for passing red light, green color for passing green light and cyan color for passing light other than red light.

8. A solid state color imaging apparatus in accordance with claim 6, wherein said color filter comprises stripes of color filter elements of transparent of translucent for passing light of all colors, cyan color for passing-light other than red light, green color for passing light of green color, yellow color for passing light other than blue light .

9. A solid state color imaging apparatus in accordance with claim 6, wherein said phases of the repetition of the picture elements in the horizontal lines are changed for different horizontal lines which are scanned in sequence.

10. A solid state color imaging apparatus in accordance with claim 9, wherein said color filter comprises stripes of color filter elements of red color for passing red light, green color for passing green light and cyan color for passing lights other than red light.

11. A solid state color imaging apparatus in accordance with claim 9, wherein said color filter comprises stripes of color filter elements of transparent or translucent for passing lights of all colors, cyan color for passing light other than red light , green color for passing light of green color, yellow color for passing light other than blue light.

12. A solid state color imaging apparatus in accordance with claim 6, wherein said phases of repetition of the stripes of the color filter element in the horizontal lines are changed for every horizontal lines which are scanned in sequence by disposing said stripes of the color filter elements oblique to said horizontal lines.

13. A solid state color imaging apparatus in accordance with claim 12, wherein said color filter comprises stripes of color filter elements of red color for passing red light, green color for passing green light and cyan color for passing lights other than red light.

14. A solid state color imaging apparatus in accordance with claim 12,wherein said color filter comprises stripes of color filter elements of transparent or translucent for passing light of all colors, cyan color for passing light other than red light, green color for passing light of green color, yellow color for passing lights other than blue light.

15. A solid state color imaging apparatus in accordance with claim 6, wherein said change of phase per one horizontal line is substantially 90°.

16. A solid state color imaging apparatus in accordance with claim 15, wherein said phases of the repetition of the picture elements in the horizontal lines are changed for every horizontal lines which are scanned in sequence.

17. A solid state color imaging apparatus in accordance with claim 16, wherein said color filter comprises stripes of color filter elements of red color for passing red light, green color for passing green light and cyan color for passing light other than red light.

18. A solid state color imaging apparatus in accordance with claim 16, wherein said color filter comprises stripes of color filter elements of transparent or translucent for passing light of all colors, cyan color for passing light other than red light, green color for passing light of green color, yellow color for passing light other than blue light.

19. A solid state color imaging apparatus in accordance with claim 15, wherein said phases of repetition of the stripes of the color filter element in the horizontal lines are changed for every horizontal lines which are scanned in sequence by disposing said stripes of the color filter elements oblique to said horizontal lines.

20. A solid state color imaging apparatus in accordance with claim 19, wherein said color filter comprises stripes of color filter elements of red color for passing red light, green color for passing green light and cyan color for passing light other than red light.

21. A solid state color imaging apparatus in accordance with claim 19, wherein said color filter comprises stripes of color filter elements of transparent or translucent for passing light of all colors, cyan color for passing light other than red light, green color for passing light of green color, yellow color for passing light other than blue light.--