CN101868979A - Image processing device, image processing method, and imaging device - Google Patents

Abstract

Provided is an image processing device including: a color mosaic filter (201); and a single-plate color imaging element having a patterning polarizer (202) formed by a plurality of polarization units having transmittance polarization planes of at least three different angles arranged in a plurality of pixels of the same color (G) in the color mosaic filter (201). The device further includes: a color polarized light acquisition unit (101) having a single-plate color imaging element of the aforementioned configuration; a polarization information processing unit (103) which approximates the relationship between the luminance of the light which has transmitted through the polarizer unit in the G pixels and the angle of the transmittance polarization plane of the polarizer unit by using a sinusoidal function; and a color mosaic interpolation unit (102) which interpolates the color luminance so as to obtain a color luminance which cannot be obtained by the target pixel, thereby generating a color luminance image.

Description

Image processing apparatus, image processing method and camera

Technical field

The present invention relates to obtain simultaneously the colour information of subject and the image processing apparatus and the method for polarised light information.In addition, the present invention relates to be applied to very suitably the filming apparatus of this image processing.

Background technology

In recent years, the progress of Digital Video is remarkable unusually, is envisioned that the camera of portable phone in the future also can obtain the HDTV image quality.But, if with optical system or capturing element miniaturization,, can produce the limit problem of image taking then owing to reasons such as sensitivity or lens diffraction limits, therefore, can think future height become more meticulous and also can reach capacity.In this case, it is very effective for the raising of image quality to apply the computer graphical processing in the image information of satisfied inadequately subject.But, need to obtain the physical message in the image generative processes such as light source of the three-dimensional shape information of subject or illumination subject for this reason.In order to obtain shape information, the Range Measurement System of the active sensor of common needs use laser or LED (Light Emitting Diode) or the wild stereo of double vision etc.These systems not only scale are big, and are subjected to various restrictions.For example, this restriction comprises: can only mostly be most in the distance of camera and subject in the scope about several meters and take, perhaps the subject as reference object is restricted to solid shape, bright diffusion object etc.So, can not be applied to remote outdoor scene shooting or hair or very cheese shooting of clothes.

In the past, (passive) subject shape sensing mode as passive had the technology of utilizing polarised light.This be a kind of be used to from the reverberation (specular light or diffuse reflection light) of the subject of the natural daylight of illuminated non-polarized light since surface direction or viewpoint these are geometric former thereby present the technology of the phenomenon of various partial poolarized lights.In order to obtain this information, the partial polarization light state that need obtain each pixel of subject is as polarized light image.

Patent documentation 1 and non-patent literature 1 disclose: in order to obtain the partial polarization light image of luminance picture and subject simultaneously, configuration has the graphical polarizer of a plurality of different polarised light main shafts on the space in capturing element.As graphical polarizer, use the little polar biased of photonic crystal or structural birefringence to postpone array (form birefringence microretarder array).But, in these technology, only can obtain monochrome image and polarized light image simultaneously.

Patent documentation 2 discloses in the part by G (green) pixel in the colored splicing of Bel and has disposed polarized light filter, makes the part of capturing element have the polarised light characteristic, and obtains the content of coloured image and polarised light information simultaneously.By can from coloured image, the be inhibited image of specular components of this technology.In this technology, because therefore this simple operations of obtaining the difference between 2 different polarised light pixels, can not obtain the information of the partial poolarized light of subject fully.

Patent documentation 1:JP spy opens the 2007-86720 communique

Patent documentation 2:JP spy opens the 2006-254331 communique

Non-patent literature 1: chrysanthemum field, rock field: " polarized light image measuring system " Oplus E, Vol.25, No.11, P1241-1247,2003

In technology in the past, can not obtain the polarized light image of the partial poolarized light of the coloured image of subject and subject simultaneously.Therefore, obtain color dynamic image and not have the shape information of deviation in time be impossible.

Patent documentation 2 discloses the polarised light information that adds a part in coloured image and has controlled coloured image, and the technology of control direct reflection.In this technology, as shown in figure 24, pixel is configured to Bayer splicing (Bayer Mosiac) shape.In Figure 23, G1 and G2 represent the G pixel, still, dispose polarizer on the position of G1, and do not dispose polarizer on the position of G1.On the other hand, R1 and B1 represent the pixel of R (redness) and B (blueness) respectively, and polarizer is not set on these location of pixels.That is, in this pixel arrangement, has only the G2 pixel as polarised light pixel performance function.

The processing that the device of patent documentation 2 carries out is made as constant times with the luminance difference on the location of pixels of G1 and G2, respectively with R1, G1, these non-polarized light pixel addition of B1.May command chroma-luminance value thus.Even obtain coloured image and polarised light information by this structure, different owing on the location of pixels of G2, be provided with polarizer with original G pixel, therefore,, then can on coloured image, produce colo(u)r bias if just under this state, carry out colour splicing interpolation.

And, owing to only use 2 kinds of polarised light pixels, and therefore, the INFORMATION OF INCOMPLETE of the partial poolarized light that obtains.Consequently, on each location of pixels, do not know the partial poolarized light that on which direction, has produced which kind of degree.That is, can not obtain the image of polarised light information completely.

Summary of the invention

The present invention finishes in order to solve above-mentioned problem, its objective is: provide a kind of and can obtain the colored splicing quilt full-color image of interpolation correctly, and can obtain the image processing apparatus and the image processing method of the polarized light image of expression polarization direction of light and degree simultaneously.

In addition, the present invention also aims to provide a kind of filming apparatus that can be applied to this image processing very suitably.

Image processing apparatus of the present invention has: the polarized color light acquisition unit, it comprises the single-plate color capturing element, and this single-plate color capturing element has: colored splicing filter and a plurality of polarizer units with transmission-polarizing face of at least 3 kinds of different angles are set at the graphical polarizer in a plurality of pixels of the same color in the above-mentioned colored splicing filter; The polarised light information treatment part, its relation of angle of transmission in a plurality of pixels of above-mentioned same color being crossed the transmission-polarizing face of the brightness of light of above-mentioned polarizer unit and above-mentioned polarizer unit with SIN function is similar to; And colored splicing interpolation portion, it is by carrying out the interpolation of chroma-luminance, the angle of transmission-polarizing face is differed from one another and the delta-shaped region that forms by 3 adjacent polarizer units as pixel unit, generate the chroma-luminance image.

In preferred embodiment, above-mentioned graphical polarizer has: the structure of 3 kinds of polarizer unit's disposed adjacent that the angle of transmission-polarizing face differs from one another.

In preferred embodiment, above-mentioned colored splicing filter has: the pixel of single particular color is arranged saw-toothed structure, and above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

In preferred embodiment, above-mentioned colored splicing filter has: the pixel of single particular color is aligned to the structure that jagged square lattice rotation 45 is spent, and above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

In a preferred embodiment, each pixel has octagonal shape.

In a preferred embodiment, above-mentioned single particular color is the G (green) among R (redness), G (green), the B (blueness).

In a preferred embodiment, above-mentioned colored splicing filter has the structure that each pixel is the hexagon lattice of hex shape, and above-mentioned polarizer unit is configured in the pixel of single particular color of above-mentioned arrangement.

In a preferred embodiment, above-mentioned colored splicing interpolation portion is by the next door in pixel that should the interpolation chroma-luminance, the brightness equalization that will in same color pixel, observe, eliminate the effect of polarised light, and chroma-luminance carried out interpolation, the angle that above-mentioned same color pixel has a transmission-polarizing face differs 3 kinds of polarizer units of 60 degree each other.

Image processing method of the present invention has: utilize the single-plate color capturing element of 3 kinds of different polarizer units of the angle that is provided with the transmission-polarizing face in a plurality of pixels of the single particular color in colour element is arranged, observe the step of the brightness of each pixel; From the brightness that 3 kinds of different pixels of the angle of the transmission-polarizing face of above-mentioned single particular color, observes, obtain the step of polarised light information; And the delta-shaped region that will be formed by 3 kinds of different pixels of angle of the transmission-polarizing face of above-mentioned single particular color carries out the interpolation of chroma-luminance as pixel unit, thereby generates the step of chroma-luminance image.

Filming apparatus of the present invention has: colored splicing filter; Graphical polarizer, wherein, a plurality of polarizer units with transmission-polarizing face of 3 kinds of different angles are set in a plurality of pixels of the same color in the above-mentioned colored splicing filter; And the single-plate color capturing element, it is with the corresponding signal of brightness of the light of above-mentioned colored splicing filter of pixel unit output and transmission and graphical polarizer.

In preferred embodiment, above-mentioned colored splicing filter has: the pixel of single particular color is arranged saw-toothed structure, and above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

In preferred embodiment, above-mentioned colored splicing filter has: the pixel of single particular color is aligned to the structure that jagged square lattice rotation 45 is spent, and above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

In a preferred embodiment, each pixel has octagonal shape.

In a preferred embodiment, above-mentioned colored splicing filter has the structure that each pixel is the hexagon lattice of hex shape, and above-mentioned polarizer unit is configured in the pixel of single particular color of above-mentioned arrangement.

(invention effect)

According to the present invention,, therefore, can obtain, handle information simultaneously about chroma-luminance and polarised light owing to be to use during the pixel that multiple polarizer unit is combined to colored splicing filter is arranged.

In addition, in the present invention, the angle of transmission-polarizing face differs from one another, and, the delta-shaped region that will be made of 3 kinds of adjacent polarizer units is as pixel unit, therefore, compare as the situation of pixel unit, can obtain polarised light information local, that precision is high from the littler pixel unit of area with the zone that the polarizer unit more than 4 kinds that will be differed from one another by the angle of transmission-polarizing face constitutes.

Description of drawings

Fig. 1 is the block diagram of the structure of expression image processing apparatus of the present invention.

Fig. 2 is the figure of the structure of expression polarized color light acquisition unit of the present invention.

Fig. 3 is the key diagram of 3 kinds of polarised light main shafts of polarizer unit.

Fig. 4 (a) and (b) be the key diagram of the ordered state of the chromatic filter of the 1st execution mode and graphical polarization element.

Fig. 5 (a) and (b) be the key diagram of other examples of the ordered state of the chromatic filter of the 1st execution mode and graphical polarization element.

Fig. 6 is SIN function shape luminance fluctuation in explanation the 1st execution mode and the figure that observes luminance point.

Fig. 7 is the figure of 3 kinds of unknown parameters of the SIN function in explanation the 1st execution mode.

Fig. 8 is the figure of the interpolating method of the set of the delta-shaped region of expression in the 1st execution mode and G chroma-luminance.

Fig. 9 is the figure of the interpolating method of the set of the delta-shaped region of expression in the 1st execution mode and B chroma-luminance.

Figure 10 is the figure of the interpolating method of the set of the delta-shaped region of expression in the 1st execution mode and R chroma-luminance.

Figure 11 is the flow chart of the operation of the colour splicing interpolation portion in explanation the 1st execution mode.

Figure 12 is the flow chart of the operation of the polarised light information treatment part in explanation the 1st execution mode.

Figure 13 (a) is the input picture of the subject of the ball made as the plastics of spheroid; (b) and (c) be represent respectively at the subject of (a) degree of polarization image ρ (x, y) and the polarization phase image

(x, the image of example y).

Figure 14 (a) and (b) be expression degree of polarization image ρ (x, y) and the polarization phase image (x, the schematic diagram of the numerical value change on subject y).

Figure 15 (a) to (c) is the figure of example from the diffuse reflection component image to the specular components image that separate with of expression.

Figure 16 is the chromatic filter of expression in the 2nd execution mode and the figure of the shape of the arrangement of graphical polarizer and unit picture element.

Figure 17 is the set of the delta-shaped region in expression the 2nd execution mode and the figure of interpolating method.

Figure 18 is the chromatic filter of explanation in the 3rd execution mode and the figure of the shape of the arrangement of graphical polarizer and unit picture element.

Figure 19 is the figure of the set of the delta-shaped region in expression the 3rd execution mode.

Figure 20 is the figure of the interpolating method of the set of the delta-shaped region of explanation in the 3rd execution mode and G chroma-luminance.

Figure 21 is the figure of the interpolating method of the set of the delta-shaped region of explanation in the 3rd execution mode and B chroma-luminance.

Figure 22 is the figure of the interpolating method of the set of the delta-shaped region of explanation in the 3rd execution mode and R chroma-luminance.

Figure 23 is the block diagram of structure of the execution mode of expression filming apparatus of the present invention.

Figure 24 is the key diagram of prior art.

The explanation of symbol:

100 lens

101 polarized color light acquisition units

The 102 colored interpolation portions of splicing

103 polarised light information treatment parts

104 coloured image frame memories

105 degree of polarization picture frame memories

106 polarization phase picture frame memories

107 stitching image frame memories

Embodiment

Below, describe with reference to the execution mode of accompanying drawing image processing apparatus of the present invention and image processing method.The preferred implementation of the present invention that below will illustrate has following structure roughly.

Execution mode 1: only dispose 3 kinds of different polarizers in the G pixel in the colored splicing of Bel.

Execution mode 2: the colored splicing of Bel is being rotated in the structure of 45 degree, only 3 kinds of different polarizers of configuration in the G pixel.

Execution mode 3: in the colour splicing of hexagonal lattice is arranged, only in G, dispose 3 kinds of different polarizers.

(execution mode 1)

Fig. 1 is expression and the block diagram of the common basic structure of all of the embodiments of the present invention of explanation in this manual.The device of present embodiment can obtain polarized light image information when subject is obtained color image information in real time, and as 2 kinds of polarized light image (degree of polarization image ρ and polarization phase image ) output.Degree of polarization image ρ and polarization phase image

It can be any one situation in static, the dynamic image.

Incident light by lens shown in Figure 1 100 incides polarized color light acquisition unit 101.Polarized color light acquisition unit 101 is obtained the data of color dynamic image image and polarised light frame simultaneously from this incident light.From the storage of the colored stitching image of polarized color light acquisition unit 101 output stitching image frame memory 107.

From the data that stitching image frame memory 107 is read stitching image in order, send to the colored interpolation portion 102 of splicing, carry out interpolation and handle.At each pixel, the result that interpolation is handled is stored in the coloured image frame memory 104 that 3 plane structures by RGB form, and also suitably reads.

From stitching image frame memory 107, read picture element signal in order, send to polarised light information treatment part 103.These picture element signals are handled by polarised light information treatment part 103, and are stored in degree of polarization picture frame memory 105 and the polarization phase picture frame memory 106.The data of degree of polarization image (ρ) are exported from degree of polarization picture frame memory 105, the polarization phase image (

) data by from polarization phase picture frame memory 106 output.

Fig. 2 is the schematic diagram of the basic structure of expression polarized color light acquisition unit 101.In illustrated example, colored splicing filter 201 and the graphical polarizer 202 overlapping fronts that are arranged on capturing element pixel 203.Fig. 2 is conceptual figure, the overlapping order of colored splicing filter 201 and graphical polarizer 202 is opposite with Fig. 2, graphical polarizer 202 can overlap the front of colored splicing filter 201, in addition, merged in use under the situation of optical element of chromatic filter function and polarised light function, owing to himself can realize 2 kinds of functions, therefore, this operation of overlap operation itself does not just need.

Incident light 204 transmit color splicing filter 201 and graphical polarizer 202 arrive capturing element, observe brightness by capturing element pixel 203 with pixel unit.According to present embodiment, can use the single-plate color capturing element, obtain colour information and polarised light both information simultaneously.And as the back will describe in detail, a plurality of polarizer units of polarizer unit's (sections) that graphical polarizer 202 is differed from one another by the angle that comprises the transmission-polarizing face constituted.The typical case, each polarizer unit has the size that is equivalent to 1 pixel, and still, polarizer unit need not to be configured in all pixels of colored splicing filter 201.Graphical polarizer 202 is configured to the tartan shape.

This graphical polarizer 202 can use the photonic crystal of for example non-patent literature 1 record to realize.Under the situation of photonic crystal, light with electric field intensity (vibration plane) parallel with the ditch that forms in its surface is TE ripple (Transverse ElectricWave, electric field component is horizontal with respect to the plane of incidence), light with vertical electric field intensity (vibration plane) is TM ripple (Transverse Magnetic Wave, magnetic-field component is horizontal with respect to the plane of incidence).In addition, the polarizer unit representation transmission of TM ripple and polarised light characteristic of TE wave reflection (not transmission) in each wavelength frequency domain.

Fig. 3 is illustrated in the implication of the oblique line that schematically draws in each polarizer unit of graphical polarizer 202.Oblique line in each pixel shown in Figure 3 is illustrated in the polarised light major axes orientation of the small polarizer (polarizer unit) that is provided with on each pixel.At this, " polarised light main shaft " is meant the axle parallel with the polarization surface (transmission-polarizing face) of transmission-polarizing device.

The transmission on major axes orientation of polarizer unit has the light of vibration plane, and shielding has the light of vertical vibration face.In this manual, respectively angle Ψ=0 °, 60 °, 120 ° polarised light main shaft are distributed to the polarizer unit of polarizer numbering 1～3.The polarized light transmission rate of polarizer unit depends on the light wavelength of being utilized, and therefore, designs with the transmission peak wavelength territory of colour splicing filter.For example, be designed to meeting the polarizer unit that " G1 " limit: in the wavelength domain of " G ", major axes orientation makes the polarized light transmission of the direction of " 1 " (that is, angle Ψ=0 °).

Fig. 4 represents the configuration of the pixel in the polarized color light acquisition unit 101 of present embodiment.Fig. 4 (a) expression is only disposed these 3 kinds of polarizer units of " G1 "～" G3 " on the G locations of pixels in the colored splicing of Bel filter.In this embodiment, under the situation of the arrangement of paying close attention to G, arranged the row 401 of G1 in the vertical, the row 403 of having arranged the row 402 of G2 and having arranged G3 are arranged according to this sequence period ground.Be expert in 404, G1, G3, G2 arrange according to this sequence alternate in the horizontal.In addition, be expert in 405, though same with row 404, G1, G3, G2 arrange according to this sequence alternate,, with respect to row 404, the phase place of arrangement is to horizontal 3 pixels that have been shifted.And, on R pixel and B locations of pixels, do not dispose polarizer unit.

Though only shown 5 * 5=25 pixel among Fig. 4,, in the polarized color light acquisition unit 101 of reality, a plurality of block of pixels identical with 25 block of pixels shown here are arranged on the face intercycle ground parallel with shooting face.In Fig. 4 (b), the aggregate of triangle G1-G2-G3 has been described.In fact very small as the delta-shaped region on summit with 3 kinds of adjacent G pixels, in the inside of this delta-shaped region, polarised light information can be thought identical, therefore, and from the polarised light information below the luminance acquisition of observing with these 3 kinds of polarizer units.That is, triangle becomes the base unit that obtains polarised light information.Therefore, in this manual, can think that delta-shaped region G1-G2-G3 is and the different virtual triangle pixel of pixel that is subjected to light unit as the lip-deep physical property of capturing element.In the present embodiment, the pixel arrangement on the shooting face itself is foursquare lattice, and therefore, the virtual triangle pixel becomes isosceles triangle.

Fig. 5 represents other example of the pixel arrangement in the polarized color light acquisition unit 101 of present embodiment.This configuration mode is: the row 503 of having arranged the row 501 of G2, the row 502 of having arranged G1 and arrangement G3 are in the vertical arranged according to this sequence period ground.Be expert in 504, G2, G3, G1 arrange according to this sequence alternate in the horizontal.In addition, be expert in 505, though same with row 504, G2, G3, G1 arrange according to this sequence alternate,, with respect to row 504, the phase place of arrangement is to horizontal 3 pixels that have been shifted.The structure of triangle G1-G2-G3 is identical with the structure arranged of Fig. 4.

(polarised light information)

Fig. 6 has represented transmission and has had the brightness 601～603 of G light of 3 kinds of polarizers of the different polarised light main shaft of direction (Ψ i=0 °, 60 °, 120 °).At this, be Ψ with the anglec of rotation Ψ of polarised light main shaft _iThe time observation brightness be made as I _iWherein, " i " is the following integer of 1 above N, and " N " is sample number.In example shown in Figure 6, because N=3, so i=1,2,3.Shown sample (Ψ among Fig. 6 with 3 G pixels _i, I _i) corresponding brightness 601～603.The angle Ψ i of polarised light main shaft and the relation of brightness 601～603 are represented by the SIN function of cycle=π (180 °).The fixing unknown number that SIN function had of cycle has only 3 kinds of amplitude, phase place and mean values, by observing 3 brightness 601～603 of different Ψ, can determine 1 SIN function curve fully.

With respect to the observation brightness of the angle Ψ of the polarised light main shaft of polarizer unit with following formulate.

[formula 1]

I (Ψ)=Asin 2 (Ψ-B)+C (formula 1)

At this, as shown in Figure 7, A, B, C are unknown constant, represent amplitude, phase place, the mean value of the change curve of polarised light brightness respectively.Observation (formula 1) according to 3 points becomes following simultaneous equations.

[formula 2]

$\left\{\begin{array}{c}{I}_1=-A\sin \left(2B\right)+C\\ I_2=A\sin (\frac{2\mathrm{\π}}{3}-2B)+C=A[\frac{\sqrt{3}}{2}\cos \left(2B\right)+\frac{1}{2}\sin \left(2B\right)]+C\\ I_3=A\sin (\frac{4\mathrm{\π}}{3}-2B)+C=A[-\frac{\sqrt{3}}{2}\cos \left(2B\right)+\frac{1}{2}\sin \left(2B\right)]+C\end{array}\right.$ (formula 2)

Unknown number C is the mean value with polarised light pixel intensity of impartial phase difference, therefore, is determined shown in following (formula 3).

[formula 3]

$C=\frac{I_1+I_2+I_3}{3}$ (formula 3)

In addition, A and B are determined shown in (formula 4) and (formula 5) respectively by the simultaneous equations of (formula 2).

[formula 4]

$A=\frac{2}{3}\sqrt{(I_1^2+I_2^2+I_3^2-I_1{I}_2-I_2{I}_3-I_3{I}_1)}$ (formula 4)

[formula 5]

$B=\frac{1}{2}{\tan }^{-1}\left(\frac{I_2+I_3-2I_1}{\sqrt{3}(I_2-I_3)}\right)$ (formula 5)

And " polarised light information " in this specification is meant: expression is for Modulation and Amplitude Modulation degree ρ and phase information φ on the SIN function curve of the interdependence of the polarised light main shaft angle of brightness.If by above processing, determine A, the B of SIN function, 3 parameters of C at each delta-shaped region G1-G2-G3, then can obtain the degree of polarization image of the degree of polarization ρ in each pixel of expression and the polarization phase image of the polarization phase φ in each pixel of expression.Degree of polarization ρ represents the degree of the light polarization of this pixel, and polarization phase φ represents to get the peaked angle position of SIN function.This angle is the angle of the face that exists of the surface normal in the subject of image surface internal representation under the situation that cause the internal diffusion reflection from the reverberation of subject.And 0 ° of the angle of polarised light main shaft is identical with 180 ° (π).

Numerical value ρ, φ (0≤φ≤π) calculate by following (formula 6) and (formula 7) respectively.

[formula 6]

$\mathrm{\ρ}=\frac{I_{\max }-I_{\min }}{I_{\max }+I_{\min }}=\frac{A}{C}$ (formula 6)

[formula 7]

$\mathrm{\φ}=\frac{\mathrm{\π}}{4}+B$ (formula 7)

And, try to achieve above-mentioned degree of polarization and polarization phase means that the image of degree of polarization picture frame memory 105 and polarization phase frame memory 106 becomes the structure of triangular pixel at each delta-shaped region G1-G2-G3.

(interpolation of the chroma-luminance of G)

Fig. 9 has described the set of 8 triangular pixels among Fig. 4 (b) or Fig. 5 (b), and leg-of-mutton each summit (a)～(i) is corresponding to by the polarised light pixel G1 of G, any one 9 pixel that constitute among G2, the G3.In preferred implementation of the present invention, as shown in Figure 9, the chroma-luminance interpolation also is that unit implements with the triangular pixel.If the observation brightness of each summit pixel is made as I _a～I _e, then will by (a) shown in the figure (b) triangle (a) after (e) oblique square of (d) constituting is cut apart up and down (b) the G brightness of (d) be G _uAnd triangle (b) (e) the G brightness of (d) be G _dCan obtain by following (formula 8) and (formula 9).

[formula 8]

$G_U=\frac{2(I_a+I_b+I_d)}{3T}$ (formula 8)

[formula 9]

$G_d=\frac{2(I_b+I_d+I_e)}{3T}$ (formula 9)

Constant 2 in formula 8, the formula 9 be in unpolarized transmittance under the situation of rectilinearly polarized light light quantity become the correction term of 1/2 phenomenon.In addition, the T in these formula represents the transmissivity of polarizer, is that T is not 100% correction term.

Equally, the G brightness G in all delta-shaped regions of Fig. 8 _uAnd G _dCan obtain.And these triangular pixels become 1 unit with brightness respectively.

(interpolation of the chroma-luminance of B)

Fig. 9 is the figure of expression for the required pixel of the chroma-luminance of the B that obtains the triangular pixel shown in Fig. 4 (b) or Fig. 5 (b).9 summits (a)～(i) shown in Figure 9 constitute the summit of triangular pixel, and are corresponding with in the polarised light pixel 1,2,3 of G any one.At Fig. 9, as the location of pixels that is used to obtain the needed data of interpolation, illustrate the triangular pixel that constitutes by above-mentioned summit (a)～(i) the outside 4 summits (α) (β) (γ) (δ) and the summit in the outside (μ) (v).

In Fig. 9, rectangular area 901～904 expressions that with dashed lines fences up have the square pixel of B chroma-luminance.

The B pixel is positioned at rectangular area 901～904, the area of B pixel account for triangular pixel area 50%.Also adopt this value as triangular pixel up and down.If based on this idea, the zone of oblique line that has been picture that then in Fig. 9, has the B value.Particularly, for oblique square (b) (c) (f) (e), tiltedly square (e) (h) (g) (d), (b) (d) (γ) (i), triangle (h) (i) (δ) of (β), triangle (f) of (a), triangle (a) of triangle (α).

The delta-shaped region of shortcoming B brightness is (b) (e) (d) and oblique (f) triangle shown in (i) 2 white portions being comprised respectively in (h) of square (e) of oblique square (a).B chroma-luminance in these triangular pixels must generate by interpolation.And, can average by B chroma-luminance and implement interpolation rectangular area 901～904.For example, if the B brightness of rectangular area 901 is recited as B ₉₀₁, then can calculate interpolate value by following (formula 10).

[formula 10]

$B=\frac{{\mathrm{<figure-callout\; id="901"\; label="B"\; filenames="HPA00001140391700071.png"\; state="\{\{state\}\}">B</figure-callout>}}_{901}+{\mathrm{<figure-callout\; id="902"\; label="B"\; filenames="HPA00001140391700071.png"\; state="\{\{state\}\}">B</figure-callout>}}_{902}+{\mathrm{<figure-callout\; id="903"\; label="B"\; filenames="HPA00001140391700071.png"\; state="\{\{state\}\}">B</figure-callout>}}_{903}+{\mathrm{<figure-callout\; id="904"\; label="B"\; filenames="HPA00001140391700071.png"\; state="\{\{state\}\}">B</figure-callout>}}_{904}}{4}$ (formula 10)

Wherein, need oblique foursquare zone is divided into 2 triangular pixels up and down.Utilize the correlation of B chroma-luminance and G chroma-luminance, calculate the B chroma-luminance B of each triangular pixel by following (formula 11) _u, B _d

[formula 11]

$B_U=\frac{2G_u}{G_u+G_d}B$

(formula 11)

$B_d=\frac{2G_d}{G_u+G_d}B$

Figure 10 is the figure of expression for the required pixel of the chroma-luminance of the R that obtains the triangular pixel shown in Fig. 4 (b) or Fig. 5 (b).As the needed data of interpolation, promptly (ζ) (η) (θ) on 4 summits (ε) also to have described the G location of pixels in the outside of the triangular pixel that is made of summit (a)～(i).At this, according to the identical idea of above-mentioned B pixel, what have the R pixel is the zone of picture oblique line.Particularly be oblique square (a) (b) (e) (d), oblique (f) (c) (ζ) (g) (η), triangle (g) (h) (θ) of (f), triangle (d) of (b), triangle (c) of (i) (h) position, triangle (ε) of square (e).

(interpolation of the chroma-luminance of R)

Figure 10 is the figure of expression for the required pixel of the chroma-luminance of the R that obtains the triangular pixel shown in Fig. 4 (b) or Fig. 5 (b).As the needed data of interpolation, promptly (ζ) (η) (θ) on 4 summits (ε) also to have described the G location of pixels in the outside of the triangular pixel that is made of summit (a)～(i).At this, according to the identical idea of above-mentioned B pixel, what have the R pixel is the zone of picture oblique line.Particularly be oblique square (a) (b) (e) (d), oblique (f) (c) (ζ) (g) (η), triangle (g) (h) (θ) of (f), triangle (d) of (b), triangle (c) of (i) (h) position, triangle (ε) of square (e).The interpolation of triangular pixel that does not have the R pixel is identical with the interpolation of B pixel, can calculate according to following (formula 12) and (formula 13).

[formula 12]

$R=\frac{{\mathrm{<figure-callout\; id="1001"\; label="R"\; filenames="HPA00001140391700081.png"\; state="\{\{state\}\}">R</figure-callout>}}_{1001}+{\mathrm{<figure-callout\; id="1002"\; label="R"\; filenames="HPA00001140391700081.png"\; state="\{\{state\}\}">R</figure-callout>}}_{1002}+{\mathrm{<figure-callout\; id="1003"\; label="R"\; filenames="HPA00001140391700081.png"\; state="\{\{state\}\}">R</figure-callout>}}_{1003}+{\mathrm{<figure-callout\; id="1004"\; label="R"\; filenames="HPA00001140391700081.png"\; state="\{\{state\}\}">R</figure-callout>}}_{1004}}{4}$ (formula 12)

[formula 13]

$R_u=\frac{{2G}_u}{G_u+G_d}R$

(formula 13)

$R_d=\frac{2G_d}{G_u+G_d}R$

By above processing, generate the degree of polarization image of each triangular pixel shown in Fig. 4 (b) or Fig. 5 (b) and polarisation phase image and (RGB) panchromatic luminance picture.

If try the dot structure and the overlapping demonstration of dot structure under the situation that obtains the triangular pixel image of polarized color light acquisition unit, then triangular pixel and original square-shaped image equate on area.But under the situation of not using triangular pixel, the coordinate system of original square lattice can be departed from the residing centre coordinate of the interpolation result position of polarised light information or G chroma-luminance.Adopted this processing for complicated worry.

Next, with reference to Figure 11 the operation of the splicing of the colour among Fig. 1 interpolation portion 102 is described.

At first, will be made as the data that are stored in the stitching image frame memory 107 in the data of the colored stitching image that polarized color light acquisition unit 101 is obtained.In step S1101, the pixel groups (G1-G2-G3) of the G brightness of stitching image is used as 1 unit and reads.

In step S1102, use (formula 8) or (formula 9) with G brightness interpolation.

In step S1103, storage G brightness is as triangular pixel in the G of coloured image frame memory 104 plane.In step S1104, judge whether the pixel groups (G1-G2-G3) of all G brightness finishes.Under the situation that is not having to finish, carry out step 1101 repeatedly～1104 processing.When in step S1104, being judged as under the situation of " end ", enter step S1105.

Next, in step S1105, obtain the pixel of B brightness and R brightness from the stitching image frame memory.This obtains and can carry out side by side.In step S1106, if (formula 10) then used in B brightness; If (formula 12) then used in R brightness, calculate B brightness and R basis in the triangular pixel.In step S1107, if the triangular pixel of shortcoming B brightness then uses (formula 11); If the triangular pixel of shortcoming R brightness then uses (formula 13) to carry out interpolation.In step S1108, the triangular pixel of the triangular pixel of the B brightness after the above-mentioned interpolation and R brightness is stored among the B, R plane of coloured image frame memory 104.

In step S1109,, judge whether above-mentioned processing finishes at all the B luminance pixels, the R luminance pixel that are comprised in the stitching image frame memory.When being judged as under the situation that does not have to finish, repeat the processing of step S1105～S1109.

As the result of above-mentioned processing, the data of the chroma-luminance image I with brightness value (x, y) of (RGB) generate in coloured image frame memory 104 in each pixel.This I (x, y) though image be the triangular pixel structure,, but the full-colour image interpolation that has with the colorrendering quality of the single-plate color capturing element same degree of using the colored splicing of common Bel generates.

Next, with reference to Figure 12 the operation of the polarised light information treatment part 103 of Fig. 1 is described.

At first, the data of the colored stitching image that will be obtained by polarized color light acquisition unit 101 are made as the data of being stored in the stitching image frame memory 107.In step S1201, read G luminance pixel (G1-G2-G3) group from the stitching image frame memory.Next, use G1, G2, these polarised light brightness of G3, utilize (formula 2) to determine SIN function parameter A, B, C to (formula 5).

In step S1203, use (formula 6), (formula 7) to generate degree of polarization ρ and polarization phase φ.

In step S1204, the value that generates is stored on the position of the triangular pixel in polarized light image frame memory 105 and the polarization phase picture frame memory 106.

Till all pixels of being judged the stitching image frame memory by step S1205 all finish, carry out above processing repeatedly.Like this, in degree of polarization picture frame memory 105, generate degree of polarization image ρ (x, data y); In addition, in polarization phase picture frame memory 106, generate polarization phase image φ (x, data y).By its forming process as can be known, the size of these images is different with the picture structure of colored stitching image, becomes the structure of triangular pixel.Consequently:, but can obtain polarised light information by dot structure identical and definition with full-colour image I (x, y) although only in the G pixel, disposed graphical polarizer.

And the processing of Figure 11 and Figure 12 is separate, therefore, also can carry out these processing side by side.In addition, these processing can utilize software implementation, also can utilize hardware to implement.

In the present embodiment, though use the graphical polarizer that forms by photonic crystal,, also can use the polarization element of film-type or utilize wire grid type or the polarization element of other principles.

Figure 13 (a) is the input picture of the subject of the ball made of plastics for spheroid.Figure 13 (b) and (c) represent respectively with respect to the degree of polarization image ρ (x, y) of the subject of Figure 13 (a) and the example of polarization phase image φ (x, y).Figure 13 (a) and (b) illustrate, and degree of polarization ρ, the polarization phase φ of each image are big more, represent the lightness height more.

Figure 14 (a) and (b) be the schematic diagram that is used to illustrate Figure 13 (b) and image (c).In degree of polarization image ρ (x, y), location of pixels near the identical center of the surface normal of the direction of visual lines of camera and ball to orientation 1401 deviations in driction, the degree of polarization ρ of this pixel increases more.In addition, at the surface normal of ball with respect to the direction of visual lines of camera near near the covering the edge (with the border of background) of 90 ° ball, degree of polarization ρ becomes maximum.In Figure 14 (a), schematically shown this degree of polarization ρ with contour.

By the polarization phase image φ (x, y) of Figure 14 (b) as can be known, with respect to the vertical line of the above-below direction of the image of expression phase place=0 °, polarization phase increased to arrow 1402,1403 directions are dull with cycle of 180 ° with being rotated counterclockwise around spheroid.According to these polarised light frames as can be known, degree of polarization ρ and polarization phase φ are equivalent to the direction of 2DOF of the surface normal of subject.That is the shape of polarised light information deducibility subject.

And, in the present embodiment, though with the degree of polarization image of the diffuse reflection component in the reverberation of subject and polarization phase image as output,, it also can be a specular components, in this case, polarization phase φ becomes and differs 90 °.

In addition, as polarised light information,,, also can be the image that generates by this information if the information that obtains from the SIN function of Fig. 7 then also can be other information sets except (ρ, φ) this combination.For example, separate as component with specular components from the diffuse reflection component of polarised light information with the dielectric subject, this operation is very important from the aspect of using.In order to carry out this operation in the present invention, use A, the C of SIN function parameter.

Figure 15 (a) relation of representing specular components and diffuse reflection component with the relation of SIN function change.Therefore, if hypothesis will be made as r by the partial poolarized light ratio (Specular PFR) of the Fresnel reflection formula certain refractive index determined and the direct reflection with illumination incidence angle, then polarised light information can obtain from the G chrominance component,

[formula 14]

$\frac{G_S+A}{G_S-A}=r$ (formula 14)

So, can obtain the chroma-luminance specular components according to following method based on this.

[formula 15]

$G_S=\left(\frac{r+1}{r-1}\right)A$

$R_S=\left(\frac{G_S}{G}\right)R$ (formula 15)

$B_S=\left(\frac{G_S}{G}\right)B$

As mentioned above the example of the image of Sheng Chenging as Figure 15 (b) (c) shown in.

(execution mode 2)

Below, the 2nd execution mode of image processing apparatus of the present invention is described.

The basic structure of also representing present embodiment in the block diagram of Fig. 1, therefore, at this suitably with reference to Fig. 1.

Figure 16 represents the configuration of the pixel in the polarized color light acquisition unit 101 of present embodiment.Processes pixel apparatus features in the present embodiment is: the arrangement of the chromatic filter in the arrangement of chromatic filter and the execution mode 1 is different.Particularly, and with the arrangement equivalence behind square lattice arrangement rotation 45 degree of Fig. 4 or Bel's type shown in Figure 5, with respect to 2 G pixels, R, B pixel only dispose the character that 1 Bel arranges respectively and are kept.Owing to increased light-receiving area, so the shape of pixel separately can not be square but octangle.In Figure 16,, 3 pixel G1, the B, the G3 that enlarge have schematically been put down in writing as the typical example of pixel with octagonal shape.

By adopting pixel shown in Figure 16 to arrange, the line of pixels array structure of the coloured image after the interpolation, degree of polarization image, polarization phase image is uprightly, therefore, can generate the image that is suitable for image processing.

In the example of Figure 16, only in the G pixel arrangement these 3 kinds of polarizer units of " G1 "～" G3 " and on R pixel and B locations of pixels, do not dispose polarizer unit.Though in Figure 16, only represented 32 pixels,, in the polarized color light acquisition unit 101 of reality, the identical a plurality of block of pixels of 32 block of pixels to that indicated in the drawings are periodically arranged in the face parallel with shooting face.

Figure 17 has described the aggregate of triangle G1-G2-G3.Can think that polarised light information is identical in this triangle, therefore, from the above-mentioned polarised light information of luminance acquisition that observes with these 3 kinds of polarizer units.Identical with execution mode 1, this triangular pixel becomes that polarised light information is obtained and the base unit of chroma-luminance interpolation.The flow chart that actual interpolation is handled or handled also with illustrated identical of execution mode 1, therefore omit its explanation.The dot structure that finally obtains becomes the square lattice of Figure 17.For oblique dot structure is erectility in the present embodiment, therefore, advantage is to have the structure of being convenient to handle in execution mode 1.

(execution mode 3)

Below, the 3rd execution mode of image processing apparatus of the present invention is described.

The basic structure of present embodiment also represented in the block diagram of Fig. 1, therefore, at this suitably with reference to Fig. 1.

Figure 18 represents the configuration of the pixel in the polarized color light acquisition unit 101 of present embodiment.The characteristics of the image processing apparatus of present embodiment are: the arrangement of chromatic filter that becomes the basis of appending graphical polarizer is different in the following areas with execution mode 1 or 2.

1) is not based on the arrangement of square lattice, and is based on the arrangement of hexagonal cell lattice.This shows it is the arrangement that pixel respectively staggers half-pixel.

2) frequency of occurrences of G pixel, B pixel, R pixel all equates.

Based on this colored splicing filter, only in the G pixel, be provided with 3 kinds of polarizer G1, G2, G3.Though in Figure 18, only shown 9 * 5=45 pixel,, in the polarized color light acquisition unit 101 of reality, the identical a plurality of block of pixels of 45 block of pixels to that indicated in the drawings are periodically arranged in the face parallel with shooting face.

The shape of each pixel unit can not be a square, but can more effectively utilize the hexagon of light-receiving area.In Figure 18,, 3 pixel B, G3, the R that enlarge have been described schematically as the typical example of pixel with hexagonal shape.

In arrangement shown in Figure 180, the leg-of-mutton shape and the 1st, the 2nd execution mode that become information obtaining unit are compared, and approach equilateral triangle, have in the few advantage of deviation from the information of 3 kinds of polarised light pixels is obtained.

Figure 19 has described the aggregate of triangle G1-G2-G3.The length on 3 limits of this isoceles triangle shape is shown in following (formula 16).

[formula 16]

$[2,\frac{\sqrt{13}}{2},\frac{\sqrt{13}}{2}]\&ap;\left[\mathrm{1.00,0.901,0.901}\right]$ (formula 16)

On the other hand, leg-of-mutton 3 limits of the 1st, the 2nd execution mode are shown in following (formula 17).

[formula 17]

$[\sqrt{2},\mathrm{1,1}]\&ap;\left[\mathrm{1.00,0.707,0.707}\right]$ (formula 17)

Because in this local triangle, can think that polarised light information is identical, so, can be from the polarised light information below the luminance acquisition that observes with these 3 kinds of polarizer units.That is, this triangle becomes that polarised light information is obtained and this content of base unit of chroma-luminance interpolation is identical with the 1st, the 2nd execution mode.

(polarised light information)

By the structure of Figure 19 as can be known, the delta-shaped region of 3 kinds of different polarised light information of G color can obtain 1 polarised light information from only having.As describing in detail in other the execution mode, also the plane can be obtained degree of polarization image and polarization phase image information as the aggregate of the pixel of delta-shaped region in the present embodiment.

(interpolation of the chroma-luminance of G)

The summit of the leg-of-mutton aggregate of point (a)～(i) expression Figure 19 shown in Figure 20.Therefore, each triangle can be considered as 1 pixel, the G chroma-luminance of each triangular pixel is carried out interpolation as the mean value of the G1 that is positioned at 3 summits, G2, G3.For example, will with point (b) (f) (e) be expressed as G as the G chroma-luminance of the triangular pixel on summit _B-f-eSituation under, brightness G _B-f-eCan calculate by following (formula 18).

[formula 18]

$G_{b-f-e}=\frac{2(I_b+I_f+I_e)}{3T}$ (formula 18)

Wherein, I _b, I _f, I _eBe respectively the G chroma-luminance of observing in the G pixel that is arranged in point (b), (f), (e).

(interpolation of the chroma-luminance of B, R)

Figure 21, Figure 22 are the figure that describes the leg-of-mutton set among Figure 19.9 pixels having represented summit and the polarised light pixel G1 of G, any one the corresponding point (a)～(i) among G2, the G3 among Figure 21, Figure 22.At this, the delta-shaped region of shortcoming B chroma-luminance or R chroma-luminance carries out interpolation by triangle on every side.Under the situation of the interpolation of carrying out the B chroma-luminance, shown in the arrow of Figure 21,3 kinds of delta-shaped regions around this interpolation utilization carry out.Under the situation of interpolation R chroma-luminance, shown in the arrow of Figure 22,3 kinds of delta-shaped regions around using carry out.

For example, will with point (b) (f) (e) be that the B chroma-luminance of the triangular pixel on summit is expressed as B _B-f-eSituation under, brightness B _B-f-eCan calculate by following (formula 19).

[formula 19]

$B_{b-f-e}=\frac{B_{b-c-f}+B_{a-b-e}+B_{e-f-i}}{3}$ (formula 19)

In addition, for example, will with point (e) (h) (d) be that the B chroma-luminance of the triangular pixel on summit is expressed as B _B-f-eSituation under, brightness R _E-h-dCan calculate by following (formula 20).

[formula 20]

$R_{e-h-d}=\frac{R_{a-e-d}+R_{e-i-h}+R_{d-h-g}}{3}$ (formula 20)

By above processing,, generate the degree of polarization image and show the polarization phase image of the polarization phase φ in each pixel and (RGB) panchromatic luminance picture at each delta-shaped region.

As shown in Figure 1, the respective embodiments described above not only have polarized color light acquisition unit 101, also have the colored image processing part that splices interpolation portion 102 grades, and still, the present invention is not as this image processing apparatus, but can realize as filming apparatus yet.That is, the filming apparatus that can be used as the colour splicing filter 201 that has shown in giving an example among Fig. 2, graphical polarizer 202 and capturing element pixel 203 is implemented the present invention.

Figure 23 is the block diagram of structure of the execution mode of expression filming apparatus of the present invention.

The filming apparatus 232 of present embodiment has lens 100, polarized color light acquisition unit 101 and the stitching image frame memory 107 in the execution mode 1～3, also has the data that are used for stitching image frame memory 107 in addition and outputs to outside efferent 108a.

Therefore the structure of the lens 100 in the present embodiment, polarized color light acquisition unit 101 and stitching image frame memory 107 and operation, do not repeat its explanation at this as enforcement mode 1～3 is illustrated.Efferent 108a has recorded data in the stitching image of the reading frame memory 107, and the function of exporting to the outside.

The signal of filming apparatus 232 outputs from present embodiment is imported in the processing unit shown in Figure 23 234.In processing unit shown in Figure 23 234, input part 108b receives the signal from filming apparatus 232, and data are recorded in the frame memory 109.The data of stitching image are read in order from frame memory 109, and are sent to the colored interpolation portion 102 of splicing, and carry out interpolation and handle.The result that interpolation is handled is: each pixel is stored in the coloured image frame memory 104 that 3 plane structures by RGB constitute, and also suitably reads.In addition, picture element signal is read from frame memory 109 in order, and is sent to polarised light information treatment part 103.These picture element signals are handled by polarised light information treatment part 103, and are stored in degree of polarization picture frame memory 105 and the polarization phase picture frame memory 106.From the data of degree of polarization picture frame memory 105 output degree of polarization images (ρ), from the data of polarization phase picture frame memory 106 output polarization phase images (φ).

Processing unit 234 can be built-in carries out the all-purpose computer of the software program of processing for example shown in Figure 12, also can be for implementing the processing unit that the present invention makes.

(utilizability on the industry)

Image processing apparatus of the present invention and image processing method can obtain simultaneously from the colour information of subject and polarised light information, therefore, can be applied to various digital still cameras, digital camera machine, monitoring camera machine, vehicle-mounted vidicon etc.

Claims (15)

1. image processing apparatus has:

The polarized color light acquisition unit, it comprises the single-plate color capturing element, and this single-plate color capturing element has: colored splicing filter and a plurality of polarizer units with transmission-polarizing face of at least 3 kinds of different angles are set at the graphical polarizer in a plurality of pixels of the same color in the above-mentioned colored splicing filter;

The polarised light information treatment part, it uses SIN function, and the relation of angle of transmission in a plurality of pixels of above-mentioned same color being crossed the transmission-polarizing face of the brightness of light of above-mentioned polarizer unit and above-mentioned polarizer unit is similar to; And

Colored splicing interpolation portion, it is by carrying out the interpolation of chroma-luminance, the angle of transmission-polarizing face is differed from one another and the delta-shaped region that forms by 3 adjacent polarizer units as pixel unit, generate the chroma-luminance image.

2. image processing apparatus according to claim 1, wherein,

Above-mentioned graphical polarizer has: the structure of 3 kinds of polarizer unit's disposed adjacent that the angle of transmission-polarizing face differs from one another.

3. image processing apparatus according to claim 1, wherein,

Above-mentioned colored splicing filter has: the pixel of single particular color is arranged saw-toothed structure,

Above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

4. image processing apparatus according to claim 1, wherein,

Above-mentioned colored splicing filter has: the pixel of single particular color is aligned to the structure that jagged square lattice rotation 45 is spent,

Above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

5. image processing apparatus according to claim 4, wherein,

Each pixel has octagonal shape.

6. image processing apparatus according to claim 3, wherein,

Above-mentioned single particular color is the G among R, G, the B, and wherein R is red, and G is green, and B is blue.

7. image processing apparatus according to claim 4, wherein,

Above-mentioned single particular color is the G among R, G, the B, and wherein R is red, and G is green, and B is blue.

8. image processing apparatus according to claim 1, wherein,

Above-mentioned colored splicing filter has: each pixel is the hexagonal cell lattice structure of hex shape,

Above-mentioned polarizer unit is configured in the pixel of single particular color of above-mentioned arrangement.

9. image processing apparatus according to claim 1, wherein,

Above-mentioned colored splicing interpolation portion is by the next door in pixel that should the interpolation chroma-luminance, the brightness equalization that will in same color pixel, observe, eliminate the effect of polarised light, and chroma-luminance carried out interpolation, the angle that above-mentioned same color pixel has a transmission-polarizing face differs 3 kinds of polarizer units of 60 ° each other.

10. image processing method has:

Be provided with the single-plate color capturing element of 3 kinds of different polarizer units of the angle of transmission-polarizing face in a plurality of pixels of the single particular color of utilization in colour element is arranged, observe the step of the brightness of each pixel;

From the brightness that 3 kinds of different pixels of the angle of the transmission-polarizing face of above-mentioned single particular color, observes, obtain the step of polarised light information; And

The delta-shaped region that will be formed by 3 kinds of different pixels of angle of the transmission-polarizing face of above-mentioned single particular color carries out the interpolation of chroma-luminance as pixel unit, thereby generates the step of chroma-luminance image.

11. a filming apparatus has:

Colored splicing filter;

Graphical polarizer, wherein, a plurality of polarizer units with transmission-polarizing face of 3 kinds of different angles are set in a plurality of pixels of the same color in the above-mentioned colored splicing filter; And

The single-plate color capturing element, it crosses the corresponding signal of brightness of the light of above-mentioned colored splicing filter and graphical polarizer with pixel unit output and transmission.

12. filming apparatus according to claim 11, wherein,

Above-mentioned colored splicing filter has: the pixel of single particular color is arranged saw-toothed structure,

Above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

13. filming apparatus according to claim 11, wherein,

Above-mentioned colored splicing filter has: the pixel of single particular color is aligned to the structure that jagged square lattice rotation 45 is spent,

Above-mentioned polarizer unit is configured in above-mentioned being arranged in the jagged pixel.

14. filming apparatus according to claim 13, wherein,

Each pixel has octagonal shape.

15. filming apparatus according to claim 11, wherein,

Above-mentioned colored splicing filter has: each pixel is the hexagonal cell lattice structure of hex shape,

Above-mentioned polarizer unit is configured in the pixel of single particular color of above-mentioned arrangement.

Images