CN111182245A

CN111182245A - Polarization type CIS, image processing method, storage medium and terminal equipment

Info

Publication number: CN111182245A
Application number: CN202010027227.0A
Authority: CN
Inventors: 杨鑫
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2020-01-10
Filing date: 2020-01-10
Publication date: 2020-05-19

Abstract

The embodiment of the application discloses a polarization type CIS, an image processing method, a storage medium and a terminal device, wherein the polarization type CIS comprises a plurality of groups of pixel unit sets with a plurality of preset directions, each group of pixel unit sets corresponds to one preset direction, and each group of pixel unit sets comprises a plurality of pixel units which are provided with a plurality of groups of polarization photodiode components in one preset direction; the multi-group pixel unit set is used for converting incident light into polarized light with three preset wavelengths in multiple preset directions, performing light absorption and photoelectric conversion on the polarized light with the three preset wavelengths in the multiple preset directions, and obtaining and reading out electric signals corresponding to the three preset wavelengths in the multiple preset directions; each group of pixel units are concentrated, the plurality of groups of polarized photodiode components comprise polarized photodiode components with three sizes, each polarized photodiode component with one size corresponds to polarized light with a preset wavelength, and the three preset wavelengths comprise a red light wavelength, a green light wavelength and a blue light wavelength.

Description

Polarization type CIS, image processing method, storage medium and terminal equipment

Technical Field

The present application relates to the field of image processing technologies, and in particular, to a polarization CIS, an image processing method, a storage medium, and a terminal device.

Background

A CMOS Image Sensor (CIS) has the characteristics of high integration level, low power consumption, high speed, low cost, and the like, and is widely applied to high-resolution pixel products. The CIS comprises two forms of monochrome polarization and color polarization, and the color polarization obtains richer colors, so that the color of the generated image is brighter compared with the monochrome polarization.

The existing polarized CIS mainly includes a microlens array, a polarizer array, and a pixel array. Here, each pixel includes a Photodiode (PD) structure, four polarizers at different angles are disposed on the PD structure, and each four pixels are used as a calculation unit to calculate the polarization degree and the polarization direction through the association between the polarizers at different directions, so as to obtain a polarization image according to the polarization degree and the polarization direction.

However, the conventional pixels are square and have a low arrangement density, and the conventional polarized CIS easily loses resolution, so that the resolution of the CIS is low.

Disclosure of Invention

The embodiment of the application provides a polarization type CIS, an image processing method, a storage medium and a terminal device, which can improve the pixel density of the CIS and the resolution of the CIS.

The technical scheme of the embodiment of the application is realized as follows:

in a first aspect, an embodiment of the present application provides a polarized CIS, which includes a plurality of sets of pixel units having a plurality of preset directions, each set of pixel units corresponding to one preset direction and each set of pixel units including a plurality of pixel units, in which a plurality of sets of polarized photodiode components are arranged in the one preset direction; wherein the content of the first and second substances,

the multi-group pixel unit set is used for converting incident light into polarized light with three preset wavelengths in multiple preset directions, performing light absorption and photoelectric conversion on the polarized light with the three preset wavelengths in the multiple preset directions, and obtaining and reading out electric signals corresponding to the three preset wavelengths in the multiple preset directions;

in each pixel unit set, the multiple groups of polarized photodiode components include polarized photodiode components of three sizes, each polarized photodiode component of one size corresponds to polarized light of a preset wavelength, and the three preset wavelengths include a red wavelength, a green wavelength and a blue wavelength.

In a second aspect, an embodiment of the present application provides an image processing method applied to the polarized CIS according to the first aspect, where the method includes:

converting incident light into polarized light with three preset wavelengths in a plurality of preset directions;

carrying out light absorption and photoelectric conversion on the polarized light with the three preset wavelengths in a plurality of preset directions to obtain electric signals corresponding to the three preset wavelengths in the plurality of preset directions;

and reading the electric signals corresponding to the three preset wavelengths in a plurality of preset directions.

In a third aspect, embodiments of the present application provide a computer storage medium storing an image processing program, which when executed by at least one processor implements the method according to the second aspect.

In a fourth aspect, an embodiment of the present application provides a terminal device, where the terminal device at least includes the polarized CIS according to the first aspect.

The polarized CIS comprises a plurality of groups of pixel unit sets with a plurality of preset directions, wherein each group of pixel unit sets corresponds to one preset direction and comprises a plurality of pixel units in which a plurality of groups of polarized photodiode components are arranged in one preset direction; the multi-group pixel unit set is used for converting incident light into polarized light with three preset wavelengths in multiple preset directions, performing light absorption and photoelectric conversion on the polarized light with the three preset wavelengths in the multiple preset directions, and obtaining and reading out electric signals corresponding to the three preset wavelengths in the multiple preset directions; in each group of pixel units, the plurality of groups of polarized photodiode components comprise polarized photodiode components with three sizes, each polarized photodiode component with each size corresponds to polarized light with a preset wavelength, and the three preset wavelengths comprise a red light wavelength, a green light wavelength and a blue light wavelength. Therefore, as a plurality of groups of polarized photodiode components are arranged in a plurality of groups of pixel units, incident light can be converted into polarized light with three preset wavelengths in a plurality of preset directions by utilizing color channels of red light, green light, blue light and the like and combining a demosaicing algorithm, and the output of a color polarized image can be realized; meanwhile, a plurality of pixel units in each group of pixel unit can be arranged in a hexagonal array mode, so that the pixel density of the CIS is improved, and the resolution of the CIS is also improved.

Drawings

Fig. 1 is a schematic diagram of a structure of a polarized CIS provided in the related art;

fig. 2 is a schematic structural diagram of a polarizing CIS provided in an embodiment of the present application;

fig. 3 is a schematic structural diagram of a pixel unit in a hexagonal array arrangement according to an embodiment of the present disclosure;

fig. 4 is a schematic diagram of a color filter array arrangement according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of an arrangement of polarized photodiodes in multiple directions according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of another polarized CIS provided in an embodiment of the present application;

fig. 7 is a schematic cross-sectional structure diagram of a pixel unit according to an embodiment of the present disclosure;

fig. 8 is a specific hardware circuit diagram of a readout circuit according to an embodiment of the present disclosure;

fig. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present application;

fig. 10 is a flowchart illustrating an image processing method according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant application and are not limiting of the application. It should be noted that, for the convenience of description, only the parts related to the related applications are shown in the drawings.

In practical applications, a conventional polarized CIS is implemented by placing four polarizing plates at different angles, for example, 0 degrees, 45 degrees, 90 degrees and 135 degrees, on the PD structure in a pixel unit, and then calculating the polarization degree and the polarization direction by using each 4 pixel units as a calculation unit through the correlation between polarizers at different directions. Specifically, if the light is natural light, after passing through a polarizing plate or a polarizer, the light intensity should be changed to half of the original light, if the four directions are all half of the original light, the light is natural light, but after linearly polarized light is introduced, the intensities of the four polarization angles are certainly different, at this time, a model can be established by assuming the proportion of the linearly polarized light and the natural light, and then according to a plurality of polarizing plates in different preset directions, the finally required proportion of the linearly polarized light and the natural light, namely the polarization degree and the polarization direction, can be obtained, so that a polarization image can be obtained.

Referring to fig. 1, a schematic diagram of a composition structure of a polarized CIS provided in the related art is shown. As shown in fig. 1, the polarizing CIS includes a microlens array, a polarizer array, and a pixel array; each pixel unit comprises a micro lens, a polarizer and a photodiode, an angular polarizer and a micro lens are placed on the PD structure, four polarizers (or polarizers) with different angles are respectively placed on every four pixel units, every four pixel structures form a group of pixel unit sets, the group of pixel unit sets serve as a calculation unit, the polarization degree and the polarization direction are calculated through association between the polarizers in different directions, and then a polarization image can be obtained according to the polarization degree and the polarization direction.

Based on the polarized CIS shown in fig. 1, the pixel units are all square, and the arrangement density is low; especially, compared with the arrangement in the hexagonal array form, the arrangement density is far lower than that in the hexagonal array form; meanwhile, the polarized CIS is easy to lose resolution, and the existing polarized CIS is black and white, so that the resolution of the CIS is low.

The embodiment of the application provides a polarization CIS, which can comprise a plurality of groups of pixel unit sets with a plurality of preset directions, wherein each group of pixel unit sets corresponds to one preset direction and comprises a plurality of pixel units in which a plurality of groups of polarization photodiode components are arranged in one preset direction; in each group of pixel units, the plurality of groups of polarized photodiode components comprise polarized photodiode components with three sizes, and each polarized photodiode component with one size corresponds to polarized light with a preset wavelength; therefore, as a plurality of groups of polarized photodiode components are arranged in a plurality of groups of pixel units, incident light can be converted into polarized light with three preset wavelengths in a plurality of preset directions by utilizing color channels of red light, green light, blue light and the like and combining a demosaicing algorithm, and the output of a color polarized image can be realized; meanwhile, a plurality of pixel units in each group of pixel unit can be arranged in a hexagonal array mode, so that the pixel density of the CIS is improved, and the resolution of the CIS is also improved.

The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

In an embodiment of the present application, referring to fig. 2, a schematic structural diagram of a polarized CIS provided in the embodiment of the present application is shown. As shown in fig. 2, the polarized CIS0 may include a plurality of sets 10 of pixel units having a plurality of predetermined directions, each set corresponding to one predetermined direction and each set including a plurality of pixel units 101 having a plurality of sets 101a of polarized photodiodes arranged in the one predetermined direction; wherein the content of the first and second substances,

the multi-group pixel unit set 10 is used for converting incident light into polarized light with three preset wavelengths in multiple preset directions, performing light absorption and photoelectric conversion on the polarized light with the three preset wavelengths in the multiple preset directions, and obtaining and reading out electric signals corresponding to the three preset wavelengths in the multiple preset directions;

in each pixel unit set, the plurality of sets of polarized photodiode portions 101a may include polarized photodiode portions of three sizes, and each polarized photodiode portion of one size corresponds to a polarized light with a preset wavelength, where the three preset wavelengths include a red wavelength, a green wavelength, and a blue wavelength.

In the case of the polarization CIS, the RGB color scheme is generally adopted as the color standard of an image. Wherein, RGB represents the colors of three channels of Red (Red, R), Green (Green, G) and Blue (Blue, B), and the colors of the three channels are mixed or superimposed according to different proportions, so that all the colors perceived by human vision in the image can be obtained. For red, the preset wavelength may be a red wavelength; for blue, the preset wavelength may be a blue wavelength; for green, the predetermined wavelength may be a green wavelength. That is, in some embodiments, the three preset wavelengths may generally include a red wavelength, a green wavelength, and a blue wavelength.

It should be further noted that each group of pixel unit sets can be regarded as a computing unit, the computing unit includes a plurality of pixel units, and the plurality of pixel units have the same polarization direction, that is, each group of pixel unit sets corresponds to a preset direction; in addition, a plurality of groups of polarized photodiode components are arranged in each group of pixel units in the same preset direction, that is, a group of polarized photodiode components are correspondingly arranged in each pixel unit, and different polarized photodiodes with different sizes can be arranged in different pixel units, so that the plurality of pixel units can comprise polarized photodiode components with three sizes.

Thus, in a group of pixel units, each size of the polarized photodiode section corresponds to a polarized light with a preset wavelength; that is, for red wavelengths, the size of the polarized photodiode section is assumed to be a first size; for green wavelengths, assume the size of the polarized photodiode section is the second size; for blue wavelengths, assume the size of the polarized photodiode section is the third size; as such, the first size, the second size, and the third size are different. In order to obtain polarized light of three colors, i.e., red, green, and blue, a set of pixel units needs to have three sizes of polarization photodiode components, i.e., one size of polarization photodiode component corresponds to at least one pixel unit in a set of pixel units.

Specifically, assuming that a group of pixel unit sets may include four pixel units, two of the pixel units may include a first-sized polarization photodiode component and may be used to obtain polarized light corresponding to a red wavelength, and the other two pixel units may include a second-sized polarization photodiode component and a third-sized polarization photodiode component and may be used to obtain polarized light corresponding to a green wavelength and polarized light corresponding to a blue wavelength, respectively; or, two of the pixel units may include a polarized photodiode component with a second size, which may be used to obtain polarized light corresponding to a green light wavelength, and the other two pixel units include a polarized photodiode component with a first size and a polarized photodiode component with a third size, which may be used to obtain polarized light corresponding to a red light wavelength and polarized light corresponding to a blue light wavelength, respectively; or, two of the pixel units may include a polarization photodiode component with a third size, which may be used to obtain polarized light corresponding to a blue light wavelength, and the other two pixel units may include a polarization photodiode component with a first size and a polarization photodiode component with a second size, which may be used to obtain polarized light corresponding to a red light wavelength and polarized light corresponding to a green light wavelength, respectively; the embodiments of the present application do not limit this.

In an embodiment of the present application, a set of polarized photodiode sections may include a plurality of polarized photodiode sections. Wherein, the number of the group of polarized photodiode parts is determined by the size of one pixel unit and the preset distance; here, the preset distance means a gap between adjacent two polarization photodiode sections in a group of polarization photodiode sections.

In some embodiments, the predetermined distance is greater than or equal to 50 nm.

That is, a set of polarized photodiode components is arranged within each pixel cell. The gap between two adjacent polarized photodiode components is a preset distance, and the preset distance can avoid mutual interference between the two adjacent polarized photodiode components. In general, the predetermined distance is usually greater than or equal to 50nm in order to avoid mutual interference between two adjacent polarization photodiode components, but this is not particularly limited in the embodiments of the present application. Thus, after the preset distance is determined, the number of the polarized photodiode components which can be arranged in the pixel unit can be determined according to the size of the pixel unit and the preset distance.

Further, in some embodiments, each pixel unit may be a regular triangle structure.

In general, a polarized CIS may constitute a minimum pixel cycle unit for every 16 pixels; the 16 pixels can be divided into four groups of pixel unit sets, and each group of pixel unit set comprises four pixel units. Thus, in some embodiments, each set of pixel units may include four pixel units, and the four pixel units are arranged in a hexagonal array; and the sets of pixel units may include four sets of pixel units, and the four sets of pixel units are arranged in a hexagonal array.

It should be noted that, since the resolution of the quad array is smaller than that of the hexagonal array, in order to improve the resolution of the CIS, every four pixel units may be arranged in the form of the hexagonal array, as shown in fig. 3; in fig. 3, 16 pixel cells may be respectively denoted by 0, 1, 2, 3, …, 15, wherein a first group of four pixel cells (including 0, 1, 2, and 3) constitutes a first set of pixel cells a, a second group of four pixel cells (including 4, 5, 6, and 7) constitutes a second set of pixel cells b, a third group of four pixel cells (including 8, 9, 10, and 11) constitutes a third set of pixel cells c, and a fourth group of four pixel cells (including 12, 13, 14, and 15) constitutes a fourth set of pixel cells d; the 16 pixel units are all in a regular triangle structure, and the 16 pixel units can be arranged in a hexagonal array as shown in fig. 3.

In some embodiments, the sets of pixel units 10 can include four sets of pixel units, which can include a first set of pixel units, a second set of pixel units, a third set of pixel units, and a fourth set of pixel units; wherein the content of the first and second substances,

the first pixel unit set is provided with a plurality of groups of polarized photodiode components in a first preset direction, and is used for converting incident light into polarized light in the first preset direction;

a plurality of groups of polarized photodiode components are arranged in the second pixel unit set in the second preset direction and are used for converting incident light into polarized light in the second preset direction;

a plurality of groups of polarized photodiode components are arranged in the third pixel unit set in a third preset direction and are used for converting incident light into polarized light in the third preset direction;

and a plurality of groups of polarized photodiode components are arranged in the fourth pixel unit set in the fourth preset direction and are used for converting incident light into polarized light in the fourth preset direction.

It should be noted that the plurality of preset directions at least include a first preset direction, a second preset direction, a third preset direction and a fourth preset direction, and the first preset direction, the second preset direction, the third preset direction and the fourth preset direction are different from each other.

In some embodiments, the plurality of predetermined directions includes at least 0 degrees, 45 degrees, 90 degrees, and 135 degrees.

That is, the first preset direction may be 0 degree, the second preset direction may be 45 degrees, the third preset direction may be 90 degrees, and the fourth preset direction may be 135 degrees; alternatively, the first preset direction may be 0 degree, the second preset direction may be 135 degrees, the third preset direction may be 90 degrees, and the fourth preset direction may be 45 degrees; alternatively, the first preset direction may be 45 degrees, the second preset direction may be 135 degrees, the third preset direction may be 0 degrees, the fourth preset direction may be 90 degrees, and so on; here, the first preset direction, the second preset direction, the third preset direction and the fourth preset direction are specifically set according to actual situations, and the present application embodiment does not limit this.

It should be further noted that, in each group of pixel unit sets, the preset directions corresponding to different pixel units are the same; but the corresponding preset directions are different for different sets of pixel cells. Here, the number of the preset directions may correspond to the number of the pixel unit sets; for example, when there are four preset directions, the multi-group pixel unit set includes four groups of pixel unit sets; when the number of the preset directions is six, the multiple groups of pixel unit sets comprise six groups of pixel unit sets; when the number of the preset directions is eight, the multiple groups of pixel unit sets comprise eight groups of pixel unit sets; in addition, the number of the preset directions may not correspond to the number of the pixel unit sets, and particularly, when the number of the preset directions is smaller than the number of the pixel unit sets, the number of one preset direction may correspond to one or more groups of pixel unit sets; for example, when there are 2 preset directions, the sets of pixel units include four sets of pixel units, and each preset direction may correspond to two sets of pixel units. That is to say, although the present embodiment adopts four polarization directions, such as 0 degree, 45 degree, 90 degree and 135 degree, as basic directions, 9, 16 or even more polarization directions may be used to acquire the polarization signal, or fewer polarization directions may be used, for example, only 2 polarization directions (0 degree and 45 degree) or other numbers of polarization directions are used to acquire the polarization signal, which is not limited in the present embodiment.

In addition, when the first preset direction is0 degree, the second preset direction is 45 degrees, the third preset direction is 90 degrees, and the fourth preset direction is 135 degrees, it is described that the first pixel unit set is provided with a plurality of groups of polarized photodiode components arranged in the 0 degree direction, and is used for converting incident light into polarized light in the 0 degree direction; a plurality of groups of polarized photodiode components are arranged in the 45-degree direction of the second pixel unit set and are used for converting incident light into polarized light in the 45-degree direction; a plurality of groups of polarized photodiode components are arranged in the 90-degree direction of the third pixel unit set and are used for converting incident light into polarized light in the 90-degree direction; the fourth pixel unit group is arranged with a plurality of groups of polarized photodiode components in 135 degree direction for converting incident light into polarized light in 135 degree direction.

Further, for each set of pixel units, it is assumed that a set of pixel units includes four pixel units. Specifically, in some embodiments, the four pixel units may include a first pixel unit, a second pixel unit, a third pixel unit, and a fourth pixel unit; wherein the content of the first and second substances,

the first pixel unit comprises a first group of polarized photodiode components which are arranged in a preset direction, the corresponding size of the first group of polarized photodiode components is 70nm multiplied by 50nm, and the first pixel unit is used for converting incident light into first polarized light with blue light wavelength in the preset direction, and performing light absorption and photoelectric conversion on the first polarized light to obtain an electric signal with blue light wavelength in the preset direction;

the second pixel unit and the third pixel unit respectively comprise a second group of polarized photodiode components which are arranged in a preset direction, the corresponding size of the second group of polarized photodiode components is 90nm multiplied by 50nm, and the second group of polarized photodiode components are used for converting incident light into second polarized light of which the green light wavelength is in the preset direction, and performing light absorption and photoelectric conversion on the second polarized light to obtain an electric signal of which the green light wavelength is in the preset direction;

the fourth pixel unit comprises a third group of polarized photodiode components which are arranged in the preset direction, the corresponding size of the third group of polarized photodiode components is 110nm multiplied by 50nm, and the third group of polarized photodiode components are used for converting incident light into third polarized light with red light wavelength in the preset direction, and performing light absorption and photoelectric conversion on the third polarized light to obtain an electric signal with red light wavelength in the preset direction.

It should be noted that the preset direction here is one of a plurality of preset directions, that is, the preset direction may be a 0-degree direction, a 45-degree direction, a 90-degree direction, or even a 135-degree direction, and the embodiment of the present application is not limited.

It is also noted that there are three dimensions for the polarizing photodiode element, such as 70nm x 50nm, 90nm x 50nm and 110nm x 50 nm. The three sizes of polarized photodiode sections may be placed in the plurality of pixel cells, i.e., each size of polarized photodiode section is placed in at least one pixel cell.

Further, in some embodiments, the first thickness parameter corresponding to the 70nm × 50nm polarization photodiode section is set to range from 80nm to 500m, the second thickness parameter corresponding to the 90nm × 50nm polarization photodiode section is set to range from 500nm to 1um, and the third thickness parameter corresponding to the 110nm × 50nm polarization photodiode section is set to range from 500nm to 2 um.

Here, the larger the value of the thickness parameter, the higher the light absorption rate. In general, whether the first thickness parameter, the second thickness parameter, or the third thickness parameter, the thickness may be appropriately increased in order to increase the light absorption rate. For example, for a 70nm x 50nm polarized photodiode component, the absorption of blue light may be increased by increasing the first thickness parameter; for a 90nm x 50nm polarized photodiode component, the absorption of green light may be increased by increasing the second thickness parameter; for a 110nm x 50nm polarized photodiode component, the absorption of red light can be increased by adding the third thickness parameter.

It should be noted that, for a 70nm × 50nm polarized photodiode component, the optimal setting range of the first thickness parameter is 80nm to 500 m; the larger the thickness, the higher the light absorption rate; wherein, the thickness of 1um, the light absorption rate can reach more than 98%; meanwhile, due to resonance absorption of the polarized photodiode component, more than 95% of blue light can be absorbed, and corresponding electric signals can be obtained through photoelectric conversion. In addition, for the 90nm × 50nm polarized photodiode section and the 110nm × 50nm polarized photodiode section, the value of the second thickness parameter may also be increased appropriately to increase the light absorption rate of the 90nm × 50nm polarized photodiode section for green light; and properly increasing the value of the third thickness parameter to increase the light absorption rate of the polarized photodiode component with the wavelength of 110nm multiplied by 50nm to red light, and finally obtaining a corresponding electric signal through photoelectric conversion.

In some embodiments, a plurality of pixel cells in each set of pixel cells have three color filters including a blue color filter, a green color filter, and a red color filter.

Further, when each set of pixel units includes four pixel units, the four color filters corresponding to the four pixel units include one blue color filter, two green color filters, and one red color filter, and the four color filters are arranged in a hexagonal array.

The color filter is mainly used for filtering incident light, transmitting an optical signal corresponding to a predetermined wavelength, and absorbing other optical signals in the incident light. Specifically, the blue color filter (which may be denoted by B) is mainly used for transmitting an optical signal corresponding to a blue wavelength and absorbing other optical signals (e.g., optical signals corresponding to a green wavelength, a red wavelength, etc.) in the incident light; the green light filter (which may be denoted by G) is mainly used for transmitting an optical signal corresponding to a green wavelength and absorbing other optical signals (e.g., optical signals corresponding to blue wavelengths, red wavelengths, etc.) in incident light; the red color filter (which may be denoted by R) is mainly used to transmit the light signal corresponding to the red wavelength and absorb other light signals (e.g., light signals corresponding to blue wavelength, green wavelength, etc.) in the incident light.

It should be noted that when each pixel unit set includes four pixel units, two green color filters may be present at this time, that is, four color filters including 2G, 1R, and one B, in order to improve the light absorption rate of green light. It should be noted that the arrangement order of the color filter array can be changed arbitrarily, but it is preferable to ensure that two G's are not adjacent; for example, the color filter array may be GBGR, GRGB, BGRG, or RGBG, which is not limited in this application.

In addition, in order to increase the light absorption of blue light, two blue color filters may be present at this time, i.e., four color filters including 2B, 1R, and one G; alternatively, in order to improve the light absorption rate of red light, two red color filters may be present, that is, four color filters include 2R, 1B and one G, which is not limited in the present application.

In this way, taking a set of pixel units such as the first pixel unit, the second pixel unit, the third pixel unit and the fourth pixel unit as an example, the polarization directions of the four pixel units are the same preset direction. For BGRG, if the color filter corresponding to the first pixel unit is B, the first pixel unit is configured to convert the incident light into a first polarized light with a blue light wavelength in a preset direction, and the size of the corresponding polarized photodiode component is 70nm × 50nm, and the first polarized light can be subjected to light absorption and photoelectric conversion to obtain an electrical signal with a blue light wavelength in a preset direction; if the color filter corresponding to the second pixel unit is G, the second pixel unit is used for converting the incident light into second polarized light with green light wavelength in the preset direction, the size of the corresponding polarized photodiode component is 90nm multiplied by 50nm, and the second polarized light can be subjected to light absorption and photoelectric conversion to obtain an electric signal with green light wavelength in the preset direction; if the color filter corresponding to the third pixel unit is R, the third pixel unit is configured to convert the incident light into a third polarized light with a red light wavelength in a preset direction, and the size of the corresponding polarized photodiode component is 110nm × 50nm, and the third polarized light can be subjected to light absorption and photoelectric conversion to obtain an electrical signal with the red light wavelength in the preset direction; if the color filter corresponding to the fourth pixel unit is also G, the fourth pixel unit is configured to convert the incident light into a second polarized light with a green wavelength in a predetermined direction, and the size of the polarized photodiode component corresponding to the fourth pixel unit is 90nm × 50nm, and the second polarized light can be subjected to light absorption and photoelectric conversion to obtain an electrical signal with a green wavelength in a predetermined direction. Or, for GBGR, if the color filter corresponding to the first pixel unit is G, the first pixel unit is configured to convert the incident light into a second polarized light with a green wavelength in a preset direction, and the size of the corresponding polarized photodiode component is 90nm × 50nm, and the second polarized light can be subjected to light absorption and photoelectric conversion to obtain an electrical signal with a green wavelength in a preset direction; if the color filter corresponding to the second pixel unit is B, the second pixel unit is used for converting the incident light into first polarized light with the blue light wavelength in the preset direction, the size of the corresponding polarized photodiode component is 70nm multiplied by 50nm, and the first polarized light can be subjected to light absorption and photoelectric conversion to obtain an electric signal with the blue light wavelength in the preset direction; if the color filter corresponding to the third pixel unit is G, the third pixel unit is configured to convert the incident light into a second polarized light with a green wavelength in a preset direction, and the size of the corresponding polarized photodiode component is 90nm × 50nm, and the second polarized light can be subjected to light absorption and photoelectric conversion to obtain an electrical signal with a green wavelength in a preset direction; if the color filter corresponding to the fourth pixel unit is R, the fourth pixel unit is configured to convert the incident light into a third polarized light with a red wavelength in a preset direction, and the size of the corresponding polarized photodiode unit is 110nm × 50nm, and the third polarized light can be subjected to light absorption and photoelectric conversion to obtain an electrical signal with a red wavelength in a preset direction.

For example, refer to fig. 4, which shows a schematic diagram of a color filter array arrangement provided in an embodiment of the present application. As shown in fig. 4, there are 16 pixel units in total, and every four pixel units constitute a set of pixel units. In fig. 4, four adjacent pixel units corresponding to the upper left constitute a first pixel unit set, four adjacent pixel units corresponding to the upper right constitute a second pixel unit set, four adjacent pixel units corresponding to the lower left constitute a third pixel unit set, four adjacent pixel units corresponding to the lower right constitute a fourth pixel unit set, and the color filter arrangements of the four pixel unit sets are the same; taking one group of pixel unit sets as an example, one group of pixel unit sets includes a first pixel unit, a second pixel unit, a third pixel unit and a fourth pixel unit, the first pixel unit is set as a green color filter, and is denoted by G, and can be used for filtering to obtain a green wavelength; the second pixel unit is provided with a blue light color filter, indicated by B, and can be used for filtering to obtain blue light wavelength; the third pixel unit is provided with a green light color filter, indicated by G, and can be used for filtering green light wavelength; the fourth pixel unit is provided with a red light color filter, indicated by R, and can be used for filtering to obtain red light wavelength; of the 16 pixel units, the color filter arrays corresponding to every four adjacent pixel units are in G, B, G, R order.

Referring to fig. 5, a schematic diagram of an arrangement of polarized photodiodes in multiple preset directions according to an embodiment of the present application is shown. As shown in fig. 5, there are 16 pixel units, and each four pixel units form a set of pixel units, so that four sets of pixel units can be obtained, and the four sets of pixel units adopt the color filter array arrangement shown in fig. 4. Wherein different sets of pixel units have different polarization directions, but each pixel unit in the same set of pixel units has the same polarization direction. For the first pixel unit set at the upper left, a group of polarized photodiode components are arranged on the four pixel units in the 0-degree direction; for the second pixel unit set at the upper right, a group of polarized photodiode components are arranged in the 135-degree direction of the four pixel units; for the third pixel unit set at the lower left, a group of polarized photodiode components are arranged in the 90-degree direction of the four pixel units; for the fourth set of pixel cells at the bottom right, each of these four pixel cells has a set of polarized photodiode components arranged at 45 degrees. Further, for each group of pixel unit sets, the sizes of the polarized photodiode components arranged in the first pixel unit and the third pixel unit are 90nm × 50nm (which can be represented by black filled cuboids), polarized light corresponding to the green light wavelength in the preset direction can be obtained, and an electric signal corresponding to the green light wavelength in the preset direction can be obtained by performing light absorption and photoelectric conversion on the polarized light; the size of the polarized photodiode component arranged in the second pixel unit is 70nm × 50nm (which can be represented by a gray-filled cuboid), polarized light corresponding to the blue light wavelength in the preset direction can be obtained, and an electric signal corresponding to the blue light wavelength in the preset direction can be obtained by performing light absorption and photoelectric conversion on the polarized light; the polarized photodiode components arranged in the fourth pixel unit have the size of 110nm × 50nm (which can be represented by white-filled cuboids), can obtain polarized light with the red light wavelength corresponding to the preset direction, and can obtain an electric signal with the red light wavelength corresponding to the preset direction by performing light absorption and photoelectric conversion on the polarized light; that is, for each set of pixel units, the four pixel units can respectively absorb light signals of G, R, G and B and the same polarization direction, the 16 pixel units can absorb light signals of R, G and B colors in four directions of 0 degree, 45 degree, 90 degree and 135 degree, and can perform photoelectric conversion on the absorbed light signals of R, G and B colors in four directions to convert the light signals into corresponding electric signals.

Further, as can be seen from fig. 5, a set of polarization photodiode units is arranged in each pixel unit, and the number of the set of polarization photodiode units is determined by the size of one pixel unit and the preset distance. Wherein, the predetermined distance is usually greater than or equal to 50nm, so as to avoid mutual interference between two adjacent polarized photodiode components.

In some embodiments, refer to fig. 6, which shows a schematic structural diagram of another polarized CIS provided in the embodiments of the present application. As shown in fig. 6, the polarized CIS0 may also include an image processor 20, wherein,

and the image processor 20 is configured to determine a polarization degree and a polarization direction by using the electrical signals corresponding to the three preset wavelengths in a plurality of preset directions, and obtain a color polarization image according to the polarization degree and the polarization direction.

It should be noted that the polarization CIS0 may further include an image processor 20 connected to the multiple sets of pixel units 10. The Image processor 20 may be referred to as an Image Signal Processor (ISP), so that after the electrical signals with three preset wavelengths corresponding to a plurality of preset directions are obtained, the electrical signals can be input to the ISP for Image processing, such as first determining a polarization degree and a polarization direction, and then obtaining a color polarization Image corresponding to the incident light according to the polarization degree and the polarization direction.

In some embodiments, one of the pixel unit sets in the multiple pixel unit sets 10 is specifically configured to convert incident light into polarized light corresponding to three preset wavelengths in one preset direction, and perform light absorption and photoelectric conversion on the polarized light corresponding to the three preset wavelengths in the one preset direction; the preset wavelength corresponds to the size of the polarized photodiode component in each pixel unit.

Further, in some embodiments, each pixel cell may include a color filter, a set of polarized photodiode components, and readout circuitry connected to the set of polarized photodiode components; wherein the content of the first and second substances,

the color filter is used for filtering incident light to obtain an optical signal corresponding to a preset wavelength;

the group of polarized photodiode components is used for converting the obtained optical signals into polarized light with a preset wavelength in a preset direction, and performing light absorption and photoelectric conversion on the polarized light with the preset wavelength in the preset direction to obtain electric signals corresponding to the preset wavelength in the preset direction;

and the reading circuit is used for reading the electric signal corresponding to the preset wavelength in the preset direction.

It should be noted that, for each pixel unit, in addition to the set of polarized photodiode sections and the color filter, each pixel unit further includes a readout circuit, which is connected to the set of polarized photodiode sections and is used for reading out the electrical signal corresponding to the preset wavelength in the preset direction.

Referring to fig. 7, a schematic cross-sectional structure diagram of a pixel unit provided in an embodiment of the present application is shown. As shown in fig. 7, the pixel unit may include a color filter layer, a polarized photodiode section layer, and a readout circuit layer; wherein the color filter layer may include a blue color filter 71, a green color filter 72, and a red color filter 73, and the polarization photodiode section layer may include a first group of polarization photodiode sections 74, a second group of polarization photodiode sections 75, and a third group of polarization photodiode sections 76; here, each set of the polarized photodiode section may be composed of several polarized photodiode sections, and the readout circuit layer may be composed of Metal Wiring (Metal Wiring).

Based on the pixel unit shown in fig. 7, taking the B channel as an example, after the incident light passes through the blue light filter 71, only the transmitted blue light will irradiate on the first set of polarized photodiode parts 74, where the polarized photodiode parts in the first set of polarized photodiode parts 74 have a size of 70nm × 50nm and a thickness of preferably 80nm to 500m, and due to the resonant absorption of the rectangular parallelepiped photodiode, 95% or more of the blue light can be absorbed and converted into corresponding electrical signals. For the G channel and the R channel, only the respective color filters need to be replaced. That is, for the G channel, after the incident light passes through the green color filter 72 along the incident light direction, only the transmitted green light will be irradiated onto the second group of polarized photodiode sections 75, where the polarized photodiode sections in the second group of polarized photodiode sections 75 have a size of 90nm × 50nm and a thickness of preferably 500nm to 1um, so that the green light can be absorbed and converted into corresponding electrical signals; for the R channel, after the incident light passes through the red light filter 73 along the incident light direction, only the transmitted red light will be irradiated onto the third set of polarized photodiode sections 76, where the polarized photodiode sections in the third set of polarized photodiode sections 76 have a size of 110nm × 50nm and a thickness of preferably 500 nm-2 um, so that the red light can be absorbed and converted into corresponding electrical signals, and finally the electrical signals are read out by the readout circuit.

Further, in some embodiments, in a specific hardware circuit of the readout circuit, the readout circuit may include a transfer transistor (denoted by TG) connected to the at least one polarized photodiode element, a readout region (denoted by FD) connected to the transfer transistor, and a gate transistor (denoted by SEL) connected to the readout region, wherein the gate transistor may be configured to gate the transfer transistor in a preset readout order; the transfer tube may be used to transfer the corresponding electrical signal to the read region when the gate tube is gated.

Further, the readout circuit may further include an amplifier tube (denoted by BSF) connected to the readout region and the gate tube; the amplifying tube can be used for amplifying the electric signals read out by the readout region, and the gate tube can be used for transmitting the amplified electric signals to the image processor.

In addition, the readout circuit may further include a reset transistor (denoted by RST) connected to the readout region and the amplifying transistor; the readout region can also be used for reading out the reset level in the reset tube, and the amplifying tube can also be used for amplifying the reset level.

It should be noted that the source and power supply (using V) of the reset transistor_APPIXRepresents) a connection; the drain of the reset tube is connected to the FD, wherein the reset tube stores a reset level, and the reset level is read out through the FD. In this way, the reset level is read from the reset transistor, the electric signal is read from the transfer transistor, the reset level and the electric signal are amplified, and the amplified electric signal and the amplified reset level are correlated double-sampled, thereby reducing the noise of the read electric signal.

For example, refer to fig. 8, which shows a specific hardware circuit diagram of a readout circuit provided in an embodiment of the present application. As shown in FIG. 8, the n-region of at least one of the polarized photodiode sections is connected to the readout region (FD) via the transfer Transistor (TG), the FD is also connected to the drain of the reset transistor (RST), the source of the reset transistor and the power supply (V)_APPIX) Connecting; the FD is further connected to the gate of an amplifying transistor (BSF), the source of the BSF being connected to the power supply, the drain of the BSF being connected to the source of a gate line (SEL), the drain of the gate line being connected to the Output (OUT). Specifically, the work flow of the readout circuit shown in fig. 8 is: exposure: electron-hole pairs generated by light irradiation are separated by the presence of an electric field generated by the PPD region, electrons move to the n region, and holes move to the p region; resetting: at the end of exposure, RST is activated, and a read-out area is reset to a high level; reset level readout: after the reset is finished, reading out a reset level, and storing a read-out signal in a first capacitor; and (3) charge transfer: TX is activated, transferring charge from the photosensitive region completely to the n + region for readout; signal level readout: after the charge transfer, the signal level is read out.

In the embodiment of the application, in the polarization CIS, each 16 pixel units can form a minimum pixel period unit, the polarization directions of four transversely continuous pixel units are the same, and the GBGR sequence is adopted for the corresponding color filter array above the pixel units. Here, each pixel unit has a regular triangle structure, and 16 pixel units are arranged in a hexagonal array. Each pixel unit can contain a plurality of polarized photodiode components, the polarized photodiode components are cuboid, and the sizes include three types: 70nm × 50nm corresponding to blue light wavelength, 90nm × 50nm corresponding to green light wavelength, and 110nm × 50nm corresponding to red light wavelength; in addition, four sets of polarized photodiode components with different orientations (0 degree direction, 45 degree direction, 90 degree direction and 135 degree direction) are arranged in the 16 pixel units; therefore, after the incident light passes through the polarized photodiode component, the incident light is changed into light with special polarization, and then by utilizing colors of R, G, B channels and combining with a demosaicing algorithm, a hexagonal array color polarized CIS can be finally realized, so that not only is the pixel density of the polarized CIS improved, but also the resolution of the CIS is improved, and finally a color polarized image can be output.

The present embodiment provides a polarization CIS, which may include a plurality of sets of pixel units having a plurality of preset directions, each set of pixel units corresponding to one preset direction and each set of pixel units including a plurality of pixel units having a plurality of sets of polarization photodiode components arranged in the one preset direction; in each group of pixel units, the plurality of groups of polarized photodiode components comprise polarized photodiode components with three sizes, and each polarized photodiode component with one size corresponds to polarized light with a preset wavelength; therefore, as a plurality of groups of polarized photodiode components are arranged in a plurality of groups of pixel units, incident light can be converted into polarized light with three preset wavelengths in a plurality of preset directions by utilizing a demosaicing algorithm and combining polarized pixels, and the output of a color polarized image can be realized; meanwhile, a plurality of pixel units in each group of pixel unit can be arranged in a hexagonal array mode, so that the pixel density of the CIS is improved, and the resolution of the CIS is also improved.

In another embodiment of the present application, the polarizing CIS0 of any one of the preceding embodiments may be located in a terminal device. Referring to fig. 9, a schematic diagram of a composition structure of a terminal device provided in an embodiment of the present application is shown. As shown in fig. 9, the terminal device 90 includes at least the polarized CIS0 described in any of the previous embodiments.

Here, the terminal device 90 may be implemented in various forms. For example, the terminal device 90 described in the embodiment of the present application may include a mobile terminal device such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a digital camera, a digital video camera, and a stationary terminal device such as a digital TV, a desktop computer, and the like.

In another embodiment of the present application, refer to fig. 10, which shows a flowchart of an image processing method provided in an embodiment of the present application. As shown in fig. 10, the method may further include:

s1001: converting incident light into polarized light with three preset wavelengths in a plurality of preset directions;

it should be noted that the image processing method can be applied to the polarized CIS described in any one of the foregoing embodiments or a terminal device including the polarized CIS.

It should be further noted that the polarized CIS may include a plurality of sets of pixel units having a plurality of preset directions, each set of pixel units corresponds to one preset direction, and each set of pixel units includes a plurality of pixel units in which a plurality of sets of polarized photodiode components are arranged in the one preset direction; in each pixel unit set, the plurality of sets of polarized photodiode sections may include polarized photodiode sections of three sizes, and each polarized photodiode section of one size corresponds to polarized light of a predetermined wavelength.

For a polarized CIS, the color standard of an image generally adopts an RGB color mode. Wherein, RGB represents the colors of three channels of Red (Red, R), Green (Green, G) and Blue (Blue, B), and the colors of the three channels are mixed or superimposed according to different proportions, so that all the colors perceived by human vision in the image can be obtained. For red, the preset wavelength may be a red wavelength; for blue, the preset wavelength may be a blue wavelength; for green, the predetermined wavelength may be a green wavelength. Thus, in some embodiments, the three preset wavelengths may generally include a red wavelength, a green wavelength, and a blue wavelength.

In some embodiments, each pixel unit may be a regular triangle structure.

It should be noted that, since the resolution of the quad array is smaller than that of the hexagonal array, in order to improve the resolution of the CIS, every four pixel units may be arranged in the form of the hexagonal array. In general, a polarized CIS may constitute a minimum pixel cycle unit for every 16 pixels; the 16 pixels can be divided into four groups of pixel unit sets, and each group of pixel unit set comprises four pixel units. Thus, in some embodiments, each set of pixel units may include four pixel units, and the four pixel units are arranged in a hexagonal array; the plurality of groups of pixel unit sets can comprise four groups of pixel unit sets, and the four groups of pixel unit sets are arranged in a hexagonal array form, so that the pixel density of the CIS can be improved, and the resolution of the CIS can be improved.

Further, in some embodiments, the sets of pixel units may include four sets of pixel units, which may include a first set of pixel units, a second set of pixel units, a third set of pixel units, and a fourth set of pixel units; wherein the content of the first and second substances,

S1002: carrying out light absorption and photoelectric conversion on the polarized light with the three preset wavelengths in a plurality of preset directions to obtain electric signals corresponding to the three preset wavelengths in the plurality of preset directions;

it should be noted that, for each set of pixel units, a set of polarization photodiode components is arranged in each pixel unit, and the polarization photodiode components can not only realize polarized light in a preset direction, but also perform light absorption and photoelectric conversion on the polarized light in the preset direction.

In some embodiments, assuming that a group of pixel unit sets includes four pixel units, the four pixel units may include a first pixel unit, a second pixel unit, a third pixel unit, and a fourth pixel unit; wherein the content of the first and second substances,

It should be noted that the preset direction here is one of a plurality of preset directions, that is, the preset direction may be a 0-degree direction, a 45-degree direction, a 90-degree direction, or even a 135-degree direction, and the embodiment of the present application is not limited. In addition, there are three sizes of the polarized photodiode section, such as 70nm × 50nm, 90nm × 50nm, and 110nm × 50 nm. The three sizes of polarized photodiode sections may be placed in the plurality of pixel cells, i.e., each size of polarized photodiode section is placed in at least one pixel cell.

Therefore, incident light can be converted into polarized light with three preset wavelengths in multiple preset directions through the multiple groups of pixel unit sets, the polarized light with the three preset wavelengths in the multiple preset directions is subjected to light absorption and photoelectric conversion, and electric signals corresponding to the three preset wavelengths in the multiple preset directions are obtained.

S1003: and reading the electric signals corresponding to the three preset wavelengths in a plurality of preset directions.

Further, in some embodiments, for S1003, after reading out the electrical signals corresponding to the three preset wavelengths in the plurality of preset directions, the method may further include:

and determining the polarization degree and the polarization direction by utilizing the electric signals corresponding to the three preset wavelengths in a plurality of preset directions, and obtaining a color polarization image according to the polarization degree and the polarization direction.

It should be noted that, in the polarized CIS, an image processor connected to a plurality of sets of pixel units may be further included. The Image Processor may be referred to as an Image Signal Processor (ISP), so that after the electrical signals with three preset wavelengths corresponding to a plurality of preset directions are obtained, the electrical signals may be input to the ISP for Image processing, for example, first determining a polarization degree and a polarization direction, and then obtaining a color polarization Image corresponding to the incident light according to the polarization degree and the polarization direction.

The present embodiment provides an image processing method applied to the polarizing CIS described in any one of the preceding embodiments. Converting incident light into polarized light with three preset wavelengths in a plurality of preset directions; carrying out light absorption and photoelectric conversion on the polarized light with the three preset wavelengths in a plurality of preset directions to obtain electric signals corresponding to the three preset wavelengths in the plurality of preset directions; reading the electric signals corresponding to the three preset wavelengths in a plurality of preset directions; therefore, as a plurality of groups of polarized photodiode components are intensively arranged in a plurality of groups of pixel units in the polarization CIS, incident light can be converted into polarized light with three preset wavelengths in a plurality of preset directions by utilizing color channels such as R, G and B and combining a demosaicing algorithm, and the output of color polarized images can be realized; meanwhile, a plurality of pixel units in each group of pixel unit can be arranged in a hexagonal array mode, so that the pixel density of the CIS is improved, and the resolution of the CIS is also improved.

It is to be understood that each component of the polarized CIS described in the foregoing embodiments may be integrated in one processing unit, each component may exist alone physically, or two or more components may be integrated in one unit. The integrated unit can be realized in a form of hardware or a form of a software functional module.

Based on the understanding that the technical solution of the present embodiment essentially or a part contributing to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method of the present embodiment. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.

In yet another embodiment of the present application, the present embodiment provides a computer storage medium storing an image processing program that, when executed by at least one processor, implements the method of any one of the preceding embodiments.

Specifically, an image processing program in the present embodiment may be stored on a storage medium such as an optical disc, a hard disk, a usb disk, or the like, and when a program or an instruction corresponding to the method in the storage medium is read or executed by a terminal device, includes:

It should be noted that, in the present application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

The methods disclosed in the several method embodiments provided in the present application may be combined arbitrarily without conflict to obtain new method embodiments.

Features disclosed in several of the product embodiments provided in the present application may be combined in any combination to yield new product embodiments without conflict.

The features disclosed in the several method or apparatus embodiments provided in the present application may be combined arbitrarily, without conflict, to arrive at new method embodiments or apparatus embodiments.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A polarized CMOS Image Sensor (CIS) comprises multiple sets of pixel units with multiple preset directions, wherein each set of pixel units corresponds to one preset direction and comprises multiple pixel units with multiple sets of polarized photodiode components arranged in the preset direction; wherein the content of the first and second substances,

2. A polarizing CIS according to claim 1 characterised in that each pixel cell is of regular triangular structure.

3. A polarizing CIS according to claim 2 characterised in that each set of pixel units comprises four pixel units arranged in a hexagonal array.

4. A polarizing CIS according to claim 3 wherein the sets of pixel units comprise four sets of pixel units arranged in a hexagonal array.

5. A polarizing CIS according to claim 4 wherein the four sets of pixel units comprise a first set of pixel units, a second set of pixel units, a third set of pixel units and a fourth set of pixel units; wherein the content of the first and second substances,

a plurality of groups of polarized photodiode components are arranged in the first pixel unit set in the 0-degree direction and are used for converting incident light into polarized light in the 0-degree direction;

a plurality of groups of polarized photodiode components are arranged in the 45-degree direction of the second pixel unit set and are used for converting incident light into polarized light in the 45-degree direction;

a plurality of groups of polarized photodiode components are arranged in the 90-degree direction of the third pixel unit set and are used for converting incident light into polarized light in the 90-degree direction;

and a plurality of groups of polarized photodiode components are arranged in the 135-degree direction of the fourth pixel unit set and are used for converting incident light into polarized light in the 135-degree direction.

6. A polarizing CIS according to claim 1 characterised in that the plurality of preset directions comprises at least 0, 45, 90 and 135 degrees.

7. A polarizing CIS according to claim 3, characterised in that the four pixel units comprise a first pixel unit, a second pixel unit, a third pixel unit and a fourth pixel unit; wherein the content of the first and second substances,

8. The polarizing CIS of claim 1, wherein a plurality of pixel cells in each set of pixel cells have three color filters including a blue color filter, a green color filter, and a red color filter.

9. The polarizing CIS of claim 8, wherein when each set of pixel units comprises four pixel units, the four color filters corresponding to the four pixel units comprise one blue color filter, two green color filters and one red color filter, and the four color filters are arranged in a hexagonal array.

10. A polarizing CIS according to claim 1, characterised in that it further comprises an image processor, wherein,

the image processor is used for determining the polarization degree and the polarization direction by utilizing the electric signals corresponding to the three preset wavelengths in a plurality of preset directions, and obtaining a color polarization image according to the polarization degree and the polarization direction.

11. A polarizing CIS according to claim 1, wherein each pixel cell comprises a color filter, a set of polarizing photodiode components and a readout circuit connected to the set of polarizing photodiode components; wherein the content of the first and second substances,

12. A polarizing CIS according to any of claims 1 to 11, characterised in that each polarizing photodiode component is shaped as a cuboid.

13. An image processing method applied to the polarized CIS of claim 1, the method comprising:

14. The method of claim 13, wherein after said reading out the electrical signals corresponding to the three preset wavelengths in a plurality of preset directions, the method further comprises:

15. A computer storage medium, characterized in that it stores an image processing program which, when executed by at least one processor, implements the method of any one of claims 13 to 14.

16. A terminal device characterized in that it comprises at least a polarized CIS according to any of claims 1 to 12.