CN110087005A - A kind of Color Polarization formula CIS and image processing method, storage medium - Google Patents

A kind of Color Polarization formula CIS and image processing method, storage medium Download PDF

Info

Publication number
CN110087005A
CN110087005A CN201910330918.5A CN201910330918A CN110087005A CN 110087005 A CN110087005 A CN 110087005A CN 201910330918 A CN201910330918 A CN 201910330918A CN 110087005 A CN110087005 A CN 110087005A
Authority
CN
China
Prior art keywords
polarization
color
information
wavelength
rgb
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910330918.5A
Other languages
Chinese (zh)
Other versions
CN110087005B (en
Inventor
杨鑫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201910330918.5A priority Critical patent/CN110087005B/en
Priority to CN202110532817.3A priority patent/CN113329193A/en
Publication of CN110087005A publication Critical patent/CN110087005A/en
Application granted granted Critical
Publication of CN110087005B publication Critical patent/CN110087005B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/71Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/75Circuitry for providing, modifying or processing image signals from the pixel array
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Color Television Image Signal Generators (AREA)
  • Image Input (AREA)
  • Polarising Elements (AREA)

Abstract

The embodiment of the present application provides a kind of Color Polarization formula CIS and image processing method, storage medium, Color Polarization formula CIS includes: the sub-wavelength pixel unit in preset direction three kinds of sized photo diode PD columns of arrangement, and sub-wavelength pixel unit is used to absorb the corresponding three coloured light of RGB that the imaging optical signal of preset wavelength is polarized in preset direction respectively using three kinds of size PD columns;The image processor connecting with sub-wavelength pixel unit for determining polarization information and color information using the corresponding three coloured light of RGB, and obtains the corresponding Color Polarization image of imaging optical signal based on polarization information and color information.

Description

A kind of Color Polarization formula CIS and image processing method, storage medium
Technical field
This application involves field of image processings more particularly to a kind of Color Polarization formula CIS and image processing method, storage to be situated between Matter.
Background technique
Complementary metal oxide semiconductor (CMOS, Complementary Metal-Oxide Semiconductor) figure Picture sensor (CIS, CMOS Image Sensor) has the characteristics that integrated level height, small power consumption, speed are fast and at low cost, in height It is widely used in terms of definition pixel product.CIS includes monochromatic polarization and polychrome polarizes both forms, and Color Polarization due to The color got is more abundant, so that the image color of generation is more bright-coloured for the more monochromatic polarization of Color Polarization.
The structure of existing polarization type CIS as shown in Figure 1, include microlens array, polarizer array and pixel array, In, each pixel includes photodiode (PD, a Photo Diode) structure, and the inclined of an angle is placed in PD structure Vibration piece and a lenticule, every four pixels placed the polarizing film of four different angles respectively, using every four pixels as One computing unit calculates polarization degree and polarization direction by the association between different directions polarizer, and then according to polarization Degree and polarization direction obtain polarization image.
However, existing polarization type CIS needs to place the polarizing film of four different angles on four PD columns, wherein each Pixel can only absorb the polarised light of an angle, when wavelength the sum of of the wavelength of imaging optical signal less than four pixels, can drop The quantum efficiency of low polarization type CIS.
Summary of the invention
The embodiment of the present application provides a kind of Color Polarization formula CIS and image processing method, storage medium, can be improved polarization The quantum efficiency of formula CIS.
The technical solution of the application is achieved in that
The embodiment of the present application provides a kind of Color Polarization formula cmos image sensor CIS, described Color Polarization formula CIS includes:
It is described for being utilized respectively in the sub-wavelength pixel unit of preset direction three kinds of sized photo diode PD columns of arrangement Three kinds of size PD columns absorb the corresponding three coloured light of RGB that the imaging optical signal of preset wavelength is polarized in the preset direction respectively;
The image processor being connect with the sub-wavelength pixel unit, for being determined using the corresponding three coloured light of the RGB Polarization information and color information out;And it is corresponding based on the polarization information and the color information to obtain the imaging optical signal Color Polarization image.
In above-mentioned Color Polarization formula CIS, the Pixel Dimensions of the sub-wavelength pixel unit are less than the preset wavelength.
In above-mentioned Color Polarization formula CIS, three kinds of sizes of the PD column are to be based respectively on being total to for the corresponding three coloured light of RGB What the refractive index of the long and described imaging optical signal of vibration wave determined, the shape of the PD column includes at least rectangle, circle, parallel four Side shape and diamond shape.
In above-mentioned Color Polarization formula CIS, the dimensioning rank of the PD column is hundred nano-scale, the preset direction row The size and shape of each PD column of cloth are identical.
In above-mentioned Color Polarization formula CIS, the preset direction includes at least 0 degree, 45 degree, 90 degree and 135 degree.
In above-mentioned Color Polarization formula CIS, the Color Polarization formula CIS further include: connect with three kinds of sizes PD column Reading circuit, the reading circuit connect with described image processor;
Three kinds of sizes PD column, specifically for the corresponding three coloured light of the RGB to be converted to the electricity of the preset direction Signal;
The reading circuit obtains RAW data for the electric signal of the preset direction to be converted to digital signal, and The RAW data are transmitted to described image processor;
Described image processor is polarized specifically for being associated the RAW data by default interrelational form Degree and polarization direction, using the polarization degree and the polarization direction as the polarization information;Restore according to preset color Method carries out color recovery to the RAW data, obtains color information, and obtain institute according to the polarization information and color information State polarization image.
In above-mentioned Color Polarization formula CIS, the Color Polarization formula CIS further include: connect with the sub-wavelength pixel unit The lens unit connect;
The lens unit is focused for the imaging optical signal to the preset wavelength.
The embodiment of the present application provides a kind of image processing method, is applied to Color Polarization formula CIS, the Color Polarization formula The sub-wavelength pixel unit in preset direction three kinds of size PD columns of arrangement is provided on CIS, the preset direction is arranged each The size and shape of kind PD column are identical, which comprises
When getting the imaging optical signal of preset wavelength, three kinds of size PD columns point of the sub-wavelength pixel unit are utilized The corresponding three coloured light of RGB that the imaging optical signal is polarized in preset direction is not absorbed;
Polarization information and color information are determined using the corresponding three coloured light of the RGB;And based on the polarization information and The color information obtains the polarization image of the corresponding colour of the imaging optical signal.
It is in the above-mentioned methods, described to determine polarization information using the RGB color light, comprising:
The corresponding three coloured light of the RGB is converted to the electric signal of the preset direction;
The electric signal of the preset direction is converted into digital signal, obtains RAW data;
By presetting interrelational form, the RAW data are associated, the polarization information is obtained.
The embodiment of the present application provides a kind of storage medium, is stored thereon with computer program, is applied to Color Polarization formula CIS, the computer program realize method as described in any one of the above embodiments when being executed by processor.
The embodiment of the present application provides a kind of Color Polarization formula CIS and image processing method, storage medium, the Color Polarization Formula CIS includes: the sub-wavelength pixel unit in preset direction three kinds of sized photo diode PD columns of arrangement, for being utilized respectively three Kind size PD column absorbs the corresponding three coloured light of RGB that the imaging optical signal of preset wavelength is polarized in preset direction respectively;With sub- wave The image processor of long pixel unit connection, for determining polarization information and color information using the corresponding three coloured light of RGB;And The corresponding Color Polarization image of imaging optical signal is obtained based on polarization information and color information.Using above-mentioned Color Polarization formula CIS Implementation, the corresponding three coloured light of RGB that each sub-wavelength pixel unit can absorb multiple angles, and sub-wavelength pixel unit Wavelength be less than imaging optical signal preset wavelength so that improving the quantum efficiency of polarization type CIS;The structure of PD column can be real Existing optical resonance, absorption efficiency is much higher than traditional PD structure, and then can be improved the quantum efficiency of polarization type CIS.
Detailed description of the invention
Fig. 1 is a kind of structural schematic diagram for polarization type CIS that the prior art proposes;
Fig. 2 is a kind of structural schematic diagram of Color Polarization formula CIS provided by the embodiments of the present application;
Fig. 3 is a kind of PD column row of three kinds of sizes of illustrative sub-wavelength pixel unit 10 provided by the embodiments of the present application Butut;
Fig. 4 is a kind of flow chart of image processing method provided by the embodiments of the present application.
Specific embodiment
It should be appreciated that specific embodiment described herein is only used to explain the application.It is not used to limit the application.
Embodiment one
The embodiment of the present application provides a kind of Color Polarization formula cmos image sensor CIS1, such as schemes Shown in 2, Color Polarization formula CIS1 may include:
In the sub-wavelength pixel unit 10 of preset direction three kinds of sized photo diode PD columns 100 of arrangement, for benefit respectively Corresponding three color of RGB polarized with the imaging optical signal that three kinds of sizes PD column absorbs preset wavelength in the preset direction Light;
The image processor 11 being connect with the sub-wavelength pixel unit 10, for utilizing the corresponding three coloured light of the RGB Determine polarization information and color information;And the imaging optical signal pair is obtained based on the polarization information and the color information The Color Polarization image answered.
In the embodiment of the present application, the Pixel Dimensions of sub-wavelength pixel unit 10 are less than the corresponding default wave of imaging optical signal It is long;Illustratively, in practical situations, the corresponding preset wavelength of imaging optical signal is 400nm, therefore, sub-wavelength pixel unit 10 Pixel be less than or equal to 400nm.
In the embodiment of the present application, each interior PD column along preset direction three kinds of sizes of arrangement of sub-wavelength pixel unit 10, Multiple sub-wavelength pixel units 10 constitute sub-wavelength pixel array.
In the embodiment of the present application, in a sub-wavelength pixel unit 10, the PD of three kinds of sizes of each preset direction arrangement Column, wherein each size is corresponding to absorb a kind of corresponding three coloured light of RGB.
Optionally, preset direction includes 0 degree, 45 degree, 90 degree and 135 degree, can specifically be increased according to the actual situation It deletes, the embodiment of the present application does not do specific restriction.
In the embodiment of the present application, as shown in figure 3, respectively along 0 degree, 45 degree, 90 degree in each sub-wavelength pixel unit 10 With 135 degree of arrangement other PD columns of three kinds of size hundred nano-scales, wherein three kinds of sizes are respectively long 70nm wide 50nm, long 90nm wide 50nm and long 110nm wide 50nm.The PD column of the long 70nm wide 50nm of 0 degree, 45 degree, 90 degree and 135 degree arrangement absorbs correspondence respectively 0 degree, 45 degree, 90 degree and 135 degree polarization blue light;The PD column of the long 90nm wide 50nm of 0 degree, 45 degree, 90 degree and 135 degree arrangement The green light of corresponding 0 degree, 45 degree, 90 degree and 135 degree polarization is absorbed respectively;The length of 0 degree, 45 degree, 90 degree and 135 degree arrangement The PD column of 110nm wide 50nm absorbs the feux rouges of corresponding 0 degree, 45 degree, 90 degree and 135 degree polarization respectively;And by each sub-wavelength Pixel unit is as a computing unit.
In the embodiment of the present application, in sub-wavelength pixel unit, the size and shape of each PD column of preset direction arrangement Shape is identical.
Optionally, the size of three kinds of PD columns is the folding of resonant wavelength and imaging optical signal based on the corresponding three coloured light of RGB Penetrate what rate determined, or obtained by optical analog, it is specifically selected according to the actual situation, the embodiment of the present application is not done It is specific to limit.
In the embodiment of the present application, the size of PD column is determined using formula (1)
The size of PD column=(resonant wavelength-preset constant)/refractive index (1)
Wherein, monochrome different in RGB three primary colors corresponds to different resonant wavelengths, and refractive index is the refractive index of lens.
Optionally, the shape of PD column includes at least rectangle, circle, parallelogram and diamond shape, specifically according to reality Situation is selected, and the embodiment of the present application does not do specific restriction.
In the embodiment of the present application, Color Polarization formula CIS utilizes the optical resonance of PD column, realizes and polarizes in preset direction The corresponding three coloured light of RGB RESONANCE ABSORPTION.
In the embodiment of the present application, Color Polarization formula CIS further include: the reading circuit being connect with three kinds of size PD columns, and read Circuit is connect with image processor out.
In the embodiment of the present application, when three kinds of size PD columns of preset direction absorb the RGB of corresponding preset direction respectively After corresponding three coloured light, three kinds of size PD columns of preset direction convert the corresponding three coloured light of the RGB of corresponding preset direction For the electric signal of preset direction, and by the electric signal transmission of preset direction to reading circuit, reading circuit is by the electricity of preset direction Signal is converted to digital signal, obtains RAW data, and RAW data are transmitted to image processor;Image processor passes through default RAW data are associated by interrelational form, obtain polarization degree and polarization direction, using polarization degree and polarization direction as polarization Information carries out color recovery to RAW data according to preset color restoration methods, obtains color information, and according to polarization information and Color information obtains polarization image.
In the embodiment of the present application, reading circuit utilizes analog-to-digital conversion device (ADC, Analog-to-Digital Converter the electric signal of preset direction) is converted into digital signal.
In the embodiment of the present application, default interrelational form can be the mode of vector addition, and reading circuit passes through default side To electric signal carry out vector addition, and then obtain imaging optical signal polarization degree and polarization direction, later, reading circuit mistake The reflected light and transmitted light of different polarization are filtered, and then determines the material properties of reference object, it is more clear thus, it is possible to provide Clear image.
It should be noted that corresponding polarization angle to be imaged can be any angle in Color Polarization image, at image Device is managed by the way that polarization angle is mapped to polarization information to be imaged, RAW data are mapped to Color Polarization image.
In the embodiment of the present application, Color Polarization formula CIS further include: the lens unit being connect with sub-wavelength pixel unit;Thoroughly Mirror unit is focused for the imaging optical signal to preset wavelength.
It should be noted that since the optical resonance of PD column can enhance local light intensity, therefore, lens unit is not the application Necessary part in Color Polarization formula CIS in embodiment, specifically whether increase in Color Polarization formula CIS lens unit according to Actual conditions are selected, and the embodiment of the present application does not do specific restriction.
It is understood that each sub-wavelength pixel unit can absorb in the Color Polarization formula CIS that the application proposes The corresponding three coloured light of RGB of multiple angle polarizations, and the wavelength of sub-wavelength pixel unit is less than the preset wavelength of imaging optical signal, So that improving the quantum efficiency of polarization type CIS;The structure of PD column can be realized optical resonance, and absorption efficiency is much higher than tradition PD structure, and then can be improved the quantum efficiency of polarization type CIS.
Embodiment two
The embodiment of the present application provides a kind of image processing method, is applied to Color Polarization formula CIS, on Color Polarization formula CIS It is provided with the sub-wavelength pixel unit in preset direction three kinds of size PD columns of arrangement, the ruler of each PD column of preset direction arrangement It is very little identical with shape, as shown in figure 4, this method may include:
S101, when getting the imaging optical signal of preset wavelength, utilize three kinds of size PD columns of sub-wavelength pixel unit The corresponding three coloured light of RGB that imaging optical signal is polarized in preset direction is absorbed respectively.
A kind of image processing method provided by the embodiments of the present application is suitable for carrying out image procossing using Color Polarization formula CIS Scene under.
In the embodiment of the present invention, Color Polarization formula CIS is absorbed respectively using three kinds of size PD columns of sub-wavelength pixel unit The corresponding three coloured light of RGB that imaging optical signal is polarized in preset direction, wherein preset direction includes 0 degree, 45 degree, 90 degree and 135 Three kinds of size PD columns are arranged in preset direction in degree, each sub-wavelength pixel unit, three kinds of size PD base for posts of preset direction in The optical resonance of itself, respectively in the corresponding three coloured light of the corresponding RGB of preset direction RESONANCE ABSORPTION.
In the embodiment of the present application, the division of preset direction is not limited only to a kind of 0 degree, 45 degree, 90 degree and 135 degree this division shape Formula, specific zoned format can be selected according to the actual situation, and the embodiment of the present application does not do specific restriction.
Optionally, the shape of PD column includes at least rectangle, circle, parallelogram and diamond shape, specifically according to reality Situation is selected, and the embodiment of the present application does not do specific restriction.
In the embodiment of the present application, the size of PD column is resonant wavelength and imaging optical signal based on the corresponding three coloured light of RGB Refractive index determine, or obtained, specifically selected according to the actual situation, the embodiment of the present application by optical analog Specific restriction is not done.
In the embodiment of the present application, the size of PD column is determined using formula (1)
The size of PD column=(resonant wavelength-preset constant)/refractive index (1)
Wherein, monochrome different in RGB three primary colors corresponds to different resonant wavelengths, and refractive index is that the refraction of optical signal is imaged Rate.
S102, polarization information and color information are determined using the corresponding three coloured light of RGB;And it is based on polarization information and color Information obtains the polarization image of the corresponding colour of imaging optical signal.
When Color Polarization formula CIS absorbs imaging optical signal pre- using sub-wavelength pixel unit but middle size PD column respectively After the corresponding three coloured light of RGB of set direction polarization, Color Polarization formula CIS determines polarization letter using the corresponding three coloured light of RGB Breath and color information, and the corresponding Color Polarization image of imaging optical signal is obtained based on polarization information and color information.
In the embodiment of the present application, the corresponding three coloured light of RGB is converted to the electric signal of preset direction by Color Polarization formula CIS; Later, the electric signal of the preset direction is converted to digital signal by Color Polarization formula CIS, obtains RAW data, and by default RAW data are associated, obtain polarization information by interrelational form.
In the embodiment of the present application, three kinds of size PD columns of preset direction are by corresponding three color of the RGB of corresponding preset direction Light is converted to the electric signal of preset direction, and by the electric signal transmission of preset direction to reading circuit, and reading circuit is by default side To electric signal be converted to digital signal, obtain RAW data, and RAW data are transmitted to image processor;Image processor is logical It crosses default interrelational form to be associated RAW data, obtains polarization degree and polarization direction, polarization degree and polarization direction are made For polarization information, and polarization image is obtained according to polarization information, image processor is according to preset color restoration methods to RAW data Color recovery is carried out, obtains color information, and polarization image is obtained according to polarization information and color information.
In the embodiment of the present application, default interrelational form can be the mode of vector addition, and reading circuit passes through default side To electric signal carry out vector addition, and then obtain imaging optical signal polarization degree and polarization direction, later, reading circuit mistake The reflected light and transmitted light of different polarization are filtered, and then determines the material properties of reference object, it is more clear thus, it is possible to provide Clear image.
In the embodiment of the present application, RAW data contain the information of tri- Color Channels of RGB, and preset color restoration methods can To include the method for interpolation or be determined based on three components of RGB, specifically selected according to the actual situation, the application Embodiment does not do specific restriction.
It is understood that each sub-wavelength pixel unit can absorb in the Color Polarization formula CIS that the application proposes The corresponding three coloured light of RGB of multiple angle polarizations, and the wavelength of sub-wavelength pixel unit is less than the preset wavelength of imaging optical signal, So that improving the quantum efficiency of polarization type CIS;The structure of PD column can be realized optical resonance, and absorption efficiency is much higher than tradition PD structure, and then can be improved the quantum efficiency of polarization type CIS.
Embodiment three
The embodiment of the present application provides a kind of storage medium, is stored thereon with computer program, above-mentioned computer-readable storage Media storage has one or more program, and said one or multiple programs can be executed by one or more processor, be answered For in Color Polarization formula CIS1, which to realize the image processing method as described in embodiment two.
Specifically, the corresponding program instruction of one of the present embodiment image processing method read by an electronic equipment or It is performed, includes the following steps:
When getting the imaging optical signal of preset wavelength, three kinds of size PD columns point of the sub-wavelength pixel unit are utilized The corresponding three coloured light of RGB that the imaging optical signal is polarized in preset direction is not absorbed;
Polarization information and color information are determined using the corresponding three coloured light of the RGB;And based on the polarization information and The color information obtains the polarization image of the corresponding colour of the imaging optical signal.
In an embodiment of the present invention, further, polarization information is determined using the corresponding three coloured light of the RGB, on It states one or more program to be executed by said one or multiple processors, implements following steps:
The corresponding three coloured light of the RGB is converted to the electric signal of the preset direction;
The electric signal of the preset direction is converted into digital signal, obtains RAW data;
By presetting interrelational form, the RAW data are associated, the polarization information is obtained.
The above, the only preferred embodiment of the application, are not intended to limit the protection scope of the application.

Claims (10)

1. a kind of Color Polarization formula cmos image sensor CIS, which is characterized in that the Color Polarization Formula CIS includes:
In the sub-wavelength pixel unit of preset direction three kinds of sized photo diode PD columns of arrangement, for being utilized respectively described three kinds Size PD column absorbs the corresponding three coloured light of RGB that the imaging optical signal of preset wavelength is polarized in the preset direction respectively;
The image processor being connect with the sub-wavelength pixel unit, for being determined partially using the corresponding three coloured light of the RGB Information of shaking and color information;And the corresponding colour of the imaging optical signal is obtained based on the polarization information and the color information Polarization image.
2. Color Polarization formula CIS according to claim 1, which is characterized in that the pixel ruler of the sub-wavelength pixel unit It is very little to be less than the preset wavelength.
3. Color Polarization formula CIS according to claim 1, which is characterized in that three kinds of sizes of the PD column are difference bases It is determined in the resonant wavelength of the corresponding three coloured light of RGB and the refractive index of the imaging optical signal, the shape of the PD column is at least Including rectangle, circle, parallelogram and diamond shape.
4. Color Polarization formula CIS according to claim 1 or 3, which is characterized in that the dimensioning rank of the PD column is The size and shape of hundred nano-scale, each PD column of the preset direction arrangement are identical.
5. Color Polarization formula CIS according to claim 1, which is characterized in that the preset direction includes at least 0 degree, 45 Degree, 90 degree and 135 degree.
6. Color Polarization formula CIS according to claim 1, which is characterized in that the Color Polarization formula CIS further include: with The reading circuit of three kinds of sizes PD column connection, the reading circuit are connect with described image processor;
Three kinds of sizes PD column, specifically for the corresponding three coloured light of the RGB to be converted to the electric signal of the preset direction;
The reading circuit obtains RAW data for the electric signal of the preset direction to be converted to digital signal, and by institute It states RAW data and is transmitted to described image processor;
Described image processor obtains polarization degree specifically for being associated the RAW data by default interrelational form And polarization direction, using the polarization degree and the polarization direction as the polarization information;According to preset color restoration methods Color recovery is carried out to the RAW data, obtains color information, and institute is obtained according to the polarization information and the color information State polarization image.
7. Color Polarization formula CIS according to claim 1, which is characterized in that the Color Polarization formula CIS further include: with The lens unit of the sub-wavelength pixel unit connection;
The lens unit is focused for the imaging optical signal to the preset wavelength.
8. a kind of image processing method, which is characterized in that be applied to Color Polarization formula CIS, be arranged on the Color Polarization formula CIS There are the sub-wavelength pixel unit in preset direction three kinds of size PD columns of arrangement, the ruler of each PD column of the preset direction arrangement It is very little identical with shape, which comprises
When getting the imaging optical signal of preset wavelength, inhaled respectively using three kinds of size PD columns of the sub-wavelength pixel unit Receive the corresponding three coloured light of RGB that the imaging optical signal is polarized in preset direction;
Polarization information and color information are determined using the corresponding three coloured light of the RGB;And based on the polarization information and described Color information obtains the polarization image of the corresponding colour of the imaging optical signal.
9. according to the method described in claim 8, it is characterized in that, described determined partially using the corresponding three coloured light of the RGB Vibration information, comprising:
The corresponding three coloured light of the RGB is converted to the electric signal of the preset direction;
The electric signal of the preset direction is converted into digital signal, obtains RAW data;
By presetting interrelational form, the RAW data are associated, the polarization information is obtained.
10. a kind of storage medium, is stored thereon with computer program, it is applied to Color Polarization formula CIS, which is characterized in that the meter Such as claim 8-9 described in any item methods are realized when calculation machine program is executed by processor.
CN201910330918.5A 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium Active CN110087005B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910330918.5A CN110087005B (en) 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium
CN202110532817.3A CN113329193A (en) 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910330918.5A CN110087005B (en) 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202110532817.3A Division CN113329193A (en) 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium

Publications (2)

Publication Number Publication Date
CN110087005A true CN110087005A (en) 2019-08-02
CN110087005B CN110087005B (en) 2021-07-09

Family

ID=67416362

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202110532817.3A Pending CN113329193A (en) 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium
CN201910330918.5A Active CN110087005B (en) 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202110532817.3A Pending CN113329193A (en) 2019-04-23 2019-04-23 Color polarization CIS, image processing method and storage medium

Country Status (1)

Country Link
CN (2) CN113329193A (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110445998A (en) * 2019-08-30 2019-11-12 Oppo广东移动通信有限公司 A kind of Color Polarization formula CIS and image processing method, storage medium
CN110460781A (en) * 2019-08-26 2019-11-15 Oppo广东移动通信有限公司 A kind of imaging sensor, image processing method and storage medium
CN110460788A (en) * 2019-08-14 2019-11-15 Oppo广东移动通信有限公司 A kind of monochrome polarization type CIS and image processing method, storage medium
CN110504279A (en) * 2019-08-30 2019-11-26 Oppo广东移动通信有限公司 A kind of polarization type CIS, image processing method and storage medium and terminal device
CN110505422A (en) * 2019-08-20 2019-11-26 Oppo广东移动通信有限公司 A kind of CIS and terminal
CN110536084A (en) * 2019-09-10 2019-12-03 Oppo广东移动通信有限公司 Lamination cmos image sensor and image processing method
CN110572594A (en) * 2019-09-11 2019-12-13 Oppo广东移动通信有限公司 stacked CMOS image sensor and image processing method
CN110740236A (en) * 2019-10-16 2020-01-31 Oppo广东移动通信有限公司 Image sensor, electronic device, image processing method, and storage medium
CN110740277A (en) * 2019-10-29 2020-01-31 Oppo广东移动通信有限公司 Image sensor, electronic device and imaging method
CN110854145A (en) * 2019-11-01 2020-02-28 Oppo广东移动通信有限公司 Pixel structure, image sensor and terminal
CN110891137A (en) * 2019-11-15 2020-03-17 Oppo广东移动通信有限公司 Image sensor, electronic device, image processing method, and storage medium
CN111182245A (en) * 2020-01-10 2020-05-19 Oppo广东移动通信有限公司 Polarization type CIS, image processing method, storage medium and terminal equipment
CN111193886A (en) * 2020-01-09 2020-05-22 Oppo广东移动通信有限公司 Pixel structure, image sensor and terminal
CN111212247A (en) * 2020-01-13 2020-05-29 Oppo广东移动通信有限公司 Polarization type image sensor, signal processing method and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101887900A (en) * 2009-05-11 2010-11-17 索尼公司 Two-dimensional solid-state image capture device and polarization-light data processing method thereof
CN101894849A (en) * 2009-05-19 2010-11-24 索尼公司 Two-dimensional solid-state imaging device
CN102110703A (en) * 2009-12-28 2011-06-29 索尼公司 Semiconductor device and electronic apparatus
CN202693864U (en) * 2012-05-09 2013-01-23 上海波汇通信科技有限公司 Photoelectric receiving module
CN204809223U (en) * 2015-05-19 2015-11-25 苏州晶方半导体科技股份有限公司 Image sensor packaging structure
CN105556680A (en) * 2013-05-22 2016-05-04 王士原 Microstructure enhanced absorption photosensitive devices
CN108507678A (en) * 2018-03-01 2018-09-07 东南大学 A kind of adjustable ultraphotic spectrum detection chip of phasmon multi-resonant mechanism enhancing
CN109314124A (en) * 2016-07-20 2019-02-05 索尼公司 Light receiving element and its manufacturing method, image device and electronic device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9305948B2 (en) * 2014-05-30 2016-04-05 Raytheon Company Dynamic polarizer having material operable to alter its conductivity responsive to an applied stimulus
CN105049690B (en) * 2015-07-06 2017-06-09 中国科学院遥感与数字地球研究所 Portable polarization digital camera and its imaging method

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101887900A (en) * 2009-05-11 2010-11-17 索尼公司 Two-dimensional solid-state image capture device and polarization-light data processing method thereof
US20160190193A1 (en) * 2009-05-11 2016-06-30 Sony Corporation Two-dimensional solid-state image capture device with polarization member and color filter for sub-pixel regions and polarization-light data processing method therefor
CN101894849A (en) * 2009-05-19 2010-11-24 索尼公司 Two-dimensional solid-state imaging device
CN102110703A (en) * 2009-12-28 2011-06-29 索尼公司 Semiconductor device and electronic apparatus
CN202693864U (en) * 2012-05-09 2013-01-23 上海波汇通信科技有限公司 Photoelectric receiving module
CN105556680A (en) * 2013-05-22 2016-05-04 王士原 Microstructure enhanced absorption photosensitive devices
CN204809223U (en) * 2015-05-19 2015-11-25 苏州晶方半导体科技股份有限公司 Image sensor packaging structure
CN109314124A (en) * 2016-07-20 2019-02-05 索尼公司 Light receiving element and its manufacturing method, image device and electronic device
CN108507678A (en) * 2018-03-01 2018-09-07 东南大学 A kind of adjustable ultraphotic spectrum detection chip of phasmon multi-resonant mechanism enhancing

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110460788A (en) * 2019-08-14 2019-11-15 Oppo广东移动通信有限公司 A kind of monochrome polarization type CIS and image processing method, storage medium
CN110505422A (en) * 2019-08-20 2019-11-26 Oppo广东移动通信有限公司 A kind of CIS and terminal
CN110505422B (en) * 2019-08-20 2022-01-11 Oppo广东移动通信有限公司 CIS and terminal
WO2021036850A1 (en) * 2019-08-26 2021-03-04 Oppo广东移动通信有限公司 Image sensor, image processing method, and storage medium
CN110460781A (en) * 2019-08-26 2019-11-15 Oppo广东移动通信有限公司 A kind of imaging sensor, image processing method and storage medium
CN113709382B (en) * 2019-08-26 2024-05-31 Oppo广东移动通信有限公司 Image sensor, image processing method and storage medium
CN113709382A (en) * 2019-08-26 2021-11-26 Oppo广东移动通信有限公司 Image sensor, image processing method and storage medium
CN110460781B (en) * 2019-08-26 2021-10-12 Oppo广东移动通信有限公司 Image sensor, image processing method and storage medium
CN110504279A (en) * 2019-08-30 2019-11-26 Oppo广东移动通信有限公司 A kind of polarization type CIS, image processing method and storage medium and terminal device
CN110445998A (en) * 2019-08-30 2019-11-12 Oppo广东移动通信有限公司 A kind of Color Polarization formula CIS and image processing method, storage medium
CN110445998B (en) * 2019-08-30 2022-02-25 Oppo广东移动通信有限公司 Color polarization CIS, image processing method and storage medium
CN110536084A (en) * 2019-09-10 2019-12-03 Oppo广东移动通信有限公司 Lamination cmos image sensor and image processing method
CN110572594B (en) * 2019-09-11 2022-04-15 Oppo广东移动通信有限公司 Stacked CMOS image sensor and image processing method
CN110572594A (en) * 2019-09-11 2019-12-13 Oppo广东移动通信有限公司 stacked CMOS image sensor and image processing method
CN110740236B (en) * 2019-10-16 2021-11-12 Oppo广东移动通信有限公司 Image sensor, electronic device, image processing method, and storage medium
CN110740236A (en) * 2019-10-16 2020-01-31 Oppo广东移动通信有限公司 Image sensor, electronic device, image processing method, and storage medium
CN110740277A (en) * 2019-10-29 2020-01-31 Oppo广东移动通信有限公司 Image sensor, electronic device and imaging method
CN110740277B (en) * 2019-10-29 2022-06-21 Oppo广东移动通信有限公司 Image sensor, electronic device and imaging method
CN110854145A (en) * 2019-11-01 2020-02-28 Oppo广东移动通信有限公司 Pixel structure, image sensor and terminal
CN110891137A (en) * 2019-11-15 2020-03-17 Oppo广东移动通信有限公司 Image sensor, electronic device, image processing method, and storage medium
CN111193886A (en) * 2020-01-09 2020-05-22 Oppo广东移动通信有限公司 Pixel structure, image sensor and terminal
CN111182245A (en) * 2020-01-10 2020-05-19 Oppo广东移动通信有限公司 Polarization type CIS, image processing method, storage medium and terminal equipment
CN111212247A (en) * 2020-01-13 2020-05-29 Oppo广东移动通信有限公司 Polarization type image sensor, signal processing method and storage medium

Also Published As

Publication number Publication date
CN110087005B (en) 2021-07-09
CN113329193A (en) 2021-08-31

Similar Documents

Publication Publication Date Title
CN110087005A (en) A kind of Color Polarization formula CIS and image processing method, storage medium
CN110087004A (en) A kind of monochrome polarization type CIS and image processing method, storage medium
CN103703770B (en) Polarized color camera head
CN103119516B (en) Light field camera head and image processing apparatus
CN202750183U (en) Parallax imaging apparatus and parallax imaging system
Xiong et al. Snapshot hyperspectral light field imaging
KR101265432B1 (en) Imaging element and imaging apparatus using the same
US10386649B2 (en) Optical apparatus and image pickup apparatus
KR20110084367A (en) Imaging device
CN110504279A (en) A kind of polarization type CIS, image processing method and storage medium and terminal device
CN110445998A (en) A kind of Color Polarization formula CIS and image processing method, storage medium
CN104270555A (en) Surface CMOS image sensor camera shooting module
CN110505422A (en) A kind of CIS and terminal
JP5947217B2 (en) Color separation filter array, solid-state imaging device, imaging device, and display device
CN110740236B (en) Image sensor, electronic device, image processing method, and storage medium
CN102918355B (en) Three-dimensional image pickup device, image processing apparatus
CN108243331A (en) Video generation device and filming apparatus
US6166800A (en) Solid-state image capture system including H-PDLC color separation element
CN110225319A (en) A kind of imaging sensor, image processing method and storage medium
CN108140655A (en) Capturing element and filming apparatus
CN207691912U (en) The optical field imaging module of small size
CN110740277A (en) Image sensor, electronic device and imaging method
CN110312088A (en) A kind of pixel unit circuit and image processing method, storage medium
CN110112156A (en) A kind of dot structure, cmos image sensor and terminal
JP7293020B2 (en) Imaging element and imaging device provided with the same

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant