WO2024083035A1 - 图像传感器、摄像模组和电子设备 - Google Patents
图像传感器、摄像模组和电子设备 Download PDFInfo
- Publication number
- WO2024083035A1 WO2024083035A1 PCT/CN2023/124438 CN2023124438W WO2024083035A1 WO 2024083035 A1 WO2024083035 A1 WO 2024083035A1 CN 2023124438 W CN2023124438 W CN 2023124438W WO 2024083035 A1 WO2024083035 A1 WO 2024083035A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- area
- electrode
- storage area
- filter
- sub
- Prior art date
Links
- 238000003860 storage Methods 0.000 claims abstract description 175
- 239000002245 particle Substances 0.000 claims abstract description 114
- 238000001914 filtration Methods 0.000 claims abstract description 24
- 239000003086 colorant Substances 0.000 claims abstract description 17
- 239000000463 material Substances 0.000 claims abstract description 11
- 238000003672 processing method Methods 0.000 claims abstract description 11
- 230000003287 optical effect Effects 0.000 claims abstract description 10
- 238000006243 chemical reaction Methods 0.000 claims description 9
- 230000002093 peripheral effect Effects 0.000 claims 1
- 238000000034 method Methods 0.000 description 21
- 239000002775 capsule Substances 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- 239000012780 transparent material Substances 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 206010034960 Photophobia Diseases 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 230000005684 electric field Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 208000013469 light sensitivity Diseases 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
Definitions
- the present application belongs to the field of image processing technology, and specifically relates to an image sensor, a camera module and an electronic device.
- the traditional complementary metal oxide semiconductor (CMOS) image sensor mainly includes an upper filter and a photosensitive layer below the filter to collect different colors of light. Natural light is composed of RGB three-color light, which becomes monochromatic light after passing through the filter and is received by the photosensitive layer below.
- CMOS complementary metal oxide semiconductor
- a pixel unit usually includes four identical photosensors and four filter units corresponding to filtering R, B, Gr, and Gb color lights to realize one pixel.
- a single photosensor can only receive light of one color, and the utilization rate is low.
- the purpose of the embodiments of the present application is to provide an image sensor, a camera module, an electronic device and an image processing method, which can solve the problem of low utilization rate of photosensors in the pixel structure of existing image sensors.
- an embodiment of the present application provides an image sensor, comprising a plurality of pixel units, wherein the pixel units include: a photosensitive layer located at a lower layer of the pixel units, for collecting light signals and converting them into electrical signals; a filter layer located at an upper layer of the pixel units, wherein the filter layer includes a filter area and a storage area,
- the filter area is made of a translucent material and at least partially overlaps with the projection of the photosensitive layer in the direction of the optical axis.
- the storage area is made of an opaque material. The storage area is used for colored electric particles, and the electric particles can move between the storage area and the filter area.
- the filter area is used to allow light with the same color as the electric particles in the filter area to pass through and enter the underlying photosensitive layer.
- an embodiment of the present application provides a camera module, comprising an image sensor as described in the first aspect.
- an embodiment of the present application provides an electronic device, comprising the camera module as described in the second aspect.
- an embodiment of the present application provides an image processing method, which is applied to an image processing device including the image sensor as described in the first aspect, including:
- the light signals of the first color transmitted through the corresponding filter area 203 are collected by each photosensitive layer of the plurality of pixel units and converted into the electric signals of the first color;
- the light signal of the second color transmitted through the corresponding filter area 203 is collected through each photosensitive layer and converted into an electrical signal of the second color;
- the first color and the second color are different colors.
- a single photosensor can collect light of different colors in time-sharing, thereby realizing the collection of image light information.
- the area of the photosensor is constant, more photosensors can be placed in the same image sensor area, and a single photosensor can realize one pixel, so that a larger number of pixels can be realized in the same image sensor area.
- the photosensitive sensor can be made larger within the same image sensor area, thereby improving image quality.
- FIG. 1 is a schematic diagram of the structure of a pixel unit of an image sensor according to an embodiment of the present application.
- FIG. 2 is a schematic diagram of the overall architecture of a pixel unit of an image sensor according to an embodiment of the present application.
- FIG. 3 is a schematic diagram of light signal acquisition of a pixel unit of an image sensor according to an embodiment of the present application.
- FIG. 4 is a flowchart of the steps of the image processing method according to an embodiment of the present application.
- first, second, etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first”, “second”, etc. are generally of one type, and the number of objects is not limited.
- the first object can be one or more.
- “and/or” in the specification and claims represents at least one of the connected objects, and the character “/" generally indicates that the objects associated with each other are in an "or” relationship.
- the embodiment of the present application provides a pixel structure, including: a photosensitive layer located at the lower layer of the pixel unit, used to collect light signals and convert them into electrical signals; a filter layer located at the upper layer of the pixel unit, the filter layer including a filter area and a storage area, the filter area is made of a light-transmitting material, and at least partially overlaps with the projection of the photosensitive layer in the direction of the optical axis, the storage area is made of an opaque material, the storage area is used for colored electric particles, the electric particles can move between the storage area and the filter area, and the filter area is used to allow light with the same color as the electric particles in the filter area to pass through And enter the underlying photosensitive layer.
- the pixel unit includes a photosensitive sensor and a corresponding filter area. By moving charged particles of different colors in the filter area, a pixel unit can collect light of different colors, so that subsequent processing can obtain pixel values of each color corresponding to a pixel.
- the pixel unit includes a filter layer 22 and a photosensitive layer 24 , which are stacked from top to bottom, and the projections of the filter layer 22 and the photosensitive layer 24 in the optical axis direction at least partially overlap.
- the filter layer 22 located on the upper layer of the pixel unit includes a filter area of a transparent material and a storage area of an opaque material.
- the storage area is used to store colored electric particles, such as red electric particles, green electric particles and/or blue electric particles, and the electric particles of the target color in the storage area can be moved to the filter area.
- the light-transmitting property of the filter area can allow light of the same color as the target color of the electric particles moved to the filter area to pass through and enter the lower photosensitive layer 24, which collects the light signal of the target color and converts it into an electric signal.
- the target color is the color of the above-mentioned electric particles, red, green or blue.
- the image sensor further includes: a driving unit, configured to drive the electric particles to move between the storage area and the filter area.
- the driving unit includes: a first control electrode disposed in the storage area; and
- a second control electrode is arranged in the filter area; wherein the first control electrode is used to drive the electric particles to move from the storage area to the filter area, and the second control electrode is used to drive the electric particles to move from the filter area to the storage area.
- Electric particles are particles with positive or negative charge.
- Appropriate control electrodes can be set in the storage area and the filter area respectively, and according to the principle that like charges repel and opposite charges attract, the particles stored in the storage area can be The red charged particles, green charged particles or blue charged particles are moved to the filter area to filter the corresponding color light.
- the storage area includes a first sub-storage area 201 for storing red electric particles, a second sub-storage area 202 for storing green electric particles, and a third sub-storage area 204 for storing blue electric particles; the first sub-storage area 201, the second sub-storage area 202, and the third sub-storage area 204 are distributed around the filter area.
- the filter layer 22 is divided into four areas, including a filter area 203 and three storage areas 201, 202, 203.
- a pixel unit can filter light of different colors through a filter area 203 .
- FIG. 2 wherein the left side of FIG. 2 is a three-dimensional schematic diagram of the entire pixel unit, and the right side of FIG. 2 is a corresponding planar schematic diagram of the filter layer 22 on the upper layer of the pixel unit.
- the filter area is made of a light-transmitting material, which can transmit light of the same color as the electric particles in the filter area.
- the storage area is made of an opaque material, and the three storage areas are used to store red, green, and blue electric particles in a one-to-one correspondence, respectively, and light of the same color as the electric particles in the storage area cannot transmit.
- the storage area includes a first sub-storage area 201 for storing red charged particles, a second sub-storage area 202 for storing green charged particles, and a third sub-storage area 204 for storing blue charged particles; the first sub-storage area 201, the second sub-storage area 202 and the third sub-storage area 204 are distributed on the periphery of the filtering area.
- the filter layer 22 includes a filter region 203 and three storage regions 201, 202, and 203.
- the first sub-storage region 201, the second sub-storage region 202, and the third sub-storage region 204 are distributed around the filter region 204, and the first sub-storage region 201 is adjacent to the second sub-storage region 202 and the third sub-storage region 204 at one edge, and the filter region 203 is adjacent to the second sub-storage region 202 and the third sub-storage region 204 at one edge.
- the first sub-storage area 201, the second sub-storage area 202 and the third sub-storage area Area 204 is used to store red, green and blue electric particles respectively.
- electric particles are charged particles, which can be positively charged or negatively charged.
- the electric particles with the same color stored in each of the three storage areas need to be charged with the same polarity at the same time.
- the colored electric particles can exist in the form of capsules, for example.
- the electric particles themselves carry colors, when they enter the filter area of a transparent material, the color corresponding to the electric particles will be displayed in the transparent filter area.
- the four regions included in the filter layer 22 are rectangular, but the present application is not limited to this specific embodiment.
- the four regions of the filter layer 22 can be guaranteed to have four edges, and the edges of two adjacent regions can be completely connected.
- the first sub-storage area 201, the second sub-storage area 202, the filtering area 203 and the third sub-storage area 204 are respectively rectangular, or the first sub-storage area 201, the second sub-storage area 202, the filtering area 203 and the third sub-storage area 204 are respectively rhombus.
- the number and size of the electric particles are the same, and the size and number of electric particles in different areas can also be adjusted according to actual needs.
- the filter area 203 transmits light of the same color as the colored electric particles it accommodates to the underlying photosensitive layer.
- the first control electrode includes: a first electrode 101 and a second electrode 102 set in the first sub-storage area 201; a third electrode 103 and a fourth electrode 104 set in the second sub-storage area 202; The seventh electrode 107 and the eighth electrode 108 in the third sub-storage area 204; the second control electrode includes: a fifth electrode 105 and a sixth electrode 106 arranged in the filter area 203; wherein the first electrode 101 is opposite to the fourth electrode 104, the second electrode 102 is opposite to the seventh electrode 107, the third electrode 103 is opposite to the sixth electrode 106, the fifth electrode 105 is opposite to the eighth electrode 108, and the two opposite electrodes have different polarities when power is supplied.
- each region is a rectangle as an example for explanation.
- the first sub-storage region 201, the second sub-storage region 202, the filter region 203 and the third sub-storage region 204 are rectangles with four sides.
- the first sub-storage area 201 is provided with a first electrode 101 and a second electrode 102, which are arranged at corresponding positions of two edges of the outer periphery of the first sub-storage area 201, that is, the two edges where the first electrode 101 and the second electrode 102 are arranged are the edges where the first sub-storage area 201 and the adjacent second sub-storage area 202 and third sub-storage area 204 are not adjacent.
- the second sub-storage area 202 is provided with a third electrode 103 and a fourth electrode 104, which are arranged at corresponding positions of two edges of the outer periphery of the second sub-storage area 202, that is, the two edges where the third electrode 103 and the fourth electrode 104 are arranged are the edges where the second sub-storage area 202 and the adjacent first sub-storage area 201 and the filtering area 203 are not adjacent.
- the filter area 203 is provided with a fifth electrode 105 and a sixth electrode 106, which are arranged at corresponding positions of two edges of the outer periphery of the filter area 203, that is, the two edges where the fifth electrode 105 and the sixth electrode 105 are arranged are the edges where the filter area 203 is not adjacent to the adjacent second sub-storage area 202 and the third sub-storage area 204.
- the third sub-storage area 204 is provided with a seventh electrode 107 and an eighth electrode 108, which are arranged at corresponding positions of two edges of the outer periphery of the third sub-storage area 204, that is, the two edges where the seventh electrode 107 and the eighth electrode 108 are arranged are the edges where the third sub-storage area 204 is not adjacent to the adjacent first sub-storage area 201 and the filtering area 203.
- the first electrode 101 of the first sub-storage area 201 and the second sub-storage area 202 The fourth electrode 104 is opposite, the second electrode 102 of the first sub-storage area 201 is opposite to the seventh electrode 107 of the third sub-storage area 204, the third electrode 103 of the second sub-storage area 202 is opposite to the sixth electrode 106 of the filter area 203, the fifth electrode 105 of the filter area 203 is opposite to the eighth electrode 108 of the third sub-storage area 204, and the two opposite electrodes have different polarities when power is applied.
- the electric particles contained in each area are charged themselves. Therefore, when two electrodes arranged opposite to each other in the two areas are respectively charged with positive and negative electricity, the electric particles in one area can be driven into another area through the principle that like charges attract and opposite charges repel each other in the electric field.
- each relative electrode needs to be set so that the movement of the electric particles can be in the clockwise direction, from the second sub-storage area 202 to the filter area 203, from the filter area 203 to the third sub-storage area 204, from the third sub-storage area 204 to the first sub-storage area 201, and from the first sub-storage area 201 to the second sub-storage area 202.
- each relative electrode needs to be set so that the movement of the electric particles can be in the counterclockwise direction, from the fourth sub-storage area 204 to the filtering area 203, from the filtering area 203 to the second sub-storage area 202, from the second sub-storage area 202 to the first sub-storage area 201, and from the first sub-storage area 201 to the third sub-storage area 203.
- the polarity setting of each region relative to the electrode is related to the polarity of the electric charge of the electric particles and the moving direction of the electric particles.
- the positive electric particles are driven to move from the second sub-storage region 202 to the light filtering region 203.
- the polarity of the third electrode 103 of the second sub-storage region 202 is positively charged, which is the same as the polarity of the electric particles, while the polarity of the sixth electrode 106 of the light filtering region 203 is negatively charged, which is different from the polarity of the electric particles.
- the positively charged electric particles of a certain color currently stored in the second sub-storage region 202 can be quickly moved from the second sub-storage region 202 to the light filtering region 203.
- the positively charged particles are driven to move from the filter area 203 to the third sub-storage area 204.
- the polarity of the fifth electrode 105 of the filter area 203 is positively charged, which is the same as the polarity of the electric particles, while the polarity of the eighth electrode 108 of the third sub-storage area 204 is negatively charged, which is different from the polarity of the electric particles.
- the electric particles of a certain color with positive charge currently contained in the filter area 203 can be quickly moved from the filter area 203 to the third sub-storage area 204.
- the fifth electrode 105 and the eighth electrode 108 are controlled to be powered off.
- the positively charged particles are driven to move from the third sub-storage area 204 to the first sub-storage area 201. Then, after power is turned on, the polarity of the seventh electrode 107 of the third sub-storage area 204 is positive, which is the same as the polarity of the particles, while the polarity of the second electrode 102 of the first sub-storage area 201 is negative, which is different from the polarity of the particles.
- the charged particles that have moved into the target area can be kept in the area by cutting off the power to the electrodes.
- the filter area allows light of the same color as the electric particles in the filter area to pass through and enter the underlying photosensitive layer.
- the electric particles of one color are driven to move to the filter area so that the photosensitive layer collects the light signal of the corresponding color and converts it into an electrical signal.
- red electric particles, green electric particles and blue electric particles can be moved to the filtering area in turn, and the corresponding red light, green light and blue light can pass through the filter layer into the same photosensitive layer below where the projection of the photosensitive layer in the direction of the optical axis at least partially overlaps, and they can be collected and processed separately.
- the filter area 203 contains a red ink capsule as an example. If the blue and green ink capsules are to be switched in sequence, the following steps need to be performed:
- the fifth electrode 105 and the eighth electrode 108 are powered on to control the red ink capsules in the filter area 203 to enter the third sub-storage area 204, and the fifth electrode 105 and the eighth electrode 108 are powered off;
- the third electrode 103 and the sixth electrode 106 are powered on to control the blue ink capsules in the second sub-storage area 202 to enter the filter area 203. At this time, the filter area 203 can only transmit blue light. The third electrode 103 and the sixth electrode 106 are powered off, so that the photosensitive layer under the filter area 203 can collect blue light.
- the first electrode 101 and the fourth electrode 104 are powered on to control the green ink capsule to enter the second sub-storage area 202, and the first electrode 101 and the fourth electrode 104 are powered off;
- the second electrode 102 and the seventh electrode 107 are powered on to control the red ink capsule to enter the first sub-storage area 201 , and the second electrode 102 and the seventh electrode 107 are powered off.
- Steps 3 and 4 are to prepare for the next color switching, which occurs between blue and green. By looping the above steps 1-4, the color switching can be completed. If you need to collect more energy of a certain color, you only need to control the electrode to be powered off for a longer time.
- Electrodes 101 to 108 in the figure are multiple control electrodes on the filter layer.
- the electric particles with different colors in the first sub-storage area 201, the second sub-storage area 202, the filter area 203 and the third sub-storage area 204 are periodically driven to move, so that the filter area 203 of the transparent material is filled with colored electric particles, and light with the same color as the electric particles can pass through. For example, if the filter area 203 is filled with red electric particles, the filter area 203 can only let red light pass through.
- the photosensitive layer includes a photosensitive element and a conversion circuit, wherein the photosensitive element is located below the filtering area and is used to collect light signals transmitted through the filtering area; the conversion circuit is connected to the photosensitive element and is used to convert the light signals collected by the photosensitive element into corresponding electrical signals; wherein the area of the photosensitive element is greater than or equal to the area of the filtering area.
- the photosensitive layer 24 includes a photosensitive element 301 and a conversion circuit 302.
- the photosensitive element 301 is located directly below the filter region 203, and the conversion circuit 302 is located around the photosensitive element 301.
- the photosensitive element 301 is, for example, a photosensor.
- the area of the photosensitive layer 22 is consistent with the area of the filter layer 24, and the area of the filter region 203 is consistent with the area of the photosensitive element 301.
- the area of the photosensitive element 301 can be set to be slightly larger than the area of the filter region 203.
- RGB natural light first enters the filter area 203 on the upper layer of the pixel unit, and passes through the red electric particles 10 to transmit the red light in the natural light from the filter area 203 and enter the photosensitive element 301 of the filter layer on the lower layer of the pixel unit.
- the photosensitive element 301 collects the incoming red light signal and obtains the corresponding red electrical signal through the photoelectric conversion of the peripherally connected conversion circuit 302.
- the green light and the blue light can be moved to the filter area 203 in sequence according to the same method, and the corresponding green electrical signal and blue electrical signal can be obtained by combining the photosensitive element 301 and the conversion circuit 302. In this way, the natural light corresponding to a pixel can be collected.
- a single photosensitive sensor of the filter layer can collect light of different colors transmitted from the filter area in a time-sharing manner to realize a pixel.
- the pixel structure of the embodiment of the present application can collect light of different colors to realize a pixel through a single photosensitive sensor, thereby improving the utilization rate of the photosensitive sensor.
- the area of the photosensitive sensor can be only 1/4 of the total area of the four photosensitive sensors included in an existing pixel unit, so that more photosensitive sensors can be placed in the same image sensor area, which can significantly increase the number of pixels and improve the imaging quality.
- the area of the filter region 203 is the area of the storage region.
- the area of the filter region 203 is respectively larger than the area of the first sub-storage region 201, the area of the second sub-storage region 202, and the area of the third sub-storage region 204.
- the area of the image sensor remains unchanged and the number of pixels remains unchanged, that is, the area of one pixel unit in the embodiment of the present application is the same as the area of four photosensitive sensors included in one existing pixel unit
- the area of a single photosensitive sensor of each pixel unit can be correspondingly increased, thereby increasing the amount of light, that is, the photosensitive sensor can collect more color light.
- the imaging quality is correspondingly better.
- the manufacturing process difficulty of a larger area photosensitive sensor can be significantly reduced, which reduces the manufacturing difficulty of the image sensor as a whole.
- the same number and size of charged particles can be accommodated in the corresponding regions by setting different thicknesses of the regions.
- the volume of the first sub-storage area 201, the volume of the second sub-storage area 202, the volume of the third sub-storage area 204 and the volume of the filter area 203 are the same, and correspond to and accommodate the same number and size of electronic particles.
- the volumes of different sub-storage areas can also be set according to the number and size of electronic particles accommodated in the first sub-storage area 201.
- the areas of the three storage areas can be made smaller and the area of the filter area can be made larger, so that the filter area can transmit more color light and the photosensitive layer can collect more light, thereby improving the quality of imaging.
- a single photosensor can collect light of different colors in time-sharing, thereby realizing image collection.
- the area of the photosensor is constant, more photosensors can be placed in the same image sensor area, and a single photosensor can realize one pixel. Therefore, under the same chip manufacturing process, more photosensors can be placed in the same image sensor area, and a larger number of pixels can be realized.
- the photosensor can be made larger within the same image sensor area to improve image quality.
- the sensing unit in a single pixel structure of the image sensor can be made larger, thereby increasing the light sensitivity and improving the imaging quality.
- an embodiment of the present application further provides a camera module, characterized in that it includes the image sensor described in any of the above embodiments.
- the camera module further includes: a circuit board, the image sensor being electrically connected to the circuit board; and a lens, the lens being arranged on a side of the image sensor away from the circuit board.
- an embodiment of the present application further provides an electronic device, comprising the camera module described in any of the above embodiments.
- the electronic devices in the embodiments of the present application include mobile electronic devices and non-mobile electronic devices.
- an embodiment of the present application also provides an image processing method, which is applied to an image processing device including the image sensor described in any of the above embodiments.
- Step 102 when each filter region of the plurality of pixel units contains electric particles with a first color, light signals of the first color transmitted through the corresponding filter region are collected through each photosensitive layer of the plurality of pixel units and converted into electric signals of the first color;
- Step 104 driving the electric particles of the first color to move from the filter area to the storage area, and controlling the electric particles with the second color stored in the storage area to move to the filter area 203;
- Step 106 collecting the light signal of the second color transmitted from the corresponding filter area 203 through each photosensitive layer and converting it into an electrical signal of the second color; the first color and the second color are different colors.
- the first color may be one of red, green and blue
- the second color may also be one of red, green and blue and different from the first color
- the colors corresponding to the first color and the second color can be preset. For example, it is first assumed that the electric particles contained in the filter area are red, that is, in the process of capturing an image, the red color is first collected by the pixel unit; after time x, after the electric particles move, it is assumed that the electric particles contained in the filter area are blue, that is, the blue color is subsequently collected by the pixel unit; after time y, it is assumed that the electric particles contained in the filter area are green, that is, the green color is subsequently collected by the pixel unit. In this way, the collection of color light corresponding to each pixel of a captured image is achieved.
- the image processing method provided in the embodiment of the present application is executed by an image processing device, which includes the image sensor of the above-mentioned embodiment of the present application, and the image sensor of the embodiment of the present application includes the pixel structure of any of the above-mentioned embodiments.
- An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
- a program or instruction is stored.
- the various processes of the above-mentioned image processing method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
- the processor is the processor in the electronic device described in the above embodiment.
- the readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
- An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
- the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
- An embodiment of the present application provides a computer program product, which is stored in a storage medium.
- the program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
- the technical solution of the present application can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
- a storage medium such as ROM/RAM, a magnetic disk, or an optical disk
- a terminal which can be a mobile phone, a computer, a server, or a network device, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
本申请公开了一种图像传感器、摄像模组、电子设备和图像处理方法，属于图像处理技术领域。该图像传感器包括多个像素单元，所述像素单元包括：位于像素单元下层的感光层，用于采集光信号并转换为电信号；位于像素单元上层的滤光层，所述滤光层包括滤光区域和存储区域，所述滤光区域为透光材质，并和所述感光层在光轴方向的投影至少部分存在重合，所述存储区域为不透光材质，所述存储区域用于带有颜色的电粒子，所述电粒子可在所述存储区域与所述滤光区域之间移动，所述滤光区域用于使得与所述滤光区域的电粒子颜色相同的光透过并进入所述下层的感光层。
Description
相关申请的交叉引用
本申请要求在2022年10月19日提交中国专利局、申请号为202211279686.3、发明名称为“图像传感器、摄像模组和电子设备”的中国专利申请的优先权，该中国专利申请的全部内容通过引用包含于此。
本申请属于图像处理技术领域，具体涉及一种图像传感器、摄像模组和电子设备。
传统的互补金属氧化物半导体(Complementary Metal Oxide Semiconductor，CMOS)图像传感器的主要包括上层滤光片和位于滤光片下方的感光层，来对不同颜色光进行采集。自然光由RGB三色光组成，经过滤光片之后成为单色光，单色光被下方的感光层接收。
一个像素单元内通常包括四个同样的感光传感器以及对应过滤R、B、Gr、Gb对应颜色光的四个滤光单元，才能实现一个像素，单个感光传感器也只能接收到一种颜色的光，利用率较低。
发明内容
本申请实施例的目的是提供一种图像传感器、摄像模组、电子设备和图像处理方法，能够解决现有的图像传感器的像素结构中感光传感器利用率低的问题。
第一方面，本申请实施例提供了一种图像传感器，包括多个像素单元，所述像素单元包括：位于像素单元下层的感光层，用于采集光信号并转换为电信号；位于像素单元上层的滤光层，所述滤光层包括滤光区域和存储区域，
所述滤光区域为透光材质，并和所述感光层在光轴方向的投影至少部分存在重合，所述存储区域为不透光材质，所述存储区域用于带有颜色的电粒子，所述电粒子可在所述存储区域与所述滤光区域之间移动，所述滤光区域用于使得与所述滤光区域的电粒子颜色相同的光透过并进入所述下层的感光层。
第二方面，本申请实施例提供了一种摄像模组，包括如第一方面所述的图像传感器。
第三方面，本申请实施例提供了一种电子设备，包括如第二方面所述的摄像模组。
第四方面，本申请实施例提供了一种图像处理方法，应用于包括如第一方面所述的图像传感器的图像处理装置，包括：
在所述多个像素单元的各滤光区域203中容纳带有第一颜色的电粒子的情况下，通过所述多个像素单元的各感光层采集从对应滤光区域203透过的所述第一颜色的光信号并转换为第一颜色的电信号；
驱动所述第一颜色的电粒子从滤光区域203移动到存储区域，并控制存储区域中存储的带有第二颜色的电粒子移动到所述滤光区域203；
通过各感光层采集从对应滤光区域203透过的所述第二颜色的光信号并转换为第二颜色的电信号；
所述第一颜色与所述第二颜色为不同的颜色。
在本申请实施例中，通过上述实施例的图像传感器，能够实现单个感光传感器分时采集不同颜色的光，从而实现图像光信息的采集，在感光传感器面积一定的情况下，能够在同样的图像传感器面积内放置更多的感光传感器，单个感光传感器就能实现一个像素，从而可以在同样的图像传感器面积内可以实现更多数量的像素。
如果像素数量不需要增加，那么可以在同样的图像传感器面积内将感光传感器做大，从而提升图像质量。
图1是本申请实施例的图像传感器的像素单元的结构示意图。
图2是本申请实施例的图像传感器的像素单元的整体架构示意图。
图3是本申请实施例的图像传感器的像素单元的光信号采集示意图。
图4是本申请实施例的图像处理方法的步骤流程图。
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员获得的所有其他实施例，都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象，而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施，且“第一”、“第二”等所区分的对象通常为一类，并不限定对象的个数，例如第一对象可以是一个，也可以是多个。此外，说明书以及权利要求中“和/或”表示所连接对象的至少其中之一，字符“/”，一般表示前后关联对象是一种“或”的关系。
下面结合附图，通过具体的实施例及其应用场景对本申请实施例提供的图像传感器、摄像模组、电子设备和图像处理方法进行详细地说明。
本申请实施例提供了一种像素结构，包括：位于像素单元下层的感光层，用于采集光信号并转换为电信号；位于像素单元上层的滤光层，所述滤光层包括滤光区域和存储区域，所述滤光区域为透光材质，并和所述感光层在光轴方向的投影至少部分存在重合，所述存储区域为不透光材质，所述存储区域用于带有颜色的电粒子，所述电粒子可在所述存储区域与所述滤光区域之间移动，所述滤光区域用于使得与所述滤光区域的电粒子颜色相同的光透过
并进入所述下层的感光层。
在本申请实施例中，像素单元包括一个感光传感器和对应的一个滤光区域，通过滤光区域内移动设置有不同颜色的带电粒子，一个像素单元能够实现不同颜色光的采集，从而进行后续处理可得到对应一个像素的各颜色的像素值。
如图1所示，像素单元包括滤光层22和感光层24，滤光层22和感光层24按照从上到下的顺序堆叠设置，且滤光层22和感光层24在光轴方向的投影至少部分存在重合。
位于像素单元上层的滤光层22包括透光材质的滤光区域，和不透光材质的存储区域。存储区域用于存储带有颜色的电粒子，例如红色电粒子、绿色电粒子和/或蓝色电粒子，存储区域内目标颜色的电粒子可以移动至滤光区域。
滤光区域的透光属性，可以使得与移动至滤光区域的目标颜色的电粒子颜色相同的光透过，并进入下层的感光层24，由感光层24采集目标颜色的光信号并转换为电信号。目标颜色是上述电粒子的颜色，红色、绿色或蓝色。当存储区域内的红色电粒子移动至滤光区域时，滤光区域可以使得红光透过；当存储区域内的绿色电粒子移动至滤光区域时，滤光区域可以使得绿光透过；当存储区域内的蓝色电粒子移动至滤光区域时，滤光区域可以使得蓝光透过。
可选的，图像传感器还包括：驱动单元，用于驱动所述电粒子在所述存储区域和所述滤光区域之间移动。
可选的，所述驱动单元包括：设置在所述存储区域的第一控制电极；以及
设置在所述滤光区域的第二控制电极；其中，所述第一控制电极用于驱动所述电粒子从所述存储区域移动至所述滤光区域，所述第二控制电极用于驱动所述电粒子从所述滤光区域移动至所述存储区域。
电粒子是带有正电或负电的粒子，可以在存储区域和滤光区域分别设置合适的控制电极，并根据同性相斥、异性相吸的原理，使得存储区域内存储
的红色电粒子、绿色电粒子或蓝色电粒子被移动到滤光区域，以进行对应颜色光的过滤。
可选的，所述存储区域包括用于存储红色电粒子的第一子存储区域201、用于存储绿色电粒子的第二子存储区域202和用于存储蓝色电粒子的第三子存储区域204；所述第一子存储区域201、所述第二子存储区域202和所述第三子存储区域204分布在所述滤光区域的周侧。如图1所示，滤光层22被划分为四个区域，其中包括一个滤光区域203和三个存储区域201,202,203。
与现有技术中一个像素单元的滤光层包括四个滤光单元并分别用于过滤红、绿、蓝不同颜色的光，本申请实施例中，一个像素单元可通过一个滤光区域203来过滤不同颜色的光。
参考图2，其中图2左侧为整体像素单元的立体示意图，右侧为像素单元上层的滤光层22对应的平面示意图。
滤光区域为透光材质，可以将与位于滤光区域内的电粒子颜色相同的光透过。存储区域为不透光材质，三个存储区域内分别用于一一对应存储红、绿、蓝三种颜色的电粒子，与位于存储区域内的电粒子颜色相同的光不能透过。
可选地，所述存储区域包括用于存储红色电粒子的第一子存储区域201、用于存储绿色电粒子的第二子存储区域202和用于存储蓝色电粒子的第三子存储区域204；所述第一子存储区域201、所述第二子存储区域202和所述第三子存储区域204分布在所述滤光区域的周侧。
参考图1及图2右侧的平面图示例，滤光层22包括滤光区域203和三个存储区域201,202,203。第一子存储区域201、第二子存储区域202和第三子存储区域204分布在滤光区域204的周侧，第一子存储区域201与第二子存储区域202、第三子存储区域204分别存在一个边相邻，滤光区域203与第二子存储区域202、第三子存储区域204分别存在一个边相邻。
如上文所述，第一子存储区域201、第二子存储区域202和第三子存储
区域204分别用于对应存储红、绿、蓝三种颜色的电粒子，每个存储区域对应存储带有哪个颜色的电粒子是没有限制的，只要保证三种带有不同颜色的电粒子分别位于不同的存储区域即可。也即，每个存储区域只能存储带有同一种颜色的电粒子。
电粒子顾名思义是带电的粒子，电粒子可以带正电也可以带负电，当然三个存储区域内各自存储的带有同一颜色的电粒子需要同时带相同极性的电。在本申请实施例中，带有颜色的电粒子例如可以以胶囊包裹的形式存在。
由于电粒子本身自己携带颜色，在进入透明材质的滤光区域的环境中，则使得透明的滤光区域中显示电粒子对应的颜色。
图2的实施例中，滤光层22包括的四个区域为矩形，但是本申请不局限于该具体实施例。为提高像素单元的利用率，滤光层22四个区域可保证具有四条边，且两个区域邻接的边完全对接即可。
可选地，所述第一子存储区域201、所述第二子存储区域202、所述滤光区域203和所述第三子存储区域204分别为矩形，或者所述第一子存储区域201、所述第二子存储区域202、所述滤光区域203和所述第三子存储区域204分别为菱形。
无论是第一子存储区域201、第二子存储区域202、第三子存储区域204各自存储的电粒子，还是移动到滤光区域203的电粒子，电粒子的数量和大小相同，也可以根据实际需求调整不同区域电粒子的大小和数量。
本申请实施例中，需要将原本存储在第一子存储区域201、第二子存储区域202、第三子存储区域204内的各带有颜色电粒子，依次移动到滤光区域203中，从而滤光区域203将与其容纳的带有颜色的电粒子的颜色相同的光，透射到下层的感光层中。
电粒子的移动可以通过在每个区域设置电极来实现，可选地，所述第一控制电极包括：设置在所述第一子存储区域201的第一电极101和第二电极102；设置在所述第二子存储区域202的第三电极103和第四电极104；设置
在所述第三子存储区域204的第七电极107和第八电极108；所述第二控制电极包括：设置在所述滤光区域203的第五电极105和第六电极106；其中，所述第一电极101与所述第四电极104相对，所述第二电极102与所述第七电极107相对，所述第三电极103与第六电极106相对，第五电极105与第八电极108相对，相对的两个电极通电时极性相异。
下面结合图2对滤光层包括的各个区域的电极布局，以及电粒子通过对应电极在不同区域之间移动的原理进行描述。在图示实施例中，以各个区域为矩形为例进行说明。第一子存储区域201、第二子存储区域202、滤光区域203和第三子存储区域204分别为包括四条边的矩形。
第一子存储区域201设置有第一电极101和第二电极102，对应设置在第一子存储区域201外周边的两条边对应位置处，即设置第一电极101和第二电极102的两条边，是第一子存储区域201与相邻的第二子存储区域202、第三子存储区域204不邻接的边。
第二子存储区域202设置有第三电极103和第四电极104，对应设置在第二子存储区域202外周边的两条边对应位置处，即设置第三电极103和第四电极104的两条边，是第二子存储区域202与相邻的第一子存储区域201、滤光区域203不邻接的边。
滤光区域203设置有第五电极105和第六电极106，对应设置在滤光区域203外周边的两条边对应位置处，即设置第五电极105和第六电极105的两条边，是滤光区域203与相邻的第二子存储区域202和第三子存储区域204不邻接的边。
第三子存储区域204设置有第七电极107和第八电极108，对应设置在第三子存储区域204外周边的两条边对应位置处，即设置第七电极107和第八电极108的两条边，是第三子存储区域204与相邻的第一子存储区域201、滤光区域203不邻接的边。
对应地，第一子存储区域201的第一电极101与第二子存储区域202的
第四电极104相对，第一子存储区域201的第二电极102与第三子存储区域204的第七电极107相对，第二子存储区域202的第三电极103与滤光区域203的第六电极106相对，滤光区域203的第五电极105与第三子存储区域204的第八电极108相对，并且相对的两个电极通电时极性相异。
如上文所述，容纳于各区域内的电粒子本身带电，由此，在对两个区域相对设置的两个电极分别通上正、负电的情况下，可以通过电粒子在电场中的运动为同性相吸、异性相斥的原理，将其中一个区域内的电粒子驱动到另外一个区域内。
初始状态下，仅三个存储区域内容纳带有颜色的电粒子，滤光区域中没有任何电粒子。对于上述四个区域，需设置各相对电极的极性使得电粒子的移动可沿顺时针方向，从第二子存储区域202移动到滤光区域203、从滤光区域203移动到第三子存储区域204、从第三子存储区域204移动到第一子存储区域201、以及从第一子存储区域201移动到第二子存储区域202。
或者，需设置各相对电极的极性使得电粒子的移动可沿逆时针方向，从第四子存储区域204移动到滤光区域203、从滤光区域203移动到第二子存储区域202、从第二子存储区域202移动到第一子存储区域201、以及从第一子存储区域201移动到第三子存储区域203。
关于各区域相对电极的极性设置，与电粒子的带电电荷的极性以及电粒子的移动方向有关。
以电粒子带正电、并驱动电粒子可沿顺时针方向在各区域之间移动为例，驱动正电电粒子从第二子存储区域202向滤光区域203移动，则通电后第二子存储区域202的第三电极103的极性为与电粒子极性相同的正电，而滤光区域203的第六电极106的极性为与电粒子极性相异的负电。由此，可以将第二子存储区域202当前存储的带正电的某种颜色的电粒子从第二子存储区域202快速移动到滤光区域203。
同样地，驱动正电电粒子从滤光区域203移动到第三子存储区域204，
则通电后滤光区域203的第五电极105的极性为与电粒子极性相同的正电，而第三子存储区域204的第八电极108的极性为与电粒子极性相异的负电。由此，可以将滤光区域203当前容纳的带正电的某种颜色的电粒子从滤光区域203快速移动到第三子存储区域204。移动到第三子存储区域204后，控制第五电极105和第八电极108断电。
驱动正电电粒子从第三子存储区域204移动到第一子存储区域201，则通电后第三子存储区域204的第七电极107的极性为与电粒子极性相同的正电，而第一子存储区域201的第二电极102的极性为与电粒子极性相异的负电。
在移动到对应区域后，通过对电极断电，可以将移动到目标区域内的电粒子保持停留在该区域内。
如上文所述，滤光区域可使得与滤光区域的电粒子颜色相同的光透过并进入下层的感光层。在一个时段内，驱动一种颜色的电粒子移动到滤光区域，以由感光层采集对应颜色的光信号并转换为电信号。
通过区分三个时段，可以将红色的电粒子、绿色的电粒子、蓝色的电粒子依次移动到滤光区域，将对应的红色光、绿色光、蓝色光透过滤光层进入下方和感光层在光轴方向的投影至少部分存在重合的同一个感光层，并分别进行采集和处理。
下面以当前状态下，滤光区域203中容纳有红色水墨胶囊为例，如果要依次进行蓝、绿颜色的水墨胶囊的切换，则需要执行以下步骤：
1、第五电极105和第八电极108通电，控制滤光区域203中的红色水墨胶囊进入第三子存储区域204，断电第五电极105和第八电极108；
2、第三电极103和第六电极106通电，控制第二子存储区域202中的蓝色水墨胶囊进入滤光区域203，此时滤光区域203只能透过蓝光，断电第三电极103和第六电极106，由此滤光区域203下方的感光层可进行对蓝光的采集；
3、第一电极101和第四电极104通电，控制绿色水墨胶囊进入第二子存储区域202，断电第一电极101和第四电极104；
4、第二电极102和第七电极107通电，控制红色水墨胶囊进入第一子存储区域201，断电第二电极102和第七电极107。
关于感光层采集颜色的切换在步骤2的时候已经完成，步骤3和步骤4是为了下一次颜色切换做准备，下一次颜色切换发生在蓝色和绿色之间。循环上述1-4步骤，就能够完成颜色的切换。如果需要多采集某个颜色的能量，则仅需要控制电极断电保持久一点的时间即可实现。
图中电极101至电极108是滤光层上的多个控制电极，通过对电极周期性地施加电压，周期性地驱动第一子存储区域201、第二子存储区域202、滤光区域203和第三子存储区域204内带有不同颜色的电粒子移动，从而使得透明材质的滤光区域203中被带有颜色的电粒子充斥，能够让与电粒子颜色相同的光通过。例如在滤光区域203中充斥有红色电粒子，那么滤光区域203只能让红光通过。
在一个实施例中，可选地，所述感光层包括感光元件和转换电路，所述感光元件，位于所述滤光区域的下方，用于采集从所述滤光区域透过的光信号；所述转换电路，与所述感光元件连接，用于将所述感光元件采集的光信号转换为对应的电信号；其中，所述感光元件的面积大于或等于所述滤光区域的面积。
如图2所示，感光层24包括感光元件301和转换电路302，感光元件301位于滤光区域203的正下方，转换电路302位于感光元件301的周侧。感光元件301例如为感光传感器。
在一个像素结构中，感光层22的面积与滤光层24的面积一致，滤光区域203的面积与感光元件301的面积一致。但为了使得滤光区域203透出的带颜色的光线更多被感光元件301采集到，可以设置感光元件301的面积略大于滤光区域203的面积。
如图3所示，在滤光区域203中移动有例如红色电粒子10的情况下，摄像头拍摄过程中，RGB自然光首先进入像素单元上层的滤光区域203中，并经过红色电粒子10将自然光中的红色光从滤光区域203中透出，并进入像素单元下层的滤光层的感光元件301中。感光元件301对进入的红色光信号进行采集，并通过周边连接的转换电路302的光电转换，得到对应的红色电信号。
在采集完红色光之后，依照同样的方法，可将绿色光和蓝色光依次移动到滤光区域203中，并结合感光元件301和转换电路302，可得到对应的绿色电信号、蓝色电信号。由此，可以实现对一个像素对应的自然光的采集。
在本申请实施例中，滤光层的单个感光传感器可分时采集滤光区域透出的不同颜色的光来实现一个像素，相比现COMS图像传感器中通过四个感光传感器采集三种颜色的光才能够实现一个像素，本申请实施例的像素结构通过单个感光传感器即可采集不种颜色的光以实现一个像素，由此提高了感光传感器的利用率。并且，感光传感器的面积可以仅为现有一个像素单元包括的四个感光传感器的总面积的1/4，则能够在同样的图像传感器面积内放置更多的感光传感器，如此能够显著增大像素的数量，提高成像质量。
可选地，在一个实施例中，所述滤光区域203的面积存储区域的面积。在存储区域包括三个子区域的情况下，所述滤光区域203的面积则分别大于所述第一子存储区域201的面积、所述第二子存储区域202的面积、所述第三子存储区域204的面积。
该实施例中，将滤光区域203的面积做大，则可以将更多量的颜色光透出并进入下方的感光层。
在图像传感器面积不变且像素数量也不变，即本申请实施例的一个像素单元的面积与现有的一个像素单元包括的四个感光传感器面积相同的情况下，通过将本申请中滤光区域的面积做大，则每个像素单元的单个感光传感器的面积能够对应做大，由此感光量更大，即感光传感器可采集更多的颜色光，
相应地成像质量越好。并且，更大面积的感光传感器的制造工艺难度可显著降低，整体上降低了图像传感器的制造难度。
在滤光区域与其他三个存储区域的面积不同的情况下，可以通过设置各区域厚度的不同，将相同数量和大小的电粒子容纳在对应区域内。
在存储区域包括三个子区域的情况下，可选地，所述第一子存储区域201的容积、第二子存储区域202的容积、第三子存储区域204的容积和所述滤光区域203的容积相同，分别对应容纳相同数量和大小的电粒子。还可根据第一子存储区域201所容纳的电粒子的数量和大小分别设置不同子存储区域的容积。
由此，可以将三个存储区域的面积做小，将滤光区域的面积做大，使得滤光区域透过更多的颜色光，感光层采集到更多的感光量，因此提高成像的质量。
在本申请实施例中，通过上述实施例的图像传感器，能够实现单个感光传感器分时采集不同颜色的光，从而实现图像的采集，在感光传感器面积一定的情况下，能够在同样的图像传感器面积内放置更多的感光传感器，单个感光传感器就能实现一个像素，从而可以在同样芯片制造工艺下，同样的图像传感器面积内能够放置更多的感光传感器，可以实现更多数量的像素。
如果像素数量不需要增加，那么可以在同样的图像传感器面积内将感光传感器做大，提升图像质量。
此外，如果在图像传感器面积不变且像素数量也不变的情况下，图像传感器的单个像素结构中的感应单元能够做的更大，由此增大感光量更大，提高成像质量。
可选地，本申请实施例还提供一种摄像模组，其特征在于，包括上述任一实施例所述的图像传感器。
所述摄像模组还包括：电路板，所述图像传感器与所述电路板电连接；镜头，所述镜头设置在所述图像传感器的远离所述电路板的一侧。
可选地，本申请实施例还提供一种电子设备，包括上述任一实施例所述的摄像模组。
需要说明的是，本申请实施例中的电子设备包括移动电子设备和非移动电子设备。
此外，本申请实施例还提供一种图像处理方法，应用于包括上述任一实施例所述的图像传感器的图像处理装置。
如图4所示，包括：
步骤102，在所述多个像素单元的各滤光区域中容纳带有第一颜色的电粒子的情况下，通过所述多个像素单元的各感光层采集从对应滤光区域透过的所述第一颜色的光信号并转换为第一颜色的电信号；
步骤104，驱动所述第一颜色的电粒子从滤光区域移动到存储区域，并控制存储区域中存储的带有第二颜色的电粒子移动到所述滤光区域203；
步骤106，通过各感光层采集从对应滤光区域203透过的所述第二颜色的光信号并转换为第二颜色的电信号；所述第一颜色与所述第二颜色为不同的颜色。
上述第一颜色可以是红色、绿色和蓝色中的一种，第二颜色也是红色、绿色和蓝色中的一种且与第一颜色不同。
在实际应用中，第一颜色、第二颜色对应的色彩可以预先设置。比如首先默认为滤光区域中容纳的电粒子带有红色，即拍摄一张图像过程中，先通过像素单元采集红色；经过时间x，经电粒子移动后，默认为滤光区域中容纳的电粒子带有蓝色，即后续通过像素单元采集蓝色；经过时间y，默认为滤光区域中容纳的电粒子带有绿色，即后续通过像素单元采集绿色。由此，实现对一张拍摄图像的各像素对应的颜色光的采集。本申请实施例提供的图像处理方法，执行主体为图像处理装置，该图像处理装置包括本申请上述实施例的图像传感器，且本申请实施例的图像传感器包括上述任一实施例的像素结构。
本申请实施例还提供一种可读存储介质，所述可读存储介质上存储有程序或指令，该程序或指令被处理器执行时实现上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等。
本申请实施例另提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
应理解，本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
本申请实施例提供一种计算机程序产品，该程序产品被存储在存储介质中，该程序产品被至少一个处理器执行以实现如上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外，需要指出的是，本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能，还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能，例如，可以按不同于所描述的次序来执行所描述的方法，并且还可以添加、省去、或组合各种步骤。另外，参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述，但是本申请并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本申请的保护之内。
Claims (12)
- 一种图像传感器，包括多个像素单元，所述像素单元包括：位于所述像素单元下层的感光层，用于采集光信号并转换为电信号；位于像素单元上层的滤光层，所述滤光层包括滤光区域和存储区域，所述滤光区域为透光材质，并和所述感光层在光轴方向的投影至少部分存在重合，所述存储区域为不透光材质，所述存储区域用于存储带有颜色的电粒子，所述电粒子可在所述存储区域与所述滤光区域之间移动，所述滤光区域用于使得与所述滤光区域的电粒子颜色相同的光透过并进入所述下层的感光层。
- 根据权利要求1所述的图像传感器，其中，还包括：驱动单元，用于驱动所述电粒子在所述存储区域和所述滤光区域之间移动。
- 根据权利要求2所述的图像传感器，其中，所述驱动单元包括：设置在所述存储区域的第一控制电极；以及设置在所述滤光区域的第二控制电极；其中，所述第一控制电极用于驱动所述电粒子从所述存储区域移动至所述滤光区域，所述第二控制电极用于驱动所述电粒子从所述滤光区域移动至所述存储区域。
- 根据权利要求3所述的图像传感器，其中，所述存储区域包括用于存储红色电粒子的第一子存储区域、用于存储绿色电粒子的第二子存储区域和用于存储蓝色电粒子的第三子存储区域；所述第一子存储区域、所述第二子存储区域和所述第三子存储区域分布在所述滤光区域的周侧。
- 根据权利要求4所述的图像传感器，其中，所述第一控制电极包括：设置在所述第一子存储区域的第一电极和第二电极；设置在所述第二子存储区域的第三电极和第四电极；设置在所述第三子存储区域的第七电极和第八电极；所述第二控制电极包括：设置在所述滤光区域的第五电极和第六电极；其中，第一电极、第二电极、第三电极、第四电极、第五电极、第六电极、第七电极和第八电极分别设置在对应区域不与其他区域相邻的的周侧；所述第一电极与所述第四电极相对，所述第二电极与所述第七电极相对，所述第三电极与第六电极相对，第五电极与第八电极相对，相对的两个电极通电时极性相异。
- 根据权利要求1所述的图像传感器，其中，所述滤光区域的面积大于存储区域的面积。
- 根据权利要求4所述的图像传感器，其中，所述第一子存储区域的容积、第二子存储区域的容积、第三子存储区域的容积和所述滤光区域的容积相同，分别对应容纳相同数量和大小的电粒子。
- 根据权利要求1至7中任一项所述的图像传感器，其中，所述感光层包括感光元件和转换电路，所述感光元件，位于所述滤光区域的下方，用于采集从所述滤光区域透过的光信号；所述转换电路，与所述感光元件连接，用于将所述感光元件采集的光信号转换为对应的电信号；其中，所述感光元件的面积大于或等于所述滤光区域的面积。
- 一种摄像模组，包括如权利要求1-8中任一项所述的图像传感器。
- 根据权利要求9所述的摄像模组，其中，所述摄像模组还包括：电路板，所述图像传感器与所述电路板电连接；镜头，所述镜头设置在所述图像传感器的远离所述电路板的一侧。
- 一种电子设备，包括权利要求9或10所述的摄像模组。
- 一种图像处理方法，应用于包括如权利要求1-8中任一项所述的图像传感器的图像处理装置，包括：在所述多个像素单元的各滤光区域中容纳带有第一颜色的电粒子的情况 下，通过所述多个像素单元的各感光层采集从对应滤光区域透过的所述第一颜色的光信号并转换为第一颜色的电信号；驱动所述第一颜色的电粒子从滤光区域移动到存储区域，并控制存储区域中存储的带有第二颜色的电粒子移动到所述滤光区域；通过各感光层采集从对应滤光区域透过的所述第二颜色的光信号并转换为第二颜色的电信号；所述第一颜色与所述第二颜色为不同的颜色。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211279686.3A CN115589540A (zh) | 2022-10-19 | 2022-10-19 | 图像传感器、摄像模组和电子设备 |
| CN202211279686.3 | 2022-10-19 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024083035A1 true WO2024083035A1 (zh) | 2024-04-25 |
Family
ID=84780497
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/124438 WO2024083035A1 (zh) | 2022-10-19 | 2023-10-13 | 图像传感器、摄像模组和电子设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN115589540A (zh) |
| WO (1) | WO2024083035A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115589540A (zh) * | 2022-10-19 | 2023-01-10 | 维沃移动通信有限公司 | 图像传感器、摄像模组和电子设备 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006064943A (ja) * | 2004-08-26 | 2006-03-09 | Fuji Photo Film Co Ltd | 光学フィルタ、結像ユニット、および画像撮影装置 |
| CN101782707A (zh) * | 2009-01-19 | 2010-07-21 | 元太科技工业股份有限公司 | 彩色电泳式显示装置的像素结构与子像素结构 |
| CN102314037A (zh) * | 2010-07-06 | 2012-01-11 | 群康科技(深圳)有限公司 | 显示组件、显示装置与显示组件的制造方法 |
| CN204633909U (zh) * | 2014-05-30 | 2015-09-09 | 半导体元件工业有限责任公司 | 成像器 |
| CN115589540A (zh) * | 2022-10-19 | 2023-01-10 | 维沃移动通信有限公司 | 图像传感器、摄像模组和电子设备 |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104159049A (zh) * | 2014-08-15 | 2014-11-19 | 北京思比科微电子技术股份有限公司 | 一种图像传感器及其工作方法 |
| CN110868527A (zh) * | 2019-11-14 | 2020-03-06 | 维沃移动通信有限公司 | 一种拍摄模组、拍摄方法及电子设备 |
| CN114758626B (zh) * | 2022-04-20 | 2024-07-23 | 福州京东方光电科技有限公司 | 显示模组、显色控制方法及显示面板 |
-
2022
- 2022-10-19 CN CN202211279686.3A patent/CN115589540A/zh active Pending
-
2023
- 2023-10-13 WO PCT/CN2023/124438 patent/WO2024083035A1/zh unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006064943A (ja) * | 2004-08-26 | 2006-03-09 | Fuji Photo Film Co Ltd | 光学フィルタ、結像ユニット、および画像撮影装置 |
| CN101782707A (zh) * | 2009-01-19 | 2010-07-21 | 元太科技工业股份有限公司 | 彩色电泳式显示装置的像素结构与子像素结构 |
| CN102314037A (zh) * | 2010-07-06 | 2012-01-11 | 群康科技(深圳)有限公司 | 显示组件、显示装置与显示组件的制造方法 |
| CN204633909U (zh) * | 2014-05-30 | 2015-09-09 | 半导体元件工业有限责任公司 | 成像器 |
| CN115589540A (zh) * | 2022-10-19 | 2023-01-10 | 维沃移动通信有限公司 | 图像传感器、摄像模组和电子设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115589540A (zh) | 2023-01-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2024083035A1 (zh) | 图像传感器、摄像模组和电子设备 | |
| CN212435794U (zh) | 图像传感器和电子设备 | |
| CN104221365B (zh) | 拍摄元件、摄影方法及拍摄装置 | |
| CN106454161B (zh) | 改善图像传感器的图像质量的方法 | |
| CN105516697B (zh) | 图像传感器、成像装置、移动终端及成像方法 | |
| CN101778221B (zh) | 固态成像装置 | |
| US20080165257A1 (en) | Configurable pixel array system and method | |
| CN107480639A (zh) | 一种触控显示面板和显示装置 | |
| CN105611258A (zh) | 图像传感器的成像方法、成像装置和电子装置 | |
| CN101110439A (zh) | 互补金属氧化物半导体图像传感器及用其的图像传感方法 | |
| CN111510651B (zh) | 一种图像传感电路、图像传感器及终端设备 | |
| CN105247851B (zh) | 能够进行相位差对焦检测的成像传感器 | |
| CN102510447B (zh) | 图像传感器 | |
| CN103096094A (zh) | 视觉识别装置和方法 | |
| CN105578079B (zh) | 图像传感器及画质调节方法、成像装置及方法和移动终端 | |
| CN105430360B (zh) | 成像方法、图像传感器、成像装置及电子装置 | |
| EP4040785B1 (en) | Camera module, camera, terminal device and image information determination method | |
| WO2023179527A1 (zh) | 摄像模组、摄像模组的控制方法以及电子设备 | |
| WO2023098552A1 (zh) | 图像传感器、信号处理方法、装置、摄像模组及电子设备 | |
| CN111818314A (zh) | 一种滤波器阵列及图像传感器 | |
| CN108965665A (zh) | 一种图像传感器及移动终端 | |
| JPS54158818A (en) | Color solid-state pickup unit | |
| CN114125237A (zh) | 图像传感器、摄像模组、电子设备、图像获取方法及介质 | |
| WO2023179589A1 (zh) | 摄像模组以及电子设备 | |
| CN103686103A (zh) | 具有合并和分裂模式的图像传感器、像素单元 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23879026 Country of ref document: EP Kind code of ref document: A1 |