CN113141488B - Color restoration method of small-size pixel image sensor - Google Patents
Color restoration method of small-size pixel image sensor Download PDFInfo
- Publication number
- CN113141488B CN113141488B CN202110307922.7A CN202110307922A CN113141488B CN 113141488 B CN113141488 B CN 113141488B CN 202110307922 A CN202110307922 A CN 202110307922A CN 113141488 B CN113141488 B CN 113141488B
- Authority
- CN
- China
- Prior art keywords
- region
- color
- distributed
- bayer pattern
- restoration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 16
- 238000010586 diagram Methods 0.000 claims description 72
- 238000004364 calculation method Methods 0.000 claims description 24
- 230000002093 peripheral effect Effects 0.000 claims description 15
- 239000003086 colorant Substances 0.000 claims description 5
- 238000004519 manufacturing process Methods 0.000 abstract description 7
- 238000003384 imaging method Methods 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention relates to a color restoration method of a small-size pixel image sensor, which comprises four steps of image marking, image splitting, color restoration and image combination. The invention replaces and restores the color of the original image by the color filter with the size of 2 times, does not increase the manufacturing cost of components, has simple manufacture and easy realization, and solves the problem that the color filter with small-size pixels can not be manufactured.
Description
Technical Field
The invention relates to a color restoration method of a small-size pixel image sensor, belonging to the technical field of image processing.
Background
The imaging process of the camera is the process of digitizing the optical signal. Light firstly passes through the lens to reach a photosensitive element, namely an image sensor CCD, a CMOS and the like, light signals are converted into digital signals, and the digital signals are transmitted to equipment such as a camera after being subjected to subsequent signal processing by a special digital signal processing chip.
The image sensor with photosensitive intensity introduced above can only transmit black and white photos, i.e. grayscale images, and if a color image is required to be output finally, i.e. light of different wave bands is desired to be sensed, the most direct way is to add different color filters in front of the photosensitive element, so as to filter out the colors of three channels of RGB. However, if three channels of light intensity are obtained for each picture element in this way, three filters need to be applied for each picture element, which is too costly. The inventor of the kodak company engineer blaise-bayer, the bayer array, has conceived a solution, the bayer array. The Bayer array does not place three color filters on each pixel, but places a single color filter on each pixel at intervals, so that a picture with vacant color values can be obtained, and the vacant color values can be filled through various interpolation means.
With the further development of the image sensor technology, the size of each pixel of the image sensor is gradually reduced to reach the nanometer level, but the corresponding bayer pattern filter cannot manufacture the bayer pattern with the same size level due to the limitation of the production process, so that a filter called a four bayer pattern is derived, that is, four bayer arrays with the same color are arranged together, and the 4 bayer arrays with the same color are taken as a whole, which is actually a classic bayer array, and the width and the height of each bayer array are 2 times of the size of the pixel, so that the bayer array with the 2 times of the size of the pixel can be manufactured by the current production process.
As described above, the finally obtained color image is restored by various interpolation means, and the conventional bayer array-based color restoration method is not applicable to the quad bayer pattern, and therefore, the present invention provides a color restoration method for a small-size pixel image sensor with the quad bayer pattern.
Disclosure of Invention
In order to solve the technical problem, the invention provides a color restoration method of a small-size pixel image sensor, which has the following specific technical scheme:
the color restoration method of the small-size pixel image sensor comprises the following steps of:
step 1: image marking: dividing a four-Bayer pattern image into a plurality of regions, uniformly dividing each region into four units, and sequentially marking each unit;
step 2: image splitting: splitting each four-Bayer pattern image into four separate Bayer pattern images, wherein each separate Bayer pattern image is composed of four units with the same mark in four regions, and the length and the width of each separate Bayer pattern image correspond to the length and the width of the original four-Bayer pattern image and are half of the numerical values of the four-Bayer pattern image;
and step 3: color restoration: carrying out color reduction on each single Bayer pattern image by using a traditional interpolation means, and correspondingly obtaining 4 color images, wherein the length and the width of each color image correspond to the length and the width of the original single Bayer pattern image and are half of the numerical value of the original single Bayer pattern image;
and 4, step 4: combining images: and sequentially combining and arranging units with the same area and different assignments in the color image to obtain the color image with the restored colors.
Further, the quad bayer pattern image in step 1 is divided into a plurality of regions, and sequentially divided into a G region, an R region, and a B region, where the distribution ratio of the G region, the R region, and the B region is 2:1:1, four units, four are divided evenly in G region the unit assign value mark in proper order and be G1, G2, G3, G4, four units, four are divided evenly in R region the unit assign value mark in proper order is R1, R2, R3, R4, four units, four are divided evenly in B region the unit assign value mark in proper order is B1, B2, B3, B4.
Further, in the step 2, a color value in each individual bayer pattern image field is weighted and averaged, so as to obtain a G region component, an R region component, and a B region component of a reduction color, and the G regions distributed in the R region and the B region are reduced, the R regions distributed in the B region and the two G regions are reduced, and the B regions distributed in the R region and the two G regions are reduced.
Further, the color restoration of the G region includes two cases:
a. restoring the G region distributed in the R region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the G region distributed in the R region, and expressing the color restoration peripheral color distribution diagram by a formula (1),
in the formula, R0, R1, R2, R3, R4, G1, G2, G3 and G4 are color values of different positions in the same Bayer pattern image, wherein R0 is the color value of a G region needing to be restored at the moment, and the G region component distributed in the R region is obtained through calculation to realize color restoration;
b. restoring the G area distributed in the B area, setting a color restoration surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the G area distributed in the B area, and expressing the color restoration surrounding color distribution diagram through a formula (2),
in the formula, B0, B1, B2, B3, B4, G1, G2, G3 and G4 are color values at different positions in the same Bayer pattern image, wherein B0 is the color value of a G region needing to be restored at the moment, and the G region component distributed in the B region is obtained through calculation to realize color restoration;
the color restoration of the R region includes three cases:
c. reducing the R region distributed in the B region, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in the B region, and expressing the color reduction surrounding color distribution diagram by a formula (3),
in the formula, B0, B1, B2, B3, B4, R1, R2, R3 and R4 are color values at different positions in the same Bayer pattern image, wherein B0 is the color value of an R region needing to be restored, and R region components distributed in the B region are obtained through calculation to realize color restoration;
d. reducing the R region distributed in one of the two G regions, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in one of the two G regions, and expressing the color reduction surrounding color distribution diagram by a formula (4),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, R1 and R2 are color values of different positions in the same Bayer pattern image, wherein G0 is the color value of an R region needing to be restored, and R region components distributed in one of the two G regions are obtained through calculation to realize color restoration;
f. restoring the R region distributed in the other G region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in the other G region, and expressing by formula (5),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, R1 and R2 are color values at different positions in the same Bayer pattern image, wherein G0 is the color value of an R region needing to be restored, and R region components distributed in another G region are obtained through calculation to realize color restoration;
the color restoration of the B region includes three cases:
g. reducing the B area of the R area, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the B area distributed in the R area, and expressing the color reduction surrounding color distribution diagram by a formula (6),
in the formula, R0, R1, R2, R3, R4, B1, B2, B3 and B4 are color values at different positions in the same Bayer pattern image, wherein R0 is a color value of a B region which needs to be restored at the moment, and B region components distributed in the R region are obtained through calculation to realize color restoration;
h. restoring B region distributed in one of the two G regions, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the B region distributed in the other G region, and expressing by formula (7),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, B1 and B2 are color values at different positions in the same Bayer pattern image, wherein G0 is a color value of a B region which needs to be restored at the moment, and a B region component distributed in another G region is obtained through calculation to realize color restoration;
i. restoring the B region distributed in another G region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the B region distributed in another G region, and expressing by formula (8),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, B1, and B2 are color values at different positions in the same bayer pattern image, which are color values of a B region that needs to be restored, and a B region component distributed in another G region is obtained by calculation, so that color restoration is realized.
Further, the image in the step 3 passes through a color filter with 2 times of size and performs color restoration by using a traditional interpolation means.
The invention has the beneficial effects that:
the invention replaces and restores the color of the original image by using the color filter with the size of 2 times, does not increase the manufacturing cost of components, has simple manufacture and easy realization, and solves the problem that the color filter with small-size pixels can not be manufactured; the invention can improve the application range of the small-size pixel image sensor, including cell imaging, satellite imaging and other scenes requiring large visual field and high resolution.
Drawings
Figure 1 is a schematic flow diagram of the present invention,
figure 2 is a schematic illustration of the bayer pattern of the present invention,
figure 3 is a split tetrabyer array image of the present invention,
figure 4 is a bayer pattern image I alone after splitting according to the invention,
figure 5 is a bayer pattern image II alone after splitting according to the invention,
figure 6 is a bayer pattern image III alone after splitting according to the invention,
figure 7 is a bayer pattern image IV alone after splitting according to the invention,
figure 8 is an image recombined after color restoration according to the present invention,
FIG. 9 is a graph of the color distribution around the color reduction of the G region distributed in the R region according to the present invention,
figure 10 is a corresponding multiplication coefficient diagram of figure 9,
FIG. 11 is a color distribution diagram of the G region color reduction surrounding distributed in the B region according to the present invention,
figure 12 is a graph of the corresponding multiplication factor of figure 11,
FIG. 13 is a color distribution diagram of R region color reduction surrounding distributed in B region according to the present invention,
figure 14 is a corresponding multiplication coefficient map of figure 13,
FIG. 15 is a graph of the R region color reduction ambient color distribution of the present invention distributed in one of two G regions,
figure 16 is a corresponding multiplication coefficient plot of figure 15,
FIG. 17 is a color distribution diagram of the R region color reduction surrounding the distribution of the present invention in another G region,
figure 18 is a corresponding multiplication coefficient map of figure 17,
FIG. 19 is a color distribution diagram of the B region color reduction surrounding distributed in the R region according to the present invention,
figure 20 is a corresponding multiplication coefficient map of figure 19,
FIG. 21 is a B region color reduction surrounding color distribution diagram of the present invention distributed in one of two G regions,
figure 22 is a graph of the multiplication factor corresponding to figure 21,
FIG. 23 is a color distribution diagram of the B region color reduction surroundings of the present invention distributed in another G region,
fig. 24 is a diagram of the multiplication factor corresponding to fig. 23.
Detailed Description
The present invention will now be described in further detail with reference to the accompanying drawings. These drawings are simplified schematic views illustrating only the basic structure of the present invention in a schematic manner, and thus show only the constitution related to the present invention.
As shown in fig. 1, a color restoration method of a small-sized pixel image sensor of the present invention. Firstly, an image to be subjected to color restoration is provided with a four bayer pattern image, the four bayer pattern image is divided into a plurality of regions, and the regions are sequentially divided into a G region, an R region and a B region, wherein R represents red, G represents green, and B represents blue, and the distribution ratio of the G region, the R region and the B region is 2:1:1, and are regularly distributed. Each G area is uniformly divided into four units, the four units are sequentially assigned with values marked as G1, G2, G3 and G4, each R area is uniformly divided into four units, the four units are sequentially assigned with values marked as R1, R2, R3 and R4, each B area is uniformly divided into four units, and the four units are sequentially assigned with values marked as B1, B2, B3 and B4, as shown in FIG. 3. Then, each of the four bayer pattern images is split into four individual bayer pattern images, each of which is made up of four cells marked identically in the region, and the length and width of each of the individual bayer pattern images correspond to those of the original four bayer pattern images and are half of their numerical values, as shown in fig. 4, 5, 6, and 7. And carrying out color reduction on each single Bayer pattern image by using a traditional color interpolation means, and correspondingly obtaining 4 color images, wherein the length and the width of each color image correspond to the length and the width of the original single Bayer pattern image and are half of the numerical value of the original single Bayer pattern image. The color interpolation is that each pixel has three color values of R, G, and B in the normal color image we see. However, the image sensor of the camera acquires a bayer pattern image after passing through a color filter matrix, and the colors of the bayer pattern image are distributed as shown in fig. 2, where R represents red, G represents green, and B represents blue. Each pixel only has one of R, G or B color values, and then a certain algorithm needs to be adopted to complement the missing color value, that is, according to the position of the missing color value and the distribution of its surrounding colors, the missing color value and the surrounding color value are multiplied by a certain coefficient to obtain a color value that needs to be complemented, and this algorithm is a color interpolation algorithm. Finally, rearranging and combining the images subjected to color restoration, sequentially combining and arranging units with the same area and different assignments in the color image to obtain the color image subjected to color restoration, wherein the image subjected to color restoration is a complete RGB (red, green and blue) color image, and each group of BGR (color matching component) color values represents one image pixel as shown in FIG. 8.
The specific situations of color restoration by using an interpolation method are divided into the following cases:
the color restoration of the G area comprises two conditions:
a. restoring the G region distributed in the R region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the G region distributed in the R region, and expressing the color restoration peripheral color distribution diagram through a formula (1),
in the formula, R0, R1, R2, R3, R4, G1, G2, G3 and G4 are color values of different positions in the same Bayer pattern image, wherein R0 is the color value of a G region needing to be reduced, and G region components distributed in the R region are obtained through calculation to realize color reduction;
b. restoring the G area distributed in the B area, setting a color restoration surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the G area distributed in the B area, and expressing the color restoration surrounding color distribution diagram by a formula (2),
in the formula, B0, B1, B2, B3, B4, G1, G2, G3 and G4 are color values at different positions in the same Bayer pattern image, wherein B0 is the color value of a G region needing to be restored at the moment, and the G region component distributed in the B region is obtained through calculation to realize color restoration;
the color restoration of the R region includes three cases:
c. reducing the R region distributed in the B region, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in the B region, and expressing the color reduction surrounding color distribution diagram by a formula (3),
in the formula, B0, B1, B2, B3, B4, R1, R2, R3 and R4 are color values at different positions in the same Bayer pattern image, wherein B0 is the color value of an R region needing to be reduced, and R region components distributed in the B region are obtained through calculation to realize color reduction;
d. reducing the R region distributed in one of the two G regions, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in one of the two G regions, and expressing the color reduction surrounding color distribution diagram by a formula (4),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, R1 and R2 are color values of different positions in the same Bayer pattern image, wherein G0 is the color value of an R region needing to be restored, and R region components distributed in one of the two G regions are obtained through calculation to realize color restoration;
f. restoring the R region distributed in the other G region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in the other G region, and expressing by formula (5),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, R1 and R2 are color values at different positions in the same Bayer pattern image, wherein G0 is the color value of an R region needing to be restored, and R region components distributed in another G region are obtained through calculation to realize color restoration;
(III) the color restoration of the B region includes three cases:
g. reducing the B area of the R area, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the B area distributed in the R area, and expressing the color reduction surrounding color distribution diagram by a formula (6),
in the formula, R0, R1, R2, R3, R4, B1, B2, B3 and B4 are color values at different positions in the same Bayer pattern image, wherein R0 is a color value of a B region which needs to be restored at the moment, and B region components distributed in the R region are obtained through calculation to realize color restoration;
h. restoring B region distributed in one of the two G regions, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the B region distributed in the other G region, and expressing by formula (7),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, B1 and B2 are color values at different positions in the same Bayer pattern image, wherein G0 is a color value of a B region which needs to be restored at the moment, and a B region component distributed in another G region is obtained through calculation to realize color restoration;
i. restoring the B region distributed in another G region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the B region distributed in another G region, and expressing by formula (8),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, B1, and B2 are color values at different positions in the same bayer pattern image, which are color values of a B region that needs to be restored, and a B region component distributed in another G region is obtained by calculation, so that color restoration is realized.
The invention solves the problem that the color filter corresponding to the small-size pixel can not be manufactured, and the color filter with the size of 2 times is used for replacing and restoring the color of the original image.
In light of the foregoing description of the preferred embodiment of the present invention, many modifications and variations will be apparent to those skilled in the art without departing from the spirit and scope of the invention. The technical scope of the present invention is not limited to the content of the specification, and must be determined according to the scope of the claims.
Claims (4)
1. A color restoration method of a small-size pixel image sensor is characterized by comprising the following steps:
step 1: image marking: dividing a four-Bayer pattern image into a plurality of regions, namely a G region, an R region and a B region, wherein each region is uniformly divided into four units, each unit is marked in sequence, and the distribution ratio of the G region, the R region and the B region is 2: 1;
step 2: image splitting: splitting each four-Bayer pattern image into four separate Bayer pattern images, wherein each separate Bayer pattern image is composed of four units with the same marks in four regions, and the length and the width of each separate Bayer pattern image correspond to the length and the width of the original four-Bayer pattern image and are half of the numerical values of the four-Bayer pattern image;
and step 3: color restoration: carrying out color reduction on each single Bayer pattern image by using a traditional interpolation means, and correspondingly obtaining 4 color images, wherein the length and the width of each color image correspond to the length and the width of the original single Bayer pattern image and are half of the numerical value of the original single Bayer pattern image;
and 4, step 4: combining images: sequentially combining and arranging units with the same area and different assignments in the color image to obtain a color image with reduced colors;
the color restoration of the G region includes two cases:
a. restoring the G region distributed in the R region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the G region distributed in the R region, and expressing the color restoration peripheral color distribution diagram by a formula (1),
G＝4*R0-1*(R1+R2+R3+R4)+2*(G1+G2+G3+G4) (1)
in the formula, R0, R1, R2, R3, R4, G1, G2, G3 and G4 are color values of different positions in the same Bayer pattern image, wherein R0 is the color value of a G region needing to be restored at the moment, and the G region component distributed in the R region is obtained through calculation to realize color restoration;
b. restoring the G area distributed in the B area, setting a color restoration surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the G area distributed in the B area, and expressing the color restoration surrounding color distribution diagram by a formula (2),
G＝4*B0-1*(B1+B2+B3+B4)+2*(G1+G2+G3+G4) (2)
in the formula, B0, B1, B2, B3, B4, G1, G2, G3 and G4 are color values at different positions in the same Bayer pattern image, wherein B0 is the color value of a G region needing to be restored at the moment, and the G region component distributed in the B region is obtained through calculation to realize color restoration;
the color restoration of the R region includes three cases:
c. reducing the R region distributed in the B region, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in the B region, and expressing the color reduction surrounding color distribution diagram by a formula (3),
in the formula, B0, B1, B2, B3, B4, R1, R2, R3 and R4 are color values at different positions in the same Bayer pattern image, wherein B0 is the color value of an R region needing to be restored, and R region components distributed in the B region are obtained through calculation to realize color restoration;
d. reducing the R region distributed in one of the two G regions, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in one of the two G regions, and expressing the color reduction surrounding color distribution diagram by a formula (4),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, R1 and R2 are color values of different positions in the same Bayer pattern image, wherein G0 is the color value of an R region needing to be restored, and R region components distributed in one of the two G regions are obtained through calculation to realize color restoration;
f. restoring the R region distributed in the other G region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the R region distributed in the other G region, and expressing by formula (5),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, R1 and R2 are color values at different positions in the same Bayer pattern image, wherein G0 is the color value of an R region needing to be restored, and R region components distributed in another G region are obtained through calculation to realize color restoration;
the color restoration of the B region includes three cases:
g. reducing the B area of the R area, setting a color reduction surrounding color distribution diagram and a corresponding multiplication coefficient diagram according to the B area distributed in the R area, and expressing the color reduction surrounding color distribution diagram by a formula (6),
in the formula, R0, R1, R2, R3, R4, B1, B2, B3 and B4 are color values at different positions in the same Bayer pattern image, wherein R0 is a color value of a B region which needs to be restored at the moment, and B region components distributed in the R region are obtained through calculation to realize color restoration;
h. restoring B region distributed in one of the two G regions, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the B region distributed in the other G region, and expressing by formula (7),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, B1 and B2 are color values at different positions in the same Bayer pattern image, wherein G0 is a color value of a B region needing to be reduced at the moment, and a B region component distributed in another G region is obtained through calculation to realize color reduction;
i. restoring the B region distributed in another G region, setting a color restoration peripheral color distribution diagram and a corresponding multiplication coefficient diagram according to the B region distributed in another G region, and expressing by formula (8),
in the formula, G0, G1, G2, G3, G4, G5, G6, G7, G8, B1, and B2 are color values at different positions in the same bayer pattern image, which are color values of a B region that needs to be restored, and a B region component distributed in another G region is obtained by calculation, so that color restoration is realized.
2. The color reproduction method of a small-sized pixel image sensor according to claim 1, characterized in that: in step 1, the G area is divided into four units uniformly, four units are assigned with values and marked as G1, G2, G3 and G4 in sequence, the R area is divided into four units uniformly, four units are assigned with values and marked as R1, R2, R3 and R4 in sequence, the B area is divided into four units uniformly and marked as B1, B2, B3 and B4 in sequence.
3. The color reproduction method of a small-sized pixel image sensor according to claim 2, characterized in that: in the step 2, the color values in each individual bayer pattern image field are weighted and averaged to correspondingly obtain a G region component, an R region component, and a B region component of the reduction color, the G regions distributed in the R region and the B region are reduced, the R regions distributed in the B region and the two G regions are reduced, and the B regions distributed in the R region and the two G regions are reduced.
4. The color reproduction method of a small-sized pixel image sensor according to claim 1, wherein: and 3, the image in the step 3 passes through a color filter with the size 2 times and carries out color restoration by using a traditional interpolation means.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110307922.7A CN113141488B (en) | 2021-03-23 | 2021-03-23 | Color restoration method of small-size pixel image sensor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110307922.7A CN113141488B (en) | 2021-03-23 | 2021-03-23 | Color restoration method of small-size pixel image sensor |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113141488A CN113141488A (en) | 2021-07-20 |
| CN113141488B true CN113141488B (en) | 2023-03-21 |
Family
ID=76811610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110307922.7A Active CN113141488B (en) | 2021-03-23 | 2021-03-23 | Color restoration method of small-size pixel image sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113141488B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116074484A (en) * | 2023-01-15 | 2023-05-05 | 山东产研卫星信息技术产业研究院有限公司 | Bayer color reconstruction method of CMOS satellite image |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110310970A (en) * | 2019-07-09 | 2019-10-08 | 德淮半导体有限公司 | Imaging sensor and forming method thereof |
| CN110929615A (en) * | 2019-11-14 | 2020-03-27 | RealMe重庆移动通信有限公司 | Image processing method, image processing apparatus, storage medium, and terminal device |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108122201A (en) * | 2017-12-21 | 2018-06-05 | 珠海亿智电子科技有限公司 | A kind of Bayer interpolation slide fastener effect minimizing technology |
| WO2020244765A1 (en) * | 2019-06-06 | 2020-12-10 | Huawei Technologies Co., Ltd. | Color filter array apparatus |
-
2021
- 2021-03-23 CN CN202110307922.7A patent/CN113141488B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110310970A (en) * | 2019-07-09 | 2019-10-08 | 德淮半导体有限公司 | Imaging sensor and forming method thereof |
| CN110929615A (en) * | 2019-11-14 | 2020-03-27 | RealMe重庆移动通信有限公司 | Image processing method, image processing apparatus, storage medium, and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113141488A (en) | 2021-07-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021227250A1 (en) | Image sensor and electronic device | |
| CN111491111B (en) | High dynamic range image processing system and method, electronic device, and readable storage medium | |
| KR100982685B1 (en) | System and method for a high performance color filter mosaic array | |
| US8035710B2 (en) | Solid-state imaging device and signal processing method | |
| US7400332B2 (en) | Hexagonal color pixel structure with white pixels | |
| CN102640501B (en) | For colour filter and the inverse mosaic converter technique of digital imagery | |
| CN111479071B (en) | High dynamic range image processing system and method, electronic device, and readable storage medium | |
| CN111586375B (en) | High dynamic range image processing system and method, electronic device, and readable storage medium | |
| US6803955B1 (en) | Imaging device and imaging apparatus | |
| CN102461174A (en) | Color filter array pattern having four-channels | |
| JP2004228662A (en) | Image pickup apparatus | |
| EP3902242B1 (en) | Image sensor and signal processing method | |
| CN103416067A (en) | Imaging device and imaging program | |
| WO2023082766A1 (en) | Image sensor, camera module, electronic device, and image generation method and apparatus | |
| CN113141488B (en) | Color restoration method of small-size pixel image sensor | |
| CN108513112B (en) | Image processing method based on color filter array | |
| CN112738493B (en) | Image processing method, image processing apparatus, electronic device, and readable storage medium | |
| JP2010288093A (en) | Image processing apparatus, solid-state imaging apparatus, and electronic information apparatus | |
| EP4117282A1 (en) | Image sensor, imaging apparatus, electronic device, image processing system and signal processing method | |
| CN112019823A (en) | Filter array and image sensor | |
| JP2004112738A (en) | Resolution conversion method and pixel data processing circuit for single-ccd color-image sensor | |
| CN105826335A (en) | Solid-state image pickup device | |
| CN212785638U (en) | Filter array, image sensor and application equipment thereof | |
| JPH10189930A (en) | Solid-state image sensor | |
| CN111835971B (en) | Image processing method, image processing system, electronic device, and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |