CN106375740B - Generate the methods, devices and systems of RGB image - Google Patents
Generate the methods, devices and systems of RGB image Download PDFInfo
- Publication number
- CN106375740B CN106375740B CN201610859097.0A CN201610859097A CN106375740B CN 106375740 B CN106375740 B CN 106375740B CN 201610859097 A CN201610859097 A CN 201610859097A CN 106375740 B CN106375740 B CN 106375740B
- Authority
- CN
- China
- Prior art keywords
- pixel
- signal
- image
- picture
- picture signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The present invention relates to a kind of methods, devices and systems for generating RGB image, this method includes：Receive the RGBIR picture signals that RGBIR sensors are sent；Row interpolation is entered to RGBIR picture signals by interior differential technique and obtains the first picture signal；The infrared IR components in the first picture signal on each pixel position are removed to obtain the second picture signal；First picture signal and the second picture signal are subjected to Federated filter to obtain filtered RGB image.Using the RGBIR picture signal signal to noise ratio for not removing IR components it is high the characteristics of, correlation according to high signal-to-noise ratio image signal and the low signal-to-noise ratio (SNR) images signal for removing IR components carries out Federated filter to the low signal-to-noise ratio (SNR) images signal for removing IR components, the signal to noise ratio of RGB image is improved, especially improves the signal to noise ratio of the image obtained under low colour temperature or low-light (level) environment.
Description
Technical field
The present invention relates to image processing field, more particularly to a kind of methods, devices and systems for generating RGB image.
Background technology
RGBIR sensors are a kind of new sensors, are equipped with the imaging sensor of RGBIR filters.RGBIR filters
Array arrangement mode and conventional color filter array (Color Filter Array, CFA), such as Bayer color filter array
The arrangement mode of (Bayer CFA) is different, as depicted in figs. 1 and 2.Fig. 1 is the array schematic diagram of Bayer sensors, and R represents figure
As the pixel of all covering red filters on sensor, it is referred to as red (Red, R) passage；G represents all on imaging sensor and covered
The pixel of lid green filter, it is referred to as green (Green, G) passage, B represents the pixel of covering blueness, and it is logical to be referred to as blue (Blue, B)
Road.Fig. 2 is the array schematic diagram of RGBIR sensors, and the arrays of RGBIR filters is by the half in Bayer color filter lens arrays
Green component is substituted by infrared light (infrared) component, referred to as infrared (Infrared, the IR) passage of the partial pixel, and
RGBIR filters can sense visible ray and black light simultaneously, here represent black light with infrared light IR.In order to based on
RGBIR sensors obtain normal RGB color image, it is necessary to by RGBIR sensor senses to R, G, the IR in channel B pixel
Composition removes.
In the prior art, each picture in original image can be obtained by carrying out image interpolation to the RGBIR images of input
The pixel of missing on vegetarian refreshments position, the numerical value of the RGB channel and IR passages in output image is calculated, determines correction coefficient,
RGB channel and infrared IR passages are separated according to correction coefficient, and correct RGB channel, finally exports RGB image.
But by the RGBIR images of the prior art that obtained based on RGBIR sensors that obtain the RGB of output can be caused to scheme
The signal to noise ratio of picture is relatively low, especially higher or in the case that illuminance is relatively low in colour temperature.
The content of the invention
The invention provides a kind of methods, devices and systems for generating RGB image, to realize colour temperature is higher or illumination
Signal to noise ratio of the degree than in the case of relatively low, improving RGB image.
In a first aspect, the invention provides a kind of method for generating RGB image, this method includes：Receive RGBIR sensors
The RGBIR picture signals of transmission；Row interpolation is entered to input RGBIR picture signals by interpolation method and obtains higher the of signal to noise ratio
One picture signal, the first picture signal can be understood as carrying the Bayer (Bayer) of infrared IR components on each pixel position
Picture signal；The infrared IR components on each pixel position in the first image are removed, and RGB channel is corrected, are obtained
Second picture signal, wherein, the second picture signal can be understood as relative RGBIR picture signals and remove on each pixel position
IR components after Bayer images；First picture signal and secondary signal image are subjected to Federated filter and obtain filtered RGB
Image.
Federated filter provided by the invention, can be bilateral for example, by guiding wave filter (Guided Filter), joint
The wave filters such as wave filter (Joint Bilateral Filter) are related to the second picture signal according to the first picture signal
Property, the second picture signal is filtered to obtain filtered RGB image.
By the method for generation RGB image provided in an embodiment of the present invention, believed using the RGBIR images for not removing IR components
Make an uproar than it is high the characteristics of, during noise remove, utilize and do not remove the RGBIR picture signals of IR components with removing IR components
The correlation of RGBIR picture signals, Federated filter is carried out to the low signal-to-noise ratio RGBIR picture signals for removing IR components, realized
To the processing of the image obtained based on RGBIR sensors, the signal to noise ratio of the RGB image obtained after processing is improved；It is meanwhile also bright
The aobvious signal to noise ratio for improving the image obtained under low colour temperature or low-light (level) environment.
With reference in a first aspect, in the first mode in the cards of first aspect, by interpolation method to RGBIR images
Signal enters row interpolation to obtain the first picture signal, including：Pass through each pixel IR in interpolation calculation RGBIR picture signals
G pixel values on passage are to obtain the first picture signal.
With reference in a first aspect, in second of mode in the cards of first aspect, by interpolation method to the RGBIR
Picture signal enters row interpolation to obtain the first picture signal, including：
Pass through the R pixel values in interpolation calculation RGBIR picture signals on each pixel in R, G, B, IR passage, G pictures
Element value and B pixel values, to obtain the first picture signal；
Wherein, the first picture signal includes three picture signals, R, G, B of each pixel of a picture signal
It is the picture signal of R pixel values and IR pixel values with IR passages；R, G, B and IR of each pixel of one picture signal lead to
Road is the picture signal of G pixel values and IR pixel values, and R, G, B and IR passage of each pixel of another picture signal are equal
For the picture signal of B pixel values and IR pixel values.
With reference to second of mode in the cards of the first mode or first aspect in the cards of first aspect
In, in the third mode in the cards of first aspect, remove red on each pixel position in the first picture signal
Outer IR components to obtain the second picture signal, including：By in interpolation calculation RGBIR picture signals on each pixel position
IR pixel values to obtain the 3rd picture signal, the 3rd picture signal is IR pictures for R, G, B and IR passage of each pixel
The picture signal of element value；First picture signal and the 3rd picture signal are subtracted each other to obtain the second picture signal.Pass through the design
Scheme, the RGBIR picture signals that RGBIR sensors obtain can be converted to traditional Bayer picture signals, be easy to tradition
Image-signal processor (Image Signal Processor, ISP) docking, can be handled, be subtracted using traditional algorithm
The cost of exploitation is lacked.
With reference to the third mode in the cards of first aspect, in the 4th kind of mode in the cards of first aspect
In, the first picture signal and the second picture signal are subjected to Federated filter to obtain filtered RGB image, including：
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal
Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around first pixel；
Determine in the second picture signal with the first pixel corresponding to the second pixel and corresponding with the first reference image vegetarian refreshments
The second reference image vegetarian refreshments；
Weighted average is carried out to the second reference pixel point in the second picture signal according to weight, determines the second pixel
Pixel value, to obtain filtered RGB image.
With reference to the 4th kind of mode in the cards of first aspect to first aspect, the 5th kind in first aspect may be real
In existing mode, filtered RGB image is used for the RGB figures for being supplied to image-signal processor to be handled to be exported
Picture.
With reference in a first aspect, in the 6th kind of mode in the cards of first aspect, pass through image-signal processor pair
Filtered RGB image is handled to obtain RGB image, including：
Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to filtered RGB image
In the RGB image that is exported of at least one processing.
With reference in a first aspect, in the 7th kind of mode in the cards of first aspect, image-signal processor is to filtering
The RGB image that RGB image afterwards is handled to be exported, including：
Pass through R, G and B pixel in filtered RGB image described in interpolation calculation on each pixel R, G and channel B
Value, to obtain the 4th picture signal；
Color correction matrix is carried out to the 4th picture signal, camera lens shadow correction, AWB handle to obtain it is described defeated
The RGB image gone out；
Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values,
Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel
It is the picture signal of B pixel values.
With reference to any implementation in any mode in the cards in first aspect to first aspect, in first party
In the 8th kind of mode in the cards in face, interpolation method includes bilinear interpolation method.
Second aspect, the invention provides a kind of device for generating RGB image, the device includes：Receiving unit, interpolation list
Member, remove component cells and filter unit.Receiving unit is used for the RGBIR picture signals for receiving the transmission of RGBIR sensors；Interpolation
Unit, for entering row interpolation to RGBIR picture signals by interpolation method to obtain the first picture signal；Component cells are removed, are used
In removing the infrared IR components in the first picture signal on each pixel position to obtain the second picture signal；Filter unit,
For the first picture signal and the second picture signal to be carried out into Federated filter to obtain filtered RGB image.
Wherein, the first picture signal can be understood as carrying the Bayer picture signals of IR components on each pixel position；
Second picture signal can be understood as RGBIR images and remove the Bayer picture signals after the IR components on each pixel position.
It can be filtered in Federated filter of the present invention for example, by Guided Filter, Joint Bilateral Filter etc.
Ripple device, according to the correlation of the first signal noise ratio (snr) of image, the second image is filtered, obtains filtered RGB image.
By device provided in an embodiment of the present invention, using the RGBIR signal noise ratio (snr) of image for not removing IR components it is high the characteristics of,
During noise remove, the RGBIR picture signals and the RGBIR picture signals of removal IR components for not removing IR components are utilized
Correlation, to remove IR components low signal-to-noise ratio RGBIR picture signals carry out Federated filter, realize to being passed based on RGBIR
The processing for the image that sensor obtains, improve the signal to noise ratio of the RGB image obtained after processing；Meanwhile also significantly improve low
The signal to noise ratio of the image obtained under colour temperature or low-light (level) environment.
With reference to second aspect, in the first mode in the cards of second aspect, interpolating unit is specifically used for, and passes through
G pixels in interpolation calculation RGBIR picture signals on each pixel IR passages enter row interpolation to obtain the first image.
With reference to second aspect, in second of mode in the cards of second aspect, interpolating unit is specifically used for,
Pass through the R pixel values in interpolation calculation RGBIR picture signals on each pixel in R, G, B, IR passage, G pictures
Element value and B pixel values, to obtain the first picture signal；
Wherein, R, G, B and IR passage that the first picture signal includes each pixel are R pixel values and IR pixel values
Picture signal, R, G, B and IR passage of each pixel are the picture signal of G pixel values and IR pixel values, and each picture
R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values and IR pixel values.
With reference to second of mode in the cards of the first mode or second aspect in the cards of second aspect,
In the third mode in the cards of second aspect, remove component cells and be specifically used for, it is extremely described by interpolation method
IR pixel values in RGBIR picture signals on each pixel position, to obtain the 3rd picture signal, the 3rd picture signal is every
R, G, B and IR passage of individual pixel are the picture signal of IR pixel values；First picture signal and the 3rd picture signal are entered
Row subtracts each other, to obtain the second picture signal.
With reference to the third mode in the cards of second aspect, the mode in the cards in the 4th of second aspect
In, filter unit is specifically used for,
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal
Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around the first pixel；
Determine in the second picture signal with the first pixel corresponding to the second pixel and corresponding with the first reference image vegetarian refreshments
The second reference image vegetarian refreshments；
Weighted average is carried out to the second reference pixel point in the second picture signal according to weight, determines the second pixel
Pixel value, to obtain filtered RGB image.
In the 5th kind of mode in the cards with reference to second aspect to second aspect, filtered image is used to be supplied to
The RGB image that image-signal processor is handled to be exported.
With reference to second aspect, in the 6th kind of mode in the cards of second aspect, image-signal processor is specifically used
In,
Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to filtered RGB image
In the RGB image that is exported of at least one processing.
With reference to second aspect, in the 7th kind of mode in the cards of second aspect, image-signal processor is specifically used
In,
By R, G and B pixel value in the filtered RGB image of interpolation calculation on each pixel R, G and channel B,
To obtain the 4th picture signal；
Color correction matrix, camera lens shadow correction, AWB are carried out to the 4th picture signal and handle what is exported
RGB image；
Wherein, the 4th picture signal includes three picture signals, R, G, B and IR of each pixel in a picture signal
Passage is the picture signal of R pixel values；R, G, B and IR passage of each pixel are G pixel values in one picture signal
Picture signal；R, G, B and IR passage of each pixel are the picture signal of B pixel values in another picture signal.
With reference to second aspect to second aspect any possible implementation in any mode in the cards,
In 8th kind of mode in the cards of two aspects, interpolation method includes bilinear interpolation method.
The third aspect, the embodiment of the present invention provide a kind of system, and the system includes RGBIR sensors, memory and processing
Device.
RGBIR sensors, for receiving RGBIR picture signals；
Memory, for store instruction and RGBIR picture signals；
Processor, for calling the instruction in the memory, and perform and complete any possible realization in first aspect
Mode and any one of second aspect mode in the cards.
Based on a kind of methods, devices and systems for generating RGB image provided by the invention, scheme by using original RGBIR
The characteristics of picture Signal-to-Noise is high, that is, picture signal (the first image of the IR components on each pixel position is not removed
Signal) signal to noise ratio it is high the characteristics of, by it and remove the picture signals of IR components on each pixel position (the second image believed
Number) carry out Federated filter, during noise remove, using the first picture signal high s/n ratio signal correlation to the
The Low SNR signal filtering of two picture signals, is realized the processing of the image to being obtained based on RGBIR sensors, improves place
The signal to noise ratio of the RGB image obtained after reason.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, it will make below to required in the embodiment of the present invention
Accompanying drawing is briefly described, it should be apparent that, drawings described below is only some embodiments of the present invention, for
For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings
Accompanying drawing.
Fig. 1 is the array schematic diagram of Bayer sensors；
Fig. 2 is the array schematic diagram of RGBIR sensors；
Fig. 3 is a kind of apparatus structure schematic diagram for generating RGB image provided in an embodiment of the present invention；
Fig. 4 is a kind of method flow diagram for generating RGB image provided in an embodiment of the present invention；
Fig. 5 is another method flow diagram for generating RGB image provided in an embodiment of the present invention；
Fig. 6 is the processing procedure sketch of generation RGB image；
Fig. 7 is another method flow diagram for generating RGB image provided in an embodiment of the present invention；
Fig. 8 is another processing procedure sketch for generating RGB image provided in an embodiment of the present invention；
Fig. 9 is the processing procedure abbreviation of another generation RGB image provided in an embodiment of the present invention；
Figure 10 is a kind of apparatus structure schematic diagram for generating RGB image provided in an embodiment of the present invention.
Embodiment
In order to allow RGBIR sensors to obtain normal RGB image, it is necessary to by red (R) passage in RGBIR sensors, green
The black light part perceived in color (G) passage and blue (B) passage removes.In the present invention by RGBIR sensor senses
To black light be written as infrared light (infrared light, IR).The invention provides a kind of new framework to handle RGBIR
The image that sensor obtains, the signal to noise ratio for the RGB image for making to finally obtain improve.
A kind of method and apparatus of raising RGBIR sensor signal to noise ratio provided by the invention, obtained according to RGBIR sensors
RGBIR picture signals, it is every in RGBIR images to removing using the edge sharpness of signal in high s/n ratio RGBIR picture signals
The low signal-to-noise ratio (SNR) images after IR components on individual pixel position are filtered, so as to improve the letter of the RGB image finally obtained
Make an uproar ratio.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is the part of the embodiment of the present invention, rather than whole embodiments.Based on this hair
Embodiment in bright, the every other reality that those of ordinary skill in the art are obtained on the premise of creative work is not made
Example is applied, should all belong to the scope of protection of the invention.
Fig. 3 is a kind of structural representation for generating RGB image system provided in an embodiment of the present invention.As shown in figure 3, this is
System 100 can include RGBIR sensors 110, processing unit 120, image-signal processor 130, display 140 and communication bus
150, RGBIR sensors 110, processing unit 120, image-signal processor (Image signal Processor, ISP) 130,
Display 140 is connected with each other by communication bus 150, and completes mutual communication.
RGBIR sensors 110 are used to receive RGBIR picture signals, and RGBIR picture signals are sent into processing unit
120 carry out picture signal processing.Processing unit 120 is used to handle RGBIR picture signals to obtain compared with the prior art
The high RGB image signal of signal to noise ratio.Image-signal processor ISP130 is used to further handle obtained RGB image signal
The RGB image visual to user, and provide a user by display 140 RGB image of display.
The processing unit 120 can include receiver 121, processor 122 and memory 123.Receiver 121 is used to receive
The RGBIR picture signals that RGBIR sensors are sent.Memory 123 be used for store instruction and the RGBIR picture signals that receive with
And RGBIR picture signals after treatment.Processor 122 is used to call the instruction in memory, and performs following operation：
Row interpolation is entered to obtain the first picture signal to the RGBIR picture signals received by interpolation method；
The infrared IR components in the first picture signal on each pixel position are removed to obtain the second picture signal；
First picture signal and the second picture signal are subjected to Federated filter to obtain filtered RGB image.
In embodiments of the present invention, processor 122 can be CPU (Central Processing Unit,
CPU), the processor 120 can also be other general processors, digital signal processor (Digital Signal
Processor, DSP), it is application specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing
Into programmable gate array (Field-Programmable Gate Array, FPGA) or other PLDs, discrete
Door or transistor logic, discrete hardware components etc..General processor can be that microprocessor or the processor also may be used
To be any conventional processor etc..
Memory 123 can include read-only storage and random access memory, and provide instruction sum to processor 122
According to.The a part of of memory can also include nonvolatile RAM.For example, memory can be with storage device class
The information of type.
It is total can also to include power bus, controlling bus and status signal in addition to including data/address bus for communication bus 150
Line etc..But for the sake of clear explanation, various buses are all designated as communication bus 150 in figure.
In addition, in embodiments of the present invention, the system can also include image-signal processor 130 in, with
In being handled filtered RGB image to obtain the RGB image of data, the processing procedure can include to filtered RGB
At least one processing that image is carried out in color correction matrix, camera lens shadow correction, AWB or mosaic processing obtains
The RGB image of output.
It should be noted that image-signal processor 130 can be arranged in processing unit 120, to this of the invention real
Apply in example and be not intended to be limited in any.
Fig. 4 is a kind of method flow diagram of raising RGBIR sensor signal to noise ratio provided in an embodiment of the present invention.Such as Fig. 4 institutes
Show, the executive agent of this method 200 can be the system shown in Fig. 3, and this method 200 can specifically include following steps：
S210, receive the RGBIR picture signals that RGBIR sensors are sent.
S220, row interpolation is entered to RGBIR picture signals by interpolation method to obtain the first picture signal.
Specifically, after the first picture signal enters row interpolation for the original RGBIR picture signals collected to RGBIR sensors
Obtained image, the picture signal can be understood as Bayer (Bayer) image with IR components on each pixel position and believe
Number.
It should be noted that in S220, can be to each picture during carrying out interpolation calculation to original RGBIR images
The color lacked and infrared light IR components on vegetarian refreshments position enter row interpolation.
The pixel value that the color on Color Channel corresponding to color is lacked in RGBIR picture signals can be specifically obtained,
, can be respectively from G passages such as G, B, IR pixel value really on R passages in R, G, B, IR passage on each pixel position
G pixel values are obtained, B pixel values are obtained in channel B, IR pixel values are obtained on IR passages, and are added on R passages, briefly may be used
With by the G pixel values on G passages, on IR pixel values copy (copy) on the B pixel values and IR passages in channel B to R passages.
G, row interpolation can also be entered by the interpolation method on B, IR passage, to obtain the first picture signal.
S230, the infrared IR components in the first picture signal on each pixel position are removed to obtain the second image letter
Number.
, can be by determining the correction coefficient in correction RGBIR images according to the first picture signal, according to school in S230
Positive coefficient corrects RGBIR images, obtains removing the image of the IR components on each pixel position, that is, the second image letter
Number.
In embodiments of the present invention, the correction coefficient of correction RGBIR images is determined according to the first picture signal, can be specific
Including：Step 1：Under a certain illumination condition, that is, under a certain illuminance, standard is shot to color using cutoff filter
Card, calculates the average value to each color lump four-way of colour atla (R, G, B, IR passage) pixel；Step 2：With the same illumination bar of step 1
Under part, collocation can be shot to colour atla by the optical filter of visible ray and infrared light, and is calculated to each color lump four-way picture of colour atla
The average value of element；Step 3：The average value obtained according to step 1 and step 2, will using 4 × 4 matrixes as shown in formula (1)
The average value obtained in step 1 substitutes into formula (1) as the numerical value of RGBIR a certain passage in formula (1) right side, by step 2
In obtained average value, the numerical value as RGBIR a certain passage on the left of formula (1) substitutes into formula (1), uses least square
The A in formula 1 is calculated in methodxx；Step 4：Repeat step 1 completes formula to the process of step 3 under different illumination conditions
(1) correction coefficient under different illumination.
It should be noted that in embodiments of the present invention, the correction coefficient can also be the correction coefficient pre-set
Table, when needing to determine correction coefficient according to the first image, it is necessary to count in RGBIR images in Statistical Area RGB a little lead to
The average value of road pixel and the average value of IR passage pixels, according to being averaged for the average value of RGB channel pixel and IR passage pixels
It is worth query correction coefficient table, it is determined that the one group of correction coefficient to match with RGBIR images.
Then RGBIR images are calculated by the correction coefficient of determination, removed in trimming process every in RGBIR picture signals
The IR components of individual pixel, obtain removing the Bayer picture signals of IR components.
Alternatively, in embodiments of the present invention, interpolation method can be used to carry out interpolation calculation to RGBIR picture signals, obtained
IR components into RGBIR picture signals on the R passages of each pixel, G passages, channel B and IR passages, obtain RGBIR figures
Picture signal as in signal on R, G, B, IR passage of each pixel being IR components, with to S220 in obtain
Bayer (Bayer) picture signal with IR components is subtracted each other on each pixel position in RGBIR picture signals
Except the Bayer picture signals of IR components.
S240, the first picture signal and the second picture signal are subjected to Federated filter with filtered RGB image.
Alternatively, in embodiments of the present invention, according to the first picture signal to the second picture signal carry out Federated filter with
Output image signal is obtained, can be included：
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal
Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around the first pixel；Determine in the second picture signal with first
Second pixel corresponding to pixel and the second reference image vegetarian refreshments corresponding with the first reference image vegetarian refreshments；According to weight to described
The second reference pixel point in two picture signals carries out weighted average, the pixel value of the second pixel is determined, after obtaining filtering
RGB image.
Briefly, Bayer picture signals and the removal of IR components will be carried on each pixel position obtained in S220
The Bayer picture signals of IR components in RGBIR picture signals on each pixel position carry out Federated filter, the Federated filter
Process can determine difference weight according to the signal edge acutance in the Bayer picture signals for not removing IR components, according to determination
Difference weight determine to remove the pixel value of each pixel in the Bayer picture signals of IR components：IR components will be removed
The weighted average of the pixel value pixel value of the pixel and the pixel value around it of each pixel in Bayer picture signals
It is determined that to realize the filtering of the Bayer picture signals to removing IR components.Its process is for example：When at image border, between pixel
When difference is larger, is done average weighted weighted value and reduced, original pixel value is kept as far as possible in other words, to keep picture signal
Edge sharpness.
In embodiments of the present invention, joint filter is carried out to the image for removing IR components according to the image for not removing IR components
Ripple, it can also use and instruct as wave filter (Guided Filter), or use joint two-sided filter, implement in the present invention
In example, this is not intended to be limited in any.
By the method for generation RGB image provided in an embodiment of the present invention, the high spy of original RGBIR signal noise ratio (snr) of image is utilized
Point, during noise remove, utilize the low noise for the high signal-to-noise ratio image signal and removal IR components for not removing IR components
Than the correlation of picture signal, Federated filter is carried out to the RGBIR picture signals for removing IR components, realized to based on RGBIR
The processing for the image that sensor obtains, improve the signal to noise ratio of the RGB image obtained after processing；Meanwhile also significantly improve
The signal to noise ratio of the image obtained under low colour temperature or low-light (level) environment.
Alternatively, can also include as another embodiment of the present invention, this method 200：
S250, the RGB figures for being supplied to image-signal processor to be handled filtered RGB image to be exported
Picture.
Specifically, according to the high s/n ratio RGBIR picture signals for not removing IR components, the low signal-to-noise ratio to removing IR components
Picture signal after picture signal progress Federated filter can not be identified, it is necessary to by image-signal processor (Image
Signal Processor, ISP) handled, obtain the image that can be identified.
Image-signal processor needs to carry out output image signal color correction matrix, camera lens shadow correction, automatic white
The RGB image that the processing such as balance and mosaic is exported.
Technical scheme is described in detail below according to Fig. 5 and Fig. 9.
Fig. 5 is a kind of flow chart of method for improving RGB image signal to noise ratio provided in an embodiment of the present invention.As shown in figure 5,
The executive agent of this method 300 can be system as shown in Figure 3, and this method 300 specifically includes following steps：
S310, the G pixel values in the RGBIR picture signals received by interpolation calculation on each pixel IR passages
Obtain the first picture signal.
Specifically, in embodiments of the present invention, can be by the method for bilinear interpolation to the IR in RGBIR picture signals
The pixel of passage carries out interpolation calculation, obtains the G pixel values of IR channel positions, to obtain the first picture signal, as shown in Figure 6.
It should be noted that in embodiments of the present invention, the G on IR channel positions is obtained by the method for bilinear interpolation
The numerical value of pixel is a kind of implementation, in embodiments of the present invention, can also realize RGBIR images by other means
The numerical value of G pixels on IR channel positions, such as：, can be by the G pixels in G passages in the G pixel values on calculating IR passages
Numerical value copy (copy) arrive IR passages position, the G pixel values on IR channel positions are obtained, in embodiments of the present invention to this
It is not intended to be limited in any.
S320, by the IR pixel values in interpolation calculation RGBIR picture signals on each pixel position, to obtain
Three picture signals.
In S320, interpolation calculation is carried out to RGBIR images, it is IR pictures to obtain on each pixel R, G, B, IR passage
The picture signal of element value, i.e. the 3rd picture signal, it is as shown in Figure 6 to be referred to as IR full width figures.
S330, the first picture signal and the 3rd picture signal are subtracted each other to obtain the second picture signal.
In embodiments of the present invention, can by the Bayer picture signals for not removing IR components that will be obtained in S310, with
The 3rd picture signal obtained in S320 steps is subtracted each other, i.e., removes the IR components in the first picture signal on each pixel position
Fall, obtain the second picture signal, that is, remove the Bayer picture signals of IR components, as shown in Figure 6.
It should be noted that the signal to noise ratio of the Bayer picture signals of the removal IR components obtained in S330 is with respect in S310
The signal to noise ratio for the Bayer picture signals of IR components that what is obtained do not remove is low.
S340, Federated filter is carried out to the second picture signal according to the first picture signal.
In S340, according to the high Bayer picture signals for not removing IR components of signal to noise ratio and the Bayer for removing IR components
The correlation of picture signal, processing is filtered to the Bayer picture signals for removing IR components, the output image after being handled
Signal.
In embodiments of the present invention, during denoising, pre- dividing regions in picture signal that can be to having removed IR components
The numerical value of each pixel is averaged in block, and the average value is substituted to the numerical value of each pixel in block, is exported
Picture signal.
It should be noted that the picture signal after Federated filter can not be identified by user, it is necessary to pass through
S350 processing, obtain the RGB image that user can identify.
S350, output image signal is handled to obtain RGB image by image-signal processor.
, it is necessary to pass through R, G in interpolation calculation output image signal on each pixel R, G and channel B in S350
With B pixel values, to obtain the 4th picture signal, wherein, R, G, B and IR passage of the 4th picture signal including each pixel are equal
For the picture signal of R pixel values, R, G, B and IR passage of each pixel are the picture signal of G pixel values, and each picture
R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values, as shown in Figure 6；Color correction is carried out to the 4th picture signal
Matrix, camera lens shadow correction, AWB handle to obtain RGB image.4th picture signal is the image that human eye can not identify
Signal by image-signal processor (Image Signal Processor, ISP), it is necessary to obtain the RGB that user can identify
Image.
It is normal that the RGBIR picture signals that the RGBIR sensors handled by S310 to S350 obtain can obtain color
RGB image.
In embodiments of the present invention, by S310 to S340 processing, the RGBIR that RGBIR sensors obtain can be schemed
As signal is changed into traditional Bayer picture signals, it is easy to dock with traditional ISP in S350 so that traditional algorithm can weigh
With reducing the cost of exploitation.
Fig. 7 is another method flow diagram for improving RGB image signal to noise ratio provided in an embodiment of the present invention.As shown in fig. 7, should
The executive agent of method 400 can be the system shown in Fig. 3, and this method 400 can specifically include following steps：
S410, in the RGBIR picture signals received by interpolation calculation on each pixel in R, G, B, IR passage
R pixel values, G pixel values and B pixel values to obtain the first picture signal
Specifically, the enterprising row interpolation of each pixel in the RGBIR picture signals obtained to RGBIR sensors, by interior
The method of inserting calculate R pixel values, G pixel values and B pixel values in RGBIR picture signals on each pixel in R, G, B, IR passage with
Obtain the first picture signal.R, G, B and IR passage obtained by interpolation method in RGBIR picture signals on each pixel is equal
For the picture signal of R pixel values and IR pixel values, R, G, B and IR passage of each pixel are G pixel values and IR pixel values
Picture signal, and each pixel R, G, B and IR passage be B pixel values and IR pixel values picture signal, or
Each first picture signal for saying to obtain is with IR components Rs, G, B, IR full width figure, i.e. the first image, as shown in Figure 8 respectively.
S420, the IR components on each pixel position in the first picture signal are removed, RGB channel is corrected, obtains second
Picture signal.
IR components in the first picture signal obtained in S410 steps on each pixel position are removed, can be passed through
S320 and S330 process obtains the second picture signal in figure, is repeated no more herein for succinct description, as shown in Figure 8.
In embodiments of the present invention, method can be passed through by removing the IR components in the first image on each pixel position
The method for the IR components on each pixel position of removal mentioned in 200, such as：Correction coefficient is determined according to the first image；
IR components in first image on each pixel position are removed according to correction coefficient, and correct RGB channel, determine the second image
Signal, as shown in figure 9, for succinct description, its detailed process will not be repeated here.
S430, Federated filter is carried out to the second picture signal according to the first picture signal and obtains output image signal.
The specific process can be carried out by being mentioned in method 200 according to the first picture signal to the second picture signal
The processing mode of Federated filter is handled, and for succinct description, is repeated no more herein.
S440, output image is handled by ISP image-signal processors, obtains RGB.
In embodiments of the present invention, ISP needs to handle the unrecognizable output image signal of human eye, such as needs
Obtained to carrying out the processing such as color correction matrix, camera lens shadow correction, AWB and mosaic to output image signal
The RGB image that human eye can identify.
Specifically, S440 specific implementation can be according to the S250 in method 200 or the S350 in method 300 to the 4th image
The processing mode of signal realizes that, for succinct description, its detailed process will not be repeated here.
Above in conjunction with Fig. 2 to Fig. 9, raising RGBIR sensor signal to noise ratio according to embodiments of the present invention is described in detail
Method, below in conjunction with Figure 10, device according to embodiments of the present invention is described in detail.
Figure 10 is a kind of structural representation of device provided in an embodiment of the present invention.As shown in Figure 10, the device 500 can be with
Including receiving unit 510, interpolating unit 520, remove component cells 530, filter unit 540 and image signal processing unit 550.
Receiving unit 510, for receiving the RGBIR picture signals of RGBIR sensors transmission.
Interpolating unit 520, for entering row interpolation to RGBIR images by interpolation method to obtain the first picture signal.
Remove component cells 530, for remove the infrared IR components in the first picture signal on each pixel position with
Obtain the second picture signal.
Filter unit 540, after the first picture signal and the second picture signal are carried out into Federated filter to obtain filtering
RGB image.
Image signal processing unit 550, for being handled output image signal to obtain RGB image.
Specifically, the interpolating unit 520 in device enters row interpolation by interpolation method to RGBIR images, implement in the present invention
In example, interpolation method can use two-wire interpolation method.Such as row interpolation is entered to IR passages, the G pixels of IR passages are obtained, are obtained every
The Bayer picture signals of IR components are carried on individual pixel position；Again by each picture in the Bayer picture signals with IR components
IR components on vegetarian refreshments position remove, and correct RGB channel, obtain removing the Bayer picture signals of IR components；According to not removing
The Bayer images of IR components carry out Federated filter, that is, the process in denoising to the Bayer images for removing IR components, obtain
Output image signal, and by image-signal processor output image signal is handled to obtain the RGB image of normal color.
By the method for raising RGB image signal to noise ratio provided in an embodiment of the present invention, original RGBIR signal noise ratio (snr) of image is utilized
The characteristics of high, during noise remove, using the correlation for the high signal-to-noise ratio image for not removing IR components to removing IR points
The low signal-to-noise ratio (SNR) images of amount carry out Federated filter, realize the processing of the image to being obtained based on RGBIR sensors, improve most
The signal to noise ratio of the RGB image obtained afterwards；Meanwhile also significantly improve the letter of the image obtained under low colour temperature or low-light (level) environment
Make an uproar ratio.
Alternatively, it is specifically used for as another embodiment of the present invention, interpolating unit 520, is schemed by interpolation calculation RGBIR
As the G pixels in signal on each pixel IR passages to obtain the first picture signal.
Alternatively, it is specifically used for as another embodiment of the present invention, interpolating unit 520,
Pass through the R pixel values in interpolation calculation RGBIR picture signals on each pixel in R, G, B, IR passage, G pictures
Element value and B pixel values, to obtain the first picture signal；Wherein, R, G, B and IR including each pixel of the first picture signal lead to
Road is the picture signal of R pixel values and IR pixel values, and R, G, B and IR passage of each pixel are G pixel values and IR pictures
The picture signal of element value, and each R, G, B and IR passage of pixel are the picture signal of B pixel values and IR pixel values.
Alternatively, in embodiments of the present invention, component cells 530 are removed to be specifically used for, is schemed by interpolation calculation RGBIR
As the IR pixel values in signal on each pixel position to obtain the 3rd image, the 3rd picture signal is each pixel
R, G, B and IR passage are the picture signal of IR pixel values；First picture signal and the 3rd image subtraction are obtained into the second image
Signal.
Wherein the second picture signal is the picture signal after removal IR components.
Alternatively, as in another embodiment of the present invention, filter unit 540 is specifically used for,
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal
Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around the first pixel；Determine in the second picture signal with first
Second pixel corresponding to pixel and the second reference image vegetarian refreshments corresponding with the first reference image vegetarian refreshments；According to weight to the second figure
As the second reference pixel point progress weighted average in signal, the pixel value of the second pixel is determined, is believed with obtaining output image
Number.
Alternatively, in one embodiment, image signal processing unit 550 is specifically used for,
Output image signal is carried out in color correction matrix, camera lens shadow correction, AWB or mosaic processing
At least one processing obtain export RGB image.
Alternatively, in another embodiment, image signal processing unit 550 is specifically used for,
By R, G and B pixel value in interpolation calculation output image signal on each pixel R, G and channel B, to obtain
To the 4th picture signal；Color correction matrix, camera lens shadow correction, AWB are carried out to the 4th picture signal to handle to obtain
The RGB image.
Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values,
Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel
It is the picture signal of B pixel values.
It should be noted that the unit in device 500 provided in an embodiment of the present invention can realize Fig. 4 to Fig. 6 institutes
The method or step for the method 200 to 400 shown, for succinct description, will not be repeated here its detailed process.
The method that is described with reference to the embodiments described herein can use hardware, computing device the step of algorithm
Software module, or the two combination are implemented.Software module can be placed in random access memory (RAM), internal memory, read-only storage
(ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical field
In any other form of storage medium well known to interior.
Above-described embodiment, the purpose of the present invention, technical scheme and beneficial effect are carried out further
Describe in detail, should be understood that the embodiment that the foregoing is only the present invention, be not intended to limit the present invention
Protection domain, within the spirit and principles of the invention, any modification, equivalent substitution and improvements done etc., all should include
Within protection scope of the present invention.
Claims (19)
- A kind of 1. method for generating RGB image, it is characterised in that methods described includes：Receive the RGBIR picture signals that RGBIR sensors are sent；Row interpolation is entered to obtain the first picture signal to the RGBIR picture signals by interpolation method；The infrared IR components in described first image signal on each pixel position are removed to obtain the second picture signal；Described first image signal and second picture signal are subjected to Federated filter to obtain filtered RGB image.
- 2. according to the method for claim 1, it is characterised in that described that the RGBIR picture signals are entered by interpolation method Row interpolation to obtain the first picture signal, including：By the G pixel values in RGBIR picture signals described in interpolation calculation on each pixel IR passages, to obtain described One picture signal.
- 3. according to the method for claim 1, it is characterised in that described that the RGBIR picture signals are entered by interpolation method Row interpolation to obtain the first picture signal, including：Pass through the R pixel values in RGBIR picture signals described in interpolation calculation on each pixel in R, G, B, IR passage, G pictures Element value and B pixel values, to obtain described first image signal；Wherein, R, G, B and IR passage that described first image signal includes each pixel are R pixel values and IR pixel values Picture signal, R, G, B and IR passage of each pixel are the picture signal of G pixel values and IR pixel values, and each picture R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values and IR pixel values.
- 4. according to the method in claim 2 or 3, it is characterised in that each picture in the removal described first image signal Infrared IR components on vegetarian refreshments position to obtain the second picture signal, including：By the IR pixel values in RGBIR picture signals described in interpolation calculation on each pixel position to obtain the 3rd image Signal, the 3rd picture signal are that R, G, B and IR passage of each pixel are the picture signal of IR pixel values；Described first image signal and the 3rd picture signal are subtracted each other to obtain second picture signal.
- 5. according to the method for claim 4, it is characterised in that described by described first image signal and second image Signal carries out Federated filter to obtain filtered RGB image, including：The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in described first image signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around first pixel；Determine in second picture signal the second pixel corresponding with first pixel and with first reference image Second reference image vegetarian refreshments corresponding to vegetarian refreshments；Weighted average is carried out to the second reference pixel point in second picture signal according to the weight, it is determined that described The pixel value of second pixel, to obtain the filtered RGB image.
- 6. according to claims 1 to 3,5 any described methods, it is characterised in that the filtered RGB image is used to provide The RGB image for being handled to be exported to image-signal processor.
- 7. according to the method for claim 6, it is characterised in that described image signal processor is to the filtered RGB The RGB image that image is handled to be exported, including：Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to the filtered RGB image In at least one processing obtain the RGB image of the output.
- 8. according to the method for claim 6, it is characterised in that described image signal processor is to the filtered RGB The RGB image that image is handled to be exported, including：By R, G and B pixel value in filtered RGB image described in interpolation calculation on each pixel R, G and channel B, To obtain the 4th picture signal；Color correction matrix is carried out to the 4th picture signal, camera lens shadow correction, AWB handle to obtain it is described defeated The RGB image gone out；Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values, Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel It is the picture signal of B pixel values.
- 9. according to the method described in claims 1 to 3,5, any one of 7-8, it is characterised in that the interpolation method includes bilinearity Interpolation method.
- 10. a kind of device for generating RGB image, it is characterised in that described device includes：Receiving unit, for receiving the RGBIR picture signals of RGBIR sensors transmission；Interpolating unit, for entering row interpolation to the RGBIR picture signals by interpolation method to obtain the first picture signal；Component cells are removed, for removing the infrared IR components in described first image signal on each pixel position to obtain Second picture signal；Filter unit, after described first image signal and second picture signal are carried out into Federated filter to obtain filtering RGB image.
- 11. device according to claim 10, it is characterised in that the interpolating unit is specifically used for,Row interpolation is entered to obtain by the G pixels in RGBIR picture signals described in interpolation calculation on each pixel IR passages Described first image signal.
- 12. device according to claim 10, it is characterised in that the interpolating unit is specifically used for,Pass through the R pixel values in RGBIR picture signals described in interpolation calculation on each pixel in R, G, B, IR passage, G pictures Element value and B pixel values, to obtain described first image signal；Wherein, R, G, B and IR passage that described first image signal includes each pixel are R pixel values and IR pixel values Picture signal, R, G, B and IR passage of each pixel are the picture signal of G pixel values and IR pixel values, and each picture R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values and IR pixel values.
- 13. the device according to claim 11 or 12, it is characterised in that the removal component cells are specifically used for,By the IR pixel values in RGBIR picture signals described in interpolation calculation on each pixel position, to obtain the 3rd figure As signal, the 3rd picture signal is that R, G, B and IR passage of each pixel are the picture signal of IR pixel values；Described first image signal and the 3rd picture signal are subtracted each other to obtain second picture signal.
- 14. device according to claim 13, it is characterised in that the filter unit is specifically used for,The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in described first image signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around first pixel；Determine in second picture signal the second pixel corresponding with first pixel and with first reference image Second reference image vegetarian refreshments corresponding to vegetarian refreshments；Weighted average is carried out to the second reference pixel point in second picture signal according to the weight, it is determined that described The pixel value of second pixel, to obtain the filtered RGB image.
- 15. according to the device described in claim 10 to 12,14 any one, it is characterised in that the filtered RGB image is used In the RGB image for being supplied to image-signal processor to be handled to be exported.
- 16. device according to claim 15, it is characterised in that described image signal processor is specifically used for,Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to the filtered RGB image In at least one processing obtain the RGB image of the output.
- 17. device according to claim 15, it is characterised in that image-signal processor is specifically used for,By R, G and B pixel value in filtered RGB image described in interpolation calculation on each pixel R, G and channel B, To obtain the 4th picture signal；Color correction matrix is carried out to the 4th picture signal, camera lens shadow correction, AWB handle to obtain it is described defeated The RGB image gone out；Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values, Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel It is the picture signal of B pixel values.
- 18. according to the device described in claim 10 to 12,14, any one of 16-17, it is characterised in that the interpolation method includes Bilinear interpolation method.
- 19. a kind of system for generating RGB image, it is characterised in that the system includes：RGBIR sensors, for receiving RGBIR picture signals；Memory, for store instruction and RGBIR picture signals；Processor, for calling the instruction in the memory, and perform following operate：Receive the RGBIR picture signals that RGBIR sensors are sent；Row interpolation is entered to obtain the first picture signal to the RGBIR picture signals by interpolation method；The infrared IR components in described first image signal on each pixel position are removed to obtain the second picture signal；Described first image signal and second picture signal are subjected to Federated filter to obtain filtered RGB image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610859097.0A CN106375740B (en) | 2016-09-28 | 2016-09-28 | Generate the methods, devices and systems of RGB image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610859097.0A CN106375740B (en) | 2016-09-28 | 2016-09-28 | Generate the methods, devices and systems of RGB image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106375740A CN106375740A (en) | 2017-02-01 |
| CN106375740B true CN106375740B (en) | 2018-02-06 |
Family
ID=57898131
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610859097.0A Active CN106375740B (en) | 2016-09-28 | 2016-09-28 | Generate the methods, devices and systems of RGB image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106375740B (en) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107590840B (en) * | 2017-09-21 | 2019-12-27 | 长沙全度影像科技有限公司 | Color shadow correction method based on grid division and correction system thereof |
| CN107731199B (en) * | 2017-10-27 | 2020-12-29 | 努比亚技术有限公司 | Screen color temperature adjusting method, terminal and computer readable storage medium |
| CN108965654B (en) * | 2018-02-11 | 2020-12-25 | 浙江宇视科技有限公司 | Double-spectrum camera system based on single sensor and image processing method |
| CN108391067B (en) * | 2018-05-10 | 2023-09-29 | 浙江芯劢微电子股份有限公司 | Denoising enhancement device and method based on RGB-IR sensor |
| CN109040720B (en) * | 2018-07-24 | 2019-11-19 | 浙江大华技术股份有限公司 | A kind of method and device generating RGB image |
| JP7306408B2 (en) * | 2018-11-05 | 2023-07-11 | ソニーグループ株式会社 | Temperature estimation device, temperature estimation method and temperature estimation program |
| CN110490187B (en) * | 2019-05-31 | 2022-04-15 | 杭州海康威视数字技术股份有限公司 | License plate recognition device and method |
| CN112399163B (en) * | 2019-08-19 | 2022-12-09 | 瑞昱半导体股份有限公司 | Image sensing device and automatic white balance method |
| CN112887513B (en) * | 2019-11-13 | 2022-08-30 | 杭州海康威视数字技术股份有限公司 | Image noise reduction method and camera |
| CN113115010B (en) * | 2020-01-11 | 2023-04-18 | 晋城三赢精密电子有限公司 | Image format conversion method and device based on RGB-IR image sensor |
| CN113365034B (en) * | 2020-03-04 | 2022-09-06 | 合肥君正科技有限公司 | Color calibration method based on RGB-IR image sensor |
| CN113365035B (en) * | 2020-03-04 | 2022-10-21 | 合肥君正科技有限公司 | Calibration system for image color restoration |
| KR20220081532A (en) * | 2020-12-09 | 2022-06-16 | 에스케이하이닉스 주식회사 | Image signal processor and image processing system |
| CN113074627B (en) * | 2021-03-12 | 2022-06-10 | 中国科学院生物物理研究所 | Imaging method and device of direct electronic detection camera and computer equipment |
| CN117692615B (en) * | 2024-02-01 | 2024-04-26 | 东北大学秦皇岛分校 | RGB image communication method based on infrared wavelength |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102665030A (en) * | 2012-05-14 | 2012-09-12 | 浙江大学 | Improved bilinear Bayer format color interpolation method |
| CN102778201A (en) * | 2011-05-13 | 2012-11-14 | 索尼公司 | Image processing device, image processing method, and program |
| CN103686111A (en) * | 2013-12-31 | 2014-03-26 | 上海富瀚微电子有限公司 | Method and device for correcting color based on RGBIR (red, green and blue, infra red) image sensor |
| CN104639923A (en) * | 2015-02-04 | 2015-05-20 | 华为技术有限公司 | Method and device for processing image data, and terminal |
| WO2016002283A1 (en) * | 2014-06-30 | 2016-01-07 | ソニー株式会社 | Image processing device, image pickup device, information processing device and program |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7821552B2 (en) * | 2005-12-27 | 2010-10-26 | Sanyo Electric Co., Ltd. | Imaging apparatus provided with imaging device having sensitivity in visible and infrared regions |
| KR20130031572A (en) * | 2011-09-21 | 2013-03-29 | 삼성전자주식회사 | Image processing method and image processing apparatus |
| JP6231284B2 (en) * | 2013-02-21 | 2017-11-15 | クラリオン株式会社 | Imaging device |
| US20140307055A1 (en) * | 2013-04-15 | 2014-10-16 | Microsoft Corporation | Intensity-modulated light pattern for active stereo |
-
2016
- 2016-09-28 CN CN201610859097.0A patent/CN106375740B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102778201A (en) * | 2011-05-13 | 2012-11-14 | 索尼公司 | Image processing device, image processing method, and program |
| CN102665030A (en) * | 2012-05-14 | 2012-09-12 | 浙江大学 | Improved bilinear Bayer format color interpolation method |
| CN103686111A (en) * | 2013-12-31 | 2014-03-26 | 上海富瀚微电子有限公司 | Method and device for correcting color based on RGBIR (red, green and blue, infra red) image sensor |
| WO2016002283A1 (en) * | 2014-06-30 | 2016-01-07 | ソニー株式会社 | Image processing device, image pickup device, information processing device and program |
| CN104639923A (en) * | 2015-02-04 | 2015-05-20 | 华为技术有限公司 | Method and device for processing image data, and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106375740A (en) | 2017-02-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106375740B (en) | Generate the methods, devices and systems of RGB image | |
| CN106504281B (en) | Image quality enhancing and filtering method applied to cmos image sensor | |
| WO2017152402A1 (en) | Image processing method and apparatus for terminal, and terminal | |
| US10735700B2 (en) | Universal and adaptive de-mosaicing (CFA) system | |
| CN103327218B (en) | image processing system and method | |
| CN104995911B (en) | Image processing device, image capture device, filter generating device, image restoration method, and program | |
| CN101626454B (en) | Method for intensifying video visibility | |
| CN102256141A (en) | Image processing device, image processing method, and imaging apparatus | |
| KR20110048922A (en) | Method of modeling integrated noise and method of reducing noises in image sensors | |
| CN109040720B (en) | A kind of method and device generating RGB image | |
| WO2008121280A2 (en) | Edge mapping using panchromatic pixels | |
| EP2436187A1 (en) | Four-channel color filter array pattern | |
| EP2130175A2 (en) | Edge mapping incorporating panchromatic pixels | |
| CN107454285A (en) | Image noise estimation method and device and image extraction device | |
| JP2008113222A (en) | Image processing apparatus, imaging apparatus, image processing method in these apparatuses, and program allowing computer to execute the method | |
| CN108122201A (en) | A kind of Bayer interpolation slide fastener effect minimizing technology | |
| WO2023016146A1 (en) | Image sensor, image collection apparatus, image processing method, and image processor | |
| CN105141838A (en) | Demosaicing method and device using demosaicing method | |
| CN110430403B (en) | Image processing method and device | |
| CN106791734A (en) | The method of device, electronic installation and IMAQ for IMAQ | |
| CN107786857B (en) | A kind of image restoring method and device | |
| CN107277369B (en) | Image processing method, device, computer readable storage medium and computer equipment | |
| CN117274060A (en) | Unsupervised end-to-end demosaicing method and system | |
| CN116503259B (en) | Mosaic interpolation method and system | |
| CN111968039A (en) | Day and night universal image processing method, device and equipment based on silicon sensor camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |