CN106375740B - Generate the methods, devices and systems of RGB image - Google Patents

Generate the methods, devices and systems of RGB image Download PDF

Info

Publication number
CN106375740B
CN106375740B CN201610859097.0A CN201610859097A CN106375740B CN 106375740 B CN106375740 B CN 106375740B CN 201610859097 A CN201610859097 A CN 201610859097A CN 106375740 B CN106375740 B CN 106375740B
Authority
CN
China
Prior art keywords
pixel
signal
image
picture
picture signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610859097.0A
Other languages
Chinese (zh)
Other versions
CN106375740A (en
Inventor
魏哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN201610859097.0A priority Critical patent/CN106375740B/en
Publication of CN106375740A publication Critical patent/CN106375740A/en
Application granted granted Critical
Publication of CN106375740B publication Critical patent/CN106375740B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/646Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Processing (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

The present invention relates to a kind of methods, devices and systems for generating RGB image, this method includes:Receive the RGBIR picture signals that RGBIR sensors are sent;Row interpolation is entered to RGBIR picture signals by interior differential technique and obtains the first picture signal;The infrared IR components in the first picture signal on each pixel position are removed to obtain the second picture signal;First picture signal and the second picture signal are subjected to Federated filter to obtain filtered RGB image.Using the RGBIR picture signal signal to noise ratio for not removing IR components it is high the characteristics of, correlation according to high signal-to-noise ratio image signal and the low signal-to-noise ratio (SNR) images signal for removing IR components carries out Federated filter to the low signal-to-noise ratio (SNR) images signal for removing IR components, the signal to noise ratio of RGB image is improved, especially improves the signal to noise ratio of the image obtained under low colour temperature or low-light (level) environment.

Description

Generate the methods, devices and systems of RGB image
Technical field
The present invention relates to image processing field, more particularly to a kind of methods, devices and systems for generating RGB image.
Background technology
RGBIR sensors are a kind of new sensors, are equipped with the imaging sensor of RGBIR filters.RGBIR filters Array arrangement mode and conventional color filter array (Color Filter Array, CFA), such as Bayer color filter array The arrangement mode of (Bayer CFA) is different, as depicted in figs. 1 and 2.Fig. 1 is the array schematic diagram of Bayer sensors, and R represents figure As the pixel of all covering red filters on sensor, it is referred to as red (Red, R) passage;G represents all on imaging sensor and covered The pixel of lid green filter, it is referred to as green (Green, G) passage, B represents the pixel of covering blueness, and it is logical to be referred to as blue (Blue, B) Road.Fig. 2 is the array schematic diagram of RGBIR sensors, and the arrays of RGBIR filters is by the half in Bayer color filter lens arrays Green component is substituted by infrared light (infrared) component, referred to as infrared (Infrared, the IR) passage of the partial pixel, and RGBIR filters can sense visible ray and black light simultaneously, here represent black light with infrared light IR.In order to based on RGBIR sensors obtain normal RGB color image, it is necessary to by RGBIR sensor senses to R, G, the IR in channel B pixel Composition removes.
In the prior art, each picture in original image can be obtained by carrying out image interpolation to the RGBIR images of input The pixel of missing on vegetarian refreshments position, the numerical value of the RGB channel and IR passages in output image is calculated, determines correction coefficient, RGB channel and infrared IR passages are separated according to correction coefficient, and correct RGB channel, finally exports RGB image.
But by the RGBIR images of the prior art that obtained based on RGBIR sensors that obtain the RGB of output can be caused to scheme The signal to noise ratio of picture is relatively low, especially higher or in the case that illuminance is relatively low in colour temperature.
The content of the invention
The invention provides a kind of methods, devices and systems for generating RGB image, to realize colour temperature is higher or illumination Signal to noise ratio of the degree than in the case of relatively low, improving RGB image.
In a first aspect, the invention provides a kind of method for generating RGB image, this method includes:Receive RGBIR sensors The RGBIR picture signals of transmission;Row interpolation is entered to input RGBIR picture signals by interpolation method and obtains higher the of signal to noise ratio One picture signal, the first picture signal can be understood as carrying the Bayer (Bayer) of infrared IR components on each pixel position Picture signal;The infrared IR components on each pixel position in the first image are removed, and RGB channel is corrected, are obtained Second picture signal, wherein, the second picture signal can be understood as relative RGBIR picture signals and remove on each pixel position IR components after Bayer images;First picture signal and secondary signal image are subjected to Federated filter and obtain filtered RGB Image.
Federated filter provided by the invention, can be bilateral for example, by guiding wave filter (Guided Filter), joint The wave filters such as wave filter (Joint Bilateral Filter) are related to the second picture signal according to the first picture signal Property, the second picture signal is filtered to obtain filtered RGB image.
By the method for generation RGB image provided in an embodiment of the present invention, believed using the RGBIR images for not removing IR components Make an uproar than it is high the characteristics of, during noise remove, utilize and do not remove the RGBIR picture signals of IR components with removing IR components The correlation of RGBIR picture signals, Federated filter is carried out to the low signal-to-noise ratio RGBIR picture signals for removing IR components, realized To the processing of the image obtained based on RGBIR sensors, the signal to noise ratio of the RGB image obtained after processing is improved;It is meanwhile also bright The aobvious signal to noise ratio for improving the image obtained under low colour temperature or low-light (level) environment.
With reference in a first aspect, in the first mode in the cards of first aspect, by interpolation method to RGBIR images Signal enters row interpolation to obtain the first picture signal, including:Pass through each pixel IR in interpolation calculation RGBIR picture signals G pixel values on passage are to obtain the first picture signal.
With reference in a first aspect, in second of mode in the cards of first aspect, by interpolation method to the RGBIR Picture signal enters row interpolation to obtain the first picture signal, including:
Pass through the R pixel values in interpolation calculation RGBIR picture signals on each pixel in R, G, B, IR passage, G pictures Element value and B pixel values, to obtain the first picture signal;
Wherein, the first picture signal includes three picture signals, R, G, B of each pixel of a picture signal It is the picture signal of R pixel values and IR pixel values with IR passages;R, G, B and IR of each pixel of one picture signal lead to Road is the picture signal of G pixel values and IR pixel values, and R, G, B and IR passage of each pixel of another picture signal are equal For the picture signal of B pixel values and IR pixel values.
With reference to second of mode in the cards of the first mode or first aspect in the cards of first aspect In, in the third mode in the cards of first aspect, remove red on each pixel position in the first picture signal Outer IR components to obtain the second picture signal, including:By in interpolation calculation RGBIR picture signals on each pixel position IR pixel values to obtain the 3rd picture signal, the 3rd picture signal is IR pictures for R, G, B and IR passage of each pixel The picture signal of element value;First picture signal and the 3rd picture signal are subtracted each other to obtain the second picture signal.Pass through the design Scheme, the RGBIR picture signals that RGBIR sensors obtain can be converted to traditional Bayer picture signals, be easy to tradition Image-signal processor (Image Signal Processor, ISP) docking, can be handled, be subtracted using traditional algorithm The cost of exploitation is lacked.
With reference to the third mode in the cards of first aspect, in the 4th kind of mode in the cards of first aspect In, the first picture signal and the second picture signal are subjected to Federated filter to obtain filtered RGB image, including:
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around first pixel;
Determine in the second picture signal with the first pixel corresponding to the second pixel and corresponding with the first reference image vegetarian refreshments The second reference image vegetarian refreshments;
Weighted average is carried out to the second reference pixel point in the second picture signal according to weight, determines the second pixel Pixel value, to obtain filtered RGB image.
With reference to the 4th kind of mode in the cards of first aspect to first aspect, the 5th kind in first aspect may be real In existing mode, filtered RGB image is used for the RGB figures for being supplied to image-signal processor to be handled to be exported Picture.
With reference in a first aspect, in the 6th kind of mode in the cards of first aspect, pass through image-signal processor pair Filtered RGB image is handled to obtain RGB image, including:
Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to filtered RGB image In the RGB image that is exported of at least one processing.
With reference in a first aspect, in the 7th kind of mode in the cards of first aspect, image-signal processor is to filtering The RGB image that RGB image afterwards is handled to be exported, including:
Pass through R, G and B pixel in filtered RGB image described in interpolation calculation on each pixel R, G and channel B Value, to obtain the 4th picture signal;
Color correction matrix is carried out to the 4th picture signal, camera lens shadow correction, AWB handle to obtain it is described defeated The RGB image gone out;
Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values, Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel It is the picture signal of B pixel values.
With reference to any implementation in any mode in the cards in first aspect to first aspect, in first party In the 8th kind of mode in the cards in face, interpolation method includes bilinear interpolation method.
Second aspect, the invention provides a kind of device for generating RGB image, the device includes:Receiving unit, interpolation list Member, remove component cells and filter unit.Receiving unit is used for the RGBIR picture signals for receiving the transmission of RGBIR sensors;Interpolation Unit, for entering row interpolation to RGBIR picture signals by interpolation method to obtain the first picture signal;Component cells are removed, are used In removing the infrared IR components in the first picture signal on each pixel position to obtain the second picture signal;Filter unit, For the first picture signal and the second picture signal to be carried out into Federated filter to obtain filtered RGB image.
Wherein, the first picture signal can be understood as carrying the Bayer picture signals of IR components on each pixel position; Second picture signal can be understood as RGBIR images and remove the Bayer picture signals after the IR components on each pixel position.
It can be filtered in Federated filter of the present invention for example, by Guided Filter, Joint Bilateral Filter etc. Ripple device, according to the correlation of the first signal noise ratio (snr) of image, the second image is filtered, obtains filtered RGB image.
By device provided in an embodiment of the present invention, using the RGBIR signal noise ratio (snr) of image for not removing IR components it is high the characteristics of, During noise remove, the RGBIR picture signals and the RGBIR picture signals of removal IR components for not removing IR components are utilized Correlation, to remove IR components low signal-to-noise ratio RGBIR picture signals carry out Federated filter, realize to being passed based on RGBIR The processing for the image that sensor obtains, improve the signal to noise ratio of the RGB image obtained after processing;Meanwhile also significantly improve low The signal to noise ratio of the image obtained under colour temperature or low-light (level) environment.
With reference to second aspect, in the first mode in the cards of second aspect, interpolating unit is specifically used for, and passes through G pixels in interpolation calculation RGBIR picture signals on each pixel IR passages enter row interpolation to obtain the first image.
With reference to second aspect, in second of mode in the cards of second aspect, interpolating unit is specifically used for,
Pass through the R pixel values in interpolation calculation RGBIR picture signals on each pixel in R, G, B, IR passage, G pictures Element value and B pixel values, to obtain the first picture signal;
Wherein, R, G, B and IR passage that the first picture signal includes each pixel are R pixel values and IR pixel values Picture signal, R, G, B and IR passage of each pixel are the picture signal of G pixel values and IR pixel values, and each picture R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values and IR pixel values.
With reference to second of mode in the cards of the first mode or second aspect in the cards of second aspect, In the third mode in the cards of second aspect, remove component cells and be specifically used for, it is extremely described by interpolation method IR pixel values in RGBIR picture signals on each pixel position, to obtain the 3rd picture signal, the 3rd picture signal is every R, G, B and IR passage of individual pixel are the picture signal of IR pixel values;First picture signal and the 3rd picture signal are entered Row subtracts each other, to obtain the second picture signal.
With reference to the third mode in the cards of second aspect, the mode in the cards in the 4th of second aspect In, filter unit is specifically used for,
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around the first pixel;
Determine in the second picture signal with the first pixel corresponding to the second pixel and corresponding with the first reference image vegetarian refreshments The second reference image vegetarian refreshments;
Weighted average is carried out to the second reference pixel point in the second picture signal according to weight, determines the second pixel Pixel value, to obtain filtered RGB image.
In the 5th kind of mode in the cards with reference to second aspect to second aspect, filtered image is used to be supplied to The RGB image that image-signal processor is handled to be exported.
With reference to second aspect, in the 6th kind of mode in the cards of second aspect, image-signal processor is specifically used In,
Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to filtered RGB image In the RGB image that is exported of at least one processing.
With reference to second aspect, in the 7th kind of mode in the cards of second aspect, image-signal processor is specifically used In,
By R, G and B pixel value in the filtered RGB image of interpolation calculation on each pixel R, G and channel B, To obtain the 4th picture signal;
Color correction matrix, camera lens shadow correction, AWB are carried out to the 4th picture signal and handle what is exported RGB image;
Wherein, the 4th picture signal includes three picture signals, R, G, B and IR of each pixel in a picture signal Passage is the picture signal of R pixel values;R, G, B and IR passage of each pixel are G pixel values in one picture signal Picture signal;R, G, B and IR passage of each pixel are the picture signal of B pixel values in another picture signal.
With reference to second aspect to second aspect any possible implementation in any mode in the cards, In 8th kind of mode in the cards of two aspects, interpolation method includes bilinear interpolation method.
The third aspect, the embodiment of the present invention provide a kind of system, and the system includes RGBIR sensors, memory and processing Device.
RGBIR sensors, for receiving RGBIR picture signals;
Memory, for store instruction and RGBIR picture signals;
Processor, for calling the instruction in the memory, and perform and complete any possible realization in first aspect Mode and any one of second aspect mode in the cards.
Based on a kind of methods, devices and systems for generating RGB image provided by the invention, scheme by using original RGBIR The characteristics of picture Signal-to-Noise is high, that is, picture signal (the first image of the IR components on each pixel position is not removed Signal) signal to noise ratio it is high the characteristics of, by it and remove the picture signals of IR components on each pixel position (the second image believed Number) carry out Federated filter, during noise remove, using the first picture signal high s/n ratio signal correlation to the The Low SNR signal filtering of two picture signals, is realized the processing of the image to being obtained based on RGBIR sensors, improves place The signal to noise ratio of the RGB image obtained after reason.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, it will make below to required in the embodiment of the present invention Accompanying drawing is briefly described, it should be apparent that, drawings described below is only some embodiments of the present invention, for For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.
Fig. 1 is the array schematic diagram of Bayer sensors;
Fig. 2 is the array schematic diagram of RGBIR sensors;
Fig. 3 is a kind of apparatus structure schematic diagram for generating RGB image provided in an embodiment of the present invention;
Fig. 4 is a kind of method flow diagram for generating RGB image provided in an embodiment of the present invention;
Fig. 5 is another method flow diagram for generating RGB image provided in an embodiment of the present invention;
Fig. 6 is the processing procedure sketch of generation RGB image;
Fig. 7 is another method flow diagram for generating RGB image provided in an embodiment of the present invention;
Fig. 8 is another processing procedure sketch for generating RGB image provided in an embodiment of the present invention;
Fig. 9 is the processing procedure abbreviation of another generation RGB image provided in an embodiment of the present invention;
Figure 10 is a kind of apparatus structure schematic diagram for generating RGB image provided in an embodiment of the present invention.
Embodiment
In order to allow RGBIR sensors to obtain normal RGB image, it is necessary to by red (R) passage in RGBIR sensors, green The black light part perceived in color (G) passage and blue (B) passage removes.In the present invention by RGBIR sensor senses To black light be written as infrared light (infrared light, IR).The invention provides a kind of new framework to handle RGBIR The image that sensor obtains, the signal to noise ratio for the RGB image for making to finally obtain improve.
A kind of method and apparatus of raising RGBIR sensor signal to noise ratio provided by the invention, obtained according to RGBIR sensors RGBIR picture signals, it is every in RGBIR images to removing using the edge sharpness of signal in high s/n ratio RGBIR picture signals The low signal-to-noise ratio (SNR) images after IR components on individual pixel position are filtered, so as to improve the letter of the RGB image finally obtained Make an uproar ratio.
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation describes, it is clear that described embodiment is the part of the embodiment of the present invention, rather than whole embodiments.Based on this hair Embodiment in bright, the every other reality that those of ordinary skill in the art are obtained on the premise of creative work is not made Example is applied, should all belong to the scope of protection of the invention.
Fig. 3 is a kind of structural representation for generating RGB image system provided in an embodiment of the present invention.As shown in figure 3, this is System 100 can include RGBIR sensors 110, processing unit 120, image-signal processor 130, display 140 and communication bus 150, RGBIR sensors 110, processing unit 120, image-signal processor (Image signal Processor, ISP) 130, Display 140 is connected with each other by communication bus 150, and completes mutual communication.
RGBIR sensors 110 are used to receive RGBIR picture signals, and RGBIR picture signals are sent into processing unit 120 carry out picture signal processing.Processing unit 120 is used to handle RGBIR picture signals to obtain compared with the prior art The high RGB image signal of signal to noise ratio.Image-signal processor ISP130 is used to further handle obtained RGB image signal The RGB image visual to user, and provide a user by display 140 RGB image of display.
The processing unit 120 can include receiver 121, processor 122 and memory 123.Receiver 121 is used to receive The RGBIR picture signals that RGBIR sensors are sent.Memory 123 be used for store instruction and the RGBIR picture signals that receive with And RGBIR picture signals after treatment.Processor 122 is used to call the instruction in memory, and performs following operation:
Row interpolation is entered to obtain the first picture signal to the RGBIR picture signals received by interpolation method;
The infrared IR components in the first picture signal on each pixel position are removed to obtain the second picture signal;
First picture signal and the second picture signal are subjected to Federated filter to obtain filtered RGB image.
In embodiments of the present invention, processor 122 can be CPU (Central Processing Unit, CPU), the processor 120 can also be other general processors, digital signal processor (Digital Signal Processor, DSP), it is application specific integrated circuit (Application Specific Integrated Circuit, ASIC), existing Into programmable gate array (Field-Programmable Gate Array, FPGA) or other PLDs, discrete Door or transistor logic, discrete hardware components etc..General processor can be that microprocessor or the processor also may be used To be any conventional processor etc..
Memory 123 can include read-only storage and random access memory, and provide instruction sum to processor 122 According to.The a part of of memory can also include nonvolatile RAM.For example, memory can be with storage device class The information of type.
It is total can also to include power bus, controlling bus and status signal in addition to including data/address bus for communication bus 150 Line etc..But for the sake of clear explanation, various buses are all designated as communication bus 150 in figure.
In addition, in embodiments of the present invention, the system can also include image-signal processor 130 in, with In being handled filtered RGB image to obtain the RGB image of data, the processing procedure can include to filtered RGB At least one processing that image is carried out in color correction matrix, camera lens shadow correction, AWB or mosaic processing obtains The RGB image of output.
It should be noted that image-signal processor 130 can be arranged in processing unit 120, to this of the invention real Apply in example and be not intended to be limited in any.
Fig. 4 is a kind of method flow diagram of raising RGBIR sensor signal to noise ratio provided in an embodiment of the present invention.Such as Fig. 4 institutes Show, the executive agent of this method 200 can be the system shown in Fig. 3, and this method 200 can specifically include following steps:
S210, receive the RGBIR picture signals that RGBIR sensors are sent.
S220, row interpolation is entered to RGBIR picture signals by interpolation method to obtain the first picture signal.
Specifically, after the first picture signal enters row interpolation for the original RGBIR picture signals collected to RGBIR sensors Obtained image, the picture signal can be understood as Bayer (Bayer) image with IR components on each pixel position and believe Number.
It should be noted that in S220, can be to each picture during carrying out interpolation calculation to original RGBIR images The color lacked and infrared light IR components on vegetarian refreshments position enter row interpolation.
The pixel value that the color on Color Channel corresponding to color is lacked in RGBIR picture signals can be specifically obtained, , can be respectively from G passages such as G, B, IR pixel value really on R passages in R, G, B, IR passage on each pixel position G pixel values are obtained, B pixel values are obtained in channel B, IR pixel values are obtained on IR passages, and are added on R passages, briefly may be used With by the G pixel values on G passages, on IR pixel values copy (copy) on the B pixel values and IR passages in channel B to R passages. G, row interpolation can also be entered by the interpolation method on B, IR passage, to obtain the first picture signal.
S230, the infrared IR components in the first picture signal on each pixel position are removed to obtain the second image letter Number.
, can be by determining the correction coefficient in correction RGBIR images according to the first picture signal, according to school in S230 Positive coefficient corrects RGBIR images, obtains removing the image of the IR components on each pixel position, that is, the second image letter Number.
In embodiments of the present invention, the correction coefficient of correction RGBIR images is determined according to the first picture signal, can be specific Including:Step 1:Under a certain illumination condition, that is, under a certain illuminance, standard is shot to color using cutoff filter Card, calculates the average value to each color lump four-way of colour atla (R, G, B, IR passage) pixel;Step 2:With the same illumination bar of step 1 Under part, collocation can be shot to colour atla by the optical filter of visible ray and infrared light, and is calculated to each color lump four-way picture of colour atla The average value of element;Step 3:The average value obtained according to step 1 and step 2, will using 4 × 4 matrixes as shown in formula (1) The average value obtained in step 1 substitutes into formula (1) as the numerical value of RGBIR a certain passage in formula (1) right side, by step 2 In obtained average value, the numerical value as RGBIR a certain passage on the left of formula (1) substitutes into formula (1), uses least square The A in formula 1 is calculated in methodxx;Step 4:Repeat step 1 completes formula to the process of step 3 under different illumination conditions (1) correction coefficient under different illumination.
It should be noted that in embodiments of the present invention, the correction coefficient can also be the correction coefficient pre-set Table, when needing to determine correction coefficient according to the first image, it is necessary to count in RGBIR images in Statistical Area RGB a little lead to The average value of road pixel and the average value of IR passage pixels, according to being averaged for the average value of RGB channel pixel and IR passage pixels It is worth query correction coefficient table, it is determined that the one group of correction coefficient to match with RGBIR images.
Then RGBIR images are calculated by the correction coefficient of determination, removed in trimming process every in RGBIR picture signals The IR components of individual pixel, obtain removing the Bayer picture signals of IR components.
Alternatively, in embodiments of the present invention, interpolation method can be used to carry out interpolation calculation to RGBIR picture signals, obtained IR components into RGBIR picture signals on the R passages of each pixel, G passages, channel B and IR passages, obtain RGBIR figures Picture signal as in signal on R, G, B, IR passage of each pixel being IR components, with to S220 in obtain Bayer (Bayer) picture signal with IR components is subtracted each other on each pixel position in RGBIR picture signals Except the Bayer picture signals of IR components.
S240, the first picture signal and the second picture signal are subjected to Federated filter with filtered RGB image.
Alternatively, in embodiments of the present invention, according to the first picture signal to the second picture signal carry out Federated filter with Output image signal is obtained, can be included:
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around the first pixel;Determine in the second picture signal with first Second pixel corresponding to pixel and the second reference image vegetarian refreshments corresponding with the first reference image vegetarian refreshments;According to weight to described The second reference pixel point in two picture signals carries out weighted average, the pixel value of the second pixel is determined, after obtaining filtering RGB image.
Briefly, Bayer picture signals and the removal of IR components will be carried on each pixel position obtained in S220 The Bayer picture signals of IR components in RGBIR picture signals on each pixel position carry out Federated filter, the Federated filter Process can determine difference weight according to the signal edge acutance in the Bayer picture signals for not removing IR components, according to determination Difference weight determine to remove the pixel value of each pixel in the Bayer picture signals of IR components:IR components will be removed The weighted average of the pixel value pixel value of the pixel and the pixel value around it of each pixel in Bayer picture signals It is determined that to realize the filtering of the Bayer picture signals to removing IR components.Its process is for example:When at image border, between pixel When difference is larger, is done average weighted weighted value and reduced, original pixel value is kept as far as possible in other words, to keep picture signal Edge sharpness.
In embodiments of the present invention, joint filter is carried out to the image for removing IR components according to the image for not removing IR components Ripple, it can also use and instruct as wave filter (Guided Filter), or use joint two-sided filter, implement in the present invention In example, this is not intended to be limited in any.
By the method for generation RGB image provided in an embodiment of the present invention, the high spy of original RGBIR signal noise ratio (snr) of image is utilized Point, during noise remove, utilize the low noise for the high signal-to-noise ratio image signal and removal IR components for not removing IR components Than the correlation of picture signal, Federated filter is carried out to the RGBIR picture signals for removing IR components, realized to based on RGBIR The processing for the image that sensor obtains, improve the signal to noise ratio of the RGB image obtained after processing;Meanwhile also significantly improve The signal to noise ratio of the image obtained under low colour temperature or low-light (level) environment.
Alternatively, can also include as another embodiment of the present invention, this method 200:
S250, the RGB figures for being supplied to image-signal processor to be handled filtered RGB image to be exported Picture.
Specifically, according to the high s/n ratio RGBIR picture signals for not removing IR components, the low signal-to-noise ratio to removing IR components Picture signal after picture signal progress Federated filter can not be identified, it is necessary to by image-signal processor (Image Signal Processor, ISP) handled, obtain the image that can be identified.
Image-signal processor needs to carry out output image signal color correction matrix, camera lens shadow correction, automatic white The RGB image that the processing such as balance and mosaic is exported.
Technical scheme is described in detail below according to Fig. 5 and Fig. 9.
Fig. 5 is a kind of flow chart of method for improving RGB image signal to noise ratio provided in an embodiment of the present invention.As shown in figure 5, The executive agent of this method 300 can be system as shown in Figure 3, and this method 300 specifically includes following steps:
S310, the G pixel values in the RGBIR picture signals received by interpolation calculation on each pixel IR passages Obtain the first picture signal.
Specifically, in embodiments of the present invention, can be by the method for bilinear interpolation to the IR in RGBIR picture signals The pixel of passage carries out interpolation calculation, obtains the G pixel values of IR channel positions, to obtain the first picture signal, as shown in Figure 6.
It should be noted that in embodiments of the present invention, the G on IR channel positions is obtained by the method for bilinear interpolation The numerical value of pixel is a kind of implementation, in embodiments of the present invention, can also realize RGBIR images by other means The numerical value of G pixels on IR channel positions, such as:, can be by the G pixels in G passages in the G pixel values on calculating IR passages Numerical value copy (copy) arrive IR passages position, the G pixel values on IR channel positions are obtained, in embodiments of the present invention to this It is not intended to be limited in any.
S320, by the IR pixel values in interpolation calculation RGBIR picture signals on each pixel position, to obtain Three picture signals.
In S320, interpolation calculation is carried out to RGBIR images, it is IR pictures to obtain on each pixel R, G, B, IR passage The picture signal of element value, i.e. the 3rd picture signal, it is as shown in Figure 6 to be referred to as IR full width figures.
S330, the first picture signal and the 3rd picture signal are subtracted each other to obtain the second picture signal.
In embodiments of the present invention, can by the Bayer picture signals for not removing IR components that will be obtained in S310, with The 3rd picture signal obtained in S320 steps is subtracted each other, i.e., removes the IR components in the first picture signal on each pixel position Fall, obtain the second picture signal, that is, remove the Bayer picture signals of IR components, as shown in Figure 6.
It should be noted that the signal to noise ratio of the Bayer picture signals of the removal IR components obtained in S330 is with respect in S310 The signal to noise ratio for the Bayer picture signals of IR components that what is obtained do not remove is low.
S340, Federated filter is carried out to the second picture signal according to the first picture signal.
In S340, according to the high Bayer picture signals for not removing IR components of signal to noise ratio and the Bayer for removing IR components The correlation of picture signal, processing is filtered to the Bayer picture signals for removing IR components, the output image after being handled Signal.
In embodiments of the present invention, during denoising, pre- dividing regions in picture signal that can be to having removed IR components The numerical value of each pixel is averaged in block, and the average value is substituted to the numerical value of each pixel in block, is exported Picture signal.
It should be noted that the picture signal after Federated filter can not be identified by user, it is necessary to pass through S350 processing, obtain the RGB image that user can identify.
S350, output image signal is handled to obtain RGB image by image-signal processor.
, it is necessary to pass through R, G in interpolation calculation output image signal on each pixel R, G and channel B in S350 With B pixel values, to obtain the 4th picture signal, wherein, R, G, B and IR passage of the 4th picture signal including each pixel are equal For the picture signal of R pixel values, R, G, B and IR passage of each pixel are the picture signal of G pixel values, and each picture R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values, as shown in Figure 6;Color correction is carried out to the 4th picture signal Matrix, camera lens shadow correction, AWB handle to obtain RGB image.4th picture signal is the image that human eye can not identify Signal by image-signal processor (Image Signal Processor, ISP), it is necessary to obtain the RGB that user can identify Image.
It is normal that the RGBIR picture signals that the RGBIR sensors handled by S310 to S350 obtain can obtain color RGB image.
In embodiments of the present invention, by S310 to S340 processing, the RGBIR that RGBIR sensors obtain can be schemed As signal is changed into traditional Bayer picture signals, it is easy to dock with traditional ISP in S350 so that traditional algorithm can weigh With reducing the cost of exploitation.
Fig. 7 is another method flow diagram for improving RGB image signal to noise ratio provided in an embodiment of the present invention.As shown in fig. 7, should The executive agent of method 400 can be the system shown in Fig. 3, and this method 400 can specifically include following steps:
S410, in the RGBIR picture signals received by interpolation calculation on each pixel in R, G, B, IR passage R pixel values, G pixel values and B pixel values to obtain the first picture signal
Specifically, the enterprising row interpolation of each pixel in the RGBIR picture signals obtained to RGBIR sensors, by interior The method of inserting calculate R pixel values, G pixel values and B pixel values in RGBIR picture signals on each pixel in R, G, B, IR passage with Obtain the first picture signal.R, G, B and IR passage obtained by interpolation method in RGBIR picture signals on each pixel is equal For the picture signal of R pixel values and IR pixel values, R, G, B and IR passage of each pixel are G pixel values and IR pixel values Picture signal, and each pixel R, G, B and IR passage be B pixel values and IR pixel values picture signal, or Each first picture signal for saying to obtain is with IR components Rs, G, B, IR full width figure, i.e. the first image, as shown in Figure 8 respectively.
S420, the IR components on each pixel position in the first picture signal are removed, RGB channel is corrected, obtains second Picture signal.
IR components in the first picture signal obtained in S410 steps on each pixel position are removed, can be passed through S320 and S330 process obtains the second picture signal in figure, is repeated no more herein for succinct description, as shown in Figure 8.
In embodiments of the present invention, method can be passed through by removing the IR components in the first image on each pixel position The method for the IR components on each pixel position of removal mentioned in 200, such as:Correction coefficient is determined according to the first image; IR components in first image on each pixel position are removed according to correction coefficient, and correct RGB channel, determine the second image Signal, as shown in figure 9, for succinct description, its detailed process will not be repeated here.
S430, Federated filter is carried out to the second picture signal according to the first picture signal and obtains output image signal.
The specific process can be carried out by being mentioned in method 200 according to the first picture signal to the second picture signal The processing mode of Federated filter is handled, and for succinct description, is repeated no more herein.
S440, output image is handled by ISP image-signal processors, obtains RGB.
In embodiments of the present invention, ISP needs to handle the unrecognizable output image signal of human eye, such as needs Obtained to carrying out the processing such as color correction matrix, camera lens shadow correction, AWB and mosaic to output image signal The RGB image that human eye can identify.
Specifically, S440 specific implementation can be according to the S250 in method 200 or the S350 in method 300 to the 4th image The processing mode of signal realizes that, for succinct description, its detailed process will not be repeated here.
Above in conjunction with Fig. 2 to Fig. 9, raising RGBIR sensor signal to noise ratio according to embodiments of the present invention is described in detail Method, below in conjunction with Figure 10, device according to embodiments of the present invention is described in detail.
Figure 10 is a kind of structural representation of device provided in an embodiment of the present invention.As shown in Figure 10, the device 500 can be with Including receiving unit 510, interpolating unit 520, remove component cells 530, filter unit 540 and image signal processing unit 550.
Receiving unit 510, for receiving the RGBIR picture signals of RGBIR sensors transmission.
Interpolating unit 520, for entering row interpolation to RGBIR images by interpolation method to obtain the first picture signal.
Remove component cells 530, for remove the infrared IR components in the first picture signal on each pixel position with Obtain the second picture signal.
Filter unit 540, after the first picture signal and the second picture signal are carried out into Federated filter to obtain filtering RGB image.
Image signal processing unit 550, for being handled output image signal to obtain RGB image.
Specifically, the interpolating unit 520 in device enters row interpolation by interpolation method to RGBIR images, implement in the present invention In example, interpolation method can use two-wire interpolation method.Such as row interpolation is entered to IR passages, the G pixels of IR passages are obtained, are obtained every The Bayer picture signals of IR components are carried on individual pixel position;Again by each picture in the Bayer picture signals with IR components IR components on vegetarian refreshments position remove, and correct RGB channel, obtain removing the Bayer picture signals of IR components;According to not removing The Bayer images of IR components carry out Federated filter, that is, the process in denoising to the Bayer images for removing IR components, obtain Output image signal, and by image-signal processor output image signal is handled to obtain the RGB image of normal color.
By the method for raising RGB image signal to noise ratio provided in an embodiment of the present invention, original RGBIR signal noise ratio (snr) of image is utilized The characteristics of high, during noise remove, using the correlation for the high signal-to-noise ratio image for not removing IR components to removing IR points The low signal-to-noise ratio (SNR) images of amount carry out Federated filter, realize the processing of the image to being obtained based on RGBIR sensors, improve most The signal to noise ratio of the RGB image obtained afterwards;Meanwhile also significantly improve the letter of the image obtained under low colour temperature or low-light (level) environment Make an uproar ratio.
Alternatively, it is specifically used for as another embodiment of the present invention, interpolating unit 520, is schemed by interpolation calculation RGBIR As the G pixels in signal on each pixel IR passages to obtain the first picture signal.
Alternatively, it is specifically used for as another embodiment of the present invention, interpolating unit 520,
Pass through the R pixel values in interpolation calculation RGBIR picture signals on each pixel in R, G, B, IR passage, G pictures Element value and B pixel values, to obtain the first picture signal;Wherein, R, G, B and IR including each pixel of the first picture signal lead to Road is the picture signal of R pixel values and IR pixel values, and R, G, B and IR passage of each pixel are G pixel values and IR pictures The picture signal of element value, and each R, G, B and IR passage of pixel are the picture signal of B pixel values and IR pixel values.
Alternatively, in embodiments of the present invention, component cells 530 are removed to be specifically used for, is schemed by interpolation calculation RGBIR As the IR pixel values in signal on each pixel position to obtain the 3rd image, the 3rd picture signal is each pixel R, G, B and IR passage are the picture signal of IR pixel values;First picture signal and the 3rd image subtraction are obtained into the second image Signal.
Wherein the second picture signal is the picture signal after removal IR components.
Alternatively, as in another embodiment of the present invention, filter unit 540 is specifically used for,
The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in the first picture signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around the first pixel;Determine in the second picture signal with first Second pixel corresponding to pixel and the second reference image vegetarian refreshments corresponding with the first reference image vegetarian refreshments;According to weight to the second figure As the second reference pixel point progress weighted average in signal, the pixel value of the second pixel is determined, is believed with obtaining output image Number.
Alternatively, in one embodiment, image signal processing unit 550 is specifically used for,
Output image signal is carried out in color correction matrix, camera lens shadow correction, AWB or mosaic processing At least one processing obtain export RGB image.
Alternatively, in another embodiment, image signal processing unit 550 is specifically used for,
By R, G and B pixel value in interpolation calculation output image signal on each pixel R, G and channel B, to obtain To the 4th picture signal;Color correction matrix, camera lens shadow correction, AWB are carried out to the 4th picture signal to handle to obtain The RGB image.
Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values, Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel It is the picture signal of B pixel values.
It should be noted that the unit in device 500 provided in an embodiment of the present invention can realize Fig. 4 to Fig. 6 institutes The method or step for the method 200 to 400 shown, for succinct description, will not be repeated here its detailed process.
The method that is described with reference to the embodiments described herein can use hardware, computing device the step of algorithm Software module, or the two combination are implemented.Software module can be placed in random access memory (RAM), internal memory, read-only storage (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technical field In any other form of storage medium well known to interior.
Above-described embodiment, the purpose of the present invention, technical scheme and beneficial effect are carried out further Describe in detail, should be understood that the embodiment that the foregoing is only the present invention, be not intended to limit the present invention Protection domain, within the spirit and principles of the invention, any modification, equivalent substitution and improvements done etc., all should include Within protection scope of the present invention.

Claims (19)

  1. A kind of 1. method for generating RGB image, it is characterised in that methods described includes:
    Receive the RGBIR picture signals that RGBIR sensors are sent;
    Row interpolation is entered to obtain the first picture signal to the RGBIR picture signals by interpolation method;
    The infrared IR components in described first image signal on each pixel position are removed to obtain the second picture signal;
    Described first image signal and second picture signal are subjected to Federated filter to obtain filtered RGB image.
  2. 2. according to the method for claim 1, it is characterised in that described that the RGBIR picture signals are entered by interpolation method Row interpolation to obtain the first picture signal, including:
    By the G pixel values in RGBIR picture signals described in interpolation calculation on each pixel IR passages, to obtain described One picture signal.
  3. 3. according to the method for claim 1, it is characterised in that described that the RGBIR picture signals are entered by interpolation method Row interpolation to obtain the first picture signal, including:
    Pass through the R pixel values in RGBIR picture signals described in interpolation calculation on each pixel in R, G, B, IR passage, G pictures Element value and B pixel values, to obtain described first image signal;
    Wherein, R, G, B and IR passage that described first image signal includes each pixel are R pixel values and IR pixel values Picture signal, R, G, B and IR passage of each pixel are the picture signal of G pixel values and IR pixel values, and each picture R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values and IR pixel values.
  4. 4. according to the method in claim 2 or 3, it is characterised in that each picture in the removal described first image signal Infrared IR components on vegetarian refreshments position to obtain the second picture signal, including:
    By the IR pixel values in RGBIR picture signals described in interpolation calculation on each pixel position to obtain the 3rd image Signal, the 3rd picture signal are that R, G, B and IR passage of each pixel are the picture signal of IR pixel values;
    Described first image signal and the 3rd picture signal are subtracted each other to obtain second picture signal.
  5. 5. according to the method for claim 4, it is characterised in that described by described first image signal and second image Signal carries out Federated filter to obtain filtered RGB image, including:
    The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in described first image signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around first pixel;
    Determine in second picture signal the second pixel corresponding with first pixel and with first reference image Second reference image vegetarian refreshments corresponding to vegetarian refreshments;
    Weighted average is carried out to the second reference pixel point in second picture signal according to the weight, it is determined that described The pixel value of second pixel, to obtain the filtered RGB image.
  6. 6. according to claims 1 to 3,5 any described methods, it is characterised in that the filtered RGB image is used to provide The RGB image for being handled to be exported to image-signal processor.
  7. 7. according to the method for claim 6, it is characterised in that described image signal processor is to the filtered RGB The RGB image that image is handled to be exported, including:
    Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to the filtered RGB image In at least one processing obtain the RGB image of the output.
  8. 8. according to the method for claim 6, it is characterised in that described image signal processor is to the filtered RGB The RGB image that image is handled to be exported, including:
    By R, G and B pixel value in filtered RGB image described in interpolation calculation on each pixel R, G and channel B, To obtain the 4th picture signal;
    Color correction matrix is carried out to the 4th picture signal, camera lens shadow correction, AWB handle to obtain it is described defeated The RGB image gone out;
    Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values, Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel It is the picture signal of B pixel values.
  9. 9. according to the method described in claims 1 to 3,5, any one of 7-8, it is characterised in that the interpolation method includes bilinearity Interpolation method.
  10. 10. a kind of device for generating RGB image, it is characterised in that described device includes:
    Receiving unit, for receiving the RGBIR picture signals of RGBIR sensors transmission;
    Interpolating unit, for entering row interpolation to the RGBIR picture signals by interpolation method to obtain the first picture signal;
    Component cells are removed, for removing the infrared IR components in described first image signal on each pixel position to obtain Second picture signal;
    Filter unit, after described first image signal and second picture signal are carried out into Federated filter to obtain filtering RGB image.
  11. 11. device according to claim 10, it is characterised in that the interpolating unit is specifically used for,
    Row interpolation is entered to obtain by the G pixels in RGBIR picture signals described in interpolation calculation on each pixel IR passages Described first image signal.
  12. 12. device according to claim 10, it is characterised in that the interpolating unit is specifically used for,
    Pass through the R pixel values in RGBIR picture signals described in interpolation calculation on each pixel in R, G, B, IR passage, G pictures Element value and B pixel values, to obtain described first image signal;
    Wherein, R, G, B and IR passage that described first image signal includes each pixel are R pixel values and IR pixel values Picture signal, R, G, B and IR passage of each pixel are the picture signal of G pixel values and IR pixel values, and each picture R, G, B and IR passage of vegetarian refreshments are the picture signal of B pixel values and IR pixel values.
  13. 13. the device according to claim 11 or 12, it is characterised in that the removal component cells are specifically used for,
    By the IR pixel values in RGBIR picture signals described in interpolation calculation on each pixel position, to obtain the 3rd figure As signal, the 3rd picture signal is that R, G, B and IR passage of each pixel are the picture signal of IR pixel values;
    Described first image signal and the 3rd picture signal are subtracted each other to obtain second picture signal.
  14. 14. device according to claim 13, it is characterised in that the filter unit is specifically used for,
    The first pixel and the distance of the first reference image vegetarian refreshments or the difference of pixel value in described first image signal Weight is determined, wherein, the first reference image vegetarian refreshments is the pixel around first pixel;
    Determine in second picture signal the second pixel corresponding with first pixel and with first reference image Second reference image vegetarian refreshments corresponding to vegetarian refreshments;
    Weighted average is carried out to the second reference pixel point in second picture signal according to the weight, it is determined that described The pixel value of second pixel, to obtain the filtered RGB image.
  15. 15. according to the device described in claim 10 to 12,14 any one, it is characterised in that the filtered RGB image is used In the RGB image for being supplied to image-signal processor to be handled to be exported.
  16. 16. device according to claim 15, it is characterised in that described image signal processor is specifically used for,
    Color correction matrix, camera lens shadow correction, AWB or mosaic processing are carried out to the filtered RGB image In at least one processing obtain the RGB image of the output.
  17. 17. device according to claim 15, it is characterised in that image-signal processor is specifically used for,
    By R, G and B pixel value in filtered RGB image described in interpolation calculation on each pixel R, G and channel B, To obtain the 4th picture signal;
    Color correction matrix is carried out to the 4th picture signal, camera lens shadow correction, AWB handle to obtain it is described defeated The RGB image gone out;
    Wherein, R, G, B and IR passage that the 4th picture signal includes each pixel are the picture signal of R pixel values, Each R, G, B and IR passage of pixel are the picture signal of G pixel values, and each R, G, B and IR passage of pixel It is the picture signal of B pixel values.
  18. 18. according to the device described in claim 10 to 12,14, any one of 16-17, it is characterised in that the interpolation method includes Bilinear interpolation method.
  19. 19. a kind of system for generating RGB image, it is characterised in that the system includes:
    RGBIR sensors, for receiving RGBIR picture signals;
    Memory, for store instruction and RGBIR picture signals;
    Processor, for calling the instruction in the memory, and perform following operate:
    Receive the RGBIR picture signals that RGBIR sensors are sent;
    Row interpolation is entered to obtain the first picture signal to the RGBIR picture signals by interpolation method;
    The infrared IR components in described first image signal on each pixel position are removed to obtain the second picture signal;
    Described first image signal and second picture signal are subjected to Federated filter to obtain filtered RGB image.
CN201610859097.0A 2016-09-28 2016-09-28 Generate the methods, devices and systems of RGB image Active CN106375740B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610859097.0A CN106375740B (en) 2016-09-28 2016-09-28 Generate the methods, devices and systems of RGB image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610859097.0A CN106375740B (en) 2016-09-28 2016-09-28 Generate the methods, devices and systems of RGB image

Publications (2)

Publication Number Publication Date
CN106375740A CN106375740A (en) 2017-02-01
CN106375740B true CN106375740B (en) 2018-02-06

Family

ID=57898131

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610859097.0A Active CN106375740B (en) 2016-09-28 2016-09-28 Generate the methods, devices and systems of RGB image

Country Status (1)

Country Link
CN (1) CN106375740B (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107590840B (en) * 2017-09-21 2019-12-27 长沙全度影像科技有限公司 Color shadow correction method based on grid division and correction system thereof
CN107731199B (en) * 2017-10-27 2020-12-29 努比亚技术有限公司 Screen color temperature adjusting method, terminal and computer readable storage medium
CN108965654B (en) * 2018-02-11 2020-12-25 浙江宇视科技有限公司 Double-spectrum camera system based on single sensor and image processing method
CN108391067B (en) * 2018-05-10 2023-09-29 浙江芯劢微电子股份有限公司 Denoising enhancement device and method based on RGB-IR sensor
CN109040720B (en) * 2018-07-24 2019-11-19 浙江大华技术股份有限公司 A kind of method and device generating RGB image
JP7306408B2 (en) * 2018-11-05 2023-07-11 ソニーグループ株式会社 Temperature estimation device, temperature estimation method and temperature estimation program
CN110490187B (en) * 2019-05-31 2022-04-15 杭州海康威视数字技术股份有限公司 License plate recognition device and method
CN112399163B (en) * 2019-08-19 2022-12-09 瑞昱半导体股份有限公司 Image sensing device and automatic white balance method
CN112887513B (en) * 2019-11-13 2022-08-30 杭州海康威视数字技术股份有限公司 Image noise reduction method and camera
CN113115010B (en) * 2020-01-11 2023-04-18 晋城三赢精密电子有限公司 Image format conversion method and device based on RGB-IR image sensor
CN113365034B (en) * 2020-03-04 2022-09-06 合肥君正科技有限公司 Color calibration method based on RGB-IR image sensor
CN113365035B (en) * 2020-03-04 2022-10-21 合肥君正科技有限公司 Calibration system for image color restoration
KR20220081532A (en) * 2020-12-09 2022-06-16 에스케이하이닉스 주식회사 Image signal processor and image processing system
CN113074627B (en) * 2021-03-12 2022-06-10 中国科学院生物物理研究所 Imaging method and device of direct electronic detection camera and computer equipment
CN117692615B (en) * 2024-02-01 2024-04-26 东北大学秦皇岛分校 RGB image communication method based on infrared wavelength

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102665030A (en) * 2012-05-14 2012-09-12 浙江大学 Improved bilinear Bayer format color interpolation method
CN102778201A (en) * 2011-05-13 2012-11-14 索尼公司 Image processing device, image processing method, and program
CN103686111A (en) * 2013-12-31 2014-03-26 上海富瀚微电子有限公司 Method and device for correcting color based on RGBIR (red, green and blue, infra red) image sensor
CN104639923A (en) * 2015-02-04 2015-05-20 华为技术有限公司 Method and device for processing image data, and terminal
WO2016002283A1 (en) * 2014-06-30 2016-01-07 ソニー株式会社 Image processing device, image pickup device, information processing device and program

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7821552B2 (en) * 2005-12-27 2010-10-26 Sanyo Electric Co., Ltd. Imaging apparatus provided with imaging device having sensitivity in visible and infrared regions
KR20130031572A (en) * 2011-09-21 2013-03-29 삼성전자주식회사 Image processing method and image processing apparatus
JP6231284B2 (en) * 2013-02-21 2017-11-15 クラリオン株式会社 Imaging device
US20140307055A1 (en) * 2013-04-15 2014-10-16 Microsoft Corporation Intensity-modulated light pattern for active stereo

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102778201A (en) * 2011-05-13 2012-11-14 索尼公司 Image processing device, image processing method, and program
CN102665030A (en) * 2012-05-14 2012-09-12 浙江大学 Improved bilinear Bayer format color interpolation method
CN103686111A (en) * 2013-12-31 2014-03-26 上海富瀚微电子有限公司 Method and device for correcting color based on RGBIR (red, green and blue, infra red) image sensor
WO2016002283A1 (en) * 2014-06-30 2016-01-07 ソニー株式会社 Image processing device, image pickup device, information processing device and program
CN104639923A (en) * 2015-02-04 2015-05-20 华为技术有限公司 Method and device for processing image data, and terminal

Also Published As

Publication number Publication date
CN106375740A (en) 2017-02-01

Similar Documents

Publication Publication Date Title
CN106375740B (en) Generate the methods, devices and systems of RGB image
CN106504281B (en) Image quality enhancing and filtering method applied to cmos image sensor
WO2017152402A1 (en) Image processing method and apparatus for terminal, and terminal
US10735700B2 (en) Universal and adaptive de-mosaicing (CFA) system
CN103327218B (en) image processing system and method
CN104995911B (en) Image processing device, image capture device, filter generating device, image restoration method, and program
CN101626454B (en) Method for intensifying video visibility
CN102256141A (en) Image processing device, image processing method, and imaging apparatus
KR20110048922A (en) Method of modeling integrated noise and method of reducing noises in image sensors
CN109040720B (en) A kind of method and device generating RGB image
WO2008121280A2 (en) Edge mapping using panchromatic pixels
EP2436187A1 (en) Four-channel color filter array pattern
EP2130175A2 (en) Edge mapping incorporating panchromatic pixels
CN107454285A (en) Image noise estimation method and device and image extraction device
JP2008113222A (en) Image processing apparatus, imaging apparatus, image processing method in these apparatuses, and program allowing computer to execute the method
CN108122201A (en) A kind of Bayer interpolation slide fastener effect minimizing technology
WO2023016146A1 (en) Image sensor, image collection apparatus, image processing method, and image processor
CN105141838A (en) Demosaicing method and device using demosaicing method
CN110430403B (en) Image processing method and device
CN106791734A (en) The method of device, electronic installation and IMAQ for IMAQ
CN107786857B (en) A kind of image restoring method and device
CN107277369B (en) Image processing method, device, computer readable storage medium and computer equipment
CN117274060A (en) Unsupervised end-to-end demosaicing method and system
CN116503259B (en) Mosaic interpolation method and system
CN111968039A (en) Day and night universal image processing method, device and equipment based on silicon sensor camera

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant