CN105635532B - imaging method, image sensor, imaging device and electronic device - Google Patents
imaging method, image sensor, imaging device and electronic device Download PDFInfo
- Publication number
- CN105635532B CN105635532B CN201510963410.0A CN201510963410A CN105635532B CN 105635532 B CN105635532 B CN 105635532B CN 201510963410 A CN201510963410 A CN 201510963410A CN 105635532 B CN105635532 B CN 105635532B
- Authority
- CN
- China
- Prior art keywords
- pixel
- photosensitive pixel
- filtering area
- photosensitive
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
Abstract
The invention discloses an imaging method. The imaging method comprises: firstly, providing an image sensor, wherein the image sensor comprises a photosensitive pixel array, a filter arranged on the photosensitive pixel array, and a control module, the filter comprises a filtering unit array, each filtering unit comprises a color filtering area and an infrared filtering area, each of the color filtering areas and the infrared filtering areas covers at least one photosensitive pixel, the control module is used for controlling a first exposed time of the photosensitive pixel covered by the corresponding color filtering area and a second exposed time of the photosensitive pixel covered by the corresponding infrared filtering area, and the second time is longer than the first time; and then, reading output of the photosensitive pixel array, and calculating pixel values of a composite image according to the photosensitive pixels covered by the color filtering areas and the photosensitive pixels covered by the infrared filtering areas so as to generate the composite image, wherein the composite image comprises complete color information and is high in signal to noise ratio. The invention further discloses the image sensor, an imaging device and an electronic device which are used for realizing the imaging method.
Description
Technical field
The present invention relates to imaging technique, more particularly to a kind of imaging method, imageing sensor, imaging device and electronics dress
Put.
Background technology
Existing RGB image sensor effect of being taken pictures under low-light (level) is poor, fuzzy, or even claps less than scenery.Some images
Infrared filtering pixel is embedded in sensor to provide imaging effect, but when bright and clear, into imageing sensor infrared ray meeting
Influence imaging effect, makes image that colour cast etc. to occur.
The content of the invention
It is contemplated that at least solving one of technical problem present in prior art.Therefore, the present invention needs offer one
Plant imaging method, imageing sensor, imaging device and electronic installation.
The imaging method of embodiment of the present invention is comprised the following steps：
Imageing sensor is provided, described image sensor includes photosensitive pixel array, is arranged at the photosensitive pixel array
On optical filter and control module, the optical filter include filter unit array, the filter unit include colorized optical filtering area and
Infrared filtering area, the colorized optical filtering area and the infrared filtering area are covered each by photosensitive pixel described at least one, the control
Molding block is used for the very first time of the photosensitive pixel exposure for controlling the colorized optical filtering area covering and the infrared fileter
Second time of the photosensitive pixel exposure of covering, second time is more than the very first time；And
The output of reading photosensitive pixel array, the output of the photosensitive pixel covered according to the colorized optical filtering area and institute
The output for stating the photosensitive pixel of infrared fileter covering calculates the pixel value of composograph to generate the composograph.
In the imaging method of embodiment of the present invention, the colorized optical filtering area of filter unit is used to obtain and synthesizes on optical filter
The color information of the pixel of image, infrared filtering area be used under low-light (level) obtain composograph pixel monochrome information and this
Monochrome information noise is less.Pixel of the pixel value of composograph according to the image of photosensitive pixel output generation.In this way, composite diagram
The pixel value of picture had not only included color information but also the monochrome information comprising low noise degree.Additionally, control module is used to control extension infrared
The time for exposure of the photosensitive pixel of filter area covering, the light-inletting quantity in infrared filtering area can so be compensated, lift its covering
Photosensitive pixel photosensitive and output intensity, be conducive to lifting the brightness of composograph, contrast and definition.Solve existing
Some of imaging method problem.
The present invention also provides a kind of imageing sensor that can be used to realize imaging method in above-mentioned implementation method, and it includes：
Photosensitive pixel array；
It is arranged at the optical filter on the photosensitive pixel array；And
Control module；
The optical filter includes filter unit array, and each described filter unit includes colorized optical filtering area and infrared filtering
Area；The colorized optical filtering area and the infrared filtering area are covered each by photosensitive pixel described at least one, and the control module is used
The very first time and the institute of infrared fileter covering in the photosensitive pixel exposure for controlling the colorized optical filtering area covering
The second time of photosensitive pixel exposure is stated, second time is more than the very first time.
The present invention a kind of imaging device including imageing sensor in embodiment of the present invention is also provided, it include with it is described
The image processing module of imageing sensor connection；
Described image processing module is used for the output of the photosensitive pixel covered according to the colorized optical filtering area and described
The output of the photosensitive pixel of infrared filtering area covering calculates the pixel value of composograph to generate the composograph.
The present invention also provides a kind of electronic installation including imaging device in embodiment of the present invention.
Additional aspect of the invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by practice of the invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from description of the accompanying drawings below to implementation method is combined
Obtain substantially and be readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet of the imaging method of embodiment of the present invention.
Fig. 2 is the schematic flow sheet of the read step of embodiment of the present invention imaging method.
Fig. 3 is the schematic flow sheet of the read step of embodiment of the present invention imaging method.
Fig. 4 is the schematic flow sheet of the read step of embodiment of the present invention imaging method.
Fig. 5 is the schematic flow sheet of the read step of embodiment of the present invention imaging method.
Fig. 6 is the schematic flow sheet of the read step of embodiment of the present invention imaging method.
Fig. 7 is the schematic flow sheet of the read step of embodiment of the present invention imaging method.
Fig. 8 is the schematic flow sheet of the read step of embodiment of the present invention imaging method.
Fig. 9 is the schematic side view of the imageing sensor of embodiment of the present invention.
Figure 10 is the filter unit schematic diagram of the imageing sensor of embodiment of the present invention.
Figure 11 is the filter unit array schematic diagram of Bayer structure.
Figure 12 is the filter unit array schematic diagram of the imageing sensor of embodiment of the present invention.
Figure 13 is the dimensional structure diagram of the imageing sensor of embodiment of the present invention.
Figure 14 is the corresponding relation schematic diagram of the filter unit array with composograph of embodiment of the present invention.
Figure 15 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 16 is the electrical block diagram of the photosensitive pixel of embodiment of the present invention imageing sensor.
Figure 17 is the dimensional structure diagram of the imageing sensor of embodiment of the present invention.
Figure 18 is the schematic side view of the imaging device of embodiment of the present invention.
Figure 19 is another corresponding relation schematic diagram of the filter unit array with composograph of embodiment of the present invention.
Figure 20 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 21 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Specific embodiment
The implementation method of embodiments of the present invention is described below in detail, the example of the implementation method is shown in the accompanying drawings
Go out, wherein same or similar label represents same or similar element or the unit with same or like function from start to finish
Part.Implementation method below with reference to Description of Drawings is exemplary, is only used for explaining embodiments of the present invention, and can not
It is interpreted as the limitation to embodiments of the present invention.
Below in conjunction with accompanying drawing to the imaging method of embodiments of the present invention, imageing sensor, imaging device and electronics dress
Put and be described further.
Fig. 1 is referred to, the imaging method of embodiment of the present invention is comprised the following steps：
S1, there is provided imageing sensor, imageing sensor includes photosensitive pixel array, the filter being arranged on photosensitive pixel array
Mating plate and control module, optical filter include filter unit array, and filter unit includes colorized optical filtering area and infrared filtering area, colored
Filter area and infrared filtering area are covered each by least one photosensitive pixel, and control module is used for the sense for controlling colorized optical filtering area to cover
The very first time of light pixel exposure and the second time of the photosensitive pixel exposure of infrared fileter covering, the second time was more than first
Time.
S2, reads the output of photosensitive pixel array, and the photosensitive pixel according to the covering of colorized optical filtering area and infrared filtering area
The output of the photosensitive pixel of covering calculates the pixel value of composograph to generate composograph.
In the imaging method of embodiment of the present invention, the colorized optical filtering area of filter unit is used to obtain and synthesizes on optical filter
The color information of the pixel of image, infrared filtering area be used under low-light (level) obtain composograph pixel monochrome information and this
Monochrome information noise is less.Pixel of the pixel value of composograph according to the image of photosensitive pixel output generation.In this way, composite diagram
The pixel value of picture had not only included the monochrome information of low noise degree again comprising color information, and the color of composograph is completely true to nature, brightness and
Definition is preferable, and noise is few.
In the imaging method of embodiment of the present invention, imageing sensor includes control module to control to extend infrared filtering
The time for exposure of the photosensitive pixel of area's covering, the light-inletting quantity in infrared filtering area can so be compensated, lift the sense of its covering
The photosensitive and output intensity of light pixel, is conducive to being lifted brightness, contrast and the definition of composograph.
Please join Figure 13, in the present embodiment, each filter unit covers 2*2 photosensitive pixel.Colorized optical filtering area covers
Three photosensitive pixels, infrared filtering area covers a photosensitive pixel.
So, the color information of the composograph of generation is more complete and definition is high.
Please join Figure 14, in the present embodiment, each photosensitive pixel 111 and a pixel for composograph 300 301 pairs
Should.
For example, the image of the photosensitive pixel array correspondence generation 16M resolution ratio of 16M resolution ratio.So, infrared image element is embedding
Enter not influence the resolution ratio of composograph.
Please join Fig. 2, in the imaging method of present embodiment, step S2 is further included：
S21, the output of the photosensitive pixel covered according to the colorized optical filtering area in same filter unit obtains infrared filtering area
The corresponding color pixel values of photosensitive pixel of covering.
Wherein, color pixel values and the corresponding infrared image element value of photosensitive pixel of infrared filtering area covering can be used to calculate right
The pixel value of the composograph answered.
Please join Fig. 3, preferably, in the imaging method of present embodiment, step S21 is further included：
S211, calculate the photosensitive pixel of colorized optical filtering area covering in same filter unit output average value as
The corresponding color pixel values of photosensitive pixel of infrared filtering area covering.
In the present embodiment, the output of the photosensitive pixel of colorized optical filtering area covering includes color pixel values, infrared filtering
The output of the photosensitive pixel of area's covering includes infrared image element value.Please join Fig. 4, step S2 is further included：
S22, senses and judges ambient brightness.
S23, when ambient brightness is more than the first predetermined threshold, color pixel values is subtracted corresponding infrared image element value to obtain
To the pixel value of corresponding composograph.
Please join Fig. 5, in some embodiments, step S2 is further included：
S25, senses and judges ambient brightness.
S27, when ambient brightness is less than the second predetermined threshold, color pixel values is added corresponding infrared image element value to obtain
To the pixel value of corresponding composograph.
Please join Fig. 6, in some embodiments, step S2 is further included：
S29, senses and judges ambient brightness.
S31, when ambient brightness is more than first threshold when being less than the second predetermined threshold, using color pixel values as corresponding
The pixel value of composograph.
Can be using the pixel value of photosensitive pixel as the foundation for judging ambient brightness, for example, all color pixel values are asked into flat
Average is used as ambient brightness value.
By sensing and ambient brightness is judged, to carry out appropriate treatment to color pixel values.Such as during daytime extraneous scape
The infrared ray of thing radiation can influence image quality, and color pixel values can be allowed to cut its infrared ray luminance components.Night brightness value compared with
When low, compensate to lift brightness of image and signal to noise ratio using infrared image element value.When the brightness values such as dusk are moderate, by coloured silk
Color pixel value as composograph pixel value.
Please join Fig. 7, in some embodiments, step S2 is further included：
S33, the output of the photosensitive pixel that colorized optical filtering area is covered is added to obtain merging pixel value.
S35, the pixel of composograph is calculated according to the output for merging the photosensitive pixel that pixel value and infrared filtering area cover
Value.
In this way, the photosensitive pixel that colorized optical filtering area is covered merges, further according to merging pixel value and the covering of infrared filtering area
Photosensitive pixel output calculate composograph composograph pixel value.
In some embodiments, each photosensitive pixel is connected with an analog-digital converter respectively；
Please join Fig. 8, step S2 is further included：
S37, is converted to the analog signal output that photosensitive pixel is produced data signal and exports and be stored in register.
S39, extracts data signal output to calculate the pixel value of composograph from register.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor)
Processing module can directly process the output of imageing sensor, and two, relative to some by circuit directly to imageing sensor
Analog signal format the scheme that is processed of output for, preferably remain the information of image.
The present invention also provides a kind of imageing sensor, the imaging method for realizing invention embodiment.
Fig. 9 and Figure 10 is referred to, the imageing sensor 10 of embodiment of the present invention includes photosensitive pixel array 11, is arranged at
Optical filter 13 and control module 17 on photosensitive pixel array 11.Optical filter 13 includes filter unit array 131, and each filters single
Unit 1311 includes colorized optical filtering area 1315 and infrared filtering area 1313.Colorized optical filtering area 1315 covers at least one photosensitive pixel
111, infrared filtering area 1313 is used to pass through only the IR of preset wavelength.Preset wavelength can be 750-850nm.It is outside
Light is irradiated to the photosensitive part 1111 of photosensitive pixel 111 to produce electric signal by optical filter 13, i.e., photosensitive pixel 111 is defeated
Go out.
Control module 17 is used for very first time and infrared of the exposure of photosensitive pixel 111 for controlling colorized optical filtering area 1315 to cover
Second time of the exposure of photosensitive pixel 111 of the covering of optical filter 1315, the second time was more than the very first time.
The colorized optical filtering area 1315 of filter unit 1311 is used for the color letter of the pixel for obtaining composograph on optical filter 13
Breath, infrared filtering area 1313 be used under low-light (level) obtain composograph pixel monochrome information and this monochrome information noise compared with
It is few.The pixel of the composograph that the pixel value of composograph is exported according to photosensitive pixel 111.In this way, the pixel value of composograph
Not only included the monochrome information of low noise degree again comprising color information, the color of composograph is completely true to nature, brightness and definition compared with
Good, noise is few.
Additionally, imageing sensor 10 includes control module 17 to control to extend the photosensitive pixel that infrared filtering area 1313 covers
111 time for exposure, the light-inletting quantity in infrared filtering area 1313 can so be compensated, lift the sense of the photosensitive pixel of its covering
Light and output intensity, and the pixel value of composograph includes the corresponding photosensitive output composition in infrared filtering area, therefore, to infrared absorption filter
Light area 1313 is exposed brightness, contrast and the definition that compensation is conducive to further being lifted composograph.
Figure 11 is referred to, in the present embodiment, colorized optical filtering area 1315 forms Bayer array (Bayer pattern).
Bayer array includes filtering structure 1317, and each filtering structure 1317 includes 2*2 filter unit 1311, respectively
It is green, red, blue, green filter unit 1311.
Picture signal can be processed to the algorithm of Bayer structure using conventional needle using Bayer structure, without hardware
Big adjustment is done in structure.
In traditional filter unit array structure, the pixel of each filter unit correspondence multiple photosensitive pixel and image.
Figure 12 is referred to, in the present embodiment, filter unit array 131 uses Bayer structure, including filtering structure
1317, each filtering structure 1317 includes green, red, blue, green filter unit 1311, each correspondence of filter unit 1311
Multiple photosensitive pixels 111.Each filter unit 1311 includes colorized optical filtering area 1315 and infrared filtering area 1313.
Figure 13 and Figure 12 is referred to, in the present embodiment, each filter unit 1311 covers 2*2 photosensitive pixel 111,
Colorized optical filtering area 1315 and infrared filtering area 1313 are covered each by three and a photosensitive pixel 111.
So, the color information of the composograph of generation is more complete.It is color in other embodiment outside present embodiment
The photosensitive pixel of color filter area covering can be two, one, and the photosensitive pixel of corresponding infrared filtering area covering is two, three
It is individual, but, when colorized optical filtering area covering photosensitive pixel is less, the pixel of more composograph is just had by other composite diagrams
The calculated for pixel values of picture is obtained, rather than is obtained by the output of its corresponding photosensitive pixel, and the color of composograph can be influenceed complete
Property and definition.
Please join Figure 14, in the present embodiment, each photosensitive pixel 111 and a pixel for composograph 300 301 pairs
Should.
For example, the image of the photosensitive pixel array correspondence generation 16M resolution ratio of 16M resolution ratio.So, infrared image element is embedding
Enter not influence the resolution ratio of composograph.
Please join Figure 15 and 16, in the present embodiment, control module 17 may include that the row selection being connected with photosensitive pixel is patrolled
Unit 171 and column selection logic unit 173 are collected, row selection logic unit 171 and column selection logic unit 173 are used for according to first
Time or the second time control photosensitive pixel are exported.
Row selection logic unit 171 represents row coordinate, and column selection logic unit 173 represents row coordinate, and control module 17 can
According to the very first time or the second time, the photosensitive pixel of preset position coordinates is controlled to expose and export, to realize controlling infrared absorption filter
The photosensitive pixel delay exposure output of light area covering.
Specifically, in the present embodiment, photosensitive pixel may include the switching tube 1115 for controlling photosensitive pixel to export,
Row selection logic unit 171 and column selection logic unit 173 are connected with switching tube 1115.
Switching tube 1115 can be FET etc., can be according to row selection logic unit 171 and column selection logic unit 173
Electric signal be turned on or off so that control photosensitive pixel export or stop output.
Further, photosensitive pixel 111 includes photodiode 1113.Photodiode 1113 is used to be converted into illumination
Electric charge, and the electric charge relation proportional to intensity of illumination for producing.Switching tube 1115 is used for according to row selection logic unit 171 and row
The control signal of logic unit 173 is selected to control the conducting and disconnection of circuit, when circuit turn-on, source follower 1117
(source follower) is used to for photodiode 1113 to be converted into voltage signal through the charge signal that illumination is produced.Modulus
Converter 211 (Analog-to-digital converter) is used to for voltage signal to be converted to data signal, to transmit to rear
Continuous processing of circuit.
This output processing mode makes the output of photosensitive pixel be converted into data signal, in following digital circuit or in chip
It is middle to be processed with software.Therefore the output information of each photosensitive pixel, including color pixel values and infrared image element value can
It is retained.Please join Figure 15, in some embodiments, imageing sensor 10 may include analog-digital converter array 21, each modulus
Converter is connected with a photosensitive pixel, and analog-digital converter is used to for the analog signal output that photosensitive pixel is produced to be converted to numeral
Signal.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor)
Processing module can directly process the output of imageing sensor, and two, relative to some by circuit directly to imageing sensor
Analog signal format the scheme that is processed of output for, preferably remain the information of image, for example the present invention is implemented
The imaging method of mode can be by color pixel values and infrared image element value generation composograph, it is also possible to retain color pixel values
Information and infrared image element value information.
Figure 17 is referred to, in some embodiments, imageing sensor 10 includes the micro mirror battle array being arranged on optical filter 13
Row 23, each micro mirror 231 is corresponding with a photosensitive pixel 111.
Specifically, each micro mirror 231 is corresponding with a photosensitive pixel 111, including size, position correspondence.In some implementations
In mode, each filter unit 1311 correspondence 2*2 photosensitive pixel 111 and 2*2 micro mirror 191.It is terrible as technology develops
To resolution ratio image higher, the photosensitive pixel 111 on sensitive film is more and more, arranges more and more intensive, single photosensitive pixel
111 is also less and less, and its light is affected, and the area of photosensitive part 1111 of photosensitive pixel 111 is limited, micro mirror 191
Light can be gathered photosensitive part 1111, so as to lift the light reception intensity of photosensitive pixel 111 to improve image quality.
The present invention also provides a kind of imaging device of the imageing sensor including embodiment of the present invention.
Please join Figure 18 and Figure 12, the imaging device 100 of embodiment of the present invention also includes what is be connected with imageing sensor 10
Image processing module 50.Image processing module 50 be used for according to colorized optical filtering area 1315 cover photosensitive pixel 111 output and
The output of the photosensitive pixel 111 of the covering of infrared filtering area 1313 calculates the pixel value of composograph to generate composograph.
In the present embodiment, image processing module 50 is used for according to the colorized optical filtering area in same filter unit 1311
The output of 1315 corresponding photosensitive pixels 111 obtains the corresponding colour element of photosensitive pixel 111 of the covering of infrared filtering area 1313
Value.
Additionally, the output of the corresponding photosensitive pixel 111 in infrared filtering area 1313 can correspond to generation infrared image element value.Color images
Plain value and infrared image element value are used to calculate the pixel value for forming composograph to generate composograph 300.
Specifically, image processing module can be by the corresponding light-sensitive image in colorized optical filtering area 1315 in same filter unit 1311
The output of element 111 calculates the corresponding color pixel values of photosensitive pixel 111 that average value is covered as infrared filtering area 1313.
For example, the photosensitive output of photosensitive pixel 111 of the covering of colorized optical filtering area 1315 is respectively G1, G2, G3, then infrared absorption filter
The corresponding color pixel values of photosensitive pixel 111 of the covering of light area 1313 are (G1+G2+G3)/3.It can be appreciated that so, can be preferably
Simulation reduces the color information that the pixel 301 of the composograph 300 corresponding to infrared filter area 1313 is lacked originally.
In some embodiments, the output correspondence color pixel values of the photosensitive pixel of colorized optical filtering area covering, infrared absorption filter
The output correspondence infrared image element value of the photosensitive pixel of light area covering.
Image processing module is used to judge ambient brightness according to the pixel value of photosensitive pixel, and according to ambient brightness to colour
Pixel value and infrared image element value are processed accordingly.For example, when ambient brightness is more than the first predetermined threshold, by colour element
Value subtracts corresponding infrared image element value to obtain the pixel value of composograph.
Further, in some embodiments, image processing module is used to be less than the second predetermined threshold in ambient brightness
When, color pixel values are added corresponding infrared image element value to obtain the pixel value of composograph.
Or, in some embodiments, it is pre- that image processing module is less than second in ambient brightness more than first threshold
When determining threshold value using color pixel values as corresponding composograph pixel value.
Wherein, can be using the pixel value of photosensitive pixel as the foundation for judging ambient brightness, for example, by all color pixel values
Average and be used as ambient brightness value.
In the above-described embodiment, imaging device 100 passes through to sense and judge ambient brightness, to be carried out to color pixel values
Appropriate treatment.For example during daytime the infrared ray of external scene radiation can influence image quality, and color pixel values can be allowed to cut it
Infrared ray luminance components.When night brightness value is relatively low, compensate to lift brightness of image and noise using infrared image element value
Than.At dusk etc. brightness value it is moderate when, using color pixel values as composograph pixel value.
In addition to above-mentioned three kinds of processing modes, under can also be varying environment brightness in some embodiments, infrared image element
Value is multiplied by a proportionality coefficient relevant with ambient brightness, and the value for obtaining is added with color pixel values again, so as to obtain composite diagram
The pixel value of picture, generates composograph.So, make imaging device 100 stronger to the adaptability of ambient brightness.
In some embodiments, color pixel values and the corresponding photosensitive pixel of infrared image element value and same filter unit pair
Should.
The implementation method that color pixel values and infrared image element are processed is processed according to ambient brightness with reference to above-mentioned, reason of being not difficult
Solution, the color pixel values and infrared image element value of the computing that add deduct correspond to same filter unit.For example, Figure 12 please be join, it is color
The color pixel values of the corresponding photosensitive pixel 111 of color filter area 1315 are respectively G1, G2, G3, it is assumed that in low-light (level) environment, its is right
The pixel value of the composograph answered respectively G1+IR, G2+IR, G3+IR.Wherein IR is that infrared filtering area 1313 is corresponding photosensitive
The infrared image element value of pixel 111.
The pixel value of the corresponding composograph of photosensitive pixel 111 of the covering of infrared filtering area 1313 can first by G1, and G2, G3 is asked
Averagely as its colored value part, along with IR, i.e. final result are：
(G1+G2+G3)/3+IR
The benefit thus nearby managed is to greatest extent to reduce the color distortion or clear produced in image synthesizing procedure
Degree declines.
Please join Figure 19, in some embodiments, image processing module is photosensitive for cover colorized optical filtering area 1315
The output of pixel 111 is added to obtain merging pixel value, and for corresponding according to merging pixel value and infrared filtering area 1313
The output of photosensitive pixel 111 calculates the pixel value of composograph.
In this way, the output of many photosensitive pixels is added, the pixel signal to noise ratio of the composograph of formation is higher.For example it is assumed that
Original each photosensitive pixel 111 is output as S, and noise is N, and the pixel 401 of composograph 400 includes m photosensitive pixel, then closes
Pixel value into the pixel 401 of image 400 is m*S, and the noise of the pixel 401 of composograph 400 isM is big
In the natural number equal to 1.It is appreciated that in m>In the case of 1, each is photosensitive before the noise of the pixel of composograph is less than merging
The noise sum of pixel output.And each photosensitive pixel exports sum before the pixel 401 of composograph 400 is output as merging, because
This color composite image 400 generated after merging, compared with the coloured image generated with single pixel in traditional approach, noise declines
Signal to noise ratio is improved, definition lifting.
To sum up, each filter unit bag colorized optical filtering area of the imaging device in embodiment of the present invention and infrared filtering
Area, colorized optical filtering area is used to obtain colour information, and infrared filtering area is used to be obtained under low-light (level) the bright of the pixel of composograph
Degree information and this monochrome information noise is less.Particularly, the light-inletting quantity in infrared filtering area can be compensated by spectrum assignment,
For example by lengthen infrared filtering area cover photosensitive pixel time for exposure.So the pixel value of the composograph for obtaining both was wrapped
The monochrome information of low noise degree is included again containing color information, to generate the composograph that color is complete, contrast is high and signal to noise ratio is high.
Additionally, the imaging device of embodiment of the present invention can also be by sensing and judging ambient brightness with different rings
The color pixel values of colorized optical filtering area correspondence generation and the infrared image element value of infrared filtering area correspondence generation are carried out under the brightness of border
The appropriate calculating treatment image high to obtain true color definition.
The present invention also provides a kind of electronic installation of application imaging device 100.In some embodiments, electronic installation bag
Include imaging device 100.Therefore, electronic installation has camera function and completely true to nature, the signal to noise ratio that can generate color under low-light (level)
Height, definition composograph high.
The electronic installation can be mobile phone.
In the present embodiment, imaging device 100 can be the Front camera of mobile phone.Because Front camera is used for certainly
Clap, and autodyne it is general require to require the definition of image and not high to image resolution requirement, using present embodiment
Electronic installation can meet this requirement.
Figure 20 is referred to, in some embodiments, electronic installation 200 includes the centre being connected with imaging device 100
Reason device 81 and external memory 83, central processing unit 81 are used to control external memory 83 to store composograph.
So, the composograph of generation can be stored, it is convenient after check, using or transfer.External memory 83 includes
SM (Smart Media) blocks and CF (Compact Flash) blocks etc..
Figure 21 is referred to, in some embodiments, electronic installation 200 also includes the center being connected with imaging device 100
Processor 81 and display device 85, central processing unit 81 are used to control display device 85 to show composograph.So, electronic installation
200 images for shooting can be shown in display device so that user checks.Display device is including light-emitting diode display etc..
To sum up, using the electronic installation of embodiment of the present invention, with camera function and color can be generated under low-light (level)
Complete true to nature, signal to noise ratio is high, definition composograph high.When Front camera of this electronic installation for mobile phone, can be lifted low
The brightness of auto heterodyne image, contrast and definition under illumination.
Part not deployed in imaging method and electronic installation in embodiment of the present invention, can join embodiment of above into
As the corresponding part of device 100, no longer it is developed in details herein.
In the description of this specification, reference term " implementation method ", " some implementation methods ", " schematically implementation
The description of mode ", " example ", " specific example " or " some examples " etc. means to combine the tool that the implementation method or example are described
Body characteristicses, structure, material or feature are contained at least one implementation method of the invention or example.In this manual,
Schematic representation to above-mentioned term is not necessarily referring to identical implementation method or example.And, the specific features of description, knot
Structure, material or feature can in an appropriate manner be combined in one or more any implementation methods or example.
Any process described otherwise above or method description in flow chart or herein is construed as, and expression includes
It is one or more for realizing specific logical function or process the step of the module of code of executable instruction, fragment or portion
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussion suitable
Sequence, including function involved by basis by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Represent in flow charts or logic and/or step described otherwise above herein, for example, being considered use
In the order list of the executable instruction for realizing logic function, in may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or with reference to these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
The dress that defeated program is used for instruction execution system, device or equipment or with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：With the electricity that one or more are connected up
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can thereon print described program or other are suitable
Medium, because optical scanner for example can be carried out by paper or other media, then enters edlin, interpretation or if necessary with it
His suitable method is processed electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In implementation method, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If for example, realized with hardware, and in another embodiment, can be with well known in the art
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried
The rapid hardware that can be by program to instruct correlation is completed, and described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
Additionally, during each functional unit in each embodiment of the invention can be integrated in a processing module, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, it would however also be possible to employ the form of software function module is realized.The integrated module is such as
Fruit is to realize in the form of software function module and as independent production marketing or when using, it is also possible to which storage is in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (28)
1. a kind of imaging method, it is characterised in that comprise the following steps：
Imageing sensor is provided, described image sensor includes photosensitive pixel array, is arranged on the photosensitive pixel array
Optical filter and control module, the optical filter include filter unit array, and the filter unit includes colorized optical filtering area and infrared
Filter area, the colorized optical filtering area and the infrared filtering area are covered each by photosensitive pixel described at least one, the control mould
Block is used for the very first time of the photosensitive pixel exposure for controlling the colorized optical filtering area covering and the infrared fileter is covered
The photosensitive pixel exposure the second time, second time be more than the very first time；And
The output of photosensitive pixel array is read, the output of the photosensitive pixel that is covered according to the colorized optical filtering area and described red
The output of the photosensitive pixel of outer optical filter covering calculates the pixel value of composograph to generate the composograph；
Each described photosensitive pixel is corresponding with the pixel of a composograph, and the read step is further included：
The output of the photosensitive pixel covered according to the colorized optical filtering area in the same filter unit obtains described red
The color pixel values of the photosensitive pixel of outer filter area covering.
2. imaging method as claimed in claim 1, it is characterised in that each described filter unit covering 2*2 is described photosensitive
Pixel；The colorized optical filtering area covers three photosensitive pixels；The infrared filtering area covers a photosensitive pixel.
3. imaging method as claimed in claim 1, it is characterised in that the color pixel values calculation procedure is further included：
Calculate the average value of output of the photosensitive pixel that the colorized optical filtering area in the same filter unit covers simultaneously
The color pixel values of the photosensitive pixel covered as the infrared filtering area.
4. imaging method as claimed in claim 1, it is characterised in that the photosensitive pixel of the colorized optical filtering area covering
Output includes color pixel values；The output of the photosensitive pixel of the infrared filtering area covering includes infrared image element value；
The read step is further included：
Sense and judge ambient brightness；And
When the ambient brightness is more than the first predetermined threshold, the color pixel values are subtracted into the corresponding infrared image element value
To obtain the pixel value of the corresponding composograph.
5. imaging method as claimed in claim 1, it is characterised in that the photosensitive pixel of the colorized optical filtering area covering
Output includes color pixel values；The output of the photosensitive pixel of the infrared filtering area covering includes infrared image element value；
The read step is further included：
Sense and judge ambient brightness；And
When the ambient brightness is less than the second predetermined threshold, the color pixel values are added into the corresponding infrared image element value
To obtain the pixel value of the corresponding composograph.
6. imaging method as claimed in claim 1, it is characterised in that the photosensitive pixel of the colorized optical filtering area covering
Output includes color pixel values；The output of the photosensitive pixel of the infrared filtering area covering includes infrared image element value；
The read step is further included：
Sense and judge ambient brightness；And
When the ambient brightness is more than first threshold when being less than the second predetermined threshold, using the color pixel values as corresponding
The pixel value of the composograph.
7. imaging method as claimed in claim 1, it is characterised in that the read step is further included：
The output of the photosensitive pixel that the colorized optical filtering area is covered is added to obtain merging pixel value；And
The output of the photosensitive pixel covered according to the merging pixel value and the infrared filtering area calculates the composite diagram
The pixel value of picture.
8. the imaging method as described in claim 1-7 any one, it is characterised in that each described photosensitive pixel is respectively with
Individual analog-digital converter connection；
The read step is further included：
The analog signal output that the photosensitive pixel is produced is converted into data signal to export and be stored in register；And
Extract the data signal output to calculate the pixel value of the composograph from the register.
9. a kind of imaging device, it is characterised in that including imageing sensor；Described image sensor includes：
Photosensitive pixel array；
It is arranged at the optical filter on the photosensitive pixel array；And
Control module, the optical filter includes filter unit array, and each described filter unit includes colorized optical filtering area and infrared
Filter area；The colorized optical filtering area and the infrared filtering area are covered each by photosensitive pixel described at least one, the control mould
Block is used for the very first time of the photosensitive pixel exposure for controlling the colorized optical filtering area covering and the infrared fileter is covered
The photosensitive pixel exposure the second time, second time be more than the very first time；
The imaging device also includes the image processing module being connected with described image sensor；
Described image processing module is used for the output of the photosensitive pixel covered according to the colorized optical filtering area and described infrared
The output of the photosensitive pixel of filter area covering calculates the pixel value of composograph to generate the composograph；Described image
Processing module is additionally operable to the output according to the corresponding photosensitive pixel in the colorized optical filtering area in the same filter unit
Obtain the corresponding color pixel values of the photosensitive pixel of the infrared filtering area covering.
10. imaging device as claimed in claim 9, it is characterised in that the colorized optical filtering area forms Bayer array.
11. imaging devices as claimed in claim 9, it is characterised in that each described filter unit includes that 2*2 is individual described photosensitive
Pixel；The colorized optical filtering area and the infrared filtering area are covered each by three and a photosensitive pixel.
12. imaging devices as claimed in claim 9, it is characterised in that each described photosensitive pixel and a composite diagram
The pixel correspondence of picture.
13. imaging devices as claimed in claim 9, it is characterised in that the control module includes connecting with the photosensitive pixel
Row selection logic unit and the column selection logic unit for connecing；The row selection logic unit and the column selection logic unit are used for
The photosensitive pixel output according to the very first time or second time control.
14. imaging devices as claimed in claim 13, it is characterised in that the photosensitive pixel includes described photosensitive for controlling
The switching tube of pixel output, the row selection logic unit and column selection logic unit are connected with the switching tube.
15. imaging devices as claimed in claim 9, it is characterised in that described image sensor includes analog-digital converter array,
Each described analog-digital converter is connected with a photosensitive pixel, and the analog-digital converter is used to produce the photosensitive pixel
Analog signal output be converted to data signal.
16. imaging devices as claimed in claim 15, it is characterised in that the imaging device includes and the analog-digital converter
The register of array connection, the register is used to store the data signal output that the analog-digital converter is produced.
17. imaging devices as claimed in claim 9, it is characterised in that described image sensor includes micro mirror array, each institute
State micro mirror corresponding with a photosensitive pixel.
18. imaging devices as claimed in claim 9, it is characterised in that described image processing module is used to calculate same described
The average value of the output of the corresponding photosensitive pixel in the colorized optical filtering area in filter unit and as the infrared filtering
The corresponding color pixel values of photosensitive pixel of area's covering.
19. imaging devices as claimed in claim 9, it is characterised in that the photosensitive pixel of the colorized optical filtering area covering
Output correspondence color pixel values；The output correspondence infrared image element value of the photosensitive pixel of the infrared filtering area covering；
Described image processing module is used to judge ambient brightness according to the pixel value of the photosensitive pixel, and in the environment
When brightness is more than the first predetermined threshold, the color pixel values are subtracted into the corresponding infrared image element value to obtain the synthesis
The pixel value of image.
20. imaging devices as claimed in claim 9, it is characterised in that the photosensitive pixel of the colorized optical filtering area covering
Output correspondence color pixel values；The output correspondence infrared image element value of the photosensitive pixel of the infrared filtering area covering；
Described image processing module is used to judge ambient brightness according to the pixel value of the photosensitive pixel, and bright for the environment
When degree is less than the second predetermined threshold, the color pixel values are added the corresponding infrared image element value to obtain the composite diagram
The pixel value of picture.
21. imaging devices as claimed in claim 9, it is characterised in that the photosensitive pixel of the colorized optical filtering area covering
Output correspondence color pixel values；The output correspondence infrared image element value of the photosensitive pixel of the infrared filtering area covering；
Described image processing module is used to judge ambient brightness according to the pixel value of the photosensitive pixel, and in the environment
Using the color pixel values as the corresponding composograph when brightness is less than the second predetermined threshold more than first threshold
Pixel value.
22. imaging device as described in claim 19-21 any one, it is characterised in that color pixel values and described
The corresponding photosensitive pixel of infrared image element value is corresponding with the same filter unit.
23. imaging devices as claimed in claim 9, it is characterised in that described image processing module is used for the colored filter
The output of the photosensitive pixel of light area covering is added to obtain merging pixel value, and for according to merging pixel value and the institute
The output for stating the photosensitive pixel of infrared filtering area covering calculates the pixel value of the composograph.
24. a kind of electronic installations, it is characterised in that including the imaging device as described in claim 9-23 any one.
25. electronic installations as claimed in claim 24, it is characterised in that the electronic installation includes mobile phone.
26. electronic installations as claimed in claim 25, it is characterised in that the imaging device includes the preposition phase of the mobile phone
Machine.
27. electronic installations as claimed in claim 24, it is characterised in that the electronic installation includes connecting with the imaging device
The central processing unit and external memory for connecing, the central processing unit are used to control the external memory to store the composograph.
28. electronic installations as claimed in claim 24, it is characterised in that the electronic installation also includes and the imaging device
The central processing unit and display device of connection, the central processing unit are used to control the display device to show the composite diagram
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963410.0A CN105635532B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963410.0A CN105635532B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105635532A CN105635532A (en) | 2016-06-01 |
| CN105635532B true CN105635532B (en) | 2017-05-24 |
Family
ID=56049983
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510963410.0A Active CN105635532B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105635532B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10638054B2 (en) | 2017-01-25 | 2020-04-28 | Cista System Corp. | System and method for visible and infrared high dynamic range sensing |
| CN107346089B (en) * | 2017-06-30 | 2020-04-14 | Oppo广东移动通信有限公司 | Image sensor, camera module and electronic device |
| CN107846537B (en) * | 2017-11-08 | 2019-11-26 | 维沃移动通信有限公司 | A kind of CCD camera assembly, image acquiring method and mobile terminal |
| CN108200354B (en) * | 2018-03-06 | 2020-09-25 | Oppo广东移动通信有限公司 | Control method and apparatus, imaging device, computer device, and readable storage medium |
| CN110248119A (en) * | 2018-03-08 | 2019-09-17 | 中国科学院上海微系统与信息技术研究所 | Imaging sensor and image detecting method |
| JP2019175912A (en) | 2018-03-27 | 2019-10-10 | ソニーセミコンダクタソリューションズ株式会社 | Imaging apparatus and image processing system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN103748868A (en) * | 2011-08-31 | 2014-04-23 | 索尼公司 | Imaging device, signal processing method, and program |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7924483B2 (en) * | 2006-03-06 | 2011-04-12 | Smith Scott T | Fused multi-array color image sensor |
-
2015
- 2015-12-18 CN CN201510963410.0A patent/CN105635532B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN103748868A (en) * | 2011-08-31 | 2014-04-23 | 索尼公司 | Imaging device, signal processing method, and program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105635532A (en) | 2016-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN105430359B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN107977940A (en) | background blurring processing method, device and equipment | |
| CN105635702B (en) | Imaging method, imaging device and electronic installation | |
| CN105578078B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN104604215B (en) | Photographic device and image capture method | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105611185B (en) | image generating method, device and terminal device | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105516697B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN106878690A (en) | The imaging method of imageing sensor, imaging device and electronic equipment | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN105578081B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN108055452A (en) | Image processing method, device and equipment | |
| CN105430362B (en) | Imaging method, imaging device and electronic installation | |
| CN106961557A (en) | Light-field camera and its image treatment method | |
| CN102984448A (en) | Method of controlling an action, such as a sharpness modification, using a colour digital image | |
| CN103430551A (en) | An imaging system using a lens unit with longitudinal chromatic aberrations and a method of operating | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN108024054A (en) | Image processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. |
|
| CP03 | Change of name, title or address |