CN105578006B - Imaging method, imaging device and electronic installation - Google Patents
Imaging method, imaging device and electronic installation Download PDFInfo
- Publication number
- CN105578006B CN105578006B CN201510963879.4A CN201510963879A CN105578006B CN 105578006 B CN105578006 B CN 105578006B CN 201510963879 A CN201510963879 A CN 201510963879A CN 105578006 B CN105578006 B CN 105578006B
- Authority
- CN
- China
- Prior art keywords
- pixel
- optical filtering
- optical
- filter unit
- photosensitive
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 130
- 238000009434 installation Methods 0.000 title claims abstract description 29
- 230000003287 optical effect Effects 0.000 claims abstract description 302
- 238000001914 filtration Methods 0.000 claims abstract description 223
- 238000009790 rate-determining step (RDS) Methods 0.000 claims description 15
- 230000013011 mating Effects 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 19
- 230000006870 function Effects 0.000 description 10
- 238000005286 illumination Methods 0.000 description 10
- 238000003860 storage Methods 0.000 description 8
- 238000000034 method Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000003750 conditioning effect Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000002156 mixing Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 241001062009 Indigofera Species 0.000 description 1
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 230000005693 optoelectronics Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 238000005303 weighing Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses a kind of imaging method, and it includes：Imaging sensor is provided, it includes photosensitive pixel array, optical filter and optical filtering control device, optical filter includes filter unit array, filter unit includes multiple optical filtering pixels, optical filter includes multiple, optical filtering control device is used to switch the optical filter above photosensitive pixel array so that the optical filtering pixel of covering photosensitive pixel switches between colorized optical filtering pixel and white optical filtering pixel, and the photosensitive pixel of each filter unit covering, which is formed, merges pixel.Then, control the optical filter above optical filtering control device switching photosensitive pixel array that at least part optical filtering pixel is switched into colorized optical filtering pixel according to ambient brightness, handle the same photosensitive pixel for merging pixel and export to obtain merging the pixel value of pixel so as to generate merging image.This imaging method is used to switch out an appropriate number of white optical filtering pixel according to ambient brightness to obtain the high image of signal to noise ratio.The invention also discloses a kind of imaging device and electronic installation.
Description
Technical field
The present invention relates to imaging technique, more particularly to a kind of imaging method, imaging device and electronic installation.
Background technology
Existing imaging device the image of high ISO or low-light (level) environment generation may exist noise it is more, it is unintelligible etc. no
Foot.Image quality is lifted using the imaging mode of multiframe synthesis, photo opporunity is long.Embedded more white optical filtering pixel can lift picture
Matter, but color distortion can be caused.
The content of the invention
It is contemplated that at least solves one of technical problem present in prior art.Therefore, the present invention needs offer one
Kind imaging method, imaging device and electronic installation.
The imaging method of embodiment of the present invention comprises the following steps：
Imaging sensor is provided, described image sensor includes photosensitive pixel array, optical filter and optical filtering control device, institute
Stating optical filter includes filter unit array, and the filter unit includes multiple optical filtering pixels, and the optical filter is described including multiple
Optical filtering control device is used to switch the optical filter above the photosensitive pixel array so as to cover the institute of the photosensitive pixel
State optical filtering pixel between colorized optical filtering pixel and white optical filtering pixel to switch, each filter unit covers described photosensitive
Pixel, which is formed, merges pixel；
The optical filtering control device is controlled to switch the optical filter above the photosensitive pixel array according to ambient brightness
So that at least partly described optical filtering pixel is switched into colorized optical filtering pixel；And
The output of the photosensitive pixel array is read, and handles the output of the same photosensitive pixel for merging pixel
To obtain the pixel value of the merging pixel so as to generate merging image.
The ratio of white optical filtering pixel in filter unit can be adjusted according to ambient brightness using this imaging method, with difference
Obtain that signal to noise ratio, brightness and definition are higher under illumination, the less image of noise.The some of existing imaging method are overcome to lack
Point.
The present invention also provides a kind of imaging device that can be used for realizing the imaging method of embodiment of the present invention, and it includes：
Imaging sensor, described image sensor include：
Photosensitive pixel array；
Optical filter；And
The optical filtering control device being connected with the optical filter；
The optical filter includes filter unit array, and the filter unit includes multiple optical filtering pixels, the optical filter bag
Include it is multiple, the optical filtering control device be used for switch the optical filter above the photosensitive pixel array so as to cover the sense
The optical filtering pixel of light pixel switches between colorized optical filtering pixel and white optical filtering pixel, each filter unit covering
The photosensitive pixel form merge pixel；
The optical filtering control device is used to switch the filter above the photosensitive pixel array according to ambient brightness control
Mating plate by least partly optical filtering pixel to switch to colorized optical filtering pixel；
The imaging device also includes image processing module, and described image processing module is used to read the light-sensitive image primitive matrix
The output of row, and handle it is same it is described merge pixel the photosensitive pixel output with obtain it is described merging pixel pixel value
So as to generate merging image.
The present invention also provides a kind of electronic installation of the imaging device including embodiment of the present invention.
The additional aspect and advantage of the present invention will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
The above-mentioned and/or additional aspect and advantage of the present invention is from combining in description of the accompanying drawings below to embodiment by change
Obtain substantially and be readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet of the imaging method of embodiment of the present invention.
Fig. 2 is the rate-determining steps schematic flow sheet of embodiment of the present invention imaging method.
Fig. 3 is the rate-determining steps schematic flow sheet of embodiment of the present invention imaging method.
Fig. 4 is the rate-determining steps schematic flow sheet of embodiment of the present invention imaging method.
Fig. 5 is the rate-determining steps schematic flow sheet of embodiment of the present invention imaging method.
Fig. 6 is the rate-determining steps schematic flow sheet of embodiment of the present invention imaging method.
Fig. 7 is the rate-determining steps schematic flow sheet of embodiment of the present invention imaging method.
Fig. 8 is the read step schematic flow sheet of embodiment of the present invention imaging method.
Fig. 9 is the read step schematic flow sheet of embodiment of the present invention imaging method.
Figure 10 is the read step schematic flow sheet of embodiment of the present invention imaging method.
Figure 11 is the structural representation of the imaging device of embodiment of the present invention.
Figure 12 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 13 is Bayer array schematic diagram.
Figure 14 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 15 is the high-level schematic functional block diagram of embodiment of the present invention imaging device.
Figure 16 is the photosensitive pixel and interlock circuit schematic diagram of the imaging device of embodiment of the present invention.
Figure 17 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 18 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 19 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 20 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 21 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 22 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 23 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 24 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 25 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 26 is the high-level schematic functional block diagram of embodiment of the present invention imaging device.
Figure 27 is the dimensional structure diagram of the imaging sensor of the imaging device of embodiment of the present invention.
Figure 28 is the structural representation of the imaging sensor of the imaging device of embodiment of the present invention.
Figure 29 is the superposition schematic diagram of the multilayer filter of embodiment of the present invention.
Figure 30 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 31 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Embodiment
The embodiment of embodiments of the present invention is described below in detail, the example of the embodiment is shown in the accompanying drawings
Go out, wherein same or similar label represents same or similar element or the member with same or like function from beginning to end
Part.Embodiment below with reference to accompanying drawing description is exemplary, is only used for explaining embodiments of the present invention, and can not
It is interpreted as the limitation to embodiments of the present invention.
Below with reference to the accompanying drawings come describe the embodiment of the present invention proposition imaging method, imaging device and electronic installation.
Referring to Fig. 1, the imaging method of embodiment of the present invention comprises the following steps：
S1, imaging sensor include photosensitive pixel array, optical filter and optical filtering control device, and optical filter includes filter unit
Array, filter unit include multiple optical filtering pixels, and including multiple, optical filtering control device is used to switch photosensitive pixel array optical filter
The optical filter of top is so that the optical filtering pixel of covering photosensitive pixel switches between colorized optical filtering pixel and white optical filtering pixel, often
The photosensitive pixel of individual filter unit covering, which is formed, merges pixel.
S2, optical filter above optical filtering control device switching photosensitive pixel array is controlled with will at least portion according to ambient brightness
Optical filtering pixel is divided to switch to colorized optical filtering pixel.
S3, reads the output of photosensitive pixel array, and handles the output of the photosensitive pixel of same merging pixel to be closed
And the pixel value of pixel is so as to generating merging image.
The colorized optical filtering area of filter unit in the imaging method of embodiment of the present invention is used to obtain the color for merging pixel
Multimedia message, white optical filtering pixel is used to obtain the monochrome information for merging pixel under low-light (level) and this monochrome information noise is less.
In this way, not only comprising color information but also the monochrome information of low noise degree was included, to merge the color of image complete for the pixel value for merging image,
Brightness and definition are preferable, and noise is few.White optical filtering pixel and colorized optical filtering pixel can need according to environment and mutually switch,
As switched under low illumination to produce more white optical filtering pixel to lift image quality.
In some embodiments, filter unit array includes Bayer (Bayer) array.Color can obtain using Bayer array
Color complete image true to nature.
In some embodiments, each filter unit covers 2*2 photosensitive pixel.
Referring to Fig. 2, in the imaging method of present embodiment, step S2 further comprises：
S201, sense ambient brightness.
S203, judges whether ambient brightness is less than the first predetermined threshold.
S205, when ambient brightness is less than the first predetermined threshold, on control optical filtering control device switching photosensitive pixel array
The optical filter of side by the three of same filter unit or two optical filtering pixels to switch to white optical filtering pixel.
In the present embodiment, can be using the output of photosensitive pixel as the index for judging ambient brightness, specifically, can be in the hope of
The average value of all or part of photosensitive pixel outputs, then this average value is correspondingly switched into illumination.Can given threshold to perform phase
The control answered.First predetermined threshold, such as 20Lux be set, illumination controlled when being less than this value with by three of each filter unit or
Two switch to white optical filtering pixel.
Referring to Fig. 3, in the imaging method of present embodiment, step S2 further comprises：
S207, judges whether ambient brightness is more than the first predetermined threshold and is less than the second predetermined threshold.
S209, when ambient brightness is more than the first predetermined threshold and is less than the second predetermined threshold, control optical filtering control device
Switch the optical filter above photosensitive pixel array with by all optical filterings of the first green filter unit and the second green filter unit
Pixel switches to white optical filtering pixel.
Referring to Fig. 4, in the imaging method of present embodiment, filter unit includes the first green filter unit and second
Green filter unit, step S2 further comprise：
S211, judges whether ambient brightness is more than the second predetermined threshold and is less than the 3rd predetermined threshold.
S213, when ambient brightness is more than the second predetermined threshold and is less than three predetermined thresholds, control optical filtering control device is cut
The optical filter changed above photosensitive pixel array by all optical filtering pixels of the first green filter unit to switch to white optical filtering picture
Element, or the two of which or three optical filtering pixels of the first green filter unit and the second green filter unit are switched into white filter
Light pixel.
In the present embodiment, the 3rd predetermined threshold can be set is 100Lux.Therefore in ambient brightness in 50~100Lux
When, the part optical filtering pixel for replacing green filter unit is white optical filtering pixel.
Referring to Fig. 5, in the imaging method of present embodiment, step S2 further comprises：
S215, judges whether ambient brightness is more than the 3rd predetermined threshold and is less than the 4th predetermined threshold.
S217, when ambient brightness is more than the 3rd predetermined threshold and is less than four predetermined thresholds, control optical filtering control device is cut
The optical filter changed above photosensitive pixel array is with by one of them of the first green filter unit and/or the second green filter unit
Optical filtering pixel switches to white optical filtering pixel.
4th predetermined threshold can be 200Lux.
Referring to Fig. 6, in the imaging method of present embodiment, step S2 further comprises：
S219, judges whether ambient brightness is more than the 4th predetermined threshold.
S221, controlled when ambient brightness is more than four predetermined thresholds above optical filtering control device switching photosensitive pixel array
Optical filter so that all optical filtering pixels are switched into colorized optical filtering pixel.
Referring to Fig. 7, in the imaging method of another embodiment, step S2 further comprises：
S223, judges whether ambient brightness is more than the first predetermined threshold and is less than the 5th predetermined threshold.
S225, when ambient brightness is more than the first predetermined threshold and is less than five predetermined thresholds, control optical filtering control device is cut
The optical filter changed above photosensitive pixel array by same filter unit an optical filtering pixel to switch to white optical filtering pixel.
In the imaging method of another embodiment, not only switched in green filter unit, but in all photosensitive units
Switch simultaneously.Such as the 5th predetermined threshold can be 100Lux, therefore when ambient brightness is in 20~100Lux, will filter single
One of optical filtering pixel switches to white optical filtering pixel to lift brightness of image and reduce noise in member.
Referring to Fig. 8, in the imaging method of some embodiments, step S3 further comprises：
S301, calculate the average value of the output of the same photosensitive pixel for merging pixel or and to obtain the pixel for merging pixel
Value.
The imaging method of embodiment of the present invention, it is assumed that the output of original each photosensitive pixel is S, noise N, merges picture
Element includes a photosensitive pixel, then the pixel value for merging pixel is n*m*S, and the noise for merging pixel isIn n
In the case of=2, m=2, the noise of resulting pixel is N/2 or so.Therefore the brightness for merging image obtains under low-light (level) environment
To lifting, and signal to noise ratio improves.
Referring to Fig. 9, in the imaging method of present embodiment, step S3 further comprises：
S303, color rendition processing is carried out to merging image.
Due to mixing white optical filtering pixel in filter unit, the color of the merging image of generation is caused to produce certain distortion,
Color rendition processing can be done to it, to recover its realistic colour as far as possible.
Referring to Fig. 10, in some embodiments, merging pixel includes color pixel values and white pixel value.Step S3
Further comprise：
S305, calculate the average value of the output of the photosensitive pixel of colorized optical filtering pixel covering or and and be used as colour element
Value.
S307, the luminance component for replacing color pixel values are the picture after the luminance component of white pixel value as merging pixel
Element value.
So, after obtaining color pixel values, yuv format can be converted into, can obtain its luminance component, YUV is colored
The luminance component of the color pixel values of image replaces with the luminance component of white pixel value, complete to generate color information, simultaneously
Brightness and the higher image of signal to noise ratio.
The imaging method of embodiment of the present invention can be realized by the imaging device of embodiment of the present invention.
Figure 11 and Figure 12 is referred to, the imaging device 100 of embodiment of the present invention is included at imaging sensor 10 and image
Manage module 50.Imaging sensor 10 includes photosensitive pixel array 11, optical filter 13 and optical filtering control device 15.Optical filter 13 includes
Filter unit array 131, each filter unit 1311 include multiple optical filtering pixels 1312, and each optical filtering pixel 1312 covers one
Photosensitive pixel 111, optical filtering pixel 1312 include colorized optical filtering pixel 1315 and white optical filtering pixel 1313, optical filtering control device 15
For controlling the optical filter 13 of the top of switching photosensitive pixel array 11 so as to cover the optical filtering pixel 1312 of photosensitive pixel 111 in coloured silk
Switch between color optical filtering pixel 1315 and white optical filtering pixel 1313, the structure of photosensitive pixel 111 that each filter unit 1311 covers
Into merging pixel.Extraneous light is irradiated to the photosensitive part 1111 of photosensitive pixel 111 to produce electric signal by optical filter 13, i.e.,
The output of photosensitive pixel 111.
Optical filtering control device 15 be used for according to ambient brightness control the optical filter 13 of switching photosensitive pixel array 11 top with
At least part optical filtering pixel 1312 is switched into colorized optical filtering pixel 1315.Imaging device 100 also includes image processing module 50,
Image processing module 50 is used for the output for reading photosensitive pixel array 11, and handle the photosensitive pixel 111 of same merging pixel
Export to obtain merging the pixel value of pixel so as to generate merging image.
Optical sensor can be set in imaging device to sense ambient brightness, optical sensor includes opto-electronic conversion mould
Block, intensity of illumination can be converted to electric signal, so as to measuring environment brightness.Or using the output of photosensitive pixel as judging environment
The index of brightness, specifically, the average value of all or part of photosensitive pixel outputs can be calculated, as the number for weighing ambient brightness
According to.Ambient brightness is divided into different scopes, correspond to the different control operation of optical filtering control device 15.
Optical filtering control device 15 switches the operation of optical filter under varying environment brightness, can be by optical sensor or image
Reason module 50 automatically controls according to the ambient brightness sensed, may also set up by manual control.
Optical filtering control device 15 may include optical-filter switcher and control circuit.Multiple optical filterings are equipped with optical-filter switcher
Piece 13, control circuit are used to control optical-filter switcher to switch optical filter 13.
The colorized optical filtering pixel 1315 of filter unit 1311 in the imaging device of embodiment of the present invention, which is used to obtain, closes
And the color information of pixel, white optical filtering pixel 1313 are used to obtain monochrome information and this brightness for merging pixel under low-light (level)
Information noise is less.In this way, the pixel value for merging image had not only included color information but also included the monochrome information of low noise degree, merge figure
The color of picture is complete, and brightness and definition are preferable, and noise is few.White optical filtering pixel 1313 and colorized optical filtering pixel 1315 can roots
Need according to environment and mutually switch, as switched under low illumination to produce more white optical filtering pixel to lift image quality.
Figure 13 is referred to, in the present embodiment, filter unit array includes Bayer array (Bayer pattern).
Because human eye is most sensitive to green glow, therefore the scenery that eyes are usually seen is the equal of what green scenery had been reinforced
As a result.Imaging device must excessively sense green glow, and obtained image can just make human eye just feel normal.Therefore Bayer array or other
Common filter unit array can typically set more green filter unit, in Bayer array Green (G), red (R), indigo plant
The number ratio of color (B) filter unit is 2:1:1, i.e. each two green filter unit, a red and blue filter unit is formed
Filtering structure 1317 simultaneously is used to form the complete image pixel of color.Therefore, to can obtain color using Bayer array completely true to nature
Image.
And picture signal can be handled to the algorithm of Bayer structure using conventional needle using Bayer structure, without hard
Big adjustment is done in part structure.
Also referring to Figure 14 and Figure 27, in the present embodiment, each filter unit 1311 covers 2*2 light-sensitive image
Element.It is green, red, blueness, green filter unit respectively.
In traditional filter unit array structure, the corresponding photosensitive pixel of each filter unit and image pixel.It please join
Figure 16 is read, in the present embodiment, filter unit array 131 uses Bayer structure, including filtering structure 1317, each knot that filters
Structure 1317 includes green, red, blueness, green filter unit 1311, and different from the filter unit array of traditional Bayer structure
, the corresponding multiple photosensitive pixels 111 of each filter unit 1311.
In addition to 2*2 structures, the also structure such as 3*3,4*4, even any n*m (n, m are natural number), it will be understood that
The number of sequencable photosensitive pixel 111 is limited on photosensitive pixel array 11, each light-sensitive image for merging pixel and being included
If element 111 is excessive, the resolution sizes of image can be restricted, and e.g., if the pixel value of photosensitive pixel array 11 is 16M, be adopted
Can obtain the merging image that resolution ratio is 4M with 2*2 merging dot structure, and use 4*4 structures just can only obtain resolution ratio for
1M merging image.Therefore 2*2 merging dot structure is a preferred arrangement mode, is sacrificing the premise of resolution ratio less as far as possible
Lower lifting brightness of image and definition.Meanwhile facilitated using 2*2 structures and reading and conjunction to photosensitive pixel output are realized on hardware
And handle.Figure 15 is referred to, in some embodiments, imaging sensor also includes control module 17, and control module 17 is used for
Control photosensitive pixel array 11 exposes line by line.
Control module 17 is connected with row selection logic unit 171 and column selection logic unit 173, to control line by line to photosensitive
The output of pixel 111 is handled.The mode for exposing and exporting line by line is easier to realize on hardware.
Also referring to Figure 15, in the present embodiment, imaging sensor 10 may also include register 19, control module 17
For gathering the output of the row k of current exposure completion and the photosensitive pixel 111 of the row of kth+1 successively and being stored in register 19, its
Middle k=2n-1, n are natural number, and k+1 is less than or equal to total line number of photosensitive pixel array 11.
Specifically, referring to Figure 16 and Figure 15, imaging sensor 10 includes patrolling with row selection logic unit 171 and column selection
Collect the control module 17 that unit 173 connects.Row selection logic unit 171 and column selection logic unit 173 and each light-sensitive image
Switching tube 1115 corresponding to element 111 connects, and control module 17 is used to control row selection logic unit 171 and column selection logic unit
173 to gate the switching tube 1115 of the photosensitive pixel 111 of ad-hoc location.
Figure 17 and Figure 18 is referred to, in some embodiments, optical filtering control device 15 is used to sense and judge that environment is bright
Degree, and for the optical filter 13 when ambient brightness is less than the first predetermined threshold above switching photosensitive pixel array 11 with will wherein
Three or two optical filtering pixels 1312 switch to white optical filtering pixel 1313.
For the ambient brightness measured, can given threshold to perform corresponding control.First predetermined threshold is set, such as
20Lux, control filter unit that the three of each filter unit or two are switched into white optical filtering picture when illumination is less than this value
Element.
Because the first predetermined threshold is very low ambient brightness value, more white optical filtering pixel need to be switched out, so that more
More light enters, so as to generate brightness value and the higher image of signal to noise ratio.But in order to retain the information of certain each color,
Whole pixels can not be replaced with to white optical filtering pixel, only switch a part of optical filtering pixel so as to the filter unit of every kind of color.
Further, Figure 19 is referred to, in the present embodiment, filter unit 1311 includes the first green filter unit
1314 and the second green filter unit 1316.Optical filtering control device 15 is additionally operable to more than the first predetermined threshold be less than in ambient brightness
Switch the optical filter 13 of the top of photosensitive pixel array 11 during the second predetermined threshold with by the first green filter unit 1314 and second
All optical filtering pixels of green filter unit 1316 switch to white optical filtering pixel 1313.
Second predetermined threshold, such as 50Lux are set, then in the present embodiment, ambient brightness, will in 20~50Lux
The optical filtering pixel of green filter unit all switches to white optical filtering pixel.Because human eye is most sensitive to green glow, imaging device sheet
Just palpus overexposure looks normal image to body to produce human eye.Compared to red or blue filter unit, green filter list
The overexposure of member makes color distortion sense caused by human eye less intense.Therefore in embodiments of the present invention, more adopts
White optical filtering pixel is switched to by the optical filtering pixel of green filter unit, so that its light-inletting quantity increases, reduces imaging noise.
Figure 20 and Figure 21 is referred to, in the present embodiment, optical filtering control device 15 is additionally operable to be more than the in ambient brightness
Two predetermined thresholds simultaneously switch the optical filter 13 of the top of photosensitive pixel array 11 when being less than three predetermined thresholds so that the first green to be filtered
All optical filtering pixels of light unit 1314 switch to white optical filtering pixel 1313, or the optical filtering of the top of switching photosensitive pixel array 11
Piece 13 is so that two or three optical filtering pixels of the first green filter unit 1314 and the second green filter unit 1316 to be switched to
White optical filtering pixel 1313.
In the present embodiment, the 3rd predetermined threshold can be set is 100Lux.Therefore in ambient brightness in 50~100Lux
When, the part optical filtering pixel for replacing green filter unit is white optical filtering pixel.
Figure 22 and Figure 23 is referred to, in the present embodiment, optical filtering control device 15 is additionally operable to be more than the in ambient brightness
Three predetermined thresholds and switch the optical filter 13 of the top of photosensitive pixel array 11 when being less than four predetermined thresholds so that the first green to be filtered
One of optical filtering pixel of the green filter unit 1316 of light unit 1314 and/or second switches to white optical filtering pixel 1313.
In the present embodiment, the 4th predetermined threshold can be set is 200Lux.Therefore in ambient brightness in 100~200Lux
When, each green filter unit switches out a white optical filtering pixel 1313, or the first green filter unit 1314 and second is green
One of those in color filter unit 1316 switches out a white optical filtering pixel 1313.The image so obtained, remain compared with
Complete color information.
Figure 24 is referred to, in other embodiments, optical filtering control device 15 is additionally operable to pre- more than first in ambient brightness
Determine to switch when threshold value is less than five predetermined thresholds the optical filter 13 of the top of photosensitive pixel array 11 with by all filter units 1311
An optical filtering pixel switch to white optical filtering pixel 1313.
In other embodiments, not only switched in green filter unit, but in all photosensitive units
Switch simultaneously.Such as the 5th predetermined threshold can be 100Lux, therefore when ambient brightness is in 20~100Lux, will filter single
One of optical filtering pixel switches to white optical filtering pixel to lift brightness of image and reduce noise in member.
Further, Figure 25 is referred to, in other embodiments, image processing module is additionally operable to be more than in ambient brightness
Switch the optical filter 13 above photosensitive pixel array 11 during four predetermined thresholds so that all optical filtering pixels are switched into colorized optical filtering
Pixel 1315.
So due to no white optical filtering pixel, the merging image of generation will not colored loss.
In some embodiments, image processing module is used for the flat of the output for calculating the photosensitive pixel of same merging pixel
Average or and with obtain merge pixel pixel value.
The imaging method of embodiment of the present invention, it is assumed that the output of original each photosensitive pixel is S, noise N, merges picture
Element includes a photosensitive pixel, then the pixel value for merging pixel is n*m*S, and the noise for merging pixel isIn n
In the case of=2, m=2, the noise of resulting pixel is N/2 or so.Therefore the brightness for merging image obtains under low-light (level) environment
To lifting, and signal to noise ratio improves.
In the present embodiment, image processing module is used to carry out color rendition processing to merging image.
Due to mixing white optical filtering pixel in filter unit, the color of the merging image of generation is caused to produce certain distortion,
Color rendition processing can be done to it, to recover its realistic colour as far as possible.The white optical filtering pixel that can be switched according to filter unit
Number, set corresponding software algorithm to reduce color.
In addition to it will merge the photosensitive pixel output summation of pixel or average, in other embodiments, merge picture
Element includes color pixel values and white pixel value, and image processing module is used for the photosensitive pixel for calculating the covering of colorized optical filtering pixel
The average value of output or and and be used as color pixel values, and the luminance component for replacing color pixel values is white pixel value
As the pixel value for merging pixel after luminance component.
So, after obtaining color pixel values, yuv format can be converted into and obtain its luminance component, by colour element
The luminance component of value replaces with the luminance component of white pixel value, complete to generate color information, at the same brightness and signal to noise ratio compared with
High merging image.Compared to output and/or average value the embodiment for calculating the photosensitive pixel for merging pixel, this is another
The merging image color loss that a little embodiments obtain is less, does not need color rendition processing typically.YUV is according to brightness and color
The principle of difference describes the picture format of color, and yuv format includes many specific forms, such as YUV422, YUV420 etc..At certain
In a little embodiments, colour, which merges pixel, includes green, red, blue combined pixels, and image processing module first closes according to colour
And the pixel of pixel is worth to the colored of rgb format and merges image, that is, red luma value, the green for obtaining each image pixel are bright
Angle value, blue intensity values, represented respectively with R, G, B, then its corresponding yuv format image pixel in some embodiments
Brightness value Y=0.299*R+0.587*G+0.114*B.
Figure 26 and Figure 16 is referred to, in some embodiments, imaging sensor 10 includes the array of analog-digital converter 21, often
Individual photosensitive pixel 111 is connected with an analog-digital converter 211 respectively.Analog-digital converter 211 is used for the simulation of photosensitive pixel 111
Signal output is converted to data signal output.
Also referring to Figure 16, the photosensitive pixel 111 in present embodiment includes photodiode 1113.Photodiode
1113 are used to illumination being converted into electric charge, and caused electric charge relation proportional to intensity of illumination.Switching tube 1115 is used for basis
The control signal of row selection logic unit 171 and column selection logic unit 173 carrys out the conducting and disconnection of control circuit, when circuit is led
When logical, source follower 1117 (source follower) is used for photodiode 1113 through charge signal caused by illumination
It is converted into voltage signal.Analog-digital converter 211 (Analog-to-digital converter) is used to switch to voltage signal
Data signal, to transmit to subsequent conditioning circuit processing.
This output processing mode makes the output of photosensitive pixel be converted into data signal, in following digital circuit or in chip
It is middle to be handled with software.Therefore the output information of each photosensitive pixel can be retained, for example, the image for 16M pixels
For sensor, the imaging method of embodiment of the present invention can retain the information of 16M pixels (image before merging), in this base
On plinth the merging image of 4M pixels or the image of other resolution ratio are obtained by processing.Ultimately generate image and the probability of bad point occur
It is relatively low.In addition, the noise of this output processing mode is smaller, signal to noise ratio is higher.
Figure 27 and Figure 28 is referred to, in some embodiments, imaging sensor 10 includes being arranged on optical filter 13
Micro mirror array 23, each micro mirror 231 are corresponding with a photosensitive pixel 111.
Specifically, each micro mirror 231 is corresponding with a photosensitive pixel 111, including size, position correspondence.In some implementations
In mode, the corresponding 2*2 photosensitive pixel 111 of each filter unit 1311 and 2*2 micro mirror 191.It is terrible as technology develops
The image higher to resolution ratio, the photosensitive pixel 111 on sensitive film is more and more, arranges more and more intensive, single photosensitive pixel
111 is also less and less, and its light is affected, and the area of photosensitive part 1111 of photosensitive pixel 111 is limited, micro mirror 191
Light can be gathered to photosensitive part 1111, so as to lift the light reception intensity of photosensitive pixel 111 to improve image quality.
Optical filtering control device 15 switches optical filter 13 to switch white optical filtering pixel 1313 and colorized optical filtering pixel 1315
Mode mainly has following two.
Figure 29 is referred to, in some embodiments, optical filtering control device 15 is used for by increasing photosensitive pixel array 11
The optical filter 13 of top covers light-sensitive image so that colorized optical filtering pixel 1315 is switched into white optical filtering pixel 1313 by reducing
The optical filter 13 of pixel array 11 by white optical filtering pixel 1313 to switch to colorized optical filtering pixel 1315.
Specifically, multiple 13 overlapping placements of optical filter, most by bottom first layer the first green filter unit 1314 and
Two green filter units 1316 are white optical filtering pixels 1313.The second layer, third layer, the 4th layer etc. respectively include positioned at green
The green filter pixel of filter unit diverse location, other positions are that transparent filter pixel (is not hindered the light of any color
The pixel of gear).
It it is appreciated that by successively increasing optical filter 13, can increase green filter pixel, white optical filtering pixel 1313 subtracts
It is few；Optical filter is successively reduced, green filter pixel is reduced, and white optical filtering pixel increases.For example, in the base of the first multilayer filter 13
Increase the second multilayer filter 13 and third layer optical filter 13 on plinth, can obtain the filter unit in embodiment corresponding to accompanying drawing 21
Array 131.Then, the setting of optical filter 13 is not limited thereto, and other kinds of optical filter 13 also can be set, such as each red
Filter unit includes the optical filter 13 of two red filter pixels and two transparent pixels, to realize that more optical filters 13 combine.
In other embodiments, optical filtering control device 15 is used for the optical filtering by replacing the top of photosensitive pixel array 11
Piece 13 is so that optical filtering pixel switches between colorized optical filtering pixel 1315 and white optical filtering pixel 1313.
Specifically, optical filter 13 includes multiple, but not overlapping placement.Each optical filter 13 includes the filter of various colors
Light unit 1311, it can independently realize and filter and generate the more complete image of color.For example, first to fourth multilayer filter 13 is distinguished
Including the filter unit array 131 as shown in Figure 19, Figure 20, Figure 22, Figure 25.By switching to the 4th layer successively from first layer,
Successively decreasing for light-inletting quantity can be achieved, correspond to the different situations of ambient brightness from low to high respectively.
To sum up, the imaging device in embodiment of the present invention can switch out the white optical filtering of respective number according to ambient brightness
Pixel makes the pixel value of merging pixel not only include color information but also include the monochrome information of low noise degree, to facilitate subsequent conditioning circuit to generate
The merging image that color is complete and signal to noise ratio is high.
The present invention also provides a kind of electronic installation using imaging device.In some embodiments, electronic installation includes
Imaging device.Therefore, electronic installation has camera function and to generate color under low-light (level) complete, and signal to noise ratio is high, definition
High merging image.
Electronic installation can be mobile phone.
In some embodiments, imaging device can be the Front camera of mobile phone.Because Front camera is used for self-timer,
And self-timer typically requires to require the definition of image and it is not high to image resolution requirement, using the electronics of present embodiment
Device can meet this requirement.
Figure 30 is referred to, in some embodiments, electronic installation 200 includes the centre being connected with imaging device 100
Device 81 and external memory 83 are managed, central processing unit 81 is used to control the storage of external memory 83 to merge image.
So, the merging image of generation can be stored, and be checked after convenient, use or transfer.External memory 83 includes
SM (Smart Media) blocks and CF (Compact Flash) blocks etc..
Figure 31 is referred to, in some embodiments, electronic installation 200 also includes the center being connected with imaging device 100
Processor 81 and display device 85, central processing unit 81 are used to control the display of display device 85 to merge image.So, electronic installation
The image of 200 shootings can be shown in display device so that user checks.Display device is including light-emitting diode display etc..
To sum up, using the electronic installation of embodiment of the present invention, there is camera function and color can be generated under low-light (level)
Completely, signal to noise ratio is high, the high merging image of definition.Particularly, when this electronic installation is the Front camera of mobile phone, can be lifted
The brightness of self-timer image and definition under low-light (level), reduce noise.
Part not deployed in imaging method and electronic installation, see embodiment of above in embodiment of the present invention
The corresponding part of imaging sensor and imaging device, is no longer developed in details herein.
Part not deployed in imaging method and electronic installation, see embodiment of above in embodiment of the present invention
The corresponding part of imaging sensor and imaging device, is no longer developed in details herein.
In the description of this specification, reference term " embodiment ", " some embodiments ", " schematically implementation
The description of mode ", " example ", " specific example " or " some examples " etc. means to combine the specific spy that embodiment or example describe
Sign, structure, material or feature are contained at least one embodiment or example of the present invention.In this manual, to upper
The schematic representation for stating term is not necessarily referring to identical embodiment or example.Moreover, description specific features, structure,
Material or feature can combine in an appropriate manner in any one or more embodiments or example.
Any process or method described otherwise above description in flow chart or herein is construed as, and represents to include
Module, fragment or the portion of the code of the executable instruction of one or more the step of being used to realize specific logical function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
Defeated program is for instruction execution system, device or equipment or the dress used with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium, which can even is that, to print the paper of described program thereon or other are suitable
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the present invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In embodiment, software that multiple steps or method can be performed in memory and by suitable instruction execution system with storage
Or firmware is realized.If, and in another embodiment, can be with well known in the art for example, realized with hardware
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, have suitable combinational logic gate circuit application specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method carries
Suddenly it is that by program the hardware of correlation can be instructed to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, can also
That unit is individually physically present, can also two or more units be integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and as independent production marketing or in use, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.
Claims (29)
1. a kind of imaging method, it is characterised in that comprise the following steps：
Imaging sensor provides step：There is provided imaging sensor, described image sensor include photosensitive pixel array, optical filter and
Optical filtering control device, the optical filter include filter unit array, and the filter unit includes multiple optical filtering pixels, the optical filtering
Piece is including multiple, and the optical filtering control device is used to switch the optical filter above the photosensitive pixel array so that covering institute
The optical filtering pixel for stating photosensitive pixel switches between colorized optical filtering pixel and white optical filtering pixel, each filter unit
The 2*2 photosensitive pixels are covered, the photosensitive pixel of each filter unit covering, which is formed, merges pixel；
Rate-determining steps：The optical filtering control device is controlled to switch the filter above the photosensitive pixel array according to ambient brightness
For mating plate so that at least partly described optical filtering pixel is switched into colorized optical filtering pixel, the rate-determining steps are described photosensitive by increasing
The optical filter above pel array passes through reduction so that the colorized optical filtering pixel is switched into the white optical filtering pixel
The optical filter of the photosensitive pixel array is covered so that the white optical filtering pixel is switched into the colorized optical filtering pixel, or
The rate-determining steps are by replacing the optical filter above the photosensitive pixel array so that the optical filtering pixel is described
Switch between colorized optical filtering pixel and the white optical filtering pixel；And
Read step：The output of the photosensitive pixel array is read, and handles the same photosensitive pixel for merging pixel
Output to obtain the pixel value of the merging pixel so as to generating merging image.
2. imaging method as claimed in claim 1, it is characterised in that the filter unit array includes Bayer (Bayer) battle array
Row.
3. imaging method as claimed in claim 1, it is characterised in that the rate-determining steps further comprise：
Sense ambient brightness；
Judge whether the ambient brightness is less than the first predetermined threshold；And
When the ambient brightness is less than first predetermined threshold, the optical filtering control device is controlled to switch the photosensitive pixel
The optical filter above array is described white so that three of the same filter unit or two optical filtering pixels to be switched to
Color optical filtering pixel.
4. imaging method as claimed in claim 3, it is characterised in that the filter unit include the first green filter unit and
Second green filter unit, the rate-determining steps further comprise：
Judge whether the ambient brightness is more than first predetermined threshold and is less than the second predetermined threshold；And
When the ambient brightness is more than first predetermined threshold and is less than second predetermined threshold, the control that filters is controlled
Device processed switches the optical filter above the photosensitive pixel array with by the first green filter unit and described second
All optical filtering pixels of green filter unit switch to the white optical filtering pixel.
5. imaging method as claimed in claim 4, it is characterised in that the rate-determining steps further comprise：
Judge whether the ambient brightness is more than second predetermined threshold and is less than the 3rd predetermined threshold；And
The control that filters is controlled when the ambient brightness is more than second predetermined threshold and is less than three predetermined threshold
Device processed switches the optical filter above the photosensitive pixel array with by all described of the first green filter unit
Optical filtering pixel switches to the white optical filtering pixel, or by the first green filter unit and the second green filter unit
Two of which or three optical filtering pixels switch to the white optical filtering pixel.
6. imaging method as claimed in claim 5, it is characterised in that the rate-determining steps further comprise：
Judge whether the ambient brightness is more than the 3rd predetermined threshold and is less than the 4th predetermined threshold；And
The control dress that filters is controlled when the ambient brightness is more than the 3rd predetermined threshold and is less than four predetermined thresholds
Put and switch the optical filter above the photosensitive pixel array with by the first green filter unit and/or described second green
One of them described optical filtering pixel of color filter unit switches to the white optical filtering pixel.
7. imaging method as claimed in claim 6, it is characterised in that the rate-determining steps further comprise：
Judge whether the ambient brightness is more than the 4th predetermined threshold；And
The optical filtering control device is controlled to switch the photosensitive pixel when the ambient brightness is more than four predetermined threshold
The optical filter above array by all optical filtering pixels to switch to the colorized optical filtering pixel.
8. imaging method as claimed in claim 3, it is characterised in that the rate-determining steps further comprise：
Judge whether the ambient brightness is more than first predetermined threshold and is less than the 5th predetermined threshold；And
When the ambient brightness is more than first predetermined threshold and is less than five predetermined threshold, control, which filters, controls dress
Put and switch the optical filter above the photosensitive pixel array with by one of the same filter unit optical filtering pixel
Switch to the white optical filtering pixel.
9. the imaging method as described in claim 1-8 any one, it is characterised in that the read step further comprises：
Calculate the average value of the output of the same photosensitive pixel for merging pixel or and to obtain the merging pixel
Pixel value.
10. imaging method as claimed in claim 9, the read step further comprises：
Color rendition processing is carried out to the merging image.
11. the imaging method as described in claim 1-8 any one, it is characterised in that the merging pixel includes color images
Element value and white pixel value；The read step includes：
Calculate the average value or and the and conduct color images of the output of the photosensitive pixel of the colorized optical filtering pixel covering
Element value；And
The luminance components of the color pixel values is replaced to be used as the merging pixel after the luminance component of the white pixel value
Pixel value.
12. a kind of imaging device, it is characterised in that including：
Imaging sensor, described image sensor include：
Photosensitive pixel array；
Optical filter；And
The optical filtering control device being connected with the optical filter；
The optical filter includes filter unit array, and the filter unit includes multiple optical filtering pixels, and the optical filter includes more
Individual, the optical filtering control device is used to switch the optical filter above the photosensitive pixel array so as to cover the light-sensitive image
The optical filtering pixel of element switches between colorized optical filtering pixel and white optical filtering pixel, each filter unit covering 2*2
The individual photosensitive pixel, the photosensitive pixel of each filter unit covering, which is formed, merges pixel；
The optical filtering control device is used to switch the optical filter above the photosensitive pixel array according to ambient brightness control
So that at least partly described optical filtering pixel is switched into colorized optical filtering pixel, the optical filtering control device is used for by increasing the sense
The optical filter above light image pixel array by the colorized optical filtering pixel to switch to the white optical filtering pixel, and by subtracting
The optical filter of the photosensitive pixel array is covered less so that the white optical filtering pixel is switched into the colorized optical filtering pixel,
Or the optical filtering control device is used for by replacing the optical filter above the photosensitive pixel array so that the optical filtering
Pixel switches between the colorized optical filtering pixel and the white optical filtering pixel；
The imaging device also includes image processing module, and described image processing module is used to read the photosensitive pixel array
Output, and handle it is same it is described merge pixel the photosensitive pixel output with obtain it is described merging pixel pixel value so as to
Generation merges image.
13. imaging device as claimed in claim 12, it is characterised in that the filter unit array includes Bayer array.
14. imaging device as claimed in claim 12, it is characterised in that described image processing module optical filtering control device is used for
Switch the optical filter above the photosensitive pixel array when the ambient brightness is less than the first predetermined threshold with will be same
The three or two optical filtering pixels switch to the white optical filtering pixel in the filter unit.
15. imaging device as claimed in claim 14, it is characterised in that the filter unit includes the first green filter unit
And the second green filter unit；
The optical filtering control device is additionally operable to cut when the ambient brightness is less than the second predetermined threshold more than the first predetermined threshold
The optical filter changed above the photosensitive pixel array is with by the first green filter unit and second green filter
All optical filtering pixels of unit switch to the white optical filtering pixel.
16. imaging device as claimed in claim 15, it is characterised in that the optical filtering control device is additionally operable in the environment
Brightness is more than second predetermined threshold and switches the filter above the photosensitive pixel array when being less than three predetermined thresholds
Mating plate by all optical filtering pixels of the first green filter unit to switch to the white optical filtering pixel, or for will
Two or three of the first green filter unit and the second green filter unit the optical filtering pixel switch to described
White optical filtering pixel.
17. imaging device as claimed in claim 16, it is characterised in that the optical filtering control device is additionally operable in the environment
Brightness switches the filter above the photosensitive pixel array when being more than the 3rd predetermined threshold and being less than four predetermined thresholds
Mating plate is so that an optical filtering pixel of the first green filter unit and/or the second green filter unit to be switched to
The white optical filtering pixel.
18. imaging device as claimed in claim 17, it is characterised in that the optical filtering control device is additionally operable in the environment
Brightness switches the optical filter above the photosensitive pixel array with by all filters when being more than four predetermined threshold
Light pixel switches to the colorized optical filtering pixel.
19. imaging device as claimed in claim 14, it is characterised in that the optical filtering control device is additionally operable in the environment
Brightness is more than the optical filtering switched when first predetermined threshold is less than five predetermined thresholds above the photosensitive pixel array
Piece by all optical filtering pixels to switch to the colorized optical filtering pixel.
20. imaging device as claimed in claim 12, it is characterised in that described image processing module is same described for calculating
Merge the average value of the output of the photosensitive pixel of pixel or and to obtain the pixel value of the merging pixel.
21. imaging device as claimed in claim 20, it is characterised in that described image processing module is used to merge figure to described
As carrying out color rendition processing.
22. imaging device as claimed in claim 12, it is characterised in that the merging pixel includes color pixel values and white
Pixel value；
Described image processing module is used for the average value for calculating the output of the photosensitive pixel of the colorized optical filtering pixel covering
Or and and be used as the color pixel values, and for replacing the luminance components of the color pixel values as the white pixel value
Pixel value after luminance component as the merging pixel.
23. imaging device as claimed in claim 12, it is characterised in that described image sensor includes analog-digital converter, often
The individual photosensitive pixel is connected with an analog-digital converter respectively.
24. imaging device as claimed in claim 12, it is characterised in that described image sensor includes being arranged on the optical filtering
Micro mirror array on piece, each micro mirror are corresponding with a photosensitive pixel.
25. a kind of electronic installation, it is characterised in that including the imaging device as described in claim 12-24 any one.
26. electronic installation as claimed in claim 25, it is characterised in that the electronic installation includes mobile phone.
27. electronic installation as claimed in claim 26, it is characterised in that the imaging device includes the preposition phase of the mobile phone
Machine.
28. electronic installation as claimed in claim 25, it is characterised in that the electronic installation includes connecting with the imaging device
The central processing unit and external memory connect, the central processing unit are used to control the external memory to store the merging image.
29. electronic installation as claimed in claim 25, it is characterised in that the electronic installation also includes and the imaging device
The central processing unit and display device of connection, the central processing unit are used to control the display device to show the merging figure
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963879.4A CN105578006B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic installation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963879.4A CN105578006B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic installation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105578006A CN105578006A (en) | 2016-05-11 |
| CN105578006B true CN105578006B (en) | 2018-02-13 |
Family
ID=55887623
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510963879.4A Active CN105578006B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic installation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105578006B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105516697B (en) | 2015-12-18 | 2018-04-17 | 广东欧珀移动通信有限公司 | Imaging sensor, imaging device, mobile terminal and imaging method |
| CN105578072A (en) | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | Imaging method, imaging device and electronic device |
| CN106210532B (en) * | 2016-07-29 | 2019-10-11 | 宇龙计算机通信科技(深圳)有限公司 | One kind is taken pictures processing method and terminal device |
| CN106454054B (en) * | 2016-11-29 | 2019-03-19 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| CN106504218B (en) | 2016-11-29 | 2019-03-12 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| CN106507018B (en) * | 2016-11-29 | 2019-05-10 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| CN106341670B (en) | 2016-11-29 | 2017-09-22 | 广东欧珀移动通信有限公司 | Control method, control device and electronic installation |
| CN110087065A (en) * | 2019-04-30 | 2019-08-02 | 德淮半导体有限公司 | Semiconductor device and its manufacturing method |
| CN115152198B (en) * | 2020-07-14 | 2024-02-09 | 深圳市汇顶科技股份有限公司 | Image sensor and related electronic device |
| CN114205566A (en) * | 2020-09-18 | 2022-03-18 | 北京小米移动软件有限公司 | Photosensitive element, photosensitive control method, photosensitive control device and medium |
| CN114650377A (en) * | 2022-03-22 | 2022-06-21 | 维沃移动通信有限公司 | Camera module, control method of camera module and electronic equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7924483B2 (en) * | 2006-03-06 | 2011-04-12 | Smith Scott T | Fused multi-array color image sensor |
| JP4386096B2 (en) * | 2007-05-18 | 2009-12-16 | ソニー株式会社 | Image input processing apparatus and method |
| JP5359465B2 (en) * | 2009-03-31 | 2013-12-04 | ソニー株式会社 | Solid-state imaging device, signal processing method for solid-state imaging device, and imaging device |
| JP5044673B2 (en) * | 2010-03-25 | 2012-10-10 | 株式会社東芝 | Solid-state imaging device and image recording device |
| AU2012374649A1 (en) * | 2012-03-27 | 2014-09-11 | Sony Corporation | Image processing device, image-capturing element, image processing method, and program |
| CN104345523B (en) * | 2013-08-05 | 2017-07-28 | 杭州海康威视数字技术股份有限公司 | Method and its device that intelligent transportation video camera part light-inletting quantity is automatically controlled |
| CN104661008B (en) * | 2013-11-18 | 2017-10-31 | 深圳中兴力维技术有限公司 | The treating method and apparatus that color image quality is lifted under low light conditions |
-
2015
- 2015-12-18 CN CN201510963879.4A patent/CN105578006B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN105578006A (en) | 2016-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN105430359B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN105578078B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN107426470A (en) | Camera module and electronic installation | |
| CN105430360B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN102165762B (en) | Imaging device and signal processing circuit for the imaging device | |
| CN105430362B (en) | Imaging method, imaging device and electronic installation | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN107977940A (en) | background blurring processing method, device and equipment | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105578081B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN107534735A (en) | Image processing method, device and the terminal of terminal | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN105516697B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
| CN107534727A (en) | Image processing apparatus, camera device, image processing method and image processing program | |
| CN107249109A (en) | Image sensor, camera module and electronic installation | |
| CN113126300B (en) | Augmented reality glasses and display picture adjusting method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. |
|
| CP03 | Change of name, title or address |