CN105578080B - Imaging method, imaging device and electronic device - Google Patents
Imaging method, imaging device and electronic device Download PDFInfo
- Publication number
- CN105578080B CN105578080B CN201510964387.7A CN201510964387A CN105578080B CN 105578080 B CN105578080 B CN 105578080B CN 201510964387 A CN201510964387 A CN 201510964387A CN 105578080 B CN105578080 B CN 105578080B
- Authority
- CN
- China
- Prior art keywords
- pixel
- merging
- image
- photosensitive
- white
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
Abstract
The invention discloses a kind of imaging method, firstly, provide imaging sensor, imaging sensor includes photosensitive pixel array and the optical filter that is arranged on photosensitive pixel array, and optical filter includes filter unit array, and filter unit includes white filter area and colorized optical filtering area.White filter area and colorized optical filtering area are covered each by multiple photosensitive pixels.Then, the output of photosensitive pixel array is read, and the pixel value for merging pixel is calculated to generate merging image according to the output of the same photosensitive pixel for merging pixel.Obtained merging image includes complete color information, and brightness and clarity are higher, and noise is less.The invention also discloses the electronic devices of a kind of imaging sensor that can be used for realizing this imaging method, imaging device and application imaging device.
Description
Technical field
The present invention relates to imaging technique, in particular to a kind of imaging method, imaging sensor, imaging device and electronics dress
It sets.
Background technique
The optical filtering pixel arrangements of conventional images sensor are RG, GB or RW, and GW, wherein R, G, B and W respectively represent red
Color, green, blue and white.RG, GB are traditional arrangement modes, can collect accurate color information, but under low-light (level)
Noise is more, unintelligible, RW, and GW arrangement mode can receive preferable clarity under low-light (level), but color can inaccuracy.
Summary of the invention
The present invention is directed at least solve one of the technical problems existing in the prior art.For this purpose, the present invention needs to provide one
Kind imaging method, imaging sensor, imaging device and electronic device.
The imaging method of embodiment of the present invention the following steps are included:
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is set to the photosensitive pixel array
On optical filter, the optical filter includes filter unit array, and the filter unit includes white filter area and colorized optical filtering area；
The white filter area and the colorized optical filtering area are covered each by multiple photosensitive pixels；The same filter unit covering
The photosensitive pixel, which is constituted, merges pixel；And
The output of the photosensitive pixel array is read, and according to the output of the same photosensitive pixel for merging pixel
The pixel value for merging pixel is calculated to generate merging image.
In the imaging method of embodiment of the present invention, each filter unit of provided imaging sensor includes that covering is multiple
The white filter area of photosensitive pixel and the colorized optical filtering area of the multiple photosensitive units of covering.The same filter unit covers described
Photosensitive pixel, which is constituted, merges pixel.The output of photosensitive pixel array is read, and according to the defeated of the same photosensitive pixel for merging pixel
Calculate the pixel value for merging pixel out to generate merging image.Obtained merging image includes complete color information, and brightness
Higher with clarity, noise is less.It solves the problems, such as certain in existing imaging method.
In some embodiments, each described 2*2 photosensitive pixels of filter unit covering.
In some embodiments, the read step further comprises:
The output of the photosensitive pixel of acquisition row k and+1 row of kth is simultaneously stored in register, wherein k=2n-1, and n is certainly
So number, k+1 are less than or equal to total line number of the photosensitive pixel array；And
The output of the photosensitive pixel of+1 row of the row k and kth is extracted from the register to obtain the conjunction
And the pixel value of pixel.
In some embodiments, the pixel value for merging pixel includes color images corresponding with the colorized optical filtering area
Element value and white pixel value corresponding with the white filter area；
The read step further comprises:
It generates colored merging image according to the color pixel values and gray scale is generated according to the white pixel value and merge figure
Picture.
In some embodiments, the read step further comprises:
The output of the same corresponding multiple photosensitive pixels of the colorized optical filtering region for merging pixel is added
As the color pixel values for merging pixel, and the same white filtered region for merging pixel is corresponding multiple
The output of the photosensitive pixel is added as the white pixel value for merging pixel.
In some embodiments, the read step further comprises:
By the colored colored subgraph for merging image and being changed into yuv format；And
The brightness value of the colored subgraph is replaced with into the gray scale and merges the brightness value of image to obtain the conjunction
And image.
In some embodiments, each photosensitive pixel is connect with an analog-digital converter respectively；
The imaging method further comprises:
The analog signal output that the photosensitive pixel generates is converted into digital signal output；And
The same digital signal for merging the corresponding photosensitive pixel in colorized optical filtering area described in pixel is defeated
It is added out to obtain the color pixel values for merging pixel, and white filter area described in the same merging pixel is corresponding
The photosensitive pixel the digital signal output phase obtained it is described merge pixel white pixel value.
The present invention also provides a kind of imaging sensors, in some embodiments, comprising:
Photosensitive pixel array；And
The optical filter being set on the photosensitive pixel array；
The optical filter includes filter unit array, and each filter unit includes white filter area and colorized optical filtering
Area；The white filter area and the colorized optical filtering area are covered each by multiple photosensitive pixels.
The photosensitive pixel of the same filter unit covering, which is constituted, merges pixel.
In some embodiments, the colorized optical filtering area forms Bayer array.
In some embodiments, each filter unit includes the 2*2 photosensitive pixels.
In some embodiments, each colorized optical filtering area for merging pixel and the white filter area difference
Cover two photosensitive pixels.
In some embodiments, described image sensor includes control module, and the control module is described for controlling
Photosensitive pixel array exposes line by line.
In some embodiments, described image sensor further includes register, and the control module is for successively acquiring
The output of the photosensitive pixel for+1 row of row k and kth that current exposure is completed simultaneously is stored in the register, wherein k=2n-1,
N is natural number, and k+1 is less than or equal to total line number of the photosensitive pixel array.
In some embodiments, described image sensor includes analog-digital converter array, each analog-digital converter
It is connect with a photosensitive pixel.
In some embodiments, described image sensor includes micro mirror array, each micro mirror and multiple senses
Light pixel is corresponding.
The present invention also provides a kind of imaging device comprising the imaging sensor in above embodiment；
The imaging device further includes the image processing module connecting with described image sensor；
Described image processing module is for reading and handling the output of the photosensitive pixel array to obtain the merging picture
For the pixel value of element to form merging image, the pixel value for merging pixel includes colour corresponding with the colorized optical filtering area
Pixel value and white pixel value corresponding with the white filter area, the color pixel values merge image for constituting colour,
The white pixel value merges image for constituting gray scale.
In some embodiments, described image processing module is used to correspond to the same merging pixel the colored filter
The output of multiple photosensitive pixels in light region is added as the color pixel values for merging pixel, and is used for same institute
The output for stating multiple photosensitive pixels that merging pixel corresponds to the white filtered region is added as the merging pixel
White pixel value.
In some embodiments, described image processing module is also used to the colored image that merges being changed into YUV lattice
The colored subgraph of formula.
Described image processing module, which is also used to the brightness value of the colored sub-image pixels to replace with the gray scale, to be merged
The brightness value of image respective pixel is to obtain the merging image.
The present invention also provides a kind of electronic devices comprising the imaging device in above embodiment.
In some embodiments, the electronic device includes mobile phone.
In some embodiments, the imaging device includes the Front camera of the mobile phone.
In some embodiments, the electronic device includes the central processing unit and external memory connecting with the imaging device
Reservoir, the central processing unit store the merging image for controlling the external memory.
In some embodiments, the electronic device further includes the central processing unit connecting with the imaging device and shows
Showing device, the central processing unit show the merging image for controlling the display device.
Additional aspect and advantage of the invention will be set forth in part in the description, and will partially become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention is from combining in description of the following accompanying drawings to embodiment by change
It obtains obviously and is readily appreciated that, in which:
Fig. 1 is the flow diagram of the imaging method of embodiment of the present invention.
Fig. 2 is that the reading photosensitive pixel of embodiment of the present invention imaging method exports and generates the flow diagram of image.
Fig. 3 is that the processing photosensitive pixel of embodiment of the present invention imaging method exports and generates the flow diagram of image.
Fig. 4 is that the processing photosensitive pixel of embodiment of the present invention imaging method exports and generates the flow diagram of image.
Fig. 5 is that the processing photosensitive pixel of embodiment of the present invention imaging method exports and generates the flow diagram of image.
Fig. 6 is that the processing photosensitive pixel of embodiment of the present invention imaging method exports and generates the flow diagram of image.
Fig. 7 is the schematic side view of the imaging sensor of embodiment of the present invention.
Fig. 8 is the filter unit schematic diagram of the imaging sensor of embodiment of the present invention.
Fig. 9 is the filter unit array schematic diagram of Bayer structure.
Figure 10 is the filter unit array schematic diagram of the imaging sensor of embodiment of the present invention.
Figure 11 is the schematic perspective view of the imaging sensor of embodiment of the present invention.
Figure 12 is the functional block diagram of the imaging sensor of embodiment of the present invention.
Figure 13 is the electrical block diagram of the photosensitive pixel of embodiment of the present invention imaging sensor.
Figure 14 is the functional block diagram of the imaging sensor of embodiment of the present invention.
Figure 15 is the schematic perspective view of the imaging sensor of embodiment of the present invention.
Figure 16 is the functional block diagram of the imaging device of embodiment of the present invention.
Figure 17 is the functional block diagram of the electronic device of embodiment of the present invention.
Figure 18 is the functional block diagram of the electronic device of embodiment of the present invention.
Specific embodiment
The embodiment of embodiments of the present invention is described below in detail, the example of the embodiment is shown in the accompanying drawings
Out, in which the same or similar labels are throughly indicated same or similar element or members with the same or similar functions
Part.It is exemplary below with reference to the embodiment of attached drawing description, embodiment for explaining only the invention, and cannot
It is interpreted as the limitation to embodiments of the present invention.
The imaging method of embodiments of the present invention, imaging sensor, imaging device and electronics are filled below in conjunction with attached drawing
It sets and is described further.
Referring to Fig. 1, the imaging method of embodiment of the present invention the following steps are included:
S1, provides imaging sensor, and imaging sensor includes photosensitive pixel array and is set on photosensitive pixel array
Optical filter, optical filter include filter unit array, and filter unit includes white filter area and colorized optical filtering area；White filter area covers
Cover multiple photosensitive pixels；Colorized optical filtering area covers multiple photosensitive pixel white filter areas and colorized optical filtering area is covered each by multiple senses
Light pixel；The photosensitive pixel of same filter unit covering, which is constituted, merges pixel
S2 reads the output of photosensitive pixel array, and is calculated and merged according to the output of the same photosensitive pixel for merging pixel
The pixel value of pixel is to generate merging image.
The colorized optical filtering area of filter unit in the imaging method of embodiment of the present invention is used to obtain the color for merging pixel
Multimedia message, luminance information and this luminance information noise of the white filter area for obtaining merging pixel under low-light (level) are less.Such as
This, the pixel value of composograph had not only included color information but also had included the luminance information of low noise degree, and the color of composograph is complete, bright
Degree and clarity are preferable, and noise is few.
It please join Figure 11, in some embodiments, each filter unit covers 2*2 photosensitive pixel.
It please join Fig. 2, in imaging method in the present embodiment, step S2 further comprises:
S21: the output of the photosensitive pixel of acquisition row k and+1 row of kth is simultaneously stored in register, wherein k=2n-1, and n is certainly
So number, k+1 are less than or equal to total line number of photosensitive pixel array；
S23: the output of the photosensitive pixel of row k and+1 row of kth is extracted from register to obtain the pixel for merging pixel
Value；
In this way, register can be made full use of to realize output reading, caching and the combined process of photosensitive unit, hardware
Easy to accomplish and processing speed is very fast.
It please join Fig. 3, in some embodiments, the pixel value for merging pixel includes color images corresponding with colorized optical filtering area
Element value and white pixel value corresponding with white filter area；
Step S2 further comprises:
S25: colored merging image is generated according to color pixel values and gray scale merging image is generated according to white pixel value.
In this way, the complete colored merging image of color information is obtained according to the color pixel values for merging pixel, according to merging
The gray scale that the white pixel value of pixel obtains brightness under low-light (level) and clarity is preferable, noise is less merges image.
It please join Fig. 4, in some embodiments, step S2 further comprises:
The output of the corresponding multiple photosensitive pixels of the corresponding colorized optical filtering region of same merging pixel is added conduct by S24
Merge pixel color pixel values, and by it is same merge pixel the corresponding multiple photosensitive pixels of white filtered region output phase
Add as the white pixel value for merging pixel.
In this way, the output for merging pixel is the sum of each pixel output before merging, and merges using the method for pixel combination
The noise of pixel is less than the sum of each pixel noise before merging, therefore the noise that image is generated after merging is less, and noise compares
It is high.
It please join Fig. 5, in some embodiments, step S2 further comprises:
S27, by the colored colored subgraph for merging image and being changed into yuv format；And
The brightness value of colored subgraph is replaced with gray scale and merges the brightness value of image to obtain merging image by S29.
The image of yuv format includes brightness attribute, it will be understood that gray scale merges image by the white filter area of merging pixel
Corresponding white pixel value obtains, and compared to colorized optical filtering area, white filter area is smaller to the barrier effect of ambient, therefore
In same merging pixel, the corresponding gray scale merging image brightness values of white pixel value are higher, noise is also less.It therefore, will be colored
The brightness value that the brightness value of subgraph replaces with gray scale merging image obtains merging image both having included complete color information, bright
Degree, clarity are also higher.Especially under low-light (level), merge image compared with the obvious noise of colored subgraph before replacement brightness value
It is less.
It please join Fig. 6, in some embodiments, each photosensitive pixel is connect with an analog-digital converter respectively；
Step S2 further comprises:
The analog signal output that photosensitive pixel generates is converted to digital signal output by S31；
S33 is obtained the digital signal output phase of the corresponding photosensitive pixel of filter area colored in same merging pixel
Merge the color pixel values of pixel, and the digital signal of the corresponding photosensitive pixel of filter area white in same merging pixel is exported
It is added to obtain merging the white pixel value of pixel.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor)
Processing module can directly handle the output of imaging sensor, two, relative to it is certain by circuit directly to imaging sensor
Analog signal format the scheme that is handled of output for, the information of image is preferably remained, for example, for 16M picture
For the imaging sensor of element, the imaging method of embodiment of the present invention can retain the letter of 16M pixel (image before merging)
Breath obtains the merging image of 4M pixel or the image of other resolution ratio by processing on this basis.
The imaging method of embodiment of the present invention can be realized by the imaging sensor of embodiment of the present invention.
Fig. 7 and Fig. 8 is please referred to, the imaging sensor 10 of embodiment of the present invention includes photosensitive pixel array 11 and is set to
Optical filter 13 on photosensitive pixel array 11.Optical filter 13 includes filter unit array 131, and each filter unit 1311 includes white
Color filter area 1313 and colorized optical filtering area 1315, white filter area 1313 cover multiple photosensitive pixels 111, colorized optical filtering area
The 1315 multiple photosensitive pixels 111 of covering.Such as in Fig. 8, colorized optical filtering area 1315 is green filter area, covers 3 photosensitive pixels
111.The photosensitive pixel 111 that same filter unit 1311 covers, which is constituted, merges pixel.Extraneous light is irradiated to by optical filter 13
The photosensitive part 1111 of photosensitive pixel 111 is to generate electric signal, the i.e. output of photosensitive pixel 111.
The colorized optical filtering area 1315 of the filter unit 1311 of the imaging sensor of embodiment of the present invention merges for obtaining
The color information of pixel, white filter area 1313 merge the luminance information and this luminance information of pixel for obtaining under low-light (level)
Noise is less.Not only included color information with the pixel value of this composograph generated but also included the luminance information of low noise degree, had synthesized
The color of image is complete, and brightness and clarity are preferable, and noise is few.
Referring to Fig. 9, in some embodiments, colorized optical filtering area forms Bayer array (Bayer pattern).Bayer
In array include filtering structure 1317, each filtering structure 1317 include 2*2 filter unit 1311, be respectively green, red,
Blue, green filter unit 1311.
Picture signal can be handled to the algorithm of Bayer structure using conventional needle using Bayer structure, without hardware
Big adjustment is done in structure.
In traditional filter unit array structure, each filter unit corresponds to multiple photosensitive pixels and image pixel.It please join
Figure 10 is read, in the present embodiment, filter unit array 131 uses Bayer structure, including filtering structure 1317, each optical filtering
Structure 1317 includes green, red, blue, green filter unit 1311, and unlike, each correspondence of filter unit 1311 is more
A photosensitive pixel 111, wherein white filter area 1313 and colorized optical filtering area 1315 respectively correspond multiple photosensitive pixels 111.
Figure 11 and Figure 10 is please referred to, in some embodiments, each filter unit 1311 covers 2*2 photosensitive pixel
111 to form merging pixel.
Other than 2*2 structure, there are also 3*3,4*4, the structures such as even any n*m (n, m are natural number), it will be understood that
The number of sequencable photosensitive pixel 111 is limited on photosensitive pixel array 11, each light-sensitive image for merging pixel and being included
If element 111 is excessive, the resolution sizes of image will receive limitation, e.g., if the pixel value of photosensitive pixel array 11 is 16M, adopt
Can obtain the merging image that resolution ratio is 4M with the merging dot structure of 2*2, and use 4*4 structure just and can only obtain resolution ratio for
The merging image of 1M.Therefore the merging dot structure of 2*2 is a preferred arrangement mode, in the premise for sacrificing resolution ratio less as far as possible
Lower promotion brightness of image and clarity.Meanwhile the reading and conjunction that realization exports photosensitive pixel on hardware are facilitated using 2*2 structure
And it handles.
Figure 11 and Figure 10 is please referred to, in some embodiments, each white filter area 1313 and colour for merging pixel
Filter area 1315 is covered each by two photosensitive pixels 111.
In this way, white filter area 1313 and colorized optical filtering area 1315 sufficiently cover four photosensitive pixels 111 for merging pixel
Lid.
Figure 12 is please referred to, in some embodiments, imaging sensor further includes control module 17, and control module 17 is used for
Control photosensitive pixel array 11 exposes line by line.Control module 17 is connected with row selection logic unit 171 and column selection logic unit
173, the output of photosensitive pixel 111 is handled line by line with control.
The mode for exposing and exporting line by line is easier to realize on hardware.
Also referring to Figure 12, in the present embodiment, imaging sensor 10 further includes register 19, and control module 17 is used
In the successively output of the photosensitive pixel 111 of+1 row of row k and kth of acquisition current exposure completion and it is stored in register 19, wherein k
=2n-1, n are natural number, and k+1 is less than or equal to total line number of photosensitive pixel array 11.
Specifically, please referring to Figure 12 and Figure 13, imaging sensor 10 includes patrolling with row selection logic unit 171 and column selection
Collect the control module 17 that unit 173 connects.Row selection logic unit 171 and column selection logic unit 173 and every multiple light-sensitive images
The corresponding switching tube 1115 of element 111 connects, and control module 17 is for controlling row selection logic unit 171 and column selection logic unit
173 to gate the switching tube 1115 of the photosensitive pixel 111 of specific position.
Control module 17 acquires the output of the photosensitive pixel of the first row and the second row first and is stored in register 19.Subsequent electricity
Road is handled the output for four photosensitive pixels 111 that position coordinates are 1-1,1-2,2-1,2-2 to obtain merging pixel
Pixel value.Wherein the left side number of position coordinates represents row, and digits right represents column.
The output for four photosensitive pixels that coordinate is 1-3,1-4,2-3,2-4 is handled again, obtains accordingly merging pixel
Pixel value.
And so on, until having handled last four photosensitive pixel of group of the first row and the second row.
By the above processing mode, the output of the photosensitive pixel of the third line and fourth line, fifth line and the 6th row etc. is carried out
Processing, until the output of whole photosensitive pixels handles completion.
It please join Figure 14 and Figure 13, in some embodiments, imaging sensor 10 includes 21 array of analog-digital converter, each
Photosensitive pixel 111 is connect with an analog-digital converter 17 respectively.Analog-digital converter 17 is used for the analog signal of photosensitive pixel 111
Output is converted to digital signal output.
Photosensitive pixel 111 in present embodiment includes photodiode 1113.Photodiode 1113 is used for illumination
It is converted into charge, and the charge relationship proportional to intensity of illumination generated.Switching tube 1115 is used to select logic unit according to row
171 and the control signal of column selection logic unit 173 come the conducting and disconnection of control circuit, when circuit conducting, source electrode is followed
Device 1117 (source follower) is used to convert the charge signal that photodiode 1113 is generated through illumination in voltage letter
Number.Analog-digital converter 211 (Analog-to-digital converter) is used to voltage signal being converted to digital signal, with
It is transmitted to subsequent conditioning circuit processing.
This output processing mode makes the output of photosensitive pixel be converted into digital signal, in following digital circuit or in chip
It is middle to be handled with software.Therefore the output information of each photosensitive pixel can be retained, for example, for the image of 16M pixel
For sensor, the imaging method of embodiment of the present invention can retain the information of 16M pixel (image before merging), in this base
The merging image of 4M pixel or the image of other resolution ratio are obtained by processing on plinth.It ultimately generates image and the probability of bad point occurs
It is lower.In addition, the noise of this output processing mode is smaller, noise is relatively high.
Figure 15 is please referred to, in some embodiments, imaging sensor 10 includes the micro mirror battle array being arranged on optical filter 13
Column 23, each micro mirror 231 are corresponding with multiple photosensitive pixels 111.
Specifically, each micro mirror 231 is corresponding with multiple photosensitive pixels 111, including size, position correspond to.In certain implementations
In mode, the corresponding 2*2 photosensitive pixel 111 of each filter unit 1311 and 2*2 micro mirror 191.It is terrible as technology develops
To the higher image of resolution ratio, the photosensitive pixel 111 on sensitive film is more and more, arranges more and more intensive, single photosensitive pixel
111 is also smaller and smaller, and light is affected, and 1111 area of photosensitive part of photosensitive pixel 111 is limited, micro mirror 191
Light can be gathered to photosensitive part 1111, to promote the light reception intensity of photosensitive pixel 111 to improve image quality.
To sum up, each filter unit of imaging sensor in embodiment of the present invention includes white filter area and colorized optical filtering
Area makes the pixel value for merging pixel not only include color information but also include the luminance information of low noise degree, to facilitate subsequent conditioning circuit to generate
The merging image that color is complete and signal-to-noise ratio is high.
It please join Figure 16, the present invention also provides a kind of imaging device 100 comprising the imaging sensor of embodiment of the present invention
It further include the image processing module 50 being connect with imaging sensor 10 except 10.Image processing module 50 is for reading and handling
Pixel value of the output of photosensitive pixel array 11 to obtain merging pixel merges the pixel value packet of pixel to form merging image
And the corresponding color pixel values in colorized optical filtering area and white pixel value corresponding with white filter area are included, color pixel values constitute color
Color merges image, and white pixel value constitutes gray scale and merges image.
Specifically, the imaging sensor of embodiment of the present invention may include control module 17, row selection logic unit 171,
Column selection logic unit 173, analog-digital converter array 21, register 19 etc., the output of photosensitive pixel array 11 is through analog-to-digital conversion
Device array 21 is converted to digital signal, is stored in register 19 line by line and is sent to the processing of image processing module 50, until all
The output of photosensitive pixel is processed to merge image to generate.
In this way, image processing module 50 is complete according to color pixel values corresponding with colorized optical filtering area generation color information
Colour merges image, and higher according to the corresponding white pixel value generation brightness of white filter area, and the less gray scale of noise merges
Image.
In the present embodiment, image processing module 50 is used to same merging pixel corresponding to the multiple of colorized optical filtering region
The output of photosensitive pixel is added as the color pixel values for merging pixel, and for same merging pixel to be corresponded to white filter area
The output of multiple photosensitive pixels in domain is added as the white pixel value for merging pixel.
In this way, the output of more photosensitive pixels is added, the merging pixel signal-to-noise ratio of formation is higher.For example it is assumed that original every
The output of a photosensitive pixel is S, noise N, and merging pixel includes m photosensitive pixel, then the pixel value for merging pixel is m*S,
And the noise for merging pixel isM is the natural number more than or equal to 1.It is appreciated that merging picture in the case where m > 1
The noise of element is less than the sum of the noise for merging preceding each photosensitive pixel output.And merge the output of pixel to merge preceding each light-sensitive image
The sum of element output, therefore the image after merging, including colored merging image and gray scale merge image, and noise declines noise on the whole
Than improving, clarity is promoted.
In some embodiments, image processing module is also used to colored colour for merging image and being changed into yuv format
Image.Image processing module is also used to the brightness value of colored sub-image pixels to replace with gray scale and merges the bright of image respective pixel
Angle value is to obtain merging image.
YUV is the picture format that color is described according to the principle of brightness and color difference, and yuv format includes many specific lattice
Formula, such as YUV422, YUV420 etc..In some embodiments, the colored pixel that merges includes green, red, blue combined pixels,
Image processing module is first to obtain the colored merging image of rgb format according to the colored pixel value for merging pixel to get each figure is arrived
Red luma value, Green brightness value, blue intensity values as pixel use R respectively, and G, B are indicated, then its corresponding yuv format
The brightness value Y=0.299*R+0.587*G+0.114*B of image pixel.
In this way, the colored subgraph of yuv format can be obtained.
Image processing module is used further to the brightness value of colored sub-image pixels be replaced with gray scale merging image respective pixel
Brightness value to obtain merge image.
Since the brightness value of colored sub-image pixels is only substituted, the integrality of its color information is not damaged.By
It is higher in the brightness value that white filter area has better translucent effect to export photosensitive pixel, therefore gray scale in low light situations
It is higher than the colored brightness for merging image to merge image, noise is also less.Therefore make color image luminance raising after replacement brightness,
Signal-to-noise ratio is promoted.
To sum up, using the imaging device of present embodiment, the brightness value of colored sub-image pixels is replaced with into gray scale and is merged
The brightness value of image respective pixel can promote its brightness, signal-to-noise ratio and clear on the basis of keeping its color information complete
Degree.
The present invention also provides a kind of electronic devices using imaging device.In some embodiments, electronic device includes
Imaging device.Therefore, electronic device has camera function and can generate color under low-light (level) complete, signal-to-noise ratio height, clarity
High merging image.
Electronic device can be mobile phone.
In some embodiments, imaging device can be the Front camera of mobile phone.Since Front camera is chiefly used in self-timer,
And self-timer generally requires to require the clarity of image and not high to image resolution requirement, using the electronics of present embodiment
Device can meet this requirement.
Figure 17 is please referred to, in some embodiments, electronic device 200 includes the centre connecting with imaging device 100
Device 81 and external memory 83 are managed, central processing unit 81 merges image for controlling the storage of external memory 83.
In this way, the merging image generated can be stored, checked after convenient, use or transfer.External memory 83 includes
SM (Smart Media) card and CF (Compact Flash) card etc..
Figure 18 is please referred to, in some embodiments, electronic device 200 further includes the center connecting with imaging device 100
Processor 81 and display device 85, central processing unit 81 merge image for controlling the display of display device 85.In this way, electronic device
The image of 200 shootings can be shown in display device so that user checks.Display device includes light-emitting diode display etc..
To sum up, using the electronic device of embodiment of the present invention, there is camera function and color can be generated under low-light (level)
Completely, signal-to-noise ratio is high, the high merging image of clarity.Particularly, it when this electronic device is the Front camera of mobile phone, can be promoted
The brightness and clarity of self-timer image under low-light (level) reduce noise.
Part undeployed in imaging method and electronic device, can join the figure of embodiment of above in embodiment of the present invention
As sensor or the corresponding part of imaging device, no longer it is developed in details herein.
In the description of this specification, reference term " embodiment ", " some embodiments ", " schematically implementation
The description of mode ", " example ", specific examples or " some examples " etc. means the tool described in conjunction with the embodiment or example
Body characteristics, structure, material or feature are contained at least one embodiment or example of the invention.In the present specification,
Schematic expression of the above terms are not necessarily referring to identical embodiment or example.Moreover, the specific features of description, knot
Structure, material or feature can be combined in any suitable manner in any one or more embodiments or example.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example
Property, it is not considered as limiting the invention, those skilled in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, modifies, replacement and variant.
Claims (12)
1. a kind of imaging method, which comprises the following steps:
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is set on the photosensitive pixel array
Optical filter, the optical filter include filter unit array, and the filter unit includes white filter area and colorized optical filtering area；It is described
White filter area and the colorized optical filtering area are covered each by multiple photosensitive pixels；The same filter unit covers described
Photosensitive pixel, which is constituted, merges pixel；
Colored merging image is generated according to the corresponding color pixel values in the colorized optical filtering area, and according to the white filter area pair
The white pixel value answered generates gray scale and merges image, described to merge as the pixel value of pixel includes the color pixel values and described
White pixel value；With
It is replaced by the colored colored subgraph for merging image and being changed into yuv format, and by the brightness value of the colored subgraph
It is changed to the gray scale and merges the brightness value of image to obtain merging image.
2. imaging method as described in claim 1, which is characterized in that each described filter unit covering 2*2 described photosensitive
Pixel.
3. imaging method as claimed in claim 2, which is characterized in that described according to the corresponding color images in the colorized optical filtering area
Plain value generates colored merging image, and generates the step that gray scale merges image according to the corresponding white pixel value of the white filter area
Suddenly further comprise:
The output of the photosensitive pixel of acquisition row k and+1 row of kth is simultaneously stored in register, and wherein k=2n-1, n are natural number,
K+1 is less than or equal to total line number of the photosensitive pixel array；And
The output of the photosensitive pixel of+1 row of the row k and kth is extracted from the register to obtain the merging picture
The pixel value of element.
4. imaging method as claimed in claim 3, which is characterized in that
It is described to generate colored merging image according to the corresponding color pixel values in the colorized optical filtering area, and filtered according to the white
The step of corresponding white pixel value generation gray scale in area merges image further comprises:
The output of the same corresponding multiple photosensitive pixels of the colorized optical filtering region for merging pixel is added conduct
The color pixel values for merging pixel, and the same white filtered region for merging pixel is corresponding multiple described
The output of photosensitive pixel is added as the white pixel value for merging pixel.
5. imaging method as described in claim 1, which is characterized in that each photosensitive pixel respectively with an analog-to-digital conversion
Device connection；
The imaging method further comprises:
The analog signal output that the photosensitive pixel generates is converted into digital signal output；And
By the same digital signal output phase for merging the corresponding photosensitive pixel in colorized optical filtering area described in pixel
The color pixel values for merging pixel are obtained, and by the corresponding institute of white filter area described in the same merging pixel
The digital signal output phase for stating photosensitive pixel is obtained the white pixel value for merging pixel.
6. a kind of imaging device, it is characterised in that including imaging sensor, described image sensor include photosensitive pixel array and
The optical filter being set on the photosensitive pixel array, the optical filter include filter unit array, and the filter unit includes
White filter area and colorized optical filtering area；The white filter area and the colorized optical filtering area are covered each by multiple light-sensitive images
Element；The photosensitive pixel of the same filter unit covering, which is constituted, merges pixel；
The imaging device further includes the image processing module connecting with described image sensor；
Described image processing module is used for:
It reads and handles the output of the photosensitive pixel array to obtain the pixel value for merging pixel, it is described to merge pixel
Pixel value includes and the corresponding color pixel values in the colorized optical filtering area and white pixel value corresponding with the white filter area,
The color pixel values merge image for constituting gray scale for constituting colored merging image, the white pixel value；With
It is replaced by the colored colored subgraph for merging image and being changed into yuv format, and by the brightness value of the colored subgraph
It is changed to the gray scale and merges the brightness value of image to obtain merging image.
7. imaging device as claimed in claim 6, which is characterized in that described image processing module is used for the same merging
The output that pixel corresponds to multiple photosensitive pixels of the colorized optical filtering region is added as the color images for merging pixel
Element value, and for the same output for merging multiple photosensitive pixels that pixel corresponds to the white filtered region to be added
As the white pixel value for merging pixel.
8. a kind of electronic device, which is characterized in that including imaging device as claimed in claims 6 or 7.
9. electronic device as claimed in claim 8, which is characterized in that the electronic device includes mobile phone.
10. electronic device as claimed in claim 9, which is characterized in that the imaging device includes the preposition phase of the mobile phone
Machine.
11. electronic device as claimed in claim 8, which is characterized in that the electronic device includes connecting with the imaging device
The central processing unit and external memory connect, the central processing unit store the merging image for controlling the external memory.
12. electronic device as claimed in claim 8, which is characterized in that the electronic device further includes and the imaging device
The central processing unit and display device of connection, the central processing unit show the merging figure for controlling the display device
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964387.7A CN105578080B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964387.7A CN105578080B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105578080A CN105578080A (en) | 2016-05-11 |
| CN105578080B true CN105578080B (en) | 2019-02-05 |
Family
ID=55887686
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510964387.7A Active CN105578080B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105578080B (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105578072A (en) | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | Imaging method, imaging device and electronic device |
| CN106507080B (en) | 2016-11-29 | 2018-07-17 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| CN109348204A (en) * | 2018-10-30 | 2019-02-15 | 德淮半导体有限公司 | Imaging sensor and the method for generating image |
| CN109922286A (en) * | 2019-03-21 | 2019-06-21 | 思特威(上海)电子科技有限公司 | Cmos image sensor and its imaging method |
| CN115152198B (en) * | 2020-07-14 | 2024-02-09 | 深圳市汇顶科技股份有限公司 | Image sensor and related electronic device |
| CN113676675B (en) * | 2021-08-16 | 2023-08-15 | Oppo广东移动通信有限公司 | Image generation method, device, electronic equipment and computer readable storage medium |
| CN113676636B (en) * | 2021-08-16 | 2023-05-05 | Oppo广东移动通信有限公司 | Method and device for generating high dynamic range image, electronic equipment and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7924483B2 (en) * | 2006-03-06 | 2011-04-12 | Smith Scott T | Fused multi-array color image sensor |
-
2015
- 2015-12-18 CN CN201510964387.7A patent/CN105578080B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105578080A (en) | 2016-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430359B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN105578078B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105516697B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN102892008B (en) | Dual image capture processes | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN105611185B (en) | image generating method, device and terminal device | |
| CN105430362B (en) | Imaging method, imaging device and electronic installation | |
| CN105578081B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105578067B (en) | image generating method, device and terminal device | |
| CN105578072A (en) | Imaging method, imaging device and electronic device | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN105049718A (en) | Image processing method and terminal | |
| CN103491295B (en) | Image sensing system and the method driving this system | |
| CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105430360B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN110493583A (en) | Image processing method, device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: 523859 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |