CN105430361A - Imaging method, image sensor, imaging device and electronic device - Google Patents
Imaging method, image sensor, imaging device and electronic device Download PDFInfo
- Publication number
- CN105430361A CN105430361A CN201510964169.3A CN201510964169A CN105430361A CN 105430361 A CN105430361 A CN 105430361A CN 201510964169 A CN201510964169 A CN 201510964169A CN 105430361 A CN105430361 A CN 105430361A
- Authority
- CN
- China
- Prior art keywords
- pixel
- photosensitive pixel
- image
- merging
- white
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses an imaging method, comprising the steps of firstly, providing an image sensor, wherein the image sensor comprises a photosensitive pixel array and a filter arranged on the photosensitive pixel array, the filter comprises a filter unit array, each filter unit comprises a color filter area and a white filter area, the color filter area covers a photosensitive pixel, and the white filter area covers at least one photosensitive pixel; and then, reading the outputs of the photosensitive pixel array, and calculating the pixel values of combined pixels according to the outputs of the photosensitive pixels of the same combined pixels to generate a combined image. The obtained combined image includes complete color information, and is high in brightness and definition and low in noise. The invention further discloses an image sensor for implementing the imaging method, an imaging device and an electronic device using the imaging device.
Description
Technical field
The present invention relates to imaging technique, particularly a kind of formation method, imageing sensor, imaging device and electronic installation.
Background technology
The optical filtering pixel arrangements of conventional images transducer is RG, GB or RW, GW, and wherein R, G, B and W represent redness, green, blueness and white respectively.RG, GB are traditional arrangement modes, can collect color information accurately, but under low-light (level), noise is many, unintelligible, and RW, GW arrangement mode can receive better definition under low-light (level), but color can be inaccurate.
Summary of the invention
The present invention is intended at least to solve one of technical problem existed in prior art.For this reason, the present invention needs to provide a kind of formation method, imageing sensor, imaging device and electronic installation.
The formation method of embodiment of the present invention comprises the following steps:
There is provided imageing sensor, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, and described filter comprises filter unit array, and described filter unit comprises colorized optical filtering district and white filter area; Described colorized optical filtering district covers a described photosensitive pixel; Described white filter area covers photosensitive pixel described at least one; The described photosensitive pixel that same described filter unit covers forms merging pixel; And
Read the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.
In the formation method of embodiment of the present invention, provide each filter unit of imageing sensor comprise the colorized optical filtering district of a covering photosensitive pixel and cover the white filter area of at least one photosensitive unit.The described photosensitive pixel that same described filter unit covers forms merging pixel.Read the output of photosensitive pixel array, and the pixel value calculating merging pixel according to the output of the photosensitive pixel of same merging pixel merges image to generate.The merging image obtained comprises complete color information, and brightness and definition higher, noise is less.Solve some problem in existing formation method.
In some embodiments, each described filter unit covers 2*2 described photosensitive pixel.
In some embodiments, described read step comprises further:
Gather the output of the described photosensitive pixel of row k and kth+1 row and stored in register, wherein k=2n-1, n are natural number, k+1 is less than or equal to total line number of described photosensitive pixel array; And
The output of the described photosensitive pixel of described row k and kth+1 row is extracted to obtain the pixel value of described merging pixel from described register.
In some embodiments, the pixel value of described merging pixel comprises the white pixel value corresponding with described white filter area and the color pixel values corresponding with described colorized optical filtering district;
Described read step comprises further:
Generate white according to described white pixel value merge image and generate coloured image according to described color pixel values.
In some embodiments,
Described read step comprises further:
Using corresponding for same described merging pixel described white filtered region at least one described in the output of photosensitive pixel be added white pixel value as described merging pixel.
In some embodiments,
Described read step comprises further:
Described coloured image is changed into the colored subgraph of yuv format; And
The brightness value of described colored subgraph is replaced with described gray scale merge the brightness value of image thus obtain described merging image.
In some embodiments, each described photosensitive pixel is connected with an analog to digital converter respectively;
Described formation method comprises further:
The analog signal output that described photosensitive pixel produces is converted to digital signal to export; And
The described digital signal of described photosensitive pixel corresponding for white filter area described in same described merging pixel is exported and is added with the pixel value obtaining described merging pixel.
The present invention also provides a kind of imageing sensor, and it comprises:
Photosensitive pixel array; And
Be arranged at the filter on described photosensitive pixel array;
Described filter comprises filter unit array, and each described filter unit comprises colorized optical filtering district and white filter area; Described colorized optical filtering district covers a described photosensitive pixel; Described white filter area covers photosensitive pixel described at least one;
The described photosensitive pixel that same described filter unit covers forms merging pixel.
In some embodiments, described colorized optical filtering district forms Bayer array.
In some embodiments, each described filter unit comprises 2*2 described photosensitive pixel.
In some embodiments, the described colorized optical filtering district of each described merging pixel covers a described photosensitive pixel, and described white filter area covers three described photosensitive pixels.
In some embodiments, described imageing sensor comprises control module, and described control module exposes line by line for controlling described photosensitive pixel array.
In some embodiments, described imageing sensor also comprises register, described control module be used for the described photosensitive pixel gathering the row k that completes of current exposure and kth+1 row successively output and stored in described register, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of described photosensitive pixel array.
In some embodiments, described imageing sensor comprises analog to digital converter array, and each described analog to digital converter is connected with a described photosensitive pixel.
In some embodiments, described imageing sensor comprises micro mirror array, and each described micro mirror is corresponding with a described photosensitive pixel.
The present invention also provides a kind of imaging device, and it comprises the imageing sensor in above-mentioned execution mode;
Described imaging device also comprises the image processing module be connected with described imageing sensor;
Described image processing module for read and the output processing described photosensitive pixel array to obtain the pixel value of described merging pixel thus to be formed and merge image, the pixel value of described merging pixel comprises the white pixel value corresponding with described white filter area and the color pixel values corresponding with described colorized optical filtering district, described white pixel value merges image for forming white, and described color pixel values is for forming coloured image.
In some embodiments, described image processing module be used for using corresponding for same described merging pixel described white filtered region at least one described in the output of photosensitive pixel be added white pixel value as described merging pixel.
In some embodiments, described image processing module is also for changing the colored subgraph of yuv format into by described coloured image.
Described image processing module also merges the brightness value of image respective pixel for the brightness value of described colored sub-image pixels being replaced with described gray scale thus obtains described merging image.
The present invention also provides a kind of electronic installation, and it comprises the imaging device in above-mentioned execution mode.
In some embodiments, described electronic installation comprises mobile phone.
In some embodiments, described imaging device comprises the Front camera of described mobile phone.
In some embodiments, described electronic installation comprises the central processing unit and external memory that are connected with described imaging device, and described central processing unit stores described merging image for controlling described external memory.
In some embodiments, described electronic installation also comprises the central processing unit and display unit that are connected with described imaging device, and described central processing unit shows described merging image for controlling described display unit.
Additional aspect of the present invention and advantage will part provide in the following description, and part will become obvious from the following description, or be recognized by practice of the present invention.
Accompanying drawing explanation
Above-mentioned and/or additional aspect of the present invention and advantage will become obvious and easy understand from accompanying drawing below combining to the description of execution mode, wherein:
Fig. 1 is the schematic flow sheet of the formation method of embodiment of the present invention.
Fig. 2 is that the reading photosensitive pixel of embodiment of the present invention formation method exports and the schematic flow sheet of synthetic image.
Fig. 3 is that the process photosensitive pixel of embodiment of the present invention formation method exports and the schematic flow sheet of synthetic image.
Fig. 4 is that the process photosensitive pixel of embodiment of the present invention formation method exports and the schematic flow sheet of synthetic image.
Fig. 5 is that the process photosensitive pixel of embodiment of the present invention formation method exports and the schematic flow sheet of synthetic image.
Fig. 6 is that the process photosensitive pixel of embodiment of the present invention formation method exports and the schematic flow sheet of synthetic image.
Fig. 7 is the schematic side view of the imageing sensor of embodiment of the present invention.
Fig. 8 is the filter unit schematic diagram of the imageing sensor of embodiment of the present invention.
Fig. 9 is the filter unit array schematic diagram of Bayer structure.
Figure 10 is the filter unit array schematic diagram of the imageing sensor of embodiment of the present invention.
Figure 11 is the perspective view of the imageing sensor of embodiment of the present invention.
Figure 12 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 13 is the electrical block diagram of the photosensitive pixel of embodiment of the present invention imageing sensor.
Figure 14 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 15 is the perspective view of the imageing sensor of embodiment of the present invention.
Figure 16 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Figure 17 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 18 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Embodiment
Be described below in detail the execution mode of embodiments of the present invention, the example of described execution mode is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Being exemplary below by the execution mode be described with reference to the drawings, only for explaining embodiments of the present invention, and the restriction to embodiments of the present invention can not being interpreted as.
Below in conjunction with accompanying drawing, the formation method of embodiments of the present invention, imageing sensor, imaging device and electronic installation are described further.
Refer to Fig. 1, the formation method of embodiment of the present invention comprises the following steps:
S1, provides imageing sensor, and imageing sensor comprises photosensitive pixel array and is arranged at the filter on photosensitive pixel array, and filter comprises filter unit array, and filter unit comprises colorized optical filtering district and white filter area; Colorized optical filtering district covers a photosensitive pixel; White filter area covers at least one photosensitive pixel; The photosensitive pixel that same filter unit covers forms merging pixel.
S2, reads the output of photosensitive pixel array, and the pixel value calculating merging pixel according to the output of the photosensitive pixel of same merging pixel merges image to generate.
The colorized optical filtering district of the filter unit in the formation method of embodiment of the present invention is for obtaining the color information merging pixel, and white filter area is used for the monochrome information of acquisition merging pixel under low-light (level) and this monochrome information noise is less.So, the pixel value of composograph had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color of composograph is complete, and brightness and definition are all better, and noise is few.
Please refer to the drawing 11, in some embodiments, each filter unit covers 2*2 photosensitive pixel.
Please refer to the drawing 2, in formation method in the present embodiment, step S2 comprises further:
S21: gather the output of the photosensitive pixel of row k and kth+1 row and stored in register, wherein k=2n-1, n are natural number, k+1 is less than or equal to total line number of photosensitive pixel array;
S23: extract the output of the photosensitive pixel of row k and kth+1 row to obtain merging the pixel value of pixel from register;
So, can make full use of register to realize the process of the output reading of photosensitive unit, buffer memory and merging, hardware easily realizes and processing speed is very fast.
Please refer to the drawing 3, in some embodiments, the pixel value merging pixel comprises the white pixel value corresponding with white filter area and the color pixel values corresponding with colorized optical filtering district;
Step S2 comprises further:
S25: generate white according to white pixel value and merge image and generate coloured image according to color pixel values.
So, obtaining the complete coloured image of color information according to merging the color pixel values of pixel, obtaining brightness under low-light (level) according to the white pixel value merging pixel and definition is better, noise is less gray scale merges image.
Please refer to the drawing 4, in some embodiments, step S2 comprises further:
S24, is added the white pixel value as merging pixel using the output of at least one photosensitive pixel of corresponding for same merging pixel white filtered region.
So, adopt the method for potting gum, the output merging pixel be merge before each pixel export and, and the noise merging pixel before being less than merging each pixel noise and, the noise that the white after therefore merging merges image is less, and signal to noise ratio is higher.
Please refer to the drawing 5, in some embodiments, step S2 comprises further:
S27, changes the colored subgraph of yuv format into by coloured image; And
S29, replaces with gray scale and merges the brightness value of image thus obtain merging image by the brightness value of colored subgraph.
The image of yuv format comprises brightness attribute, be appreciated that, gray scale merges image and is obtained by the white pixel value that the white filter area merging pixel is corresponding, compared to colorized optical filtering district, the barrier effect of white filter area light is to external world less, therefore, in same merging pixel, the gray scale merging image brightness values that white pixel value is corresponding is higher, noise is also less.Therefore, the brightness value of colored subgraph is replaced with the brightness value that gray scale merges image, the merging image obtained both had comprised complete color information, and brightness, definition are also higher.Especially, under low-light (level), image is merged less compared with the obvious noise of colored subgraph of replacing before brightness value.
Please refer to the drawing 6, in some embodiments, each photosensitive pixel is connected with an analog to digital converter respectively;
Step S2 comprises further:
S31, is converted to digital signal by the analog signal output that photosensitive pixel produces and exports;
S33, exports the pixel value be added to obtain merging pixel by the digital signal of photosensitive pixel corresponding for white filter area in same merging pixel.
So, one, be generally digital signal processing chip (DSP, digitalsignalprocessor) image processing module directly can process the output of imageing sensor, two, relative to some by circuit directly concerning the scheme that the output of the analog signal format of imageing sensor processes, remain the information of image preferably, such as, for the imageing sensor of 16M pixel, the formation method of embodiment of the present invention can retain the information of 16M pixel (before namely merging image), the merging image of 4M pixel or the image of other resolution is obtained on this basis through process.
The formation method of embodiment of the present invention can be realized by the imageing sensor of embodiment of the present invention.
Refer to Fig. 7 and Fig. 8, the imageing sensor 10 of embodiment of the present invention comprises photosensitive pixel array 11 and is arranged at the filter 13 on photosensitive pixel array 11.Filter 13 comprises filter unit array 131, and each filter unit 1311 comprises colorized optical filtering district 1313 and white filter area 1315, and colorized optical filtering district 1313 covers a photosensitive pixel 111, and white filter area 1315 covers at least one photosensitive pixel 111.Such as, in Fig. 8, colorized optical filtering district 1313 is green filter district, covers 1 photosensitive pixel 111.The photosensitive pixel 111 that same filter unit 1311 covers forms merging pixel.Extraneous light is irradiated to the photosensitive part 1111 of photosensitive pixel 111 to produce the signal of telecommunication by filter 13, i.e. the output of photosensitive pixel 111.
The colorized optical filtering district 1313 of the filter unit 1311 of the imageing sensor of embodiment of the present invention is for obtaining the color information merging pixel, and white filter area 1315 merges the monochrome information of pixel for acquisition under low-light (level) and this monochrome information noise is less.The pixel value of the composograph generated with this had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color of composograph is complete, and brightness and definition are all better, and noise is few.
Refer to Fig. 9, in some embodiments, colorized optical filtering district forms Bayer array (Bayerpattern).Bayer array comprises filtering structure 1317, and each filtering structure 1317 comprises 2*2 filter unit 1311, is green, red, blue, green filter unit 1311 respectively.
Adopt Bayer structure can adopt conventional needle to the algorithm of Bayer structure to process picture signal, thus do not need hardware configuration does large adjustment.
In traditional filter unit array structure, the corresponding photosensitive pixel of each filter unit and image pixel.Refer to Figure 10, in the present embodiment, filter unit array 131 adopts Bayer structure, comprise filtering structure 1317, each filtering structure 1317 comprises green, redness, blueness, green filter unit 1311, and unlike, the corresponding multiple photosensitive pixel 111 of each filter unit 1311, wherein, the corresponding photosensitive pixel 111 in colorized optical filtering district 1313, white filter area 1315 at least one photosensitive pixel 111 corresponding.
Refer to Figure 11 and Figure 10, in some embodiments, each filter unit 1311 covers 2*2 photosensitive pixel 111 and merges pixel to be formed.
Except 2*2 structure, also has 3*3,4*4, or even any structure (n such as n*m, m is natural number), be appreciated that, on photosensitive pixel array 11, the number of sequencable photosensitive pixel 111 is limited, the words that the photosensitive pixel 111 that each merging pixel comprises is too much, the resolution sizes of image can be restricted, e.g., if the pixel value of photosensitive pixel array 11 is 16M, adopt the merging dot structure of 2*2 can obtain the merging image that resolution is 4M, and adopt 4*4 structure just can only obtain merging image that resolution is 1M.Therefore the merging dot structure of 2*2 is a preferred arrangement mode, under sacrificing the prerequisite of resolution less, promote image brightness and definition as far as possible.Meanwhile, adopt 2*2 structure to facilitate hardware realizes reading and merging treatment that photosensitive pixel is exported.
Refer to Figure 11 and Figure 10, in some embodiments, the colorized optical filtering district 1313 of each merging pixel covers a photosensitive pixel 111, and white filter area 1315 covers three photosensitive pixels 111.
Like this, the photosensitive pixel 111 merging pixel fully covers by colorized optical filtering district 1313 and white filter area 1315.
Refer to Figure 12, in some embodiments, imageing sensor also comprises control module 17, and control module 17 exposes line by line for controlling photosensitive pixel array 11.Control module 17 is connected with row and selects logical block 171 and column selection logical block 173, to control to process the output of photosensitive pixel 111 line by line.
To expose line by line and the mode exported more easily realizes on hardware.
See also Figure 12, in the present embodiment, imageing sensor 10 also comprises register 19, control module 17 for the photosensitive pixel 111 of the row k that gathers current exposure successively and complete and kth+1 row output and stored in register 19, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of photosensitive pixel array 11.
Concrete, refer to Figure 12 and Figure 13, imageing sensor 10 comprises the control module 17 selecting logical block 171 and column selection logical block 173 to be connected with row.Row selects logical block 171 and column selection logical block 173 switching tube 1115 corresponding with each photosensitive pixel 111 to connect, control module 17 for control lines selection logical block 171 and column selection logical block 173 with the switching tube 1115 of the photosensitive pixel 111 of gating ad-hoc location.
Control module 17 first gather the photosensitive pixel of the first row and the second row output and stored in register 19.Position coordinates is the pixel value that the output of four photosensitive pixels 111 of 1-1,1-2,2-1,2-2 is carried out processing to obtain merging pixel by subsequent conditioning circuit.Wherein the left side digitized representation of position coordinates is capable, digits right representative row.
Be the output processing of four photosensitive pixels of 1-3,1-4,2-3,2-4 again by coordinate, obtain the pixel value of corresponding merging pixel.
By that analogy, until process last group four photosensitive pixels of the first row and the second row.
By above processing mode, the output of the photosensitive pixel of the third line and fourth line, fifth line and the 6th row etc. is processed, until all the output of photosensitive pixel has all processed.
Please refer to the drawing 14 and Figure 13, in some embodiments, imageing sensor 10 comprises analog to digital converter 21 array, and each photosensitive pixel 111 is connected with an analog to digital converter 17 respectively.Analog to digital converter 17 exports for the analog signal output of photosensitive pixel 111 being converted to digital signal.
Photosensitive pixel 111 in present embodiment comprises photodiode 1113.Photodiode 1113 is for being converted into electric charge by illumination, and the electric charge produced and the proportional relation of intensity of illumination.Switching tube 1115 is for selecting the control signal of logical block 171 and column selection logical block 173 to come conducting and the disconnection of control circuit according to row, when circuit turn-on, source follower 1117 (sourcefollower) is converted into voltage signal for the charge signal produced through illumination by photodiode 1113.Analog to digital converter 211 (Analog-to-digitalconverter) for voltage signal is converted to digital signal, to transfer to subsequent conditioning circuit process.
This output processing mode makes the output of photosensitive pixel be converted into digital signal, processes in following digital circuit or in the chips with software.Therefore the output information of each photosensitive pixel can be retained, such as, for the imageing sensor of 16M pixel, the formation method of embodiment of the present invention can retain the information of 16M pixel (before namely merging image), obtains the merging image of 4M pixel or the image of other resolution on this basis through process.Final synthetic image occurs that the probability of bad point is lower.In addition, the noise of this output processing mode is less, and signal to noise ratio is higher.
Refer to Figure 15, in some embodiments, imageing sensor 10 comprises the micro mirror array 23 be arranged on filter 13, and each micro mirror 231 is corresponding with a photosensitive pixel 111.
Concrete, each micro mirror 231 is corresponding with a photosensitive pixel 111, comprises size, position is corresponding.In some embodiments, the corresponding 2*2 of each filter unit 1311 photosensitive pixel 111 and 2*2 micro mirror 191.Along with technical development, in order to obtain the higher image of resolution, photosensitive pixel 111 on sensitive film gets more and more, arrange more and more intensive, single photosensitive pixel 111 is also more and more less, and its light is affected, and photosensitive part 1111 area of photosensitive pixel 111 is limited, light can be gathered photosensitive part 1111 by micro mirror 191, thus the light reception intensity of promotion feeling light pixel 111 is to improve image quality.
To sum up, the each filter unit of imageing sensor in embodiment of the present invention comprises colorized optical filtering district and white filter area, make the pixel value of merging pixel not only comprise color information but also comprise the monochrome information of low perceived noisiness, generating the complete and merging image that signal to noise ratio is high of color to facilitate subsequent conditioning circuit.
Please refer to the drawing 16, the present invention also provides a kind of imaging device 100, and it comprises outside the imageing sensor 10 of embodiment of the present invention, also comprises the image processing module 50 be connected with imageing sensor 10.Image processing module 50 for read and the output processing photosensitive pixel array 11 to obtain merging the pixel value of pixel thus to be formed and merge image, the pixel value merging pixel comprises the white pixel value corresponding with white filter area and the color pixel values corresponding with colorized optical filtering district, white pixel value forms white and merges image, and color pixel values forms coloured image.
Concrete, the imageing sensor of embodiment of the present invention can comprise control module 17, row selects logical block 171, column selection logical block 173, analog to digital converter array 21, register 19 etc., the output of photosensitive pixel array 11 is converted to digital signal through analog to digital converter array 21, be stored in register 19 line by line and be sent to image processing module 50 and process, until the output of all photosensitive pixels is processed merge image to generate.
So, image processing module 50 generates the complete coloured image of color information according to the color pixel values corresponding with colorized optical filtering district, and higher according to the white pixel value generation brightness that white filter area is corresponding, the gray scale merging image that noise is less.
In the present embodiment, image processing module 50 is added white pixel value as merging pixel for the output of at least one photosensitive pixel using corresponding for same merging pixel white filtered region.
So, the output of many photosensitive pixels be added, the merging pixel signal to noise ratio of formation is higher.Such as, assuming that the output of original each photosensitive pixel is S, noise is N, and merge pixel and comprise m white photosensitive pixel, then the pixel value merging pixel is m*S, and the noise merging pixel is
m be more than or equal to 1 natural number.Be appreciated that when m>1, the noise merging pixel is less than the noise sum merging front each white photosensitive pixel and export.And the output merging pixel exports sum for merging front each white photosensitive pixel, therefore merge noise decline signal to noise ratio in integral image and improve, definition promotes.
In some embodiments, image processing module also changes the colored subgraph of yuv format into for coloured image.Image processing module also merges the brightness value of image respective pixel for the brightness value of colored sub-image pixels being replaced with gray scale thus obtains merging image.
YUV is that yuv format comprises many concrete forms, as YUV422, YUV420 etc. according to the principle of brightness and aberration to describe the picture format of color.In some embodiments, the colored pixel that merges comprises green, redness, blue combined pixels, image processing module first obtains the coloured image of rgb format according to the pixel value of colour merging pixel, namely the red luma value of each image pixel, Green brightness value, blue intensity values is obtained, use R respectively, G, B represent, then the brightness value Y=0.299*R+0.587*G+0.114*B of its corresponding yuv format image pixel.
So, the colored subgraph of yuv format can be obtained.
Image processing module is used further to that the brightness value of colored sub-image pixels is replaced with gray scale and merges the brightness value of image respective pixel thus obtain merging image.
Owing to only substituted for the brightness value of colored sub-image pixels, therefore do not damage the integrality of its color information.The brightness value having better translucent effect that photosensitive pixel is exported due to white filter area is higher, and therefore the brightness of the colored subgraph of gray scale merging image ratio is higher in low light situations, and noise is also less.Therefore make colored subgraph luminance raising after replacing brightness, signal to noise ratio promotes.
To sum up, adopt the imaging device of present embodiment, the brightness value brightness value of colored sub-image pixels being replaced with gray scale merging image respective pixel can keep the complete basis of its color information promotes its brightness, signal to noise ratio and definition.
The present invention also provides a kind of electronic installation applying imaging device.In some embodiments, electronic installation comprises imaging device.Therefore, electronic installation has camera function and to generate color under low-light (level) complete, and signal to noise ratio is high, the merging image that definition is high.
Electronic installation can be mobile phone.
In some embodiments, imaging device can be the Front camera of mobile phone.Because Front camera is used for autodyning, and the definition of General Requirements to image of autodyning has requirement and not high to image resolution requirement, adopts the electronic installation of present embodiment can meet this requirement.
Refer to Figure 17, in some embodiments, electronic installation 200 comprises the central processing unit 81 and external memory 83 that are connected with imaging device 100, and central processing unit 81 stores merging image for controlling external memory 83.
Like this, the merging image of generation can be stored, and checks, uses or shifts after convenient.External memory 83 comprises SM (SmartMedia) card and CF (CompactFlash) card etc.
Refer to Figure 18, in some embodiments, electronic installation 200 also comprises the central processing unit 81 and display unit 85 that are connected with imaging device 100, and central processing unit 81 shows merging image for controlling display unit 85.Like this, the image that electronic installation 200 is taken can be shown in display unit and check for user.Display unit comprises light-emitting diode display etc.
To sum up, adopt the electronic installation of embodiment of the present invention, have camera function and to generate color under low-light (level) complete, signal to noise ratio is high, the merging image that definition is high.Especially, when this electronic installation is the Front camera of mobile phone, the brightness of image of autodyning under promoting low-light (level) and definition, reduce noise.
The part do not launched in formation method and electronic installation in embodiment of the present invention, can join the imageing sensor of above execution mode and the corresponding part of imaging device, launch no longer in detail at this.
In the description of this specification, specific features, structure, material or feature that the description of reference term " execution mode ", " some execution modes ", " exemplary embodiment ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with described execution mode or example are contained at least one execution mode of the present invention or example.In this manual, identical execution mode or example are not necessarily referred to the schematic representation of above-mentioned term.And the specific features of description, structure, material or feature can combine in an appropriate manner in any one or more execution mode or example.
Describe and can be understood in flow chart or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by embodiments of the invention person of ordinary skill in the field.
In flow charts represent or in this logic otherwise described and/or step, such as, the sequencing list of the executable instruction for realizing logic function can be considered to, may be embodied in any computer-readable medium, for instruction execution system, device or equipment (as computer based system, comprise the system of processor or other can from instruction execution system, device or equipment instruction fetch and perform the system of instruction) use, or to use in conjunction with these instruction execution systems, device or equipment.With regard to this specification, " computer-readable medium " can be anyly can to comprise, store, communicate, propagate or transmission procedure for instruction execution system, device or equipment or the device that uses in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electrical connection section (electronic installation) with one or more wiring, portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasablely edit read-only memory (EPROM or flash memory), fiber device, and portable optic disk read-only memory (CDROM).In addition, computer-readable medium can be even paper or other suitable media that can print described program thereon, because can such as by carrying out optical scanner to paper or other media, then carry out editing, decipher or carry out process with other suitable methods if desired and electronically obtain described program, be then stored in computer storage.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple step or method can with to store in memory and the software performed by suitable instruction execution system or firmware realize.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: the discrete logic with the logic gates for realizing logic function to data-signal, there is the application-specific integrated circuit (ASIC) of suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, also can be that the independent physics of unit exists, also can be integrated in a module by two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
The above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.
Although illustrate and describe embodiments of the invention above, be understandable that, above-described embodiment is exemplary, can not be interpreted as limitation of the present invention, and those of ordinary skill in the art can change above-described embodiment within the scope of the invention, revises, replace and modification.
Claims (23)
1. a formation method, is characterized in that, comprises the following steps:
There is provided imageing sensor, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, and described filter comprises filter unit array, and described filter unit comprises colorized optical filtering district and white filter area; Described colorized optical filtering district covers a described photosensitive pixel; Described white filter area covers photosensitive pixel described at least one; The described photosensitive pixel that same described filter unit covers forms merging pixel; And
Read the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.
2. formation method as claimed in claim 1, is characterized in that, each described filter unit covers 2*2 described photosensitive pixel.
3. formation method as claimed in claim 2, it is characterized in that, described read step comprises further:
Gather the output of the described photosensitive pixel of row k and kth+1 row and stored in register, wherein k=2n-1, n are natural number, k+1 is less than or equal to total line number of described photosensitive pixel array; And
The output of the described photosensitive pixel of described row k and kth+1 row is extracted to obtain the pixel value of described merging pixel from described register.
4. the formation method as described in claim 1-3 any one, is characterized in that, the pixel value of described merging pixel comprises the white pixel value corresponding with described white filter area and the color pixel values corresponding with described colorized optical filtering district;
Described read step comprises further:
Generate white according to described white pixel value merge image and generate coloured image according to described color pixel values.
5. formation method as claimed in claim 4, is characterized in that,
Described read step comprises further:
Using corresponding for same described merging pixel described white filtered region at least one described in the output of photosensitive pixel be added white pixel value as described merging pixel.
6. formation method as claimed in claim 4, is characterized in that,
Described read step comprises further:
Described coloured image is changed into the colored subgraph of yuv format; And
The brightness value of described colored subgraph is replaced with described gray scale merge the brightness value of image thus obtain described merging image.
7. formation method as claimed in claim 1, it is characterized in that, each described photosensitive pixel is connected with an analog to digital converter respectively;
Described formation method comprises further:
The analog signal output that described photosensitive pixel produces is converted to digital signal to export; And
The described digital signal of described photosensitive pixel corresponding for white filter area described in same described merging pixel is exported and is added with the pixel value obtaining described merging pixel.
8. an imageing sensor, is characterized in that, comprising:
Photosensitive pixel array; And
Be arranged at the filter on described photosensitive pixel array;
Described filter comprises filter unit array, and each described filter unit comprises colorized optical filtering district and white filter area; Described colorized optical filtering district covers a described photosensitive pixel; Described white filter area covers photosensitive pixel described at least one;
The described photosensitive pixel that same described filter unit covers forms merging pixel.
9. imageing sensor as claimed in claim 8, is characterized in that, described colorized optical filtering district forms Bayer array.
10. imageing sensor as claimed in claim 8, is characterized in that, each described filter unit comprises 2*2 described photosensitive pixel.
11. imageing sensors as claimed in claim 10, is characterized in that, the described colorized optical filtering district of each described merging pixel covers a described photosensitive pixel, and described white filter area covers three described photosensitive pixels.
12. imageing sensors as claimed in claim 10, it is characterized in that, described imageing sensor comprises control module, and described control module exposes line by line for controlling described photosensitive pixel array.
13. imageing sensors as claimed in claim 12, it is characterized in that, described imageing sensor also comprises register, described control module be used for the described photosensitive pixel gathering the row k that completes of current exposure and kth+1 row successively output and stored in described register, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of described photosensitive pixel array.
14. imageing sensors as claimed in claim 8, it is characterized in that, described imageing sensor comprises analog to digital converter array, and each described analog to digital converter is connected with a described photosensitive pixel.
15. imageing sensors as claimed in claim 8, it is characterized in that, described imageing sensor comprises micro mirror array, and each described micro mirror is corresponding with a described photosensitive pixel.
16. 1 kinds of imaging devices, is characterized in that comprising the imageing sensor as described in claim 8-15 any one;
Described imaging device also comprises the image processing module be connected with described imageing sensor;
Described image processing module for read and the output processing described photosensitive pixel array to obtain the pixel value of described merging pixel thus to be formed and merge image, the pixel value of described merging pixel comprises the white pixel value corresponding with described white filter area and the color pixel values corresponding with described colorized optical filtering district, described white pixel value merges image for forming white, and described color pixel values is for forming coloured image.
17. imaging devices as claimed in claim 16, it is characterized in that, described image processing module be used for using corresponding for same described merging pixel described white filtered region at least one described in the output of photosensitive pixel be added white pixel value as described merging pixel.
18. imaging devices as claimed in claim 16, is characterized in that, described image processing module is also for changing the colored subgraph of yuv format into by described coloured image;
Described image processing module also merges the brightness value of image respective pixel for the brightness value of described colored sub-image pixels being replaced with described gray scale thus obtains described merging image.
19. 1 kinds of electronic installations, is characterized in that, comprise the imaging device as described in claim 16-18 any one.
20. electronic installations as claimed in claim 19, it is characterized in that, described electronic installation comprises mobile phone.
21. electronic installations as claimed in claim 20, it is characterized in that, described imaging device comprises the Front camera of described mobile phone.
22. electronic installations as claimed in claim 19, is characterized in that, described electronic installation comprises the central processing unit and external memory that are connected with described imaging device, and described central processing unit stores described merging image for controlling described external memory.
23. electronic installations as claimed in claim 19, is characterized in that, described electronic installation also comprises the central processing unit and display unit that are connected with described imaging device, and described central processing unit shows described merging image for controlling described display unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964169.3A CN105430361B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic installation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964169.3A CN105430361B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic installation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105430361A true CN105430361A (en) | 2016-03-23 |
| CN105430361B CN105430361B (en) | 2018-03-20 |
Family
ID=55508260
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510964169.3A Active CN105430361B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic installation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105430361B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106454054A (en) * | 2016-11-29 | 2017-02-22 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| WO2017101451A1 (en) * | 2015-12-18 | 2017-06-22 | 广东欧珀移动通信有限公司 | Imaging method, imaging device, and electronic device |
| JP2018009960A (en) * | 2016-05-17 | 2018-01-18 | ローベルト ボッシュ ゲゼルシャフト ミット ベシュレンクテル ハフツング | Sensor module, method for ascertaining brightness and/or color of electromagnetic radiation, and method for manufacturing sensor module |
| CN108513112A (en) * | 2018-03-27 | 2018-09-07 | 宁波舜宇光电信息有限公司 | Color filter array and image processing method |
| CN108605099A (en) * | 2016-10-17 | 2018-09-28 | 华为技术有限公司 | The method and terminal taken pictures for terminal |
| US10382675B2 (en) | 2016-11-29 | 2019-08-13 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device including a simulation true-color image |
| US10432905B2 (en) | 2016-11-29 | 2019-10-01 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for obtaining high resolution image, and electronic device for same |
| CN111669483A (en) * | 2019-03-07 | 2020-09-15 | Oppo广东移动通信有限公司 | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method |
| WO2022011547A1 (en) * | 2020-07-14 | 2022-01-20 | 深圳市汇顶科技股份有限公司 | Image sensor and related electronic device |
| WO2022088310A1 (en) * | 2020-10-26 | 2022-05-05 | Oppo广东移动通信有限公司 | Image processing method, camera assembly, and mobile terminal |
| WO2022088311A1 (en) * | 2020-10-26 | 2022-05-05 | Oppo广东移动通信有限公司 | Image processing method, camera assembly and mobile terminal |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070206241A1 (en) * | 2006-03-06 | 2007-09-06 | Micron Technology, Inc. | Fused multi-array color image sensor |
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN101853861A (en) * | 2009-04-01 | 2010-10-06 | 博立码杰通讯(深圳)有限公司 | Photosensitive component as well as read method and read circuit thereof |
| CN102254540A (en) * | 2010-05-21 | 2011-11-23 | 精工爱普生株式会社 | Processing color sub-pixels |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN102870028A (en) * | 2010-04-28 | 2013-01-09 | 富士胶片株式会社 | Imaging device |
| CN103137638A (en) * | 2011-11-30 | 2013-06-05 | 索尼公司 | Solid-state imaging device and manufacturing method therefor, electronic apparatus, and composition for solid-state imaging device |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
-
2015
- 2015-12-18 CN CN201510964169.3A patent/CN105430361B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070206241A1 (en) * | 2006-03-06 | 2007-09-06 | Micron Technology, Inc. | Fused multi-array color image sensor |
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN101853861A (en) * | 2009-04-01 | 2010-10-06 | 博立码杰通讯(深圳)有限公司 | Photosensitive component as well as read method and read circuit thereof |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN102870028A (en) * | 2010-04-28 | 2013-01-09 | 富士胶片株式会社 | Imaging device |
| CN102254540A (en) * | 2010-05-21 | 2011-11-23 | 精工爱普生株式会社 | Processing color sub-pixels |
| CN103137638A (en) * | 2011-11-30 | 2013-06-05 | 索尼公司 | Solid-state imaging device and manufacturing method therefor, electronic apparatus, and composition for solid-state imaging device |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10257447B2 (en) | 2015-12-18 | 2019-04-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging method, imaging device, and electronic device |
| WO2017101451A1 (en) * | 2015-12-18 | 2017-06-22 | 广东欧珀移动通信有限公司 | Imaging method, imaging device, and electronic device |
| JP2018009960A (en) * | 2016-05-17 | 2018-01-18 | ローベルト ボッシュ ゲゼルシャフト ミット ベシュレンクテル ハフツング | Sensor module, method for ascertaining brightness and/or color of electromagnetic radiation, and method for manufacturing sensor module |
| US10827140B2 (en) | 2016-10-17 | 2020-11-03 | Huawei Technologies Co., Ltd. | Photographing method for terminal and terminal |
| CN108605099B (en) * | 2016-10-17 | 2020-10-09 | 华为技术有限公司 | Terminal and method for terminal photographing |
| CN108605099A (en) * | 2016-10-17 | 2018-09-28 | 华为技术有限公司 | The method and terminal taken pictures for terminal |
| CN106454054B (en) * | 2016-11-29 | 2019-03-19 | Oppo广东移动通信有限公司 | Control method, control device and electronic device |
| US10382675B2 (en) | 2016-11-29 | 2019-08-13 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device including a simulation true-color image |
| US10382709B2 (en) | 2016-11-29 | 2019-08-13 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device |
| US10432905B2 (en) | 2016-11-29 | 2019-10-01 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for obtaining high resolution image, and electronic device for same |
| CN106454054A (en) * | 2016-11-29 | 2017-02-22 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| CN108513112B (en) * | 2018-03-27 | 2020-12-08 | 宁波舜宇光电信息有限公司 | Image processing method based on color filter array |
| CN108513112A (en) * | 2018-03-27 | 2018-09-07 | 宁波舜宇光电信息有限公司 | Color filter array and image processing method |
| CN111669483A (en) * | 2019-03-07 | 2020-09-15 | Oppo广东移动通信有限公司 | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method |
| US11659294B2 (en) | 2019-03-07 | 2023-05-23 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image sensor, imaging apparatus, electronic device, image processing system, and signal processing method |
| WO2022011547A1 (en) * | 2020-07-14 | 2022-01-20 | 深圳市汇顶科技股份有限公司 | Image sensor and related electronic device |
| WO2022088310A1 (en) * | 2020-10-26 | 2022-05-05 | Oppo广东移动通信有限公司 | Image processing method, camera assembly, and mobile terminal |
| WO2022088311A1 (en) * | 2020-10-26 | 2022-05-05 | Oppo广东移动通信有限公司 | Image processing method, camera assembly and mobile terminal |
| EP4228252A4 (en) * | 2020-10-26 | 2024-03-27 | Guangdong Oppo Mobile Telecommunications Corp Ltd | Image processing method, camera assembly and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105430361B (en) | 2018-03-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430359A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105430361A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105578072A (en) | Imaging method, imaging device and electronic device | |
| CN105578080A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105578078B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105430362A (en) | Imaging method, imaging device and electronic device | |
| CN105578066A (en) | Imaging method, imaging device and electronic device | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105578081A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105611185B (en) | image generating method, device and terminal device | |
| CN105516697A (en) | Image sensor, imaging device, mobile terminal and imaging method | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN105578067B (en) | image generating method, device and terminal device | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN105578076A (en) | Imaging method, imaging device and electronic device | |
| CN105472266A (en) | High dynamic range image generation method, photographing device and terminal | |
| CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
| CN105578075A (en) | Method for generating high-dynamic range image, photographing device and terminal | |
| CN105578065A (en) | Method for generating high-dynamic range image, photographing device and terminal | |
| CN110493583A (en) | Image processing method, device, electronic equipment and computer readable storage medium | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105430360B (en) | Imaging method, imaging sensor, imaging device and electronic installation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CP03 | Change of name, title or address |