CN105611123B - imaging method, image sensor, imaging device and electronic device - Google Patents
imaging method, image sensor, imaging device and electronic device Download PDFInfo
- Publication number
- CN105611123B CN105611123B CN201510963701.XA CN201510963701A CN105611123B CN 105611123 B CN105611123 B CN 105611123B CN 201510963701 A CN201510963701 A CN 201510963701A CN 105611123 B CN105611123 B CN 105611123B
- Authority
- CN
- China
- Prior art keywords
- photosensitive
- unit
- primary colors
- output
- filter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 56
- 239000003086 colorant Substances 0.000 claims abstract description 75
- 230000003287 optical effect Effects 0.000 claims abstract description 49
- 238000001914 filtration Methods 0.000 claims description 44
- 238000012545 processing Methods 0.000 claims description 26
- 238000009434 installation Methods 0.000 claims description 24
- 238000009790 rate-determining step (RDS) Methods 0.000 claims description 5
- 238000006243 chemical reaction Methods 0.000 claims description 2
- 230000013011 mating Effects 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 28
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 6
- 230000003750 conditioning effect Effects 0.000 description 5
- 238000005286 illumination Methods 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 241000196324 Embryophyta Species 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 241001062009 Indigofera Species 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000011089 mechanical engineering Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000000465 moulding Methods 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 230000005622 photoelectricity Effects 0.000 description 1
- 238000012958 reprocessing Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
Abstract
The invention discloses an imaging method. The method comprises the following steps of firstly, providing an image sensor, wherein the image sensor comprises a photosensitive unit array and an optical filter arranged on the photosensitive unit array, the optical filter comprises a filter structure array, each filter structure comprises multiple primary color filter units, and each primary color filter unit covers a photosensitive unit; then controlling at least the photosensitive unit array and the optical filter to move relatively to enable the photosensitive units to align with and expose all primary color filter units of the same filter structure, thus obtaining the outputs of all primary colors; and finally, expressing the photosensitive units through adoption of the outputs of all primary colors, thus obtaining a colored image. The photosensitive unit array and the optical filter move relatively so that the photosensitive units respectively sense the light transmitted from the primary color filter units of different colors; therefore, the outputs of each photosensitive unit comprise various primary colors for generating a complete colored image. The invention also discloses the image sensor for realizing the method, an imaging device and an electronic device.
Description
Technical field
The present invention relates to imaging technique, more particularly to a kind of imaging method, imageing sensor, imaging device and electronics dress
Put.
Background technology
The optical filtering pixel arrangements of conventional images sensor are RGBG, and wherein R, G, B represent red, green, indigo plant respectively
Color.Therefore, each optical filtering pixel only has a kind of color, therefore corresponding image pixel initially only has a kind of color, other colors
It is to be obtained by way of interpolation.
The content of the invention
It is contemplated that at least solving one of technical problem present in prior art.Therefore, the present invention needs offer one
Plant imaging method, imageing sensor, imaging device and electronic installation.
The imaging method of embodiment of the present invention is comprised the following steps：
Imageing sensor is provided, described image sensor includes photosensitive unit array and is arranged at the photosensitive unit array
On optical filter, the optical filter includes filtering structure array, and each described filtering structure includes multiple primary colors filter units, often
The individual primary colors filter unit covers a photosensitive unit；
Control at least described photosensitive unit array and the optical filter relatively move cause the photosensitive unit respectively with together
The all described primary colors filter unit of filtering structure described in aligns and exposes to obtain the output of all primary colors respectively；And
The output of all primary colors is used to represent the photosensitive unit to obtain coloured image.
Using the imaging method of embodiment of the present invention, photosensitive unit array and optical filter are relatively moved, so that photosensitive list
The light difference that unit passes through to the primary colors filter unit of different color is photosensitive, so that the output of each photosensitive unit includes various originals
The color image complete to generate color.So as to solve some problems of present imaging method.
The present invention also provides a kind of imageing sensor of the imaging method that can be used to realize embodiment of the present invention, its bag
Include：
Photosensitive unit array；
It is arranged at the optical filter on the photosensitive unit array；And
Optical filtering control module；The optical filter includes filtering structure array, and each described filtering structure includes multiple primary colors
Filter unit, each described primary colors filter unit covers a photosensitive unit；The optical filtering control module is used to control extremely
Few photosensitive unit array and the optical filter relatively move cause the photosensitive unit respectively with the same filtering structure
All described primary colors filter unit align respectively and expose to obtain the output of all primary colors.
The present invention also provides a kind of imaging device of the imageing sensor including embodiment of the present invention, and it also includes：
Image processing module, described image processing module is used to represent the photosensitive list using the output of all primary colors
Unit is obtaining coloured image.
The present invention also provides a kind of electronic installation of the imaging device including embodiment of the present invention.
Additional aspect of the invention and advantage will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by practice of the invention.
Brief description of the drawings
Of the invention above-mentioned and/or additional aspect and advantage will become from description of the accompanying drawings below to implementation method is combined
Obtain substantially and be readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet of the imaging method of embodiment of the present invention.
Fig. 2 is the schematic flow sheet of the imaging method of embodiment of the present invention.
Fig. 3 is the schematic flow sheet of the imaging method of embodiment of the present invention.
Fig. 4 is the schematic flow sheet of the rate-determining steps of embodiment of the present invention imaging method.
Fig. 5 is the schematic flow sheet of the rate-determining steps of embodiment of the present invention imaging method.
Fig. 6 is the structural representation of the imageing sensor of embodiment of the present invention.
Fig. 7 is the filter unit array schematic diagram of the imageing sensor of embodiment of the present invention.
Fig. 8 is that the filter unit array and photosensitive unit array position relation of the imageing sensor of embodiment of the present invention show
It is intended to.
Fig. 9 is that the filter unit array and photosensitive unit array position relation of the imageing sensor of embodiment of the present invention show
It is intended to.
Figure 10 is the filter unit array and photosensitive unit array position relation of the imageing sensor of embodiment of the present invention
Schematic diagram.
Figure 11 is the filter unit array and photosensitive unit array position relation of the imageing sensor of embodiment of the present invention
Schematic diagram.
Figure 12 is the dimensional structure diagram of the imageing sensor of embodiment of the present invention.
Figure 13 is the filter unit array schematic diagram of the imageing sensor of embodiment of the present invention.
Figure 14 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 15 is the electrical block diagram of the photosensitive unit of embodiment of the present invention imageing sensor.
Figure 16 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 17 is the structural representation of the imaging device of embodiment of the present invention.
Figure 18 is the structural representation of the imaging device of embodiment of the present invention.
Figure 19 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Figure 20 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 21 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Specific embodiment
The implementation method of embodiments of the present invention is described below in detail, the example of implementation method is shown in the drawings, its
In from start to finish same or similar label represent same or similar element or the element with same or like function.Below
Exemplary by reference to the implementation method of Description of Drawings, be only used for explain embodiments of the present invention, and it is not intended that
Limitation to embodiments of the present invention.
Below in conjunction with accompanying drawing to the imaging method of embodiments of the present invention, imageing sensor, imaging device and electronics dress
Put and be described further.
Fig. 1 is referred to, the imaging method of embodiment of the present invention is comprised the following steps：
S1, there is provided imageing sensor, imageing sensor includes photosensitive unit array and is arranged on photosensitive unit array
Optical filter, optical filter includes filtering structure array, and each filtering structure includes multiple primary colors filter units, and each primary colors filters single
Unit's one photosensitive unit of covering.
S2, control at least photosensitive unit array and optical filter relatively move cause photosensitive unit respectively with same filtering structure
All primary colors filter units align respectively and expose to obtain the output of all primary colors.
S3, uses the output of all primary colors to represent photosensitive unit to obtain coloured image.
Photosensitive unit array and optical filter relative movement in the imaging method of embodiment of the present invention, so that photosensitive unit
The light difference passed through to the primary colors filter unit of different color is photosensitive, so that the output of each photosensitive unit includes various primary colors
The image complete to generate color.Please join Fig. 2, in imaging method in the present embodiment, step S2 is further included：
S201, control optical filter is moved and causes that photosensitive unit divides with all primary colors filter units of same filtering structure respectively
Do not align and expose to obtain the output of all primary colors.
So, photosensitive unit array is motionless, simply optical filter relative scene movement relative to external scene, therefore often
Individual photosensitive unit corresponds to an image pixel and need not carry out interpolation processing.
In some embodiments, each filter unit covers 2*2 photosensitive unit.
Please join Fig. 3, in imaging method in the present embodiment, step S2 is further included：
S203：Merge the output of photosensitive pixel of same photosensitive unit to obtain the output of primary colors.
The output of multiple photosensitive pixels is merged, helps to provide lifting noise when brightness, reduce noise.
Please join Fig. 4, in some embodiments, each photosensitive pixel is connected with an analog-digital converter respectively.
Step S2 is further included：
S205：The analog signal output that photosensitive pixel is produced is converted into data signal output.
S207, calculates the data signal and/or average of the corresponding photosensitive pixel of same primary colors filter unit to obtain primary colors
Output.
So, data signal is converted analog signals into, is conducive to subsequent conditioning circuit, such as ISP chips to process it, firmly
Also easily realized on part.Additionally, being first converted to data signal reprocessing, can preferably retain original output information, such as each sense
The output of light pixel, so, can carry out various treatment of algorithms of different to original output information as needed.
Please join Fig. 5, in some embodiments, step S2 is further included：
The output of the photosensitive unit of S209, collection row k and the row of kth+1 is simultaneously stored in register, and wherein k=2n-1, n are for just
Integer, total line numbers of the k+1 less than or equal to photosensitive unit array.
S211, extracts the output of photosensitive unit of row k and the row of kth+1 to obtain the output of primary colors from register.
The process that the output that register can be made full use of to realize photosensitive unit reads, caches and merges, hardware is easy
Realize and processing speed is very fast.
In some embodiments, filtering structure includes Bayer (Bayer) structure, and primary colors filter unit includes red filter
Unit, the first green filter unit, blue filter unit and the second green filter unit.
The imaging method of embodiment of the present invention can be realized by the imageing sensor of embodiment of the present invention.
Fig. 6 and Fig. 7 is referred to, the imageing sensor 10 of embodiment of the present invention includes photosensitive unit array 11, filters and control
Molding block 15 and the optical filter 13 being arranged on photosensitive unit array 11.
Specifically, optical filter 13 includes filtering structure array 131, it is single that each filtering structure 1317 includes that multiple primary colors filter
Unit 1311, each primary colors filter unit 1311 covers a photosensitive unit 111.It is at least photosensitive that optical filtering control module 15 is used for control
Cell array 11 and optical filter 13 are relatively moved so that photosensitive unit 111 respectively with all primary colors of same filtering structure 1317
Filter unit 1311 aligns and exposes to obtain the output of all primary colors respectively.
Extraneous light is irradiated to the photosensitive part 1111 of photosensitive unit 111 to produce electric signal by optical filter 13, that is, feel
The output of light unit 111.
Filtering structure is generally comprised can be mixed to form several primary colors filter units of institute's the colorful one, such as it is more common it is red,
Green, blue filter unit.By controlling to relatively move, each photosensitive unit is set to align and expose with this several primary colors filter unit
Light mistake.Each photosensitive pixel can be thus set to obtain the output of all primary colors, so that the output bag of each photosensitive unit
Include various primary colors image complete to generate color.
Please join Fig. 7, in the present embodiment, filtering structure is not limited to the primary colors filter unit layout provided in figure.
The primary colors filter unit group of the adjacent minimum number comprising all kinds, can be considered filtering structure.
Please join Fig. 8-11, preferably, in some embodiments, optical filtering control module control optical filter 13 is moved and causes sense
Light unit 111 is alignd and exposes to be owned respectively with all primary colors filter units 1311 of same filtering structure 1317 respectively
The output of primary colors.
For example, in the present embodiment, each filtering structure 1317 includes 2*2 primary colors filter unit 1311, correspondence 2*2
Individual photosensitive unit 111, if the photosensitive unit (i.e. dash area) in the upper left corner is considered as with reference to photosensitive unit, optical filter 13 is initial
It is corresponding with the Gr filter units in filtering structure 1317 with reference to photosensitive unit 111 and expose during position.Then, optical filter 13 according to
It is secondary to the left, it is upper, move right a distance for the length of side of filter unit 1311, make to be filtered with R, Gb, B respectively with reference to photosensitive unit 111
Unit is corresponding and exposes output.
So, photosensitive unit array 11 is static relative to external scene, and simply optical filter 13 is relatively moved, therefore,
The same point of the picture of the output correspondence external scene of the photosensitive unit 111 that the multiexposure, multiple exposure of photosensitive unit 111 is produced, is easy to generation
Clearly image.Further, since the filter unit 1311 of the different primary colors of multiexposure, multiple exposure correspondence, therefore the color of the image of generation is complete
It is whole true to nature.
Please join Fig. 7 in the lump, in the imageing sensor of embodiment of the present invention, filtering structure may include Bayer structure, it is former
Color filter unit includes red filter unit, the first green filter unit, blue filter unit and the second green filter unit.Visit
Ear structure is a kind of widely used filter array structure.Therefore, can be using conventional needle to Bayer structure using Bayer structure
Algorithm processes picture signal, without doing big adjustment on hardware configuration.In traditional filter array structure, each filter
Light unit correspondence one photosensitive pixel and image pixel.And in the present embodiment, each filter unit is not limited to only correspondence
One photosensitive pixel, it is also possible to which correspondence multiple photosensitive pixel simultaneously produces multiple outputs.
Please join Figure 12 and Figure 13, in some embodiments, each photosensitive unit 111 includes 2*2 photosensitive pixel 1112；
Corresponding, each primary colors filter unit 1311 covers 2*2 photosensitive pixel 1112.
In addition to 2*2 structures, also 3*3,4*4, the structure (n, m are positive integer) such as even any n*m, it will be understood that
The number of sequencable photosensitive pixel 1112 is limited on photosensitive unit array 11, and each merges the light-sensitive image that pixel is included
If element 1112 is excessive, the resolution sizes of image can be restricted, e.g., if the pixel resolution of photosensitive unit array 11 is
16M, using the merging dot structure of 2*2, to obtain resolution ratio be the merging image of 4M, and just be can only obtain point using 4*4 structures
Resolution is the merging image of 1M.Therefore the merging dot structure of 2*2 is a preferred arrangement mode, is sacrificing resolution ratio less as far as possible
On the premise of lifted brightness of image and definition.Meanwhile, the reading realized on hardware to photosensitive pixel output is facilitated using 2*2 structures
Take and merging treatment.Figure 14 is referred to, in the present embodiment, imageing sensor also includes control module 17, control module 17
For controlling photosensitive unit array 11 to expose line by line.
Exposure line by line refers to and photosensitive pixel 1112 is exposed line by line.Specifically, control module 17 can connect row selection logic list
Unit 171 and column selection logic unit 173, to control the output line by line to photosensitive pixel 1112 to process.Expose line by line and defeated
The mode for going out is the now widely used exposure way of output, and this mode is easier to realize on hardware.Line by line exposure and not only
It is confined to the photosensitive unit array 11 of the 2*2 photosensitive pixel structures.
Also referring to Figure 14, in the present embodiment, imageing sensor 10 also includes register 19, and control module 17 is used
In successively collection current exposure complete row k and the row of kth+1 photosensitive unit 111 output and be stored in register 19, wherein k
=2n-1, n are positive integer, total line numbers of the k+1 less than or equal to photosensitive pixel 11.
The control module of above-mentioned implementation method and the structure of photosensitive pixel, see Figure 15, imageing sensor 10 include with
Row selection logic unit 171 and the control module 17 of the connection of column selection logic unit 173.Row selection logic unit 171 and column selection
Select the switching tube 1115 corresponding with each photosensitive pixel 1112 of logic unit 173 to connect, control module 17 is used to control to go choosing
Logic unit 171 and column selection logic unit 173 are selected to gate the switching tube 1115 of the photosensitive pixel 1112 of ad-hoc location, so that
Can the output of photosensitive pixel be controlled deliver to subsequent conditioning circuit.Please join Figure 14 and Figure 15, control module 17 can be adopted line by line or by two rows
Collect the output of photosensitive pixel 1112 and be stored in register 19, subsequent conditioning circuit, such as ISP (image signal processor) core
Piece, extracts data to obtain the output of photosensitive pixel 1112 and process it from register 19.
Figure 16 is referred to, in some embodiments, imageing sensor 10 includes the micro mirror battle array being arranged on optical filter 13
Row 23, each micro mirror 231 is corresponding with a photosensitive pixel 1112.
Specifically, each micro mirror 231 is corresponding with a photosensitive pixel 1112, including size, position correspondence.In some implementations
In mode, each filter unit 1311 correspondence 2*2 photosensitive pixel 1112 and 2*2 micro mirror 191.As technology develops, in order to
Resolution ratio image higher is obtained, the photosensitive pixel 1112 on sensitive film is more and more, arrange more and more intensive, single light-sensitive image
Element 1112 is also less and less, and its light is affected, and the area of photosensitive part 1111 of photosensitive pixel 1112 is limited, micro mirror
Light can be gathered photosensitive part 1111 by 191, so as to lift the light reception intensity of photosensitive pixel 1112 to improve image quality.
In some embodiments, optical filtering control module includes MEMS (Micro electro-mechanical
Systems,MEMS)。
Optical filter can be made to produce controllable micro-displacement using microelectromechanical-systems, scheme in embodiment of the present invention so as to be met
As the application demand of sensor.Micro electro mechanical system (MEMS) technology is one kind industry for being fused together microelectric technique and mechanical engineering
Technology, its opereating specification is in micrometer range.It is smaller than it, it is referred to as receiving electromechanical system in the similar technology of nanometer range
System.Current microelectromechanical-systems have been widely used in the fields such as electronics industry or biomedicine.To sum up, in embodiment of the present invention
Imageing sensor 10, filtering structure array and optical filter can be relatively moved, so that photosensitive unit filters to the primary colors of different color
The light difference that unit is passed through is photosensitive, so that the output of each photosensitive unit includes various primary colors figure complete to generate color
Picture.
Particularly, when optical filter movement and static photosensitive unit array is controlled, photosensitive unit array is due to relative to outer
Boundary's scenery is static, can generate apparent image, due to the filter unit of the corresponding different primary colors of multiexposure, multiple exposure, therefore life
Into image color it is completely true to nature.Additionally, same photosensitive unit may include multiple photosensitive pixels and produce multiple outputs, rear
Merge in continuous circuit, help to lift the signal to noise ratio of image.
Please join Figure 17, the present invention also provides a kind of imaging device 100, and it includes the imageing sensor of embodiment of the present invention
Outside 10, the also image processing module 50 including being connected with imageing sensor 10.
Image processing module 50 is used to use the output of all primary colors to represent photosensitive unit 111 so as to obtain cromogram
Picture.
Image processing module 50 may include ISP chips and interlock circuit, for processing photosensitive unit 111 or photosensitive pixel
1112 output.Primary colors refers to the Essential colour that can be used for mixing to constitute other colors, and such as red, green, blue is that more common one kind is former
Color is arranged in pairs or groups.Each photosensitive unit 111 one image pixel of correspondence, image pixel can be with these three primary colors as three property values
It is indicated.
Also referring to Figure 12, in the present embodiment, photosensitive unit 111 may include multiple photosensitive pixels 1112.Image
Processing module or imageing sensor 10 are used for the output of the photosensitive pixel 1112 for merging same photosensitive unit 111 to obtain primary colors
Output.
That is, the output the multiple photosensitive pixels in photosensitive unit is complete and with one image pixel of correspondence.This
Sample is conducive to being lifted the signal to noise ratio of image.The mode of merging includes that software merges and hardware merges.Software merges i.e. first by each
The output of photosensitive pixel is converted to data signal, then delivers to subsequent conditioning circuit or chip, such as ISP (image signal
Processor treatment, is added or averages, as the output of photosensitive unit in).
Hardware merges and refers to and merged in the circuit of imageing sensor, for example, the photoelectricity two for passing through multiple photosensitive pixels
Pole pipe (PD, photo diode) connects same source follower (SF, source follower) to realize that the electric charge of output is believed
Number addition, or the photodiode of multiple photosensitive pixel connects a source follower so that charge signal is converted to electricity respectively
Pressure signal, multiple source followers connect analog-digital converter (ADC, analog to a digital jointly again
Converter), obtaining average voltage, then analog-to-digital conversion is carried out.
Refer to Figure 18, using software merge some implementation methods in, each photosensitive pixel 1112 respectively with one
Analog-digital converter 211 is connected, and analog-digital converter 211 is used to for the analog signal output that photosensitive pixel 1112 is produced to be converted to numeral
Signal output, image processing module 50 is used to calculate the data signal of the corresponding photosensitive pixel 1112 of same primary colors filter unit
And/or average is obtaining the output of primary colors.Specifically, by control module 17, row selection logic unit 171 and column selection logic list
Unit 173 controls photosensitive pixel 1112 to export line by line, and data signal is converted in analog-digital converter array 21, is stored in register 19
And and extracted and processed by image processing module 50, until the output of all photosensitive pixels 1112 is processed to merge figure generating
Picture.
It is more common processing mode that software merges, and the output of many photosensitive pixels is added, the merging image noise of formation
Than1
Positive integer.It is appreciated that in m>In the case of 1, the overall noise of photosensitive unit is less than each color sensitive picture before merging
The noise sum of element output.And each photosensitive pixel exports sum, therefore the conjunction for ultimately generating before photosensitive unit is output as merging
And image signal to noise ratio raising on the whole, definition lifting.Additionally, merging using software, can preferably retain original output information,
Such as the output of each photosensitive pixel, so, ISP chips etc. can carry out many of algorithms of different to original output information as needed
Plant treatment.
The structure of the photosensitive pixel 1112 in present embodiment see Figure 18, and photodiode 1113 is used to turn illumination
Turn to electric charge, and the electric charge relation proportional to intensity of illumination for producing.Switching tube 1115 is used for according to row selection logic unit 171
And the control signal of column selection logic unit 173 controls the conducting and disconnection of circuit, when circuit turn-on, source follower
1117 (source follower) are used to for photodiode 1113 to be converted into voltage signal through the charge signal that illumination is produced.
Analog-digital converter 211 (Analog-to-digital converter) is used to for voltage signal to be converted to data signal, to transmit
To subsequent conditioning circuit treatment.
The output processing mode that software merges makes the output of photosensitive unit be converted into data signal, with image processing module
Circuit in or chip in processed with software.Therefore the output information of each photosensitive unit can be retained, for example, for
For the imageing sensor of 16M pixels, the imaging method of embodiment of the present invention can retain 16M pixels (image before merging)
Information, the image for merging image or other resolution ratio of 4M pixels is obtained by treatment on this basis.Ultimately generate image
The probability for bad point occur is relatively low.Additionally, the noise of this output processing mode is smaller, signal to noise ratio is higher.
The present invention also provides a kind of electronic installation of application imaging device.In some embodiments, electronic installation includes
Imaging device.Therefore, electronic installation has camera function and color can be generated under low-light (level) completely, and signal to noise ratio is high, definition
Merging image high.
Electronic installation can be mobile phone.
In some embodiments, imaging device can be the Front camera of mobile phone.Because Front camera is used for autodyning,
And autodyne it is general require to require the definition of image and not high to image resolution requirement, using the electronics of present embodiment
Device can meet this requirement.
Figure 20 is referred to, in some embodiments, electronic installation 200 includes the centre being connected with imaging device 100
Reason device 81 and external memory 83, central processing unit 81 are used to control external memory 83 to store merging image.
So, the merging image of generation can be stored, it is convenient after check, using or transfer.External memory 83 includes
SM (Smart Media) blocks and CF (Compact Flash) blocks etc..
Figure 21 is referred to, in some embodiments, electronic installation 200 also includes the center being connected with imaging device 100
Processor 81 and display device 85, central processing unit 81 are used to control display device 85 to show merging image.So, electronic installation
200 images for shooting can be shown in display device 85 so that user checks.Display device 85 is including light-emitting diode display etc..
To sum up, using the electronic installation of embodiment of the present invention, with camera function and color can be generated under low-light (level)
Completely, signal to noise ratio is high, definition merging image high.Particularly, when Front camera of this electronic installation for mobile phone, can be lifted
The brightness of auto heterodyne image and definition under low-light (level), reduce noise.
Part not deployed in imaging method and electronic installation, can join the figure of embodiment of above in embodiment of the present invention
As sensor and the corresponding part of imaging device, no longer it is developed in details herein.
In the description of this specification, reference term " implementation method ", " some implementation methods ", " schematically implementation
The description of mode ", " example ", " specific example " or " some examples " etc. means to combine the tool that the implementation method or example are described
Body characteristicses, structure, material or feature are contained at least one implementation method of the invention or example.In this manual,
Schematic representation to above-mentioned term is not necessarily referring to identical implementation method or example.And, the specific features of description, knot
Structure, material or feature can in an appropriate manner be combined in one or more any implementation methods or example.
Any process described otherwise above or method description in flow chart or herein is construed as, and expression includes
It is one or more for realizing specific logical function or process the step of the module of code of executable instruction, fragment or portion
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussion suitable
Sequence, including function involved by basis by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Represent in flow charts or logic and/or step described otherwise above herein, for example, being considered use
In the order list of the executable instruction for realizing logic function, in may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The system of row system, device or equipment instruction fetch and execute instruction) use, or with reference to these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicate, propagate or pass
The dress that defeated program is used for instruction execution system, device or equipment or with reference to these instruction execution systems, device or equipment
Put.The more specifically example (non-exhaustive list) of computer-readable medium includes following：With the electricity that one or more are connected up
Connecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can thereon print described program or other are suitable
Medium, because optical scanner for example can be carried out by paper or other media, then enters edlin, interpretation or if necessary with it
His suitable method is processed electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of the invention can be realized with hardware, software, firmware or combinations thereof.Above-mentioned
In implementation method, the software that multiple steps or method can in memory and by suitable instruction execution system be performed with storage
Or firmware is realized.If for example, realized with hardware, and in another embodiment, can be with well known in the art
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried
The rapid hardware that can be by program to instruct correlation is completed, and described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
Additionally, during each functional unit in each embodiment of the invention can be integrated in a processing module, it is also possible to
It is that unit is individually physically present, it is also possible to which two or more units are integrated in a module.Above-mentioned integrated mould
Block can both be realized in the form of hardware, it would however also be possible to employ the form of software function module is realized.The integrated module is such as
Fruit is to realize in the form of software function module and as independent production marketing or when using, it is also possible to which storage is in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (23)
1. a kind of imaging method, it is characterised in that comprise the following steps：
Imageing sensor is provided, described image sensor includes photosensitive unit array and is arranged on the photosensitive unit array
Optical filter, the optical filter includes filtering structure array, and each described filtering structure includes multiple primary colors filter units, each institute
State primary colors filter unit and cover a photosensitive unit；
Control at least described photosensitive unit array and the optical filter relatively move cause the photosensitive unit respectively with same institute
The all described primary colors filter unit for stating filtering structure aligns and exposes to obtain the output of all primary colors respectively；And
The output of all primary colors is used to represent the photosensitive unit to obtain coloured image.
2. imaging method as claimed in claim 1, it is characterised in that the rate-determining steps are moved by controlling the optical filter
So that the photosensitive unit alignd respectively with all described primary colors filter unit of the same filtering structure respectively and expose with
Obtain the output of all primary colors.
3. imaging method as claimed in claim 1, it is characterised in that each described photosensitive unit includes 2*2 photosensitive pixel.
4. imaging method as claimed in claim 3, it is characterised in that the rate-determining steps are further included：
Merge the output of the photosensitive pixel of the same photosensitive unit to obtain the output of the primary colors.
5. imaging method as claimed in claim 3, it is characterised in that each described photosensitive pixel respectively with an analog-to-digital conversion
Device is connected；
The rate-determining steps are further included：
The analog signal output that the photosensitive pixel is produced is converted into data signal output；And
It is described to obtain to calculate the data signal and/or average of the corresponding photosensitive pixel of the same filter unit
The output of primary colors.
6. imaging method as claimed in claim 3, it is characterised in that the read step is further included：
The output of the photosensitive pixel of collection row k and the row of kth+1 is simultaneously stored in register, and wherein k=2n-1, n is positive integer,
Total line numbers of the k+1 less than or equal to the photosensitive pixel；And
The output of the photosensitive pixel of the row k and the row of kth+1 is extracted from the register to obtain the primary colors
Output.
7. imaging method as claimed in any one of claims 1 to 6, it is characterised in that the filtering structure includes Bayer knot
Structure, the primary colors filter unit includes red filter unit, the first green filter unit, blue filter unit and the second green filter
Light unit.
8. a kind of imageing sensor, it is characterised in that including：
Photosensitive unit array；
It is arranged at the optical filter on the photosensitive unit array；And
Optical filtering control module；The optical filter includes filtering structure array, and each described filtering structure includes that multiple primary colors filter
Unit, each described primary colors filter unit covers a photosensitive unit；The optical filtering control module is used to control at least institute
State photosensitive unit array and the optical filter relatively move cause the photosensitive unit respectively with the institute of the same filtering structure
There is the primary colors filter unit to align respectively and expose to obtain the output of all primary colors.
9. imageing sensor as claimed in claim 8, it is characterised in that the optical filtering control module is used to control the optical filtering
Piece is moved and causes that the photosensitive unit aligns simultaneously respectively with all described primary colors filter unit of the same filtering structure respectively
Expose to obtain the output of all primary colors.
10. imageing sensor as claimed in claim 8, it is characterised in that the filtering structure includes Bayer structure, the original
Color filter unit includes red filter unit, the first green filter unit, blue filter unit and the second green filter unit.
11. imageing sensors as claimed in claim 8, it is characterised in that each described photosensitive unit includes 2*2 light-sensitive image
Element.
12. imageing sensors as claimed in claim 11, it is characterised in that described image sensor includes control module, institute
Control module is stated for controlling the photosensitive unit array to expose line by line.
13. imageing sensors as claimed in claim 11, it is characterised in that described image sensor also includes register；
The control module is used for the output of the photosensitive pixel of the row k that collection current exposure is completed successively and the row of kth+1
And the register, wherein k=2n-1 are stored in, n is positive integer, total line numbers of the k+1 less than or equal to the photosensitive pixel.
14. imageing sensors as claimed in claim 8, it is characterised in that described image sensor includes being arranged on the filter
Micro mirror array on mating plate, each described micro mirror is corresponding with a photosensitive pixel.
15. imageing sensors as claimed in claim 8, it is characterised in that the optical filtering control module includes MEMS.
16. a kind of imaging device, it is characterised in that including the imageing sensor described in claim 8-15；The imaging device
Also include image processing module, described image processing module is used to represent the photosensitive unit using the output of all primary colors
To obtain coloured image.
17. imaging devices as claimed in claim 16, it is characterised in that the photosensitive unit includes multiple photosensitive pixels；Institute
State the output of the photosensitive pixel that image processing module or described image sensor are used to merging the same photosensitive unit with
Obtain the output of the primary colors.
18. imaging devices as claimed in claim 17, it is characterised in that each described photosensitive pixel turns with a modulus respectively
Parallel operation is connected；The analog-digital converter is defeated for the analog signal output that the photosensitive pixel is produced to be converted into data signal
Go out；Described image processing module is used to calculate the data signal of the corresponding photosensitive pixel of the same filter unit
And/or average is obtaining the output of the primary colors.
19. a kind of electronic installations, it is characterised in that including the imaging device as described in claim 16-18 any one.
20. electronic installations as claimed in claim 19, it is characterised in that the electronic installation includes mobile phone.
21. electronic installations as claimed in claim 20, it is characterised in that the imaging device includes the preposition phase of the mobile phone
Machine.
22. electronic installations as claimed in claim 19, it is characterised in that the electronic installation includes connecting with the imaging device
The central processing unit and external memory for connecing, the central processing unit are used to control the external memory to store the merging image.
23. electronic installations as claimed in claim 19, it is characterised in that the electronic installation also includes and the imaging device
The central processing unit and display device of connection, the central processing unit are used to control the display device to show the merging figure
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963701.XA CN105611123B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963701.XA CN105611123B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105611123A CN105611123A (en) | 2016-05-25 |
| CN105611123B true CN105611123B (en) | 2017-05-24 |
Family
ID=55990639
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510963701.XA Expired - Fee Related CN105611123B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105611123B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106162110B (en) * | 2016-07-29 | 2018-02-06 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal device |
| CN106210678A (en) * | 2016-07-29 | 2016-12-07 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106162111B (en) * | 2016-07-29 | 2018-01-19 | 广东欧珀移动通信有限公司 | Image color processing method and terminal device |
| CN106210677B (en) * | 2016-07-29 | 2018-02-06 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal device |
| CN106506915A (en) * | 2016-11-15 | 2017-03-15 | 深圳天珑无线科技有限公司 | A kind of camera module and digital equipment |
| CN106604001B (en) | 2016-11-29 | 2018-06-29 | 广东欧珀移动通信有限公司 | Image processing method, image processing apparatus, imaging device and electronic device |
| CN106507068B (en) | 2016-11-29 | 2018-05-04 | 广东欧珀移动通信有限公司 | Image processing method and device, control method and device, imaging and electronic device |
| CN112839215B (en) * | 2019-11-22 | 2022-05-13 | 华为技术有限公司 | Camera module, camera, terminal device, image information determination method and storage medium |
| CN113038091A (en) * | 2021-03-11 | 2021-06-25 | 苏州乐佰图信息技术有限公司 | Pixel rotation mechanism and pixel rotation method thereof |
| CN115118856A (en) * | 2022-06-24 | 2022-09-27 | 维沃移动通信有限公司 | Image sensor, image processing method, camera module and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7924483B2 (en) * | 2006-03-06 | 2011-04-12 | Smith Scott T | Fused multi-array color image sensor |
-
2015
- 2015-12-18 CN CN201510963701.XA patent/CN105611123B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105611123A (en) | 2016-05-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105611124B (en) | Imaging sensor, imaging method, imaging device and terminal | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105430359B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN107105141B (en) | Imaging sensor, image processing method, imaging device and mobile terminal | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105578078B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN206759600U (en) | Imaging system | |
| CN105611122B (en) | Imaging sensor and output method, phase focusing method, imaging device and terminal | |
| CN105430362B (en) | Imaging method, imaging device and electronic installation | |
| JP6676704B2 (en) | Imaging method of image sensor, imaging device, and electronic device | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN105516697B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| JP6377855B2 (en) | Imaging method, imaging apparatus, and electronic apparatus | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105578081B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105578079B (en) | Imaging sensor and picture quality regulation method, imaging device and method and mobile terminal | |
| TWI615029B (en) | Image sensor, terminal having same and imaging method using same | |
| CN105635702B (en) | Imaging method, imaging device and electronic installation | |
| CN105430360B (en) | Imaging method, imaging sensor, imaging device and electronic installation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170524 |