CN105611123A - Imaging method, image sensor, imaging device and electronic device - Google Patents
Imaging method, image sensor, imaging device and electronic device Download PDFInfo
- Publication number
- CN105611123A CN105611123A CN201510963701.XA CN201510963701A CN105611123A CN 105611123 A CN105611123 A CN 105611123A CN 201510963701 A CN201510963701 A CN 201510963701A CN 105611123 A CN105611123 A CN 105611123A
- Authority
- CN
- China
- Prior art keywords
- unit
- photosensitive
- primary colors
- output
- filter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 28
- 239000003086 colorant Substances 0.000 claims abstract description 70
- 230000003287 optical effect Effects 0.000 claims abstract description 48
- 238000000034 method Methods 0.000 claims abstract description 42
- 238000001914 filtration Methods 0.000 claims description 43
- 230000015572 biosynthetic process Effects 0.000 claims description 27
- 238000009434 installation Methods 0.000 claims description 23
- 230000013011 mating Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 9
- 206010070834 Sensitisation Diseases 0.000 description 8
- 230000008313 sensitization Effects 0.000 description 8
- 238000003860 storage Methods 0.000 description 7
- 230000003750 conditioning effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000003068 static effect Effects 0.000 description 3
- 239000000284 extract Substances 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 235000000177 Indigofera tinctoria Nutrition 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 229940097275 indigo Drugs 0.000 description 1
- COHYTHOBJLSHDF-UHFFFAOYSA-N indigo powder Natural products N1C2=CC=CC=C2C(=O)C1=C1C(=O)C2=CC=CC=C2N1 COHYTHOBJLSHDF-UHFFFAOYSA-N 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000011089 mechanical engineering Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 210000003733 optic disk Anatomy 0.000 description 1
- 230000005622 photoelectricity Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses an imaging method. The method comprises the following steps of firstly, providing an image sensor, wherein the image sensor comprises a photosensitive unit array and an optical filter arranged on the photosensitive unit array, the optical filter comprises a filter structure array, each filter structure comprises multiple primary color filter units, and each primary color filter unit covers a photosensitive unit; then controlling at least the photosensitive unit array and the optical filter to move relatively to enable the photosensitive units to align with and expose all primary color filter units of the same filter structure, thus obtaining the outputs of all primary colors; and finally, expressing the photosensitive units through adoption of the outputs of all primary colors, thus obtaining a colored image. The photosensitive unit array and the optical filter move relatively so that the photosensitive units respectively sense the light transmitted from the primary color filter units of different colors; therefore, the outputs of each photosensitive unit comprise various primary colors for generating a complete colored image. The invention also discloses the image sensor for realizing the method, an imaging device and an electronic device.
Description
Technical field
The present invention relates to imaging technique, particularly a kind of formation method, imageing sensor, imaging device and electronics dressPut.
Background technology
The optical filtering Pixel arrangement mode of conventional images sensor is RGBG, and wherein R, G, B represent respectively redness, green, indigo plantLook. Therefore, each optical filtering pixel only has a kind of color, and therefore corresponding image pixel only has a kind of color, other colors at firstTo obtain by the mode of interpolation.
Summary of the invention
The present invention is intended at least solve one of technical problem existing in prior art. For this reason, the present invention need to provide onePlant formation method, imageing sensor, imaging device and electronic installation.
The formation method of embodiment of the present invention comprises the following steps:
Imageing sensor is provided, and described imageing sensor comprises photosensitive unit array and is arranged at described photosensitive unit arrayOn optical filter, described optical filter comprises filtering structure array, each described filtering structure comprises multiple primary colors filter units, everyIndividual described primary colors filter unit covers a described photosensitive unit;
Control at least described photosensitive unit array and described optical filter relatively move make described photosensitive unit respectively withDescribed in one, all described primary colors filter unit of filtering structure aligns respectively and exposes to obtain the output of all primary colors; And
Adopt the output of all described primary colors to represent that described photosensitive unit is to obtain coloured image.
The formation method that adopts embodiment of the present invention, photosensitive unit array and optical filter relatively move, so that sensitization listThe light that unit sees through the primary colors filter unit of different color sensitization respectively, thus make the output of each photosensitive unit comprise multiple formerLook is to generate the complete image of color. Thereby solve some problem of present formation method.
The present invention also provides a kind of imageing sensor of the formation method that can be used in the present invention embodiment, its bagDraw together:
Photosensitive unit array;
Be arranged at the optical filter on described photosensitive unit array; And
Optical filtering control module; Described optical filter comprises filtering structure array, and each described filtering structure comprises multiple primary colorsFilter unit, each described primary colors filter unit covers a described photosensitive unit; Described optical filtering control module is for controlling extremelyFew described photosensitive unit array and described optical filter relatively move make described photosensitive unit respectively with same described filtering structureAll described primary colors filter unit align respectively and expose to obtain the output of all primary colors.
The present invention also provides a kind of imaging device of the imageing sensor that comprises embodiment of the present invention, and it also comprises:
Image processing module, described image processing module is for adopting the output of all described primary colors to represent described sensitization listUnit is to obtain coloured image.
The present invention also provides a kind of electronic installation of the imaging device that comprises embodiment of the present invention.
Additional aspect of the present invention and advantage in the following description part provide, and part will become from the following descriptionObtain obviously, or recognize by practice of the present invention.
Brief description of the drawings
Above-mentioned and/or additional aspect of the present invention and advantage from conjunction with below accompanying drawing to becoming the description of embodimentObtain obviously and easily and understand, wherein:
Fig. 1 is the schematic flow sheet of the formation method of embodiment of the present invention.
Fig. 2 is the schematic flow sheet of the formation method of embodiment of the present invention.
Fig. 3 is the schematic flow sheet of the formation method of embodiment of the present invention.
Fig. 4 is the schematic flow sheet of the control step of embodiment of the present invention formation method.
Fig. 5 is the schematic flow sheet of the control step of embodiment of the present invention formation method.
Fig. 6 is the structural representation of the imageing sensor of embodiment of the present invention.
Fig. 7 is the filter unit array schematic diagram of the imageing sensor of embodiment of the present invention.
Fig. 8 is that filter unit array and the photosensitive unit array position relation of the imageing sensor of embodiment of the present invention shownIntention.
Fig. 9 is that filter unit array and the photosensitive unit array position relation of the imageing sensor of embodiment of the present invention shownIntention.
Figure 10 is filter unit array and the photosensitive unit array position relation of the imageing sensor of embodiment of the present inventionSchematic diagram.
Figure 11 is filter unit array and the photosensitive unit array position relation of the imageing sensor of embodiment of the present inventionSchematic diagram.
Figure 12 is the perspective view of the imageing sensor of embodiment of the present invention.
Figure 13 is the filter unit array schematic diagram of the imageing sensor of embodiment of the present invention.
Figure 14 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 15 is the electrical block diagram of the photosensitive unit of embodiment of the present invention imageing sensor.
Figure 16 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 17 is the structural representation of the imaging device of embodiment of the present invention.
Figure 18 is the structural representation of the imaging device of embodiment of the present invention.
Figure 19 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Figure 20 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 21 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Detailed description of the invention
Describe the embodiment of embodiments of the present invention below in detail, the example of embodiment is shown in the drawings, itsIn from start to finish same or similar label represent same or similar element or there is the element of identical or similar functions. BelowThe embodiment of describing by reference to accompanying drawing is exemplary, only for explaining embodiments of the present invention, and can not be interpreted asTo the restriction of embodiments of the present invention.
Formation method, imageing sensor, imaging device and electronics dress below in conjunction with accompanying drawing to embodiments of the present inventionPut and be described further.
Refer to Fig. 1, the formation method of embodiment of the present invention comprises the following steps:
S1, provides imageing sensor, and imageing sensor comprises photosensitive unit array and is arranged on photosensitive unit arrayOptical filter, optical filter comprises filtering structure array, and each filtering structure comprises multiple primary colors filter units, and each primary colors filters singleUnit covers a photosensitive unit.
S2, control at least photosensitive unit array and optical filter relatively move make photosensitive unit respectively with same filtering structureAll primary colors filter units align respectively and expose to obtain the output of all primary colors.
S3, adopts the output of all primary colors to represent that photosensitive unit is to obtain coloured image.
Photosensitive unit array and optical filter in the formation method of embodiment of the present invention relatively move, so that photosensitive unitThe light that the primary colors filter unit of different color is seen through sensitization respectively, thus make the output of each photosensitive unit comprise multiple primary colorsTo generate the complete image of color. Please refer to the drawing 2, in formation method in the present embodiment, step S2 further comprises:
S201, control optical filter moves photosensitive unit is divided with all primary colors filter units of same filtering structure respectivelyDo not align and expose to obtain the output of all primary colors.
Like this, photosensitive unit array is motionless with respect to extraneous scenery, and just optical filter moves relative to scenery, therefore everyThe corresponding image pixel of individual photosensitive unit and do not need to carry out interpolation processing.
In some embodiments, each filter unit covers 2*2 photosensitive unit.
Please refer to the drawing 3, in formation method in the present embodiment, step S2 further comprises:
S203: merge the output of photosensitive pixel of same photosensitive unit to obtain the output of primary colors.
The output of multiple photosensitive pixels is merged, contribute to provide to promote when brightness of noise, reduce noise.
Please refer to the drawing 4, in some embodiments, each photosensitive pixel is connected with an analog-digital converter respectively.
Step S2 further comprises:
S205: the analog signal output that photosensitive pixel is produced is converted to data signal output.
S207, calculate the photosensitive pixel that same primary colors filter unit is corresponding data signal and or average to obtain primary colorsOutput.
Like this, analog signal is converted to data signal, is conducive to subsequent conditioning circuit, as ISP chip is processed it, hardOn part, also easily realize. In addition, be first converted to data signal and process again, can retain better original output information, as each senseThe output of light pixel, like this, can carry out the multiple processing of algorithms of different as required to original output information.
Please refer to the drawing 5, in some embodiments, step S2 further comprises:
S209, gathers the output of the capable and photosensitive unit that k+1 is capable of k and deposits register in, wherein k=2n-1, and n is for justInteger, k+1 is less than or equal to total line number of photosensitive unit array.
S211 extracts the output of the capable and photosensitive unit that k+1 is capable of k to obtain the output of primary colors from register.
Can make full use of that register realizes that the output of photosensitive unit is read, the process of buffer memory and merging, hardware is easyRealization and processing speed are very fast.
In some embodiments, filtering structure comprises Bayer (Bayer) structure, and primary colors filter unit comprises red optical filteringUnit, the first green filter unit, blue filter unit and the second green filter unit.
The formation method of embodiment of the present invention can be realized by the imageing sensor of embodiment of the present invention.
Refer to Fig. 6 and Fig. 7, the imageing sensor 10 of embodiment of the present invention comprises photosensitive unit array 11, control filtersMolding piece 15 and be arranged at the optical filter 13 on photosensitive unit array 11.
Concrete, optical filter 13 comprises filtering structure array 131, it is single that each filtering structure 1317 comprises that multiple primary colors filterUnit 1311, each primary colors filter unit 1311 covers a photosensitive unit 111. Optical filtering control module 15 is for controlling at least sensitizationCell array 11 and optical filter 13 relatively move so that photosensitive unit 111 respectively with all primary colors of same filtering structure 1317Filter unit 1311 aligns respectively and exposes to obtain the output of all primary colors.
Extraneous light is irradiated to the sensitization part 1111 of photosensitive unit 111 to produce the signal of telecommunication by optical filter 13, i.e. senseThe output of light unit 111.
Filtering structure generally comprises and can be mixed to form several primary colors filter units of institute's the colorful one, for example conventional red,Green, blue filter unit. Relatively move by control, make several primary colors filter units of each photosensitive unit and this align and expose to the sunLight mistake. So just can make each photosensitive pixel obtain the output of all primary colors, thereby make the output packet of each photosensitive unitDraw together multiple primary colors to generate the complete image of color.
Please refer to the drawing 7, in the present embodiment, filtering structure is not limited to the primary colors filter unit layout providing in figure.The primary colors filter unit group of the adjacent minimum number that comprises all kinds, all can be considered filtering structure.
Please refer to the drawing 8-11, preferably, in some embodiments, optical filtering control module control optical filter 13 moves and makes senseLight unit 111 aligns respectively and exposes with all primary colors filter units 1311 of same filtering structure 1317 respectively and ownedThe output of primary colors.
For example, in the present embodiment, each filtering structure 1317 comprises 2*2 primary colors filter unit 1311, corresponding 2*2Individual photosensitive unit 111, if the photosensitive unit in the upper left corner (being dash area) is considered as with reference to photosensitive unit, optical filter 13 is initiallyAnd the exposure corresponding with Gr filter unit in filtering structure 1317 with reference to photosensitive unit 111 when position. Subsequently, optical filter 13 is complied withInferior left, the distance of upper, filter unit 1311 length of sides that move right, make to filter with R, Gb, B respectively with reference to photosensitive unit 111Corresponding and the exposure output in unit.
Like this, photosensitive unit array 11 is static with respect to extraneous scenery, and just optical filter 13 relatively moves, therefore,The same point of the picture of the corresponding extraneous scenery of output of the photosensitive unit 111 that photosensitive unit 111 multiexposure, multiple exposures produce, is convenient to generateImage clearly. In addition,, due to the filter unit 1311 of the corresponding different primary colors of multiexposure, multiple exposure, the color of the image therefore generating is completeWhole true to nature.
Please join in the lump Fig. 7, in the imageing sensor of embodiment of the present invention, filtering structure can comprise Bayer structure, formerLook filter unit comprises red filter unit, the first green filter unit, blue filter unit and the second green filter unit. VisitEar structure is a kind of widely used filter array structure. Therefore, adopt Bayer structure can adopt conventional needle to Bayer structureAlgorithm is processed picture signal, thereby does not need to do on hardware configuration large adjustment. In traditional filter array structure, each filterThe corresponding photosensitive pixel in light unit and image pixel. And in the present embodiment, each filter unit is not limited to only correspondingA photosensitive pixel, also can corresponding multiple photosensitive pixels and produce multiple output.
Please refer to the drawing 12 and Figure 13, in some embodiments, each photosensitive unit 111 comprises 2*2 photosensitive pixel 1112;Corresponding, each primary colors filter unit 1311 covers 2*2 photosensitive pixel 1112.
Except 2*2 structure, also have 3*3,4*4, or even any structure (n, m is positive integer) such as n*m, be appreciated thatOn photosensitive unit array 11, the number of sequencable photosensitive pixel 1112 is limited, the light-sensitive image that each merging pixel comprisesElement 1112 is too much, and the resolution sizes of image can be restricted, as, if the pixel resolution of photosensitive unit array 11 is16M, adopts the merging dot structure of 2*2 can obtain the merging image that resolution ratio is 4M, and adopts 4*4 structure just can only obtain pointThe rate of distinguishing is the merging image of 1M. Therefore the merging dot structure of 2*2 is a preferred arrangement mode, is sacrificing less resolution ratio as far as possiblePrerequisite under promote brightness of image and definition. Meanwhile, adopt 2*2 structure to facilitate realization reading photosensitive pixel output on hardwareGet and merge processing. Refer to Figure 14, in the present embodiment, imageing sensor also comprises control module 17, control module 17Being used for controlling photosensitive unit array 11 exposes line by line.
Exposure refers to photosensitive pixel 1112 to expose line by line line by line. Particularly, control module 17 can connect row selection logic listUnit 171 and column selection logical block 173, process the output of photosensitive pixel 1112 to control line by line. Exposure defeated line by lineThe mode going out is the now widely used exposure way of output, and this mode is easier to realize on hardware. Exposure also not only line by lineBe confined to the photosensitive unit array 11 of this 2*2 photosensitive pixel structure.
See also Figure 14, in the present embodiment, imageing sensor 10 also comprises register 19, control module 17 useIn gathering successively the output of the photosensitive unit 111 that k is capable and k+1 is capable completing when prior exposure and depositing register 19 in, wherein k=2n-1, n is positive integer, k+1 is less than or equal to total line number of photosensitive pixel 11.
The control module of above-mentioned embodiment and the structure of photosensitive pixel, can consult Figure 15, imageing sensor 10 comprise withThe control module 17 that row selects logical block 171 and column selection logical block 173 to connect. Row is selected logical block 171 and column selectionSelect logical block 173 switching tube corresponding with each photosensitive pixel 1,112 1115 and connect, control module 17 is for controlling row choosingSelect logical block 171 and column selection logical block 173 switching tube 1115 with the photosensitive pixel 1112 of gating ad-hoc location, therebyControl the output of photosensitive pixel and can deliver to subsequent conditioning circuit. Please refer to the drawing 14 and Figure 15, control module 17 can be adopted line by line or by two rowThe output of collection photosensitive pixel 1112 also deposits register 19 in, and subsequent conditioning circuit, as ISP (imagesignalprocessor) coreSheet extracts data to obtain the output of photosensitive pixel 1112 and to its processing from register 19.
Refer to Figure 16, in some embodiments, imageing sensor 10 comprises the micro mirror battle array being arranged on optical filter 13Row 23, each micro mirror 231 is corresponding with a photosensitive pixel 1112.
Concrete, each micro mirror 231 is corresponding with a photosensitive pixel 1112, comprises size, position correspondence. In some enforcementIn mode, each filter unit 1311 corresponding 2*2 photosensitive pixel 1112 and 2*2 micro mirror 191. Along with technical development, forObtain the image that resolution ratio is higher, photosensitive pixel on sensitive film 1112 is more and more, arrange more and more intensive, single light-sensitive imageElement is 1112 also more and more less, and it is affected by light, and sensitization part 1111 areas of photosensitive pixel 1112 are limited, micro mirror191 can gather light sensitization part 1111, thus promotion feeling light pixel 1112 be subject to luminous intensity to improve image quality.
In some embodiments, optical filtering control module comprises MEMS (Microelectro-mechanicalSystems,MEMS)。
Adopt microelectromechanical-systems can make optical filter produce controlled micro-displacement, scheme thereby meet in embodiment of the present inventionThe application demand of image-position sensor. Micro electro mechanical system (MEMS) technology is the one industry that microelectric technique and mechanical engineering are fused togetherTechnology, its opereating specification is in micrometer range. Less than it, be called as and receive dynamo-electric system in the similar technology of nanometer rangeSystem. Microelectromechanical-systems has been widely used in the field such as electronics industry or biomedicine at present. To sum up, in embodiment of the present inventionImageing sensor 10, filtering structure array and optical filter can relatively move, so that photosensitive unit filters to the primary colors of different colorThe light that unit sees through sensitization respectively, thus make the output of each photosensitive unit comprise that multiple primary colors is to generate the complete figure of colorPicture.
Especially, when controlling that optical filter moves and photosensitive unit array when static, photosensitive unit array due to respect to outsideBoundary's scenery is static, can generate image more clearly, due to the filter unit of different primary colors corresponding to multiexposure, multiple exposure, therefore rawThe color of the image becoming is complete true to nature. In addition, same photosensitive unit can comprise multiple photosensitive pixels and produce multiple output, rearIn continuous circuit, merge, contribute to promote the signal to noise ratio of image.
Please refer to the drawing 17, the present invention also provides a kind of imaging device 100, and it comprises the imageing sensor of embodiment of the present inventionOutside 10, also comprise the image processing module 50 being connected with imageing sensor 10.
Thereby image processing module 50 obtains cromogram for the output that adopts all primary colors to represent photosensitive unit 111Picture.
Image processing module 50 can comprise ISP chip and interlock circuit, for the treatment of photosensitive unit 111 or photosensitive pixel1112 output. Primary colors refers to can be used for mix to form the Essential colour of other colors, if red, green, blue is that the one commonly used is formerLook collocation. The corresponding image pixel of each photosensitive unit 111, image pixel can be with these three kinds of primary colors as three property valuesRepresent.
See also Figure 12, in the present embodiment, photosensitive unit 111 can comprise multiple photosensitive pixels 1112. ImageProcessing module or imageing sensor 10 for the output of photosensitive pixel 1112 that merges same photosensitive unit 111 to obtain primary colorsOutput.
That is to say, be full the output of the multiple photosensitive pixels in photosensitive unit and with a corresponding image pixel. ThisSample is conducive to promote the signal to noise ratio of image. The mode merging comprises that software merges and hardware merges. Software merges first by eachThe output of photosensitive pixel is converted to data signal, then delivers in subsequent conditioning circuit or chip, as ISP (imagesignalProcessor) in, process, be added or average, as the output of photosensitive unit.
Hardware merges and refers to merge in the circuit of imageing sensor, for example, and by the photoelectricity two of multiple photosensitive pixelsUtmost point pipe (PD, photodiode) connects same source follower (SF, sourcefollower) to realize the electric charge letter of outputNumber addition, or the photodiode of multiple photosensitive pixels connects respectively a source follower so that charge signal is converted to electricityPress signal, multiple source followers connect analog-digital converter (ADC, an analogtodigital more jointlyConverter), to obtain average voltage, then carry out analog-to-digital conversion.
Refer to Figure 18, adopt software merge some embodiment in, each photosensitive pixel 1112 respectively with oneAnalog-digital converter 211 connects, and analog-digital converter 211 is converted to numeral for the analog signal output that photosensitive pixel 1112 is producedSignal output, image processing module 50 is for calculating the data signal of the photosensitive pixel 1112 that same primary colors filter unit is correspondingWith or average to obtain the output of primary colors. Concrete, select logical block 171 and column selection logic list by control module 17, rowUnit 173 controls photosensitive pixel 1112 and exports line by line, is converted to data signal at analog-digital converter array 21, is stored in register 19And and extracted and process by image processing module 50, until the output of all photosensitive pixels 1112 processed with generate merge figurePicture.
It is the processing mode of commonly using that software merges, and the output of many photosensitive pixels is added to the merging image noise of formationThan higher. For example, suppose that original each photosensitive pixel is output as S, noise is N, and photosensitive unit comprises m photosensitive pixel,Photosensitive unit be totally output as m*S, and the overall noise of photosensitive unit isM be more than or equal to 1 just wholeNumber. Be appreciated that at m > 1 in the situation that, the overall noise of photosensitive unit be less than merge before each color sensitive pixel outputNoise sum. And photosensitive unit is output as the front each photosensitive pixel output sum of merging, the therefore final merging image generatingSignal to noise ratio improves on the whole, and definition promotes. In addition, adopt software to merge, can retain better original output information, as eachThe output of photosensitive pixel, like this, ISP chip etc. can carry out the multiple place of algorithms of different as required to original output informationReason.
The structure of the photosensitive pixel 1112 in present embodiment can be consulted Figure 18, and photodiode 1113 is for turning illuminationTurn to electric charge, and the electric charge and the proportional relation of intensity of illumination that produce. Switching tube 1115 is for selecting logical block 171 according to rowAnd the control signal of column selection logical block 173 comes conducting and the disconnection of control circuit, in the time of circuit turn-on, source follower1117 (sourcefollower) are converted into voltage signal for the charge signal that photodiode 1113 is produced through illumination.Analog-digital converter 211 (Analog-to-digitalconverter) is for voltage signal is converted to data signal, to transmitTo subsequent conditioning circuit processing.
The output processing mode that software merges makes the output of photosensitive unit be converted into data signal, with at image processing moduleCircuit in or in chip, process with software. Therefore the output information of each photosensitive unit can be retained, for example, forThe imageing sensor of 16M pixel, the formation method of embodiment of the present invention can retain 16M pixel (image before merging)Information, obtaining the merging image of 4M pixel or the image of other resolution ratio through processing on this basis. Final synthetic imageThe probability that occurs bad point is lower. In addition, the noise of this output processing mode is less, and signal to noise ratio is higher.
The present invention also provides a kind of electronic installation of applying imaging device. In some embodiments, electronic installation comprisesImaging device. Therefore, electronic installation has camera function and can under low-light (level), generate color complete, and signal to noise ratio is high, definitionHigh merging image.
Electronic installation can be mobile phone.
In some embodiments, imaging device can be the preposition camera of mobile phone. Because preposition camera is used for autodyning,And auto heterodyne General Requirements has requirement to the definition of image and less demanding to image resolution ratio, adopt the electronics of present embodimentDevice can meet this requirement.
Refer to Figure 20, in some embodiments, electronic installation 200 comprises the centre being connected with imaging device 100Reason device 81 and external memory 83, central processing unit 81 merges image for controlling external memory 83 storages.
Like this, the merging image of generation can be stored, and conveniently checks, uses or shift later. External memory 83 comprisesSM (SmartMedia) card and CF (CompactFlash) card etc.
Refer to Figure 21, in some embodiments, electronic installation 200 also comprises the central authorities that are connected with imaging device 100Processor 81 and display unit 85, central processing unit 81 shows merging image for controlling display unit 85. Like this, electronic installation200 images of taking can be shown in display unit 85 and check for user. Display unit 85 comprises light-emitting diode display etc.
To sum up, adopt the electronic installation of embodiment of the present invention, there is camera function and can under low-light (level), generate colorComplete, signal to noise ratio is high, the merging image that definition is high. Especially, in the time of preposition camera that this electronic installation is mobile phone, can promoteUnder low-light (level), autodyne brightness and the definition of image, reduce noise.
The part of not launching in formation method and electronic installation in embodiment of the present invention, can join the figure of above embodimentThe corresponding part of image-position sensor and imaging device, launches no longer in detail at this.
In the description of this description, reference term " embodiment ", " some embodiments ", " schematically enforcementMode ", the descriptions of " example ", " concrete example " or " some examples " etc. means the tool of describing in conjunction with described embodiment or exampleBody characteristics, structure, material or feature are contained at least one embodiment of the present invention or example. In this manual,Schematic statement to above-mentioned term not necessarily refers to identical embodiment or example. And, the specific features of description, knotStructure, material or feature can be with suitable mode combinations in any one or more embodiments or example.
Any process of otherwise describing in flow chart or at this or method are described and can be understood to, represent to compriseOne or more is for realizing module, fragment or the portion of code of executable instruction of step of specific logical function or processPoint, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to shown or discuss suitableOrder, comprises according to related function by the mode of basic while or by contrary order, carry out function, this should be by the present inventionEmbodiment person of ordinary skill in the field understand.
The logic and/or the step that in flow chart, represent or otherwise describe at this, for example, can be considered to useIn the sequencing list of executable instruction that realizes logic function, may be embodied in any computer-readable medium, forInstruction execution system, device or equipment (as computer based system, comprise that the system of processor or other can hold from instructionRow system, device or equipment instruction fetch are also carried out the system of instruction) use, or in conjunction with these instruction execution systems, install or establishStandby and use. With regard to this description, " computer-readable medium " can be anyly can comprise, store, communicate by letter, propagate or passThe dress that defeated program is used for instruction execution system, device or equipment or in conjunction with these instruction execution systems, device or equipmentPut. The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electricity with one or more wiringsConnecting portion (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage(ROM), the erasable read-only storage (EPROM or flash memory) of editing, fiber device, and portable optic disk is read-only depositsReservoir (CDROM). In addition, computer-readable medium can be even can print the paper of described program thereon or other are suitableMedium, because can be for example by paper or other media are carried out to optical scanner, then edits, decipher or if desired with itHis suitable method is processed in electronics mode and is obtained described program, is then stored in computer storage.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination. Above-mentionedIn embodiment, multiple steps or method can be with being stored in the software of carrying out in memory and by suitable instruction execution systemOr firmware is realized. For example, if realized with hardware, with the same in another embodiment, available well known in the art underAny one in row technology or their combination realize: have the logic gates for data-signal being realized to logic functionDiscrete logic, there is the special IC of suitable combinational logic gate circuit, programmable gate array (PGA), sceneProgrammable gate array (FPGA) etc.
Those skilled in the art are appreciated that and realize all or part of step that above-described embodiment method is carriedSuddenly be can carry out the hardware that instruction is relevant by program to complete, described program can be stored in a kind of computer-readable storage mediumIn matter, this program, in the time carrying out, comprises step of embodiment of the method one or a combination set of.
In addition, the each functional unit in each embodiment of the present invention can be integrated in a processing module, also canBe that the independent physics of unit exists, also can be integrated in a module two or more unit. Above-mentioned integrated mouldPiece both can adopt the form of hardware to realize, and also can adopt the form of software function module to realize. Described integrated module asFruit is realized and during as production marketing independently or use, also can be stored in a computer using the form of software function moduleIn read/write memory medium.
The above-mentioned storage medium of mentioning can be read-only storage, disk or CD etc.
Although illustrated and described embodiments of the invention above, be understandable that, above-described embodiment is exampleProperty, can not be interpreted as limitation of the present invention, those of ordinary skill in the art within the scope of the invention can be to above-mentionedEmbodiment changes, amendment, replacement and modification.
Claims (23)
1. a formation method, is characterized in that, comprises the following steps:
Imageing sensor is provided, and described imageing sensor comprises photosensitive unit array and is arranged on described photosensitive unit arrayOptical filter, described optical filter comprises filtering structure array, each described filtering structure comprises multiple primary colors filter units, Mei GesuoState primary colors filter unit and cover a described photosensitive unit;
Control at least described photosensitive unit array and described optical filter relatively move make described photosensitive unit respectively with same instituteThe all described primary colors filter unit of stating filtering structure aligns respectively and exposes to obtain the output of all primary colors; And
Adopt the output of all described primary colors to represent that described photosensitive unit is to obtain coloured image.
2. formation method as claimed in claim 1, is characterized in that, described control step moves by controlling described optical filterMake described photosensitive unit respectively with all described primary colors filter unit of same described filtering structure align respectively and expose withObtain the output of all described primary colors.
3. formation method as claimed in claim 1, is characterized in that, each described photosensitive unit comprises 2*2 photosensitive pixel.
4. formation method as claimed in claim 3, is characterized in that, described control step further comprises:
Merge the output of described photosensitive pixel of described same described photosensitive unit to obtain the output of described primary colors.
5. formation method as claimed in claim 3, is characterized in that, each described photosensitive pixel respectively with an analog-to-digital conversionDevice connects;
Described control step further comprises:
The analog signal output that described photosensitive pixel is produced is converted to data signal output; And
Calculate the described photosensitive pixel that same described filter unit is corresponding described data signal and or average with described in obtainingThe output of primary colors.
6. formation method as claimed in claim 3, is characterized in that, described read step further comprises:
Gather the output of the capable and described photosensitive pixel that k+1 is capable of k and deposit register in, wherein k=2n-1, n is positive integer,K+1 is less than or equal to total line number of described photosensitive pixel; And
The output of extracting the capable and described photosensitive pixel that k+1 is capable of described k from described register is to obtain described primary colorsOutput.
7. the formation method as described in claim 1-6 any one, is characterized in that, described filtering structure comprises Bayer knotStructure, described primary colors filter unit comprises red filter unit, the first green filter unit, blue filter unit and the second green filterLight unit.
8. an imageing sensor, is characterized in that, comprising:
Photosensitive unit array;
Be arranged at the optical filter on described photosensitive unit array; And
Optical filtering control module; Described optical filter comprises filtering structure array, and each described filtering structure comprises that multiple primary colors filterUnit, each described primary colors filter unit covers a described photosensitive unit; Described optical filtering control module is used for controlling at least instituteState photosensitive unit array and described optical filter relatively move make described photosensitive unit respectively with the institute of same described filtering structureThere is described primary colors filter unit to align respectively and expose to obtain the output of all primary colors.
9. imageing sensor as claimed in claim 8, is characterized in that, described optical filtering control module is used for controlling described optical filteringSheet moves described photosensitive unit is alignd respectively also with all described primary colors filter unit of same described filtering structure respectivelyExposure is to obtain the output of all described primary colors.
10. imageing sensor as claimed in claim 8, is characterized in that, described filtering structure comprises Bayer structure, described formerLook filter unit comprises red filter unit, the first green filter unit, blue filter unit and the second green filter unit.
11. imageing sensors as claimed in claim 8, is characterized in that, each described photosensitive unit comprises 2*2 light-sensitive imageElement.
12. imageing sensors as claimed in claim 11, is characterized in that, described imageing sensor comprises control module, instituteStating control module exposes line by line for controlling described photosensitive unit array.
13. imageing sensors as claimed in claim 11, is characterized in that, described imageing sensor also comprises register;
Described control module is for gathering successively the output of the capable and described photosensitive pixel that k+1 is capable of the k completing when prior exposureAnd deposit described register in, and wherein k=2n-1, n is positive integer, k+1 is less than or equal to total line number of described photosensitive pixel.
14. imageing sensors as claimed in claim 8, is characterized in that, described imageing sensor comprises and is arranged on described filterMicro mirror array on mating plate, each described micro mirror is corresponding with a described photosensitive pixel.
15. imageing sensors as claimed in claim 8, is characterized in that, described optical filtering control module comprises MEMS.
16. 1 kinds of imaging devices, is characterized in that, comprise the imageing sensor described in claim 8-15; Described imaging deviceAlso comprise image processing module, described image processing module is for adopting the output of all described primary colors to represent described photosensitive unitTo obtain coloured image.
17. imaging devices as claimed in claim 16, is characterized in that, described photosensitive unit comprises multiple photosensitive pixels; InstituteState image processing module or described imageing sensor for merge same described photosensitive unit described photosensitive pixel output withObtain the output of described primary colors.
18. imaging devices as claimed in claim 17, is characterized in that, each described photosensitive pixel turns with a modulus respectivelyParallel operation connects; It is defeated that described analog-digital converter is converted to data signal for the analog signal output that described photosensitive pixel is producedGo out; Described image processing module is for calculating the described data signal of described photosensitive pixel that same described filter unit is correspondingWith or average to obtain the output of described primary colors.
19. 1 kinds of electronic installations, is characterized in that, comprise the imaging device as described in claim 16-18 any one.
20. electronic installations as claimed in claim 19, is characterized in that, described electronic installation comprises mobile phone.
21. electronic installations as claimed in claim 20, is characterized in that, described imaging device comprises the preposition phase of described mobile phoneMachine.
22. electronic installations as claimed in claim 19, is characterized in that, described electronic installation comprises with described imaging device and connectingThe central processing unit connecing and external memory, described central processing unit is used for controlling described external memory and stores described merging image.
23. electronic installations as claimed in claim 19, is characterized in that, described electronic installation also comprises and described imaging deviceThe central processing unit and the display unit that connect, described central processing unit is used for controlling described display unit and shows described merging figurePicture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963701.XA CN105611123B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963701.XA CN105611123B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105611123A true CN105611123A (en) | 2016-05-25 |
| CN105611123B CN105611123B (en) | 2017-05-24 |
Family
ID=55990639
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510963701.XA Expired - Fee Related CN105611123B (en) | 2015-12-18 | 2015-12-18 | imaging method, image sensor, imaging device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105611123B (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106162111A (en) * | 2016-07-29 | 2016-11-23 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106162110A (en) * | 2016-07-29 | 2016-11-23 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106210677A (en) * | 2016-07-29 | 2016-12-07 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106210678A (en) * | 2016-07-29 | 2016-12-07 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106506915A (en) * | 2016-11-15 | 2017-03-15 | 深圳天珑无线科技有限公司 | A kind of camera module and digital equipment |
| CN106507068A (en) * | 2016-11-29 | 2017-03-15 | 广东欧珀移动通信有限公司 | Image processing method and device, control method and device, imaging and electronic installation |
| CN106604001A (en) * | 2016-11-29 | 2017-04-26 | 广东欧珀移动通信有限公司 | Image processing method, image processing device, imaging device, and electronic device |
| CN112839215A (en) * | 2019-11-22 | 2021-05-25 | 华为技术有限公司 | Camera module, camera, terminal equipment and image information determining method |
| CN113038091A (en) * | 2021-03-11 | 2021-06-25 | 苏州乐佰图信息技术有限公司 | Pixel rotation mechanism and pixel rotation method thereof |
| CN114650376A (en) * | 2022-03-02 | 2022-06-21 | 维沃移动通信有限公司 | Image sensor and electronic device |
| CN115118856A (en) * | 2022-06-24 | 2022-09-27 | 维沃移动通信有限公司 | Image sensor, image processing method, camera module and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070206241A1 (en) * | 2006-03-06 | 2007-09-06 | Micron Technology, Inc. | Fused multi-array color image sensor |
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
-
2015
- 2015-12-18 CN CN201510963701.XA patent/CN105611123B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070206241A1 (en) * | 2006-03-06 | 2007-09-06 | Micron Technology, Inc. | Fused multi-array color image sensor |
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN102460700A (en) * | 2009-06-23 | 2012-05-16 | 诺基亚公司 | Color filters for sub-diffraction limit sensors |
| CN104170376A (en) * | 2012-03-27 | 2014-11-26 | 索尼公司 | Image processing device, image-capturing element, image processing method, and program |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018018995A1 (en) * | 2016-07-29 | 2018-02-01 | 广东欧珀移动通信有限公司 | Image color processing method and apparatus, and terminal device |
| CN106162110A (en) * | 2016-07-29 | 2016-11-23 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106210677A (en) * | 2016-07-29 | 2016-12-07 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106210678A (en) * | 2016-07-29 | 2016-12-07 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106162111A (en) * | 2016-07-29 | 2016-11-23 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal unit |
| CN106210677B (en) * | 2016-07-29 | 2018-02-06 | 广东欧珀移动通信有限公司 | Image color processing method, device and terminal device |
| CN106506915A (en) * | 2016-11-15 | 2017-03-15 | 深圳天珑无线科技有限公司 | A kind of camera module and digital equipment |
| CN106604001B (en) * | 2016-11-29 | 2018-06-29 | 广东欧珀移动通信有限公司 | Image processing method, image processing apparatus, imaging device and electronic device |
| US10447925B2 (en) | 2016-11-29 | 2019-10-15 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, electronic device and control method |
| CN106507068B (en) * | 2016-11-29 | 2018-05-04 | 广东欧珀移动通信有限公司 | Image processing method and device, control method and device, imaging and electronic device |
| CN106507068A (en) * | 2016-11-29 | 2017-03-15 | 广东欧珀移动通信有限公司 | Image processing method and device, control method and device, imaging and electronic installation |
| US10249021B2 (en) | 2016-11-29 | 2019-04-02 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device |
| US10440265B2 (en) | 2016-11-29 | 2019-10-08 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, electronic device and control method |
| US10438320B2 (en) | 2016-11-29 | 2019-10-08 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method and apparatus, and electronic device |
| CN106604001A (en) * | 2016-11-29 | 2017-04-26 | 广东欧珀移动通信有限公司 | Image processing method, image processing device, imaging device, and electronic device |
| CN112839215A (en) * | 2019-11-22 | 2021-05-25 | 华为技术有限公司 | Camera module, camera, terminal equipment and image information determining method |
| WO2021098349A1 (en) * | 2019-11-22 | 2021-05-27 | 华为技术有限公司 | Camera module, camera, terminal device and image information determination method |
| CN112839215B (en) * | 2019-11-22 | 2022-05-13 | 华为技术有限公司 | Camera module, camera, terminal device, image information determination method and storage medium |
| EP4040785A4 (en) * | 2019-11-22 | 2022-12-14 | Huawei Technologies Co., Ltd. | Camera module, camera, terminal device and image information determination method |
| CN113038091A (en) * | 2021-03-11 | 2021-06-25 | 苏州乐佰图信息技术有限公司 | Pixel rotation mechanism and pixel rotation method thereof |
| CN114650376A (en) * | 2022-03-02 | 2022-06-21 | 维沃移动通信有限公司 | Image sensor and electronic device |
| CN115118856A (en) * | 2022-06-24 | 2022-09-27 | 维沃移动通信有限公司 | Image sensor, image processing method, camera module and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105611123B (en) | 2017-05-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105611123A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105578072A (en) | Imaging method, imaging device and electronic device | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| TWI612811B (en) | Image sensor, pixel information output method of the image sensor, phase focusing method, imaging device, and mobile terminal | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105430359A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN106663688B (en) | The physical layout and structure of the RGBZ pixel cell units of RGBZ imaging sensor | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN105578076A (en) | Imaging method, imaging device and electronic device | |
| CN105578078A (en) | Image sensor, imaging device, mobile terminal and imaging method | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN103491310B (en) | Image capture apparatus and its control method | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN103081484A (en) | A 3-D camera | |
| CN105430362A (en) | Imaging method, imaging device and electronic device | |
| JP2018504034A (en) | High dynamic range image generation method, photographing apparatus and terminal, and imaging method | |
| CN105430360A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105516697A (en) | Image sensor, imaging device, mobile terminal and imaging method | |
| TWI615029B (en) | Image sensor, terminal having same and imaging method using same | |
| WO2018196703A1 (en) | Image sensor, focusing control method, imaging device and mobile terminal | |
| CN105578081A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| TW201724843A (en) | Image sensor, terminal having same and imaging method using same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170524 |