CN105430363A - Imaging method, imaging device and electronic device - Google Patents
Imaging method, imaging device and electronic device Download PDFInfo
- Publication number
- CN105430363A CN105430363A CN201510964303.XA CN201510964303A CN105430363A CN 105430363 A CN105430363 A CN 105430363A CN 201510964303 A CN201510964303 A CN 201510964303A CN 105430363 A CN105430363 A CN 105430363A
- Authority
- CN
- China
- Prior art keywords
- pixel
- photosensitive pixel
- filtering district
- output
- composograph
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses an imaging method, comprising the steps of firstly, providing an image sensor, wherein the image sensor comprises a photosensitive pixel array and a filter arranged on the photosensitive pixel array, the filter comprises a filter unit array, each filter unit comprises a color filter area and an infrared filter area, and the color filter area and the infrared filter area respectively cover at least one photosensitive pixel; and then, reading the outputs of the photosensitive pixel array, and calculating the pixel values of a composite image according to the outputs of the photosensitive pixels covered by the color filter areas and the photosensitive pixels corresponding to the infrared filter areas to generate the composite image. The obtained composite image includes complete color information, and is high in signal-to-noise ratio. The invention further discloses an imaging device for implementing the imaging method and an electronic device using the imaging device.
Description
Technical field
The present invention relates to imaging technique, particularly a kind of formation method, imaging device and electronic installation.
Background technology
Existing RGB imageing sensor is taken pictures weak effect, fuzzy under low-light (level), even claps less than scenery.Embed infrared filtering pixel in some imageing sensor to provide imaging effect, but when bright and clear, entering imageing sensor infrared ray can affect imaging effect, makes image generation colour cast etc.
Summary of the invention
The present invention is intended at least to solve one of technical problem existed in prior art.For this reason, the present invention needs to provide a kind of formation method, imaging device and electronic installation.
The formation method of embodiment of the present invention comprises the following steps:
Imageing sensor is provided, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, described filter comprises filter unit array, described filter unit comprises colorized optical filtering district and infrared filtering district, and described colorized optical filtering district and described infrared filtering district cover photosensitive pixel described at least one respectively; And
Read the output of described photosensitive pixel array, and calculate the pixel value of composograph to generate described composograph according to the output of the described photosensitive pixel of described colorized optical filtering district covering and the described photosensitive pixel of described infrared filtering district covering.
In the formation method of embodiment of the present invention, on filter, the colorized optical filtering district of filter unit is for obtaining the color information of the pixel of composograph, and infrared filtering district is used for the monochrome information of the pixel obtaining composograph under low-light (level) and this monochrome information noise is less.The pixel of composograph refers to the pixel exporting the image generated according to photosensitive pixel.So, the pixel value of composograph had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color of composograph is complete true to nature, and brightness and definition are all better, and noise is few.Solve some problem in existing formation method.
The present invention also provides a kind of imaging device of the formation method for realizing above-mentioned execution mode, and it comprises: imageing sensor, and described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array; Described filter comprises filter unit array, and each described filter unit comprises colorized optical filtering district and infrared filtering district; Described colorized optical filtering district and described infrared filtering district cover photosensitive pixel described at least one respectively;
Described imaging device also comprises the image processing module be connected with described imageing sensor;
Described image processing module for reading the output of described photosensitive pixel array, and calculates the pixel value of composograph to generate described composograph for the output of described photosensitive pixel corresponding to the described photosensitive pixel that covers according to described colorized optical filtering district and described infrared filtering district.
The present invention also provides a kind of electronic installation applying the imaging device of above-mentioned execution mode.Additional aspect of the present invention and advantage will part provide in the following description, and part will become obvious from the following description, or be recognized by practice of the present invention.
Accompanying drawing explanation
Above-mentioned and/or additional aspect of the present invention and advantage will become obvious and easy understand from accompanying drawing below combining to the description of execution mode, wherein:
Fig. 1 is the schematic flow sheet of the formation method of embodiment of the present invention.
Fig. 2 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 3 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 4 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 5 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 6 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 7 is the schematic flow sheet of the step of embodiment of the present invention formation method.
Fig. 8 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 9 is the schematic side view of the imaging device of embodiment of the present invention.
Figure 10 is the filter unit schematic diagram of the imaging device of embodiment of the present invention.
Figure 11 is the filter unit array schematic diagram of Bayer structure.
Figure 12 is the filter unit array schematic diagram of the imaging device of embodiment of the present invention.
Figure 13 is the perspective view of the imageing sensor of embodiment of the present invention.
Figure 14 is the filter unit array of embodiment of the present invention and the corresponding relation schematic diagram of composograph.
Figure 15 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Figure 16 is the photosensitive pixel circuit structural representation of embodiment of the present invention imaging device.
Figure 17 is the perspective view of the imageing sensor of embodiment of the present invention.
Figure 18 is the filter unit array of embodiment of the present invention and the another kind of corresponding relation schematic diagram of composograph.
Figure 19 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 20 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Embodiment
Be described below in detail the execution mode of embodiments of the present invention, the example of described execution mode is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Being exemplary below by the execution mode be described with reference to the drawings, only for explaining embodiments of the present invention, and the restriction to embodiments of the present invention can not being interpreted as.
Below in conjunction with accompanying drawing, the formation method of embodiments of the present invention, imaging device and electronic installation are described further.
Refer to Fig. 1, the formation method of embodiment of the present invention comprises the following steps:
S1, imageing sensor is provided, imageing sensor comprises photosensitive pixel array and is arranged at the filter on photosensitive pixel array, filter comprises filter unit array, filter unit comprises colorized optical filtering district and infrared filtering district, and colorized optical filtering district and infrared filtering district cover at least one photosensitive pixel respectively.
S2, reads the output of photosensitive pixel array, and calculates the pixel value of composograph to generate composograph according to the output of the photosensitive pixel of colorized optical filtering district covering and the photosensitive pixel of infrared filtering district covering.
In the formation method of embodiment of the present invention, on filter, the colorized optical filtering district of filter unit is for obtaining the color information of the pixel of composograph, and infrared filtering district is used for the monochrome information of the pixel obtaining composograph under low-light (level) and this monochrome information noise is less.The pixel of composograph refers to the pixel exporting the image generated according to photosensitive pixel.So, the pixel value of composograph had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color of composograph is complete true to nature, and brightness and definition are all better, and noise is few.
Please refer to the drawing 13, in the present embodiment, each filter unit covers 2*2 photosensitive pixel.Colorized optical filtering district covers three photosensitive pixels, and infrared filtering district covers a photosensitive pixel.
Like this, the color information of the composograph of generation is more complete and definition is high.
Please refer to the drawing 14, in the present embodiment, each photosensitive pixel 111 is corresponding with the pixel 301 of a composograph 300.
Such as, the photosensitive pixel array correspondence of 16M resolution generates the image of 16M resolution.Like this, the embedding of infrared image element does not affect the resolution of composograph.
Please refer to the drawing 2, in the formation method of present embodiment, step S2 comprises further:
S21, the output of photosensitive pixel covered according to the colorized optical filtering district in same filter unit obtains color pixel values corresponding to photosensitive pixel that infrared filtering district covers.
Wherein, the infrared image element value that the photosensitive pixel of color pixel values and the covering of infrared filtering district is corresponding can be used for the pixel value calculating corresponding composograph.
Please refer to the drawing 3, preferably, in the formation method of present embodiment, step S21 comprises further:
S211, the mean value calculating the output of the photosensitive pixel that colorized optical filtering district in same filter unit covers is using color pixel values corresponding to the photosensitive pixel covered as infrared filtering district.
In the present embodiment, the output of the photosensitive pixel that colorized optical filtering district covers comprises color pixel values, and the output of the photosensitive pixel that infrared filtering district covers comprises infrared image element value.Please refer to the drawing 4, step S2 comprises further:
S22, senses and judges ambient brightness.
S23, when ambient brightness is greater than the first predetermined threshold, deducts corresponding infrared image element value to obtain the pixel value of corresponding composograph by color pixel values.
Please refer to the drawing 5, in some embodiments, step S2 comprises further:
S25, senses and judges ambient brightness.
S27, when ambient brightness is less than the second predetermined threshold, adds that by color pixel values corresponding infrared image element value is to obtain the pixel value of corresponding composograph.
Please refer to the drawing 6, in some embodiments, step S2 comprises further:
S29, senses and judges ambient brightness.
S31, when ambient brightness is greater than first threshold and is less than the second predetermined threshold, using the pixel value of color pixel values as the composograph of correspondence.
Using the pixel value of photosensitive pixel as the foundation judging ambient brightness, such as, all color pixel values can be averaged and are used as ambient brightness value.
By sensing and judging ambient brightness, suitable process is carried out to color pixel values.The infrared ray of such as external scene radiation during daytime can affect image quality, and color pixel values can be allowed to cut its infrared ray luminance components.When night, brightness value was lower, infrared image element value can be utilized to compensate to promote brightness of image and signal to noise ratio.When waiting brightness value moderate between the lights, using the pixel value of color pixel values as composograph.
Please refer to the drawing 7, in some embodiments, step S2 comprises further:
S33, the output of the photosensitive pixel covered in colorized optical filtering district is added to obtain merging pixel value.
S35, calculates the pixel value of composograph according to the output of the photosensitive pixel merging pixel value and the covering of infrared filtering district.
So, the photosensitive pixel covered in colorized optical filtering district merges, then calculates the pixel value of the composograph of composograph according to the output of the photosensitive pixel merging pixel value and the covering of infrared filtering district.
In some embodiments, each photosensitive pixel is connected with an analog to digital converter respectively;
Please refer to the drawing 8, step S2 comprises further:
S37, by photosensitive pixel produce analog signal output be converted to digital signal export and stored in register.
S39, extracts digital signal from register and exports with the pixel value calculating composograph.
So, one, be generally digital signal processing chip (DSP, digitalsignalprocessor) image processing module directly can process the output of imageing sensor, two, relative to some by circuit directly concerning the scheme that the output of the analog signal format of imageing sensor processes, remain the information of image preferably.
The formation method of embodiment of the present invention can be realized by the imaging device of embodiment of the present invention.
Refer to Fig. 9 and Figure 10, the imaging device 100 of embodiment of the present invention comprises imageing sensor 10 and image processing module 50.Imageing sensor 10 comprises photosensitive pixel array 11 and is arranged at the filter 13 on photosensitive pixel array 11.Filter 13 comprises filter unit array 131, and each filter unit 1311 comprises colorized optical filtering district 1315 and infrared filtering district 1313.Colorized optical filtering district 1315 covers at least one photosensitive pixel 111, and infrared filtering district 1313 passes through for only making the Infrared of preset wavelength.Preset wavelength can be 750-850nm.Extraneous light is irradiated to the photosensitive part 1111 of photosensitive pixel 111 to produce the signal of telecommunication by filter 13, i.e. the output of photosensitive pixel 111.
Image processing module 50 for reading the output of photosensitive pixel array 11, and calculates the pixel of composograph to generate composograph according to the output of the photosensitive pixel 111 of colorized optical filtering district 1315 covering and the photosensitive pixel 111 of infrared filtering district 1313 correspondence.
On filter 13, the colorized optical filtering district 1315 of filter unit 1311 is for obtaining the color information of the pixel of composograph, and infrared filtering district 1313 for obtaining the monochrome information of the pixel of composograph and this monochrome information noise is less under low-light (level).The pixel of composograph refers to the pixel of the composograph exported according to photosensitive pixel 111.So, the pixel value of composograph had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color of composograph is complete true to nature, and brightness and definition are all better, and noise is few.
Refer to Figure 11, in the present embodiment, colorized optical filtering district 1315 forms Bayer array (Bayerpattern).
Bayer array comprises filtering structure 1317, and each filtering structure 1317 comprises 2*2 filter unit 1311, is green, red, blue, green filter unit 1311 respectively.
Adopt Bayer structure can adopt conventional needle to the algorithm of Bayer structure to process picture signal, thus do not need hardware configuration does large adjustment.
In traditional filter unit array structure, the pixel of the corresponding multiple photosensitive pixel of each filter unit and image.
Refer to Figure 12, in the present embodiment, filter unit array 131 adopts Bayer structure, comprises filtering structure 1317, each filtering structure 1317 comprises green, redness, blueness, green filter unit 1311, the corresponding multiple photosensitive pixel 111 of each filter unit 1311.Each filter unit 1311 comprises colorized optical filtering district 1315 and infrared filtering district 1313.
Refer to Figure 13 and Figure 12, in the present embodiment, each filter unit 1311 covers 2*2 photosensitive pixel 111, and colorized optical filtering district 1315 and infrared filtering district 1313 cover three and a photosensitive pixel 111 respectively.
Like this, the color information of the composograph of generation is more complete.In other execution modes outside present embodiment, the photosensitive pixel that colorized optical filtering district covers can be two, one, the photosensitive pixel that corresponding infrared filtering district covers is two, three, but, when colorized optical filtering district covering photosensitive pixel is less, the pixel just having more composograph is obtained by the calculated for pixel values of other composographs, but not is obtained by the output of the photosensitive pixel of its correspondence, can affect color integrity and the definition of composograph.
Please refer to the drawing 14, in the present embodiment, each photosensitive pixel 111 is corresponding with the pixel 301 of a composograph 300.
Image processing module is used for the color pixel values obtaining photosensitive pixel 111 correspondence that infrared filtering district 1313 covers according to the output of the photosensitive pixel 111 of colorized optical filtering district 1315 correspondence in same filter unit 1311.In addition, the output of the photosensitive pixel 111 of infrared filtering district 1313 correspondence may correspond to and generates infrared image element value.Color pixel values and infrared image element value are for calculating the pixel value of formation composograph to generate composograph 300.
Concrete, image processing module can by the output computation of mean values of the photosensitive pixel 111 of colorized optical filtering district 1315 correspondence in same filter unit 1311 using the color pixel values of photosensitive pixel 111 correspondence covered as infrared filtering district 1313.
Such as, the photosensitive output of the photosensitive pixel 111 that colorized optical filtering district 1315 covers is respectively G1, G2, G3, then the color pixel values of photosensitive pixel 111 correspondence of infrared filtering district 1313 covering is (G1+G2+G3)/3.Be understood that, like this, the color information of the pixel 301 script disappearance of energy simulate or the outer composograph 300 corresponding to filter area 1313 of vat red.
Please refer to the drawing 15, in some embodiments, imageing sensor 10 can comprise analog to digital converter array 21, and each analog to digital converter is connected with a photosensitive pixel, and the analog signal output that analog to digital converter is used for photosensitive pixel produces is converted to digital signal.
So, one, be generally digital signal processing chip (DSP, digitalsignalprocessor) image processing module directly can process the output of imageing sensor, two, relative to some by circuit directly concerning the scheme that the output of the analog signal format of imageing sensor processes, remain the information of image preferably, the formation method of such as embodiment of the present invention can generate composograph by color pixel values and infrared image element value, also can retain information and the infrared image element value information of color pixel values.
Further, in the present embodiment, imaging device 100 comprises the register be connected with analog to digital converter array, and register stores the digital signal output that analog to digital converter produces.
Please refer to the drawing 15, in some embodiments, imageing sensor 10 comprises control module 17, control module 17 control connected row select logical block 171 and column selection logical block 173 gather line by line photosensitive pixel output and by it stored in register 19.Image processing module 50 extracts the output of photosensitive pixel to process from register 19.
Concrete, refer to Figure 15 and Figure 16, imageing sensor 10 comprises the control module 17 selecting logical block 171 and column selection logical block 173 to be connected with row.Row selects logical block 171 and column selection logical block 173 switching tube 1115 corresponding with multiple photosensitive pixel 111 to connect, control module 17 for control lines selection logical block 171 and column selection logical block 173 with the switching tube 1115 of the photosensitive pixel 111 of gating ad-hoc location.
Photosensitive pixel 111 in present embodiment comprises photodiode 1113.Photodiode 1113 is for being converted into electric charge by illumination, and the electric charge produced and the proportional relation of intensity of illumination.Switching tube 1115 is for selecting the control signal of logical block 171 and column selection logical block 173 to come conducting and the disconnection of control circuit according to row, when circuit turn-on, source follower 1117 (sourcefollower) is converted into voltage signal for the charge signal produced through illumination by photodiode 1113.Analog to digital converter 211 (Analog-to-digitalconverter) for voltage signal is converted to digital signal, to transfer to subsequent conditioning circuit process.
This output processing mode makes the output of photosensitive pixel be converted into digital signal, processes in following digital circuit or in the chips with software.Therefore the output information of each photosensitive pixel, comprises color pixel values and infrared image element value can be retained.
Refer to Figure 17, in some embodiments, imageing sensor 10 comprises the micro mirror array 23 be arranged on filter 13, and each micro mirror 231 is corresponding with a photosensitive pixel 111.
Concrete, each micro mirror 231 is corresponding with a photosensitive pixel 111, comprises size, position is corresponding.In some embodiments, the corresponding 2*2 of each filter unit 1311 photosensitive pixel 111 and 2*2 micro mirror 191.Along with technical development, in order to obtain the higher image of resolution, photosensitive pixel 111 on sensitive film gets more and more, arrange more and more intensive, single photosensitive pixel 111 is also more and more less, and its light is affected, and photosensitive part 1111 area of photosensitive pixel 111 is limited, light can be gathered photosensitive part 1111 by micro mirror 191, thus the light reception intensity of promotion feeling light pixel 111 is to improve image quality.
Please refer to the drawing 14, in some embodiments, the corresponding color pixel values of output of the photosensitive pixel that colorized optical filtering district 1315 covers, the corresponding infrared image element value of output of the photosensitive pixel that infrared filtering district 1313 covers.
Image processing module is used for judging ambient brightness according to the pixel value of photosensitive pixel, and environmentally brightness processes accordingly to color pixel values and infrared image element value.Such as, when ambient brightness is greater than the first predetermined threshold, color pixel values is deducted corresponding infrared image element value to obtain the pixel value of composograph.
Further, in some embodiments, image processing module is used for when ambient brightness is less than the second predetermined threshold, color pixel values is added corresponding infrared image element value is to obtain the pixel value of composograph.
Or, in some embodiments, image processing module when ambient brightness is greater than first threshold and is less than the second predetermined threshold using the pixel value of color pixel values as the composograph of correspondence.
Wherein, using the pixel value of photosensitive pixel as the foundation judging ambient brightness, such as, all color pixel values can be averaged and are used as ambient brightness value.
In the above-described embodiment, imaging device 100, by sensing and judging ambient brightness, carries out suitable process to color pixel values.The infrared ray of such as external scene radiation during daytime can affect image quality, and color pixel values can be allowed to cut its infrared ray luminance components.When night, brightness value was lower, infrared image element value can be utilized to compensate to promote brightness of image and signal to noise ratio.When waiting brightness value moderate between the lights, using the pixel value of color pixel values as composograph.
Except above-mentioned three kinds of processing modes, can also be under varying environment brightness in some embodiments, infrared image element value be multiplied by a proportionality coefficient relevant with ambient brightness, and the value obtained is added with color pixel values again, thus obtain the pixel value of composograph, generate composograph.Like this, make the adaptability of imaging device 100 pairs of ambient brightnesss stronger.
In some embodiments, color pixel values and photosensitive pixel corresponding to infrared image element value corresponding with same filter unit.
Carry out the execution mode processed in conjunction with above-mentioned environmentally brightness processed color pixel values and infrared image element, be understood that, the color pixel values of computing of carrying out adding deduct and infrared image element value correspond to same filter unit.Such as, please refer to the drawing 12, the color pixel values of the photosensitive pixel 111 of colorized optical filtering district 1315 correspondence is respectively G1, G2, G3, supposes that, at low-light (level) environment, the pixel value of the composograph of its correspondence is respectively G1+IR, G2+IR, G3+IR.Wherein IR is the infrared image element value of the photosensitive pixel 111 of infrared filtering district 1313 correspondence.
The pixel value of the composograph of photosensitive pixel 111 correspondence that infrared filtering district 1313 covers can be first averaging as its value of color part by G1, G2, G3, and add IR, namely final result is:
(G1+G2+G3)/3+IR
The benefit processed so is nearby, can reduce the color distortion or definition decline that produce in image synthesizing procedure to greatest extent.
Please refer to the drawing 18, in some embodiments, the output that image processing module is used for the photosensitive pixel 111 covered in colorized optical filtering district 1315 is added to obtain merging pixel value, and for calculating the pixel value of composograph according to the output of the photosensitive pixel 111 merging pixel value and infrared filtering district 1313 correspondence.
So, the output of many photosensitive pixels be added, the pixel signal to noise ratio of the composograph of formation is higher.Such as, assuming that the output of original each photosensitive pixel 111 is S, noise is N, the pixel 401 of composograph 400 comprise m photosensitive
sound is less than the noise sum merging front each photosensitive pixel and export.And the output of the pixel 401 of composograph 400 exports sum, the color composite image 400 generated after therefore merging for each photosensitive pixel before merging, compared with in traditional approach with the coloured image that single pixel generates, noise decline signal to noise ratio improves, and definition promotes.
To sum up, each filter unit bag colorized optical filtering district of the imaging device in embodiment of the present invention and infrared filtering district, colorized optical filtering district is for obtaining colour information, and infrared filtering district is used for the monochrome information of the pixel obtaining composograph under low-light (level) and this monochrome information noise is less.So the pixel value of the composograph obtained not only had comprised color information but also comprised the monochrome information of low perceived noisiness, to generate the complete true to nature and composograph that signal to noise ratio is high of color.
In addition, the imaging device of embodiment of the present invention can also by sensing and judging that ambient brightness to carry out suitable computing to obtain the high image of true color definition to the corresponding infrared image element value generated of color pixel values and infrared filtering district that colorized optical filtering district correspondence generates under different ambient brightnesss.
The present invention also provides a kind of electronic installation applying imaging device 100.In some embodiments, electronic installation comprises imaging device 100.Therefore, electronic installation has camera function and to generate color under low-light (level) complete true to nature, and signal to noise ratio is high, the composograph that definition is high.
This electronic installation can be mobile phone.
In the present embodiment, imaging device 100 can be the Front camera of mobile phone.Because Front camera is used for autodyning, and the definition of General Requirements to image of autodyning has requirement and not high to image resolution requirement, adopts the electronic installation of present embodiment can meet this requirement.
Refer to Figure 19, in some embodiments, electronic installation 200 comprises the central processing unit 81 and external memory 83 that are connected with imaging device 100, and central processing unit 81 stores composograph for controlling external memory 83.
Like this, the composograph of generation can be stored, and checks, uses or shifts after convenient.External memory 83 comprises SM (SmartMedia) card and CF (CompactFlash) card etc.
Refer to Figure 20, in some embodiments, electronic installation 200 also comprises the central processing unit 81 and display unit 85 that are connected with imaging device 100, and central processing unit 81 shows composograph for controlling display unit 85.Like this, the image that electronic installation 200 is taken can be shown in display unit and check for user.Display unit comprises light-emitting diode display etc.
To sum up, adopt the electronic installation of embodiment of the present invention, have camera function and to generate color under low-light (level) complete true to nature, signal to noise ratio is high, the composograph that definition is high.Especially, when this electronic installation is the Front camera of mobile phone, the brightness of image of autodyning under promoting low-light (level) and definition, reduce noise.
The part do not launched in formation method and electronic installation in embodiment of the present invention, can join the corresponding part of the imaging device 100 of above execution mode, launch no longer in detail at this.
In the description of this specification, specific features, structure, material or feature that the description of reference term " execution mode ", " some execution modes ", " exemplary embodiment ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with described execution mode or example are contained at least one execution mode of the present invention or example.In this manual, identical execution mode or example are not necessarily referred to the schematic representation of above-mentioned term.And the specific features of description, structure, material or feature can combine in an appropriate manner in any one or more execution mode or example.
Describe and can be understood in flow chart or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by embodiments of the invention person of ordinary skill in the field.
In flow charts represent or in this logic otherwise described and/or step, such as, the sequencing list of the executable instruction for realizing logic function can be considered to, may be embodied in any computer-readable medium, for instruction execution system, device or equipment (as computer based system, comprise the system of processor or other can from instruction execution system, device or equipment instruction fetch and perform the system of instruction) use, or to use in conjunction with these instruction execution systems, device or equipment.With regard to this specification, " computer-readable medium " can be anyly can to comprise, store, communicate, propagate or transmission procedure for instruction execution system, device or equipment or the device that uses in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electrical connection section (electronic installation) with one or more wiring, portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasablely edit read-only memory (EPROM or flash memory), fiber device, and portable optic disk read-only memory (CDROM).In addition, computer-readable medium can be even paper or other suitable media that can print described program thereon, because can such as by carrying out optical scanner to paper or other media, then carry out editing, decipher or carry out process with other suitable methods if desired and electronically obtain described program, be then stored in computer storage.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple step or method can with to store in memory and the software performed by suitable instruction execution system or firmware realize.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: the discrete logic with the logic gates for realizing logic function to data-signal, there is the application-specific integrated circuit (ASIC) of suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, also can be that the independent physics of unit exists, also can be integrated in a module by two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
The above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.
Although illustrate and describe embodiments of the invention above, be understandable that, above-described embodiment is exemplary, can not be interpreted as limitation of the present invention, and those of ordinary skill in the art can change above-described embodiment within the scope of the invention, revises, replace and modification.
Claims (29)
1. a formation method, is characterized in that, comprises the following steps:
Imageing sensor is provided, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, described filter comprises filter unit array, described filter unit comprises colorized optical filtering district and infrared filtering district, and described colorized optical filtering district and described infrared filtering district cover photosensitive pixel described at least one respectively; And
Read the output of described photosensitive pixel array, and calculate the pixel value of composograph to generate described composograph according to the output of the described photosensitive pixel of described colorized optical filtering district covering and the described photosensitive pixel of described infrared filtering district covering.
2. formation method as claimed in claim 1, is characterized in that, each described filter unit covers 2*2 described photosensitive pixel; Described colorized optical filtering district covers three described photosensitive pixels; Described infrared filtering district covers a described photosensitive pixel.
3. formation method as claimed in claim 1, it is characterized in that, each described photosensitive pixel is corresponding with the pixel of a described composograph.
4. formation method as claimed in claim 3, it is characterized in that, described read step comprises further:
The color pixel values of the described photosensitive pixel that described infrared filtering district covers is obtained according to the output of the described photosensitive pixel of the described colorized optical filtering district covering in same described filter unit.
5. formation method as claimed in claim 4, it is characterized in that, described color pixel values calculation procedure comprises further:
Calculate the mean value of the output of described photosensitive pixel corresponding to described colorized optical filtering district in same described filter unit and the color pixel values of the described photosensitive pixel covered as described infrared filtering district.
6. formation method as claimed in claim 1, is characterized in that, the output of the described photosensitive pixel that described colorized optical filtering district covers comprises color pixel values; The output of the described photosensitive pixel that described infrared filtering district covers comprises infrared image element value;
Described read step comprises further:
Sense and judge ambient brightness; And
When described ambient brightness is greater than the first predetermined threshold, described color pixel values is deducted corresponding described infrared image element value to obtain the pixel value of corresponding described composograph.
7. formation method as claimed in claim 1, is characterized in that, the output of the described photosensitive pixel that described colorized optical filtering district covers comprises color pixel values; The output of the described photosensitive pixel that described infrared filtering district covers comprises infrared image element value;
Described read step comprises further:
Sense and judge ambient brightness; And
When described ambient brightness is less than the second predetermined threshold, described color pixel values is added corresponding described infrared image element value is to obtain the pixel value of corresponding described composograph.
8. formation method as claimed in claim 1, is characterized in that, the output of the described photosensitive pixel that described colorized optical filtering district covers comprises color pixel values; The output of the described photosensitive pixel that described infrared filtering district covers comprises infrared image element value;
Described read step comprises further:
Sense and judge ambient brightness; And
When described ambient brightness is greater than first threshold and is less than the second predetermined threshold, using the pixel value of described color pixel values as the described composograph of correspondence.
9. formation method as claimed in claim 1, it is characterized in that, described read step comprises further:
The output of the described photosensitive pixel covered in described colorized optical filtering district is added to obtain merging pixel value; And
The pixel value of described composograph is calculated according to the output of described photosensitive pixel corresponding to described merging pixel value and described infrared filtering district.
10. the formation method as described in claim 1-9 any one, is characterized in that, each described photosensitive pixel is connected with an analog to digital converter respectively;
Described read step comprises further:
The analog signal output that described photosensitive pixel produces is converted to digital signal export and stored in register; And
Extract described digital signal from described register to export with the pixel value calculating described composograph.
11. 1 kinds of imaging devices, is characterized in that, comprising:
Imageing sensor, described imageing sensor comprises:
Photosensitive pixel array; And
Be arranged at the filter on described photosensitive pixel array;
Described filter comprises filter unit array, and each described filter unit comprises colorized optical filtering district and infrared filtering district; Described colorized optical filtering district and described infrared filtering district cover photosensitive pixel described at least one respectively;
Described imaging device also comprises the image processing module be connected with described imageing sensor;
Described image processing module for reading the output of described photosensitive pixel array, and calculates the pixel value of composograph to generate described composograph for the output of described photosensitive pixel corresponding to the described photosensitive pixel that covers according to described colorized optical filtering district and described infrared filtering district.
12. imaging devices as claimed in claim 11, is characterized in that, described colorized optical filtering district forms Bayer array.
13. imaging devices as claimed in claim 11, is characterized in that, each described filter unit comprises 2*2 described photosensitive pixel; Described colorized optical filtering district and described infrared filtering district cover three and a described photosensitive pixel respectively.
14. imaging devices as claimed in claim 11, it is characterized in that, each described photosensitive pixel is corresponding with the pixel of a described composograph.
15. imaging devices as claimed in claim 14, it is characterized in that, described image processing module is used for obtaining color pixel values corresponding to described photosensitive pixel that described infrared filtering district covers according to the output of described photosensitive pixel corresponding to the described colorized optical filtering district in same described filter unit.
16. imaging devices as claimed in claim 15, it is characterized in that, described image processing module is for calculating the mean value of the output of described photosensitive pixel corresponding to described colorized optical filtering district in same described filter unit and color pixel values corresponding to the photosensitive pixel covered as described infrared filtering district.
17. imaging devices as claimed in claim 11, it is characterized in that, described imageing sensor comprises analog to digital converter array, each described analog to digital converter is connected with a described photosensitive pixel, and described analog to digital converter is used for the analog signal output that described photosensitive pixel produces to be converted to digital signal.
18. imaging devices as claimed in claim 17, is characterized in that, described imaging device comprises the register be connected with described analog to digital converter array, the described digital signal output that described register produces for storing described analog to digital converter.
19. imaging devices as claimed in claim 11, it is characterized in that, described imageing sensor comprises micro mirror array, and each described micro mirror is corresponding with a described photosensitive pixel.
20. imaging devices as claimed in claim 11, is characterized in that, the corresponding color pixel values of output of the described photosensitive pixel that described colorized optical filtering district covers; The corresponding infrared image element value of output of the described photosensitive pixel that described infrared filtering district covers;
Described image processing module is used for judging ambient brightness according to the pixel value of described photosensitive pixel, and for when described ambient brightness is greater than the first predetermined threshold, described color pixel values is deducted corresponding described infrared image element value to obtain the pixel value of described composograph.
21. imaging devices as claimed in claim 11, is characterized in that, the corresponding color pixel values of output of the described photosensitive pixel that described colorized optical filtering district covers; The corresponding infrared image element value of output of the described photosensitive pixel that described infrared filtering district covers;
Described image processing module is used for judging ambient brightness according to the pixel value of described photosensitive pixel, and when being less than the second predetermined threshold for described ambient brightness, described color pixel values is added corresponding described infrared image element value is to obtain the pixel value of described composograph.
22. imaging devices as claimed in claim 11, is characterized in that, the corresponding color pixel values of output of the described photosensitive pixel that described colorized optical filtering district covers; The corresponding infrared image element value of output of the described photosensitive pixel that described infrared filtering district covers;
Described image processing module is used for judging ambient brightness according to the pixel value of described photosensitive pixel, and using the pixel value of described color pixel values as the described composograph of correspondence when being less than the second predetermined threshold for being greater than first threshold at described ambient brightness.
23. imaging devices as described in claim 20-22 any one, is characterized in that, described color pixel values and described photosensitive pixel corresponding to described infrared image element value corresponding with same described filter unit.
24. imaging devices as claimed in claim 11, it is characterized in that, the output that described image processing module is used for the described photosensitive pixel described colorized optical filtering district covered is added to obtain merging pixel value, and for calculating the pixel value of described composograph according to the output of described photosensitive pixel corresponding to described merging pixel value and described infrared filtering district.
25. 1 kinds of electronic installations, is characterized in that, comprise the imaging device as described in claim 11-24 any one.
26. electronic installations as claimed in claim 25, it is characterized in that, described electronic installation comprises mobile phone.
27. electronic installations as claimed in claim 26, it is characterized in that, described imaging device comprises the Front camera of described mobile phone.
28. electronic installations as claimed in claim 25, it is characterized in that, described electronic installation comprises the central processing unit and external memory that are connected with described imaging device, described central processing unit stores described composograph for controlling described external memory.
29. electronic installations as claimed in claim 25, it is characterized in that, described electronic installation also comprises the central processing unit and display unit that are connected with described imaging device, described central processing unit shows described composograph for controlling described display unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964303.XA CN105430363B (en) | 2015-12-18 | 2015-12-18 | imaging method, imaging device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510964303.XA CN105430363B (en) | 2015-12-18 | 2015-12-18 | imaging method, imaging device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105430363A true CN105430363A (en) | 2016-03-23 |
| CN105430363B CN105430363B (en) | 2018-07-17 |
Family
ID=55508262
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510964303.XA Active CN105430363B (en) | 2015-12-18 | 2015-12-18 | imaging method, imaging device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105430363B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017101451A1 (en) * | 2015-12-18 | 2017-06-22 | 广东欧珀移动通信有限公司 | Imaging method, imaging device, and electronic device |
| WO2017193738A1 (en) * | 2016-05-09 | 2017-11-16 | 比亚迪股份有限公司 | Image sensor, imaging method, and imaging device |
| CN107465864A (en) * | 2016-06-03 | 2017-12-12 | 宏碁股份有限公司 | Camera device and image treatment method |
| CN107919102A (en) * | 2017-11-22 | 2018-04-17 | 广东欧珀移动通信有限公司 | The control method of electronic device and electronic device |
| CN109218691A (en) * | 2017-06-29 | 2019-01-15 | 安讯士有限公司 | Video camera and the method for generating color image |
| US10536645B2 (en) | 2016-05-25 | 2020-01-14 | Acer Incorporated | Image processing method and imaging device |
| US10567713B2 (en) | 2016-12-28 | 2020-02-18 | Axis Ab | Camera and method of producing color images |
| CN111835977A (en) * | 2019-04-18 | 2020-10-27 | 北京小米移动软件有限公司 | Image sensor, image generation method and device, electronic device, and storage medium |
| CN114143427A (en) * | 2021-11-23 | 2022-03-04 | 歌尔科技有限公司 | Camera assembly, mobile terminal and camera-based body temperature measuring method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1894952A (en) * | 2003-12-17 | 2007-01-10 | 诺基亚有限公司 | Method and imaging device for producing infrared images and normal images |
| US20080068475A1 (en) * | 2006-09-19 | 2008-03-20 | Samsung Electronics Co., Ltd. | Image photographing apparatus, method and medium |
| CN103220534A (en) * | 2012-01-20 | 2013-07-24 | 宏达国际电子股份有限公司 | Image capturing device and method thereof |
| CN104735427A (en) * | 2013-12-24 | 2015-06-24 | 浙江大华技术股份有限公司 | Image sensor |
| CN204498282U (en) * | 2013-11-21 | 2015-07-22 | 半导体元件工业有限责任公司 | There is the imaging system of visible ray photosensitive pixel and infrared light photosensitive pixel |
| CN105025278A (en) * | 2014-04-23 | 2015-11-04 | 全视科技有限公司 | Image sensor with scaled filter array and in-pixel binning |
-
2015
- 2015-12-18 CN CN201510964303.XA patent/CN105430363B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1894952A (en) * | 2003-12-17 | 2007-01-10 | 诺基亚有限公司 | Method and imaging device for producing infrared images and normal images |
| US20080068475A1 (en) * | 2006-09-19 | 2008-03-20 | Samsung Electronics Co., Ltd. | Image photographing apparatus, method and medium |
| CN103220534A (en) * | 2012-01-20 | 2013-07-24 | 宏达国际电子股份有限公司 | Image capturing device and method thereof |
| CN204498282U (en) * | 2013-11-21 | 2015-07-22 | 半导体元件工业有限责任公司 | There is the imaging system of visible ray photosensitive pixel and infrared light photosensitive pixel |
| CN104735427A (en) * | 2013-12-24 | 2015-06-24 | 浙江大华技术股份有限公司 | Image sensor |
| CN105025278A (en) * | 2014-04-23 | 2015-11-04 | 全视科技有限公司 | Image sensor with scaled filter array and in-pixel binning |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10257447B2 (en) | 2015-12-18 | 2019-04-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging method, imaging device, and electronic device |
| WO2017101451A1 (en) * | 2015-12-18 | 2017-06-22 | 广东欧珀移动通信有限公司 | Imaging method, imaging device, and electronic device |
| WO2017193738A1 (en) * | 2016-05-09 | 2017-11-16 | 比亚迪股份有限公司 | Image sensor, imaging method, and imaging device |
| CN107360405A (en) * | 2016-05-09 | 2017-11-17 | 比亚迪股份有限公司 | Imaging sensor, imaging method and imaging device |
| US10924683B2 (en) | 2016-05-25 | 2021-02-16 | Acer Incorporated | Image processing method and imaging device |
| US10536645B2 (en) | 2016-05-25 | 2020-01-14 | Acer Incorporated | Image processing method and imaging device |
| CN107465864A (en) * | 2016-06-03 | 2017-12-12 | 宏碁股份有限公司 | Camera device and image treatment method |
| US10567713B2 (en) | 2016-12-28 | 2020-02-18 | Axis Ab | Camera and method of producing color images |
| CN109218691A (en) * | 2017-06-29 | 2019-01-15 | 安讯士有限公司 | Video camera and the method for generating color image |
| CN107919102B (en) * | 2017-11-22 | 2019-08-06 | Oppo广东移动通信有限公司 | The control method of electronic device and electronic device |
| CN107919102A (en) * | 2017-11-22 | 2018-04-17 | 广东欧珀移动通信有限公司 | The control method of electronic device and electronic device |
| CN111835977A (en) * | 2019-04-18 | 2020-10-27 | 北京小米移动软件有限公司 | Image sensor, image generation method and device, electronic device, and storage medium |
| CN114143427A (en) * | 2021-11-23 | 2022-03-04 | 歌尔科技有限公司 | Camera assembly, mobile terminal and camera-based body temperature measuring method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105430363B (en) | 2018-07-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430363A (en) | Imaging method, imaging device and electronic device | |
| CN105430359A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105611185B (en) | image generating method, device and terminal device | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105578006A (en) | Imaging method, imaging device and electronic device | |
| CN105430361A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105578067B (en) | image generating method, device and terminal device | |
| CN105578072A (en) | Imaging method, imaging device and electronic device | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN105578081A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105472266A (en) | High dynamic range image generation method, photographing device and terminal | |
| CN105430362A (en) | Imaging method, imaging device and electronic device | |
| CN105578076A (en) | Imaging method, imaging device and electronic device | |
| CN106878690A (en) | The imaging method of imageing sensor, imaging device and electronic equipment | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN105578080A (en) | Imaging method, image sensor, imaging device and electronic device | |
| KR102158844B1 (en) | Apparatus and method for processing image, and computer-readable recording medium | |
| CN105635702A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105578075A (en) | Method for generating high-dynamic range image, photographing device and terminal | |
| CN105516697A (en) | Image sensor, imaging device, mobile terminal and imaging method | |
| CN105554485A (en) | Imaging method, imaging device and electronic device | |
| CN109040607A (en) | Image formation control method, device, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. |
|
| CP03 | Change of name, title or address |