CN105554485B - Imaging method, imaging device and electronic device - Google Patents
Imaging method, imaging device and electronic device Download PDFInfo
- Publication number
- CN105554485B CN105554485B CN201510963704.3A CN201510963704A CN105554485B CN 105554485 B CN105554485 B CN 105554485B CN 201510963704 A CN201510963704 A CN 201510963704A CN 105554485 B CN105554485 B CN 105554485B
- Authority
- CN
- China
- Prior art keywords
- pixel
- filtering area
- photosensitive pixel
- photosensitive
- infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Abstract
The invention discloses a kind of imaging methods, firstly, providing imaging sensor, imaging sensor includes photosensitive pixel array and the optical filter that is arranged on photosensitive pixel array, optical filter includes filter unit array, and each filter unit includes colorized optical filtering area and infrared filtering area.Colorized optical filtering area and infrared filtering area are covered each by least one photosensitive pixel and cover at least one photosensitive pixel, and colorized optical filtering area is for stopping infrared ray to pass through.Then, the output of photosensitive pixel array is read, and the output phase of the photosensitive pixel of photosensitive pixel and the covering of infrared filtering area that colorized optical filtering area covers is obtained into the pixel value of composograph to generate composograph.Obtained composograph includes complete color information, and signal-to-noise ratio is high.The invention also discloses a kind of imaging device that can be used for realizing this imaging method and the electronic devices of application imaging device.
Description
Technical field
The present invention relates to imaging technique, in particular to a kind of imaging method, imaging device and electronic device.
Background technique
Existing RGB image sensor effect of taking pictures under low-light (level) is poor, fuzzy, or even claps less than scenery.Some images
Infrared filtering pixel is embedded in sensor to provide imaging effect, but when bright and clear, into imaging sensor infrared ray meeting
Imaging effect is influenced, makes image that colour cast etc. occur.
Summary of the invention
The present invention is directed at least solve one of the technical problems existing in the prior art.For this purpose, the present invention needs to provide one
Kind imaging method, imaging device and electronic device.
The imaging method of embodiment of the present invention the following steps are included:
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is set to the photosensitive pixel array
On optical filter, the optical filter includes filter unit array, and the filter unit includes monochromatic colorized optical filtering area and infrared
Filter area, the colorized optical filtering area and the infrared filtering area are covered each by least one described photosensitive pixel, the colored filter
Light area is for stopping infrared ray to pass through；And
Read the output of the photosensitive pixel array, and by the photosensitive pixel of colorized optical filtering area covering and described
The output phase of the photosensitive pixel of infrared filtering area covering is obtained the pixel value of composograph to generate the composite diagram
Picture.
In the imaging method of embodiment of the present invention, the colorized optical filtering area of filter unit is for obtaining synthesis on optical filter
The color information of the pixel of image, infrared filtering area under low-light (level) obtain composograph pixel luminance information and this
Luminance information noise is less.The pixel of composograph refers to the pixel of the image generated according to photosensitive pixel output.In this way, composite diagram
The pixel value of picture had not only included color information but also had included the luminance information of low noise degree, and the color of composograph is completely true to nature, brightness and
Clarity is preferable, and noise is few.Solve the problems, such as the certain of existing imaging method.
The present invention also provides a kind of imaging devices that can be used for realizing imaging method in embodiment of the present invention comprising:
Imaging sensor, described image sensor include:
Photosensitive pixel array；And
The optical filter being set on the photosensitive pixel array；
The optical filter includes filter unit array, and each filter unit includes monochromatic colorized optical filtering area and infrared
Filter area；The colorized optical filtering area and the infrared filtering area are covered each by least one described photosensitive pixel, the colored filter
Light area is for stopping infrared ray to pass through；
The imaging device further includes the image processing module connecting with described image sensor；
Described image processing module is used to read the output of the photosensitive pixel array, and is used for the colorized optical filtering area
The output phase of the corresponding photosensitive pixel of the photosensitive pixel and the infrared filtering area of covering is obtained composograph
Pixel value to generate the composograph.
The present invention also provides a kind of electronic devices including imaging device in embodiment of the present invention.
Additional aspect and advantage of the invention will be set forth in part in the description, and will partially become from the following description
Obviously, or practice through the invention is recognized.
Detailed description of the invention
Above-mentioned and/or additional aspect and advantage of the invention is from combining in description of the following accompanying drawings to embodiment by change
It obtains obviously and is readily appreciated that, in which:
Fig. 1 is the flow diagram of the imaging method of embodiment of the present invention.
Fig. 2 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 3 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 4 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 5 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 6 is the flow diagram of the read step of embodiment of the present invention imaging method.
Fig. 7 is the schematic side view of the imaging device of embodiment of the present invention.
Fig. 8 is the filter unit schematic diagram of the imaging sensor of the imaging device of embodiment of the present invention.
Fig. 9 is the filter unit array schematic diagram of Bayer structure.
Figure 10 is the filter unit array schematic diagram of the imaging sensor of embodiment of the present invention.
Figure 11 is the schematic perspective view of the imaging sensor of embodiment of the present invention.
Figure 12 is the filter unit array of embodiment of the present invention and the correspondence diagram of composograph.
Figure 13 is the functional block diagram of the imaging device of embodiment of the present invention.
Figure 14 is the electrical block diagram of the photosensitive pixel of embodiment of the present invention imaging device.
Figure 15 is the schematic perspective view of the imaging sensor of embodiment of the present invention.
Figure 16 is the filter unit array of embodiment of the present invention and the correspondence diagram of composograph.
Figure 17 is the functional block diagram of the electronic device of embodiment of the present invention.
Figure 18 is the functional block diagram of the electronic device of embodiment of the present invention.
Specific embodiment
Embodiments of the present invention are described below in detail, the example of the embodiment is shown in the accompanying drawings, wherein from beginning
Same or similar element or element with the same or similar functions are indicated to same or similar label eventually.Below by ginseng
The embodiment for examining attached drawing description is exemplary, embodiment for explaining only the invention, and should not be understood as to this hair
The limitation of bright embodiment.
The imaging method of embodiments of the present invention, imaging sensor, imaging device and electronics are filled below in conjunction with attached drawing
It sets and is described further.
Referring to Fig. 1, the imaging method of embodiment of the present invention the following steps are included:
S1, provides imaging sensor, and imaging sensor includes photosensitive pixel array and is set on photosensitive pixel array
Optical filter, optical filter include filter unit array, and filter unit includes monochromatic colorized optical filtering area and infrared filtering area, colour filter
Light area and infrared filtering area are covered each by least one photosensitive pixel, and colorized optical filtering area is for stopping infrared ray to pass through.
S2, reads the output of photosensitive pixel array, and photosensitive pixel that colorized optical filtering area covers and infrared filtering area are covered
The output phase of the photosensitive pixel of lid is obtained the pixel value of composograph to generate composograph.
In the imaging method of embodiment of the present invention, the colorized optical filtering area of filter unit is for obtaining synthesis on optical filter
The color information of the pixel of image, infrared filtering area under low-light (level) obtain composograph pixel luminance information and this
Luminance information noise is less.The pixel of composograph refers to the pixel of the image generated according to photosensitive pixel output.In this way, composite diagram
The pixel value of picture had not only included color information but also had included the luminance information of low noise degree, and the color of composograph is completely true to nature, brightness and
Clarity is preferable, and noise is few.
It please join Figure 11, in the present embodiment, each filter unit covers 2*2 photosensitive pixel.The covering of colorized optical filtering area
Three photosensitive pixels, infrared filtering area cover a photosensitive pixel.
In this way, the color information of the composograph generated is more complete and clarity is high.
It please join Figure 12, in the present embodiment, the pixel 301 of each photosensitive pixel 111 and a composograph 300 is right
It answers.
For example, the corresponding image for generating 16M resolution ratio of the photosensitive pixel array of 16M resolution ratio.In this way, infrared image element is embedding
Enter not influence the resolution ratio of composograph.
It please join Fig. 2, in the imaging method of present embodiment, step S2 further comprises:
S21 obtains infrared filtering area according to the output of the photosensitive pixel of the colorized optical filtering area covering in same filter unit
The corresponding color pixel values of the photosensitive pixel of covering.
Wherein, color pixel values and the corresponding infrared image element value of photosensitive pixel of infrared filtering area covering can be used for calculating pair
The pixel value for the composograph answered.
It please join Fig. 3, preferably, step S21 further comprises in the imaging method of present embodiment:
S211, calculate in same filter unit colorized optical filtering area covering photosensitive pixel output average value using as
The corresponding color pixel values of photosensitive pixel of infrared filtering area covering.
It please join Fig. 4, in the present embodiment, step S2 further comprises:
S23, into night scene mode；
S25, by color pixel values plus corresponding infrared image element value to obtain the pixel value of corresponding composograph.
In this way, the corresponding infrared image element value of photosensitive pixel of infrared fileter covering compensates color pixel values, with
Generate contrast, clarity and the higher composograph of signal-to-noise ratio.
It please join Fig. 5, in some embodiments, step S2 further comprises:
S327 is obtained the output phase for the photosensitive pixel that colorized optical filtering area covers to merge pixel value.
The output for merging pixel value and the corresponding photosensitive pixel in infrared filtering area is added the picture as composograph by S29
Element value.
In this way, the photosensitive pixel that colorized optical filtering area is covered merges, covered further according to merging pixel value and infrared filtering area
Photosensitive pixel output calculate composograph composograph pixel value.
In some embodiments, each photosensitive pixel is connect with an analog-digital converter respectively；
It please join Fig. 6, step S2 further comprises:
The analog signal output that photosensitive pixel generates is converted to digital signal and exports and be stored in register by S31.
S33 extracts digital signal output from register to calculate the pixel value of composograph.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor)
Processing module can directly handle the output of imaging sensor, two, relative to it is certain by circuit directly to imaging sensor
Analog signal format the scheme that is handled of output for, preferably remain the information of image.
The imaging method of embodiment of the present invention can be realized by the imaging device of embodiment of the present invention.
Fig. 7 and Fig. 8 is please referred to, the imaging device 100 of embodiment of the present invention includes imaging sensor 10 and image procossing
Module 50.Imaging sensor 10 includes photosensitive pixel array 11 and the optical filter 13 being set on photosensitive pixel array 11.It filters
Piece 13 includes filter unit array 131, and each filter unit 1311 includes colorized optical filtering area 1315 and infrared filtering area 1313.It is color
Color filter area 1315 covers at least one photosensitive pixel 111, and infrared filtering area 1313 is used to only make the infrared light of preset wavelength
Pass through, colorized optical filtering area is for stopping infrared ray to pass through.Preset wavelength can be 750-850nm.Extraneous light passes through optical filter
13 are irradiated to the photosensitive part 1111 of photosensitive pixel 111 to generate electric signal, the i.e. output of photosensitive pixel 111.
Image processing module 50 is used to read the output of photosensitive pixel array 11, and covered according to colorized optical filtering area 1315
The pixel of composograph is calculated with life in the output of the corresponding photosensitive pixel 111 of photosensitive pixel 111 and infrared filtering area 1313
At composograph.
The colorized optical filtering area 1315 of filter unit 1311 is used to obtain the color letter of the pixel of composograph on optical filter 13
Breath.Colorized optical filtering area 1315 is for stopping the entrance of infrared ray e.g. only to enter the luminous ray of 750nm or less wavelength, in this way
The complete image true to nature of color can be directly generated under high illumination.
Infrared filtering area 1313 e.g., passes through the infrared ray of 750~850nm or so wavelength, night for passing through infrared ray
Between imaging effect it is preferable, therefore can be used under low-light (level) obtain composograph pixel luminance information and this luminance information make an uproar
Sound is less.The pixel of composograph refers to the pixel of the composograph exported according to photosensitive pixel 111.
In this way, the pixel value of composograph is exported by the corresponding photosensitive pixel in colorized optical filtering area 1315 and infrared filtering area
1313 corresponding photosensitive pixel outputs are added, therefore have not only been included color information but also included the luminance information of low noise degree, synthesis
The color of image is completely true to nature, and brightness and clarity are preferable, and noise is few.
Referring to Fig. 9, in the present embodiment, colorized optical filtering area 1315 forms Bayer array (Bayer pattern).
It include filtering structure 1317 in Bayer array, each filtering structure 1317 includes 2*2 filter unit 1311, respectively
It is green, red, blue, green filter unit 1311.
Picture signal can be handled to the algorithm of Bayer structure using conventional needle using Bayer structure, without hardware
Big adjustment is done in structure.
In traditional filter unit array structure, each filter unit corresponds to the pixel of multiple photosensitive pixels and image.
Referring to Fig. 10, in the present embodiment, filter unit array 131 uses Bayer structure, including filtering structure
1317, each filtering structure 1317 includes green, red, blue, green filter unit 1311, and each filter unit 1311 is corresponding
Multiple photosensitive pixels 111.Each filter unit 1311 includes colorized optical filtering area 1315 and infrared filtering area 1313.
Figure 11 and Figure 10 is please referred to, in the present embodiment, each filter unit 1311 covers 2*2 photosensitive pixel 111,
Colorized optical filtering area 1315 and infrared filtering area 1313 are covered each by three and a photosensitive pixel 111.
In this way, the color information of the composograph generated is more complete.It is color in other embodiments outside present embodiment
The photosensitive pixel of color filter area covering can be two, one, and the photosensitive pixel of corresponding infrared filtering area covering is two, three
It is a, still, when colorized optical filtering area covering photosensitive pixel is less, the pixel of more composograph is just had by other composite diagrams
The calculated for pixel values of picture obtains, rather than is obtained by the output of its corresponding photosensitive pixel, and the color that will affect composograph is complete
Property and clarity.
It please join Figure 12, in the present embodiment, the pixel 301 of each photosensitive pixel 111 and a composograph 300 is right
It answers.
Image processing module is used for according to the corresponding photosensitive pixel in colorized optical filtering area 1315 in same filter unit 1311
111 output obtains the corresponding color pixel values of photosensitive pixel 111 of the covering of infrared filtering area 1313.In addition, infrared filtering area
The output of 1313 corresponding photosensitive pixels 111, which can correspond to, generates infrared image element value.Color pixel values and infrared image element value are based on
The pixel value for forming composograph is calculated to generate composograph 300.
Specifically, image processing module can be by the corresponding light-sensitive image in colorized optical filtering area 1315 in same filter unit 1311
The output of element 111 calculates photosensitive pixel 111 corresponding color pixel values of the mean value to cover as infrared filtering area 1313.
For example, the photosensitive output for the photosensitive pixel 111 that colorized optical filtering area 1315 covers is respectively G1, G2, G3, then infrared absorption filter
The corresponding color pixel values of photosensitive pixel 111 that light area 1313 covers are (G1+G2+G3)/3.It can be appreciated that in this way, can be preferably
The color information that the pixel 301 of composograph 300 corresponding to simulation or the outer filter area 1313 of vat red lacks originally.
It please join Figure 13, in some embodiments, imaging sensor 10 may include analog-digital converter array 21, each modulus
Converter is connect with a photosensitive pixel, and analog-digital converter is used to the analog signal output that photosensitive pixel generates being converted to number
Signal.
In this way, one, the generally image of digital signal processing chip (DSP, digital signal processor)
Processing module can directly handle the output of imaging sensor, two, relative to it is certain by circuit directly to imaging sensor
Analog signal format the scheme that is handled of output for, preferably remain the information of image, such as the present invention is implemented
The imaging method of mode can generate composograph by color pixel values and infrared image element value, can also retain color pixel values
Information and infrared image element value information.
Further, in the present embodiment, imaging device 100 includes the register connecting with analog-digital converter array,
Register stores the digital signal output that analog-digital converter generates.
Please join Figure 12, in some embodiments, imaging sensor 10 include control module 17, control module 17 control with
Its row selection logic unit 171 connected and column selection logic unit 173 acquire the output of photosensitive pixel line by line and are deposited into
Register 19.Image processing module 50 extracts the output of photosensitive pixel from register 19 to be handled.
Specifically, please referring to Figure 13 and Figure 14, imaging sensor 10 includes patrolling with row selection logic unit 171 and column selection
Collect the control module 17 that unit 173 connects.Row selection logic unit 171 and column selection logic unit 173 and multiple photosensitive pixels
111 corresponding switching tubes 1115 connect, and control module 17 is for controlling row selection logic unit 171 and column selection logic unit
173 to gate the switching tube 1115 of the photosensitive pixel 111 of specific position.
Photosensitive pixel 111 in present embodiment includes photodiode 1113.Photodiode 1113 is used for illumination
It is converted into charge, and the charge relationship proportional to intensity of illumination generated.Switching tube 1115 is used to select logic unit according to row
171 and the control signal of column selection logic unit 173 come the conducting and disconnection of control circuit, when circuit conducting, source electrode is followed
Device 1117 (source follower) is used to convert the charge signal that photodiode 1113 is generated through illumination in voltage letter
Number.Analog-digital converter 211 (Analog-to-digital converter) is used to voltage signal being converted to digital signal, with
It is transmitted to subsequent conditioning circuit processing.
This output processing mode makes the output of photosensitive pixel be converted into digital signal, in following digital circuit or in chip
It is middle to be handled with software.Therefore the output information of each photosensitive pixel, including color pixel values and infrared image element value are ok
It is retained.
Figure 15 is please referred to, in some embodiments, imaging sensor 10 includes the micro mirror battle array being arranged on optical filter 13
Column 23, each micro mirror 231 are corresponding with multiple photosensitive pixels 111.
Specifically, each micro mirror 231 is corresponding with multiple photosensitive pixels 111, including size, position correspond to.In certain implementations
In mode, the corresponding 2*2 photosensitive pixel 111 of each filter unit 1311 and 2*2 micro mirror 191.It is terrible as technology develops
To the higher image of resolution ratio, the photosensitive pixel 111 on sensitive film is more and more, arranges more and more intensive, single photosensitive pixel
111 is also smaller and smaller, and light is affected, and 1111 area of photosensitive part of photosensitive pixel 111 is limited, micro mirror 191
Light can be gathered to photosensitive part 1111, to promote the light reception intensity of photosensitive pixel 111 to improve image quality.
It please join Figure 12, in some embodiments, the output for the photosensitive pixel that colorized optical filtering area 1315 covers is corresponding colored
The output of pixel value, the photosensitive pixel that infrared filtering area 1313 covers corresponds to infrared image element value.
Image processing module in the night mode by color pixel values plus corresponding infrared image element value to obtain pair
The pixel value for the composograph answered.
In some embodiments, user can make imaging device enter night scene mode by manual operation, or at other
In embodiment, by the output size of image forming device senses photosensitive pixel to judge ambient brightness, in ambient brightness lower than default
Enter night scene mode when threshold value.
In the night mode, it generally under low light environment, is compensated using infrared image element value bright to promote imaging
Color pixel values are such as added corresponding infrared image element value to obtain the pixel value of corresponding composograph by degree and signal-to-noise ratio.
In addition to above-mentioned three kinds of processing modes, it can also be that infrared image element value is multiplied by one and environment in some embodiments
The related proportionality coefficient of brightness, obtained value are added with color pixel values again, to obtain the pixel value of composograph, are generated and are closed
At image.In this way, the night scene mode of different stalls can be set, imaging device 100 is made to carry out phase for complex environment brightness
The imaging compensating processing answered.
In some embodiments, color pixel values and the corresponding photosensitive pixel of infrared image element value and same filter unit pair
It answers.
In conjunction with the above-mentioned embodiment for handling color pixel values according to ambient brightness and infrared image element is handled, it is not difficult to manage
Solution, the color pixel values and infrared image element value for the operation that add deduct correspond to same filter unit.For example, Figure 12 please be join, it is color
The color pixel values of the corresponding photosensitive pixel 111 of color filter area 1315 are respectively G1, G2, G3, it is assumed that right in low light environment
The pixel value for the composograph answered is respectively G1+IR, G2+IR, G3+IR.Wherein IR is that infrared filtering area 1313 is corresponding photosensitive
The infrared image element value of pixel 111.
The pixel value for the corresponding composograph of photosensitive pixel 111 that infrared filtering area 1313 covers can be asked first by G1, G2, G3
Averagely as its colored value part, IR, i.e. final result are added are as follows:
(G1+G2+G3)/3+IR
The benefit thus nearby managed is to reduce the color distortion generated in image synthesizing procedure or clear to greatest extent
Degree decline.
It please join Figure 16, in some embodiments, image processing module is photosensitive for covering colorized optical filtering area 1315
The output phase of pixel 111 is obtained merging pixel value, and for that will merge pixel value and the corresponding sense in infrared filtering area 1313
The output phase of light pixel is obtained the pixel value of composograph.
In this way, the output of more photosensitive pixels is added, the pixel signal-to-noise ratio of the composograph of formation is higher.For example it is assumed that
The output of original each photosensitive pixel 111 is S, and the pixel 401 of noise N, composograph 400 include m photosensitive pixel, then closes
Pixel value at the pixel 401 of image 400 is m*S, and the noise of the pixel 401 of composograph 400 isM is big
In the natural number for being equal to 1.It is appreciated that it is preceding each photosensitive that the noise of the pixel of composograph is less than merging in the case where m > 1
The sum of the noise of pixel output.And the output of the pixel 401 of composograph 400 is the sum of each photosensitive pixel output before merging, because
This color composite image 400 generated after merging, compared with the color image generated in traditional approach with single pixel, noise decline
Signal-to-noise ratio improves, and clarity is promoted.
To sum up, each filter unit packet colorized optical filtering area of the imaging device in embodiment of the present invention and infrared filtering
Area, colorized optical filtering area are used to obtain the bright of the pixel of composograph under low-light (level) for obtaining colour information, infrared filtering area
It spends information and this luminance information noise is less.In the night mode, the pixel value of the composograph of imaging device generation both included
Color information includes the luminance information of low noise degree again, to generate the complete composograph true to nature and high signal-to-noise ratio of color.
In addition, the imaging device of embodiment of the present invention can also be by sensing and judging ambient brightness in different rings
The corresponding infrared image element value generated of the corresponding color pixel values generated in colorized optical filtering area and infrared filtering area is carried out under the brightness of border
Calculation processing appropriate is to obtain the high image of true color clarity.
The present invention also provides a kind of electronic devices using imaging device 100.In some embodiments, electronic device packet
Include imaging device 100.Therefore, electronic device has camera function and completely true to nature, the signal-to-noise ratio that can generate color under low-light (level)
Height, the high composograph of clarity.
The electronic device can be mobile phone.
In the present embodiment, imaging device 100 can be the Front camera of mobile phone.Since Front camera is chiefly used in certainly
Clap, and self-timer generally requires to require the clarity of image and it is not high to image resolution requirement, using present embodiment
Electronic device can meet this requirement.
Figure 17 is please referred to, in some embodiments, electronic device 200 includes the centre connecting with imaging device 100
Device 81 and external memory 83 are managed, central processing unit 81 stores composograph for controlling external memory 83.
In this way, the composograph generated can be stored, checked after convenient, use or transfer.External memory 83 includes
SM (Smart Media) card and CF (Compact Flash) card etc..
Figure 18 is please referred to, in some embodiments, electronic device 200 further includes the center connecting with imaging device 100
Processor 81 and display device 85, central processing unit 81 show composograph for controlling display device 85.In this way, electronic device
The image of 200 shootings can be shown in display device so that user checks.Display device includes light-emitting diode display etc..
To sum up, using the electronic device of embodiment of the present invention, there is camera function and color can be generated under low-light (level)
Complete true to nature, signal-to-noise ratio is high, the high composograph of clarity.Particularly, when this electronic device is the Front camera of mobile phone, energy
The brightness and clarity of self-timer image under low-light (level) are promoted, noise is reduced.
Part undeployed in imaging method and electronic device, can join the figure of embodiment of above in embodiment of the present invention
As sensor or the corresponding part of imaging device 100, no longer it is developed in details herein.
In the description of this specification, reference term " embodiment ", " some embodiments ", " schematically implementation
The description of mode ", " example ", specific examples or " some examples " etc. means the tool described in conjunction with the embodiment or example
Body characteristics, structure, material or feature are contained at least one embodiment or example of the invention.In the present specification,
Schematic expression of the above terms are not necessarily referring to identical embodiment or example.Moreover, the specific features of description, knot
Structure, material or feature can be combined in any suitable manner in any one or more embodiments or example.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the invention can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of column technology or their combination are realized: having a logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, each functional unit in each embodiment of the present invention can integrate in a processing module
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example
Property, it is not considered as limiting the invention, those skilled in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, modifies, replacement and variant.
Claims (25)
1. a kind of imaging method, which comprises the following steps:
Imaging sensor is provided, described image sensor includes photosensitive pixel array and is set on the photosensitive pixel array
Optical filter, the optical filter include filter unit array, and the filter unit includes monochromatic colorized optical filtering area and infrared filtering
The colorized optical filtering area in area, the monochrome covers multiple photosensitive pixels, and the infrared filtering area covers at least one described sense
Light pixel, the colorized optical filtering area is for stopping infrared ray to pass through；And
Read the output of the photosensitive pixel array, and by the photosensitive pixel of colorized optical filtering area covering and described infrared
The output phase of the photosensitive pixel of filter area covering is obtained the pixel value of composograph to generate the composograph.
2. imaging method as described in claim 1, which is characterized in that each described filter unit covering 2*2 described photosensitive
Pixel；The colorized optical filtering area covers three photosensitive pixels；The infrared filtering area covers a photosensitive pixel.
3. imaging method as described in claim 1, which is characterized in that each photosensitive pixel and a composograph
Pixel it is corresponding.
4. imaging method as claimed in claim 3, which is characterized in that the read step further comprises:
It is obtained according to the output of the photosensitive pixel of the colorized optical filtering area covering in the same filter unit described red
The color pixel values of the photosensitive pixel of outer filter area covering.
5. imaging method as claimed in claim 4, which is characterized in that the color pixel values calculate step and further comprise:
Calculate the average value of the output of the corresponding photosensitive pixel in the colorized optical filtering area in the same filter unit simultaneously
The color pixel values of the photosensitive pixel as infrared filtering area covering.
6. imaging method as described in claim 1, which is characterized in that the photosensitive pixel of the colorized optical filtering area covering
Output includes color pixel values；The output of the photosensitive pixel of the infrared filtering area covering includes infrared image element value；
The read step further comprises:
Into night scene mode；And
By the color pixel values plus the corresponding infrared image element value to obtain the pixel value of the corresponding composograph.
7. imaging method as described in claim 1, which is characterized in that the read step further comprises:
It is obtained the output phase of the photosensitive pixel of colorized optical filtering area covering to merge pixel value；And
The output of the merging pixel value and the corresponding photosensitive pixel in the infrared filtering area is added and is used as the synthesis
The pixel value of image.
8. the imaging method as described in claim 1-7 any one, which is characterized in that each photosensitive pixel is respectively with one
A analog-digital converter connection；
The read step further comprises:
The analog signal output that the photosensitive pixel generates is converted to digital signal to export and be stored in register；And
The digital signal output is extracted from the register to calculate the pixel value of the composograph.
9. a kind of imaging device characterized by comprising
Imaging sensor, described image sensor include:
Photosensitive pixel array；And
The optical filter being set on the photosensitive pixel array；
The optical filter includes filter unit array, and each filter unit includes monochromatic colorized optical filtering area and infrared filtering
Area；The colorized optical filtering area of the monochrome covers multiple photosensitive pixels, and the infrared filtering area covers at least one described sense
Light pixel, the colorized optical filtering area is for stopping infrared ray to pass through；
The imaging device further includes the image processing module connecting with described image sensor；
Described image processing module is used to read the output of the photosensitive pixel array, and for covering the colorized optical filtering area
The output phase of the corresponding photosensitive pixel of the photosensitive pixel and the infrared filtering area obtained the picture of composograph
Plain value is to generate the composograph.
10. imaging device as claimed in claim 9, which is characterized in that the colorized optical filtering area forms Bayer array.
11. imaging device as claimed in claim 9, which is characterized in that each filter unit includes 2*2 described photosensitive
Pixel；The colorized optical filtering area and the infrared filtering area are covered each by three and a photosensitive pixel.
12. imaging device as claimed in claim 9, which is characterized in that each photosensitive pixel and a composite diagram
The pixel of picture is corresponding.
13. imaging device as claimed in claim 12, which is characterized in that described image processing module is used for according to same described
The output of the corresponding photosensitive pixel in the colorized optical filtering area in filter unit obtains the institute of the infrared filtering area covering
State the corresponding color pixel values of photosensitive pixel.
14. imaging device as claimed in claim 13, which is characterized in that described image processing module is same described for calculating
The average value of the output of the corresponding photosensitive pixel in the colorized optical filtering area in filter unit and as the infrared filtering
The corresponding color pixel values of photosensitive pixel of area's covering.
15. imaging device as claimed in claim 9, which is characterized in that described image sensor includes analog-digital converter array,
Each analog-digital converter is connect with a photosensitive pixel, and the analog-digital converter is for generating the photosensitive pixel
Analog signal output be converted to digital signal.
16. imaging device as claimed in claim 15, which is characterized in that the imaging device includes and the analog-digital converter
The register of array connection, the register are used to store the digital signal output that the analog-digital converter generates.
17. imaging device as claimed in claim 9, which is characterized in that described image sensor includes micro mirror array, Mei Gesuo
It is corresponding with multiple photosensitive pixels to state micro mirror.
18. imaging device as claimed in claim 9, which is characterized in that the photosensitive pixel of the colorized optical filtering area covering
Output correspond to color pixel values；The output of the photosensitive pixel of the infrared filtering area covering corresponds to infrared image element value；
Described image processing module is for adding the corresponding infrared image element value for the color pixel values in the night mode
To obtain the pixel value of the corresponding composograph.
19. imaging device as claimed in claim 18, which is characterized in that the color pixel values and the infrared image element value pair
The photosensitive pixel answered is corresponding with the same filter unit.
20. imaging device as claimed in claim 11, which is characterized in that described image processing module is used for the colored filter
The output phase of the photosensitive pixel of light area covering is obtained merging pixel value, and for by the merging pixel value and described
The output phase of the corresponding photosensitive pixel in infrared filtering area is obtained the pixel value of the composograph.
21. a kind of electronic device, which is characterized in that including the imaging device as described in claim 9-20 any one.
22. electronic device as claimed in claim 21, which is characterized in that the electronic device includes mobile phone.
23. electronic device as claimed in claim 22, which is characterized in that the imaging device includes the preposition phase of the mobile phone
Machine.
24. electronic device as claimed in claim 21, which is characterized in that the electronic device includes connecting with the imaging device
The central processing unit and external memory connect, the central processing unit store the composograph for controlling the external memory.
25. electronic device as claimed in claim 21, which is characterized in that the electronic device further includes and the imaging device
The central processing unit and display device of connection, the central processing unit show the composite diagram for controlling the display device
Picture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963704.3A CN105554485B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963704.3A CN105554485B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105554485A CN105554485A (en) | 2016-05-04 |
| CN105554485B true CN105554485B (en) | 2019-04-12 |
Family
ID=55833396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510963704.3A Active CN105554485B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging device and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105554485B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105578072A (en) | 2015-12-18 | 2016-05-11 | 广东欧珀移动通信有限公司 | Imaging method, imaging device and electronic device |
| CN107919102B (en) * | 2017-11-22 | 2019-08-06 | Oppo广东移动通信有限公司 | The control method of electronic device and electronic device |
| US11689785B2 (en) | 2018-09-14 | 2023-06-27 | Zhejiang Uniview Technologies Co., Ltd. | Dual-spectrum image automatic exposure method and apparatus, and dual-spectrum image camera and machine storage medium |
| CN111447423A (en) * | 2020-03-25 | 2020-07-24 | 浙江大华技术股份有限公司 | Image sensor, imaging apparatus, and image processing method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN103220534A (en) * | 2012-01-20 | 2013-07-24 | 宏达国际电子股份有限公司 | Image capturing device and method thereof |
| CN104735427A (en) * | 2013-12-24 | 2015-06-24 | 浙江大华技术股份有限公司 | Image sensor |
| CN204498282U (en) * | 2013-11-21 | 2015-07-22 | 半导体元件工业有限责任公司 | There is the imaging system of visible ray photosensitive pixel and infrared light photosensitive pixel |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100818987B1 (en) * | 2006-09-19 | 2008-04-04 | 삼성전자주식회사 | Apparatus for photographing image and operating method for the same |
-
2015
- 2015-12-18 CN CN201510963704.3A patent/CN105554485B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101321295A (en) * | 2007-06-07 | 2008-12-10 | 株式会社东芝 | Image pickup device |
| CN103220534A (en) * | 2012-01-20 | 2013-07-24 | 宏达国际电子股份有限公司 | Image capturing device and method thereof |
| CN204498282U (en) * | 2013-11-21 | 2015-07-22 | 半导体元件工业有限责任公司 | There is the imaging system of visible ray photosensitive pixel and infrared light photosensitive pixel |
| CN104735427A (en) * | 2013-12-24 | 2015-06-24 | 浙江大华技术股份有限公司 | Image sensor |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105554485A (en) | 2016-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430363B (en) | imaging method, imaging device and electronic device | |
| CN105430359B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105430361B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105578006B (en) | Imaging method, imaging device and electronic installation | |
| CN107959778B (en) | Imaging method and device based on dual camera | |
| CN105611124B (en) | Imaging sensor, imaging method, imaging device and terminal | |
| CN105578080B (en) | Imaging method, imaging device and electronic device | |
| CN102892008B (en) | Dual image capture processes | |
| CN102165762B (en) | Imaging device and signal processing circuit for the imaging device | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| US8666153B2 (en) | Image input apparatus | |
| CN105430362B (en) | Imaging method, imaging device and electronic installation | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN105611185B (en) | image generating method, device and terminal device | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN107977940A (en) | background blurring processing method, device and equipment | |
| CN105578066B (en) | Imaging method, imaging device and electronic installation | |
| CN105516697B (en) | Imaging sensor, imaging device, mobile terminal and imaging method | |
| CN105578081B (en) | Imaging method, imaging sensor, imaging device and electronic installation | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105554485B (en) | Imaging method, imaging device and electronic device | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN109005364A (en) | Image formation control method, device, electronic equipment and computer readable storage medium | |
| CN108055452A (en) | Image processing method, device and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 523860 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: 523859 No. 18, Wu Sha Beach Road, Changan Town, Dongguan, Guangdong Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |