CN105430360A - Imaging method, image sensor, imaging device and electronic device - Google Patents
Imaging method, image sensor, imaging device and electronic device Download PDFInfo
- Publication number
- CN105430360A CN105430360A CN201510963729.3A CN201510963729A CN105430360A CN 105430360 A CN105430360 A CN 105430360A CN 201510963729 A CN201510963729 A CN 201510963729A CN 105430360 A CN105430360 A CN 105430360A
- Authority
- CN
- China
- Prior art keywords
- pixel
- photosensitive pixel
- imageing sensor
- merging
- filtering district
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Color Television Image Signal Generators (AREA)
Abstract
The invention discloses an imaging method. The imaging method comprises the following steps: firstly, providing an image sensor, wherein the image sensor comprises a light sensing pixel array and an optical filter arranged on the light sensing pixel array, the optical filter comprises a filtering unit array, filtering units comprise infrared filtering areas and color filtering areas, each infrared filtering area covers one light sensing pixel, and each color filtering area covers at least one light sensing pixel; and then, reading an output of the light sensing pixel array, and calculating pixel values of combined pixels according to outputs of the light sensing pixels of one combined pixel in order to generate a combined image, wherein the obtained combined image includes complete color information, and has high brightness, high definition and less noisy points. The invention also discloses an image sensor for implementing the imaging method, an imaging device and an electronic device applying the imaging device.
Description
Technical field
The present invention relates to imaging technique, particularly a kind of formation method, imageing sensor, imaging device and electronic installation.
Background technology
The optical filtering pixel arrangements of conventional images transducer is RG, GB or RW, GW, and wherein R, G, B and W represent redness, green, blueness and white respectively.RG, GB are traditional arrangement modes, can collect color information accurately, but under low-light (level), noise is many, unintelligible, and RW, GW arrangement mode can receive better definition under low-light (level), but color can be inaccurate.
Summary of the invention
The present invention is intended at least to solve one of technical problem existed in prior art.For this reason, the present invention needs to provide a kind of formation method, imageing sensor, imaging device and electronic installation.
The formation method of embodiment of the present invention comprises the following steps:
There is provided imageing sensor, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, and described filter comprises filter unit array, and described filter unit comprises infrared filtering district and colorized optical filtering district; Described infrared filtering district covers a described photosensitive pixel; Described colorized optical filtering district covers photosensitive pixel described at least one; The described photosensitive pixel that same described filter unit covers forms merging pixel; And
Read the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.
The colorized optical filtering district of the filter unit in the formation method of embodiment of the present invention is for obtaining the color information merging pixel, and infrared filtering district is used for the monochrome information of acquisition merging pixel under low-light (level) and this monochrome information noise is less.So, the pixel value merging image had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color merging image is complete, and brightness and definition are all better, and noise is few.Solve some problem of existing formation method.
The present invention also provides a kind of imageing sensor for realizing formation method in embodiment of the present invention, and it comprises:
Photosensitive pixel array; And
Be arranged at the filter on described photosensitive pixel array;
Described filter comprises filter unit array, and each described filter unit comprises infrared filtering district and colorized optical filtering district; Described infrared filtering district covers a described photosensitive pixel; Described colorized optical filtering district covers n-1 described photosensitive pixel, and n is the number of the described photosensitive pixel that a described filter unit covers;
The described photosensitive pixel that same described filter unit covers forms merging pixel.
The present invention also provides a kind of imaging device comprising imageing sensor in embodiment of the present invention, and it comprises the image processing module be connected with described imageing sensor;
Described image processing module is for reading the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.
The present invention also provides a kind of electronic installation comprising imaging device in embodiment of the present invention.
Additional aspect of the present invention and advantage will part provide in the following description, and part will become obvious from the following description, or be recognized by practice of the present invention.
Accompanying drawing explanation
Above-mentioned and/or additional aspect of the present invention and advantage will become obvious and easy understand from accompanying drawing below combining to the description of execution mode, wherein:
Fig. 1 is the schematic flow sheet of the formation method of embodiment of the present invention.
Fig. 2 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 3 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 4 is the schematic side view of the imageing sensor of embodiment of the present invention.
Fig. 5 is the filter unit schematic diagram of the imageing sensor of embodiment of the present invention.
Fig. 6 is the filter unit array schematic diagram of Bayer structure.
Fig. 7 is the filter unit array schematic diagram of the imageing sensor of embodiment of the present invention.
Fig. 8 is the perspective view of the imageing sensor of embodiment of the present invention.
Fig. 9 is the high-level schematic functional block diagram of the imageing sensor of embodiment of the present invention.
Figure 10 is the electrical block diagram of the photosensitive pixel of embodiment of the present invention imageing sensor.
Figure 11 is the perspective view of the imageing sensor of embodiment of the present invention.
Figure 12 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Figure 13 is the electrical block diagram of the imaging device of some execution mode of the present invention.
Figure 14 is the electrical block diagram of the imaging device of other execution modes of the present invention.
Figure 15 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 16 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Embodiment
Be described below in detail the execution mode of embodiments of the present invention, the example of described execution mode is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Being exemplary below by the execution mode be described with reference to the drawings, only for explaining embodiments of the present invention, and the restriction to embodiments of the present invention can not being interpreted as.
Below in conjunction with accompanying drawing, the formation method of embodiments of the present invention, imageing sensor, imaging device and electronic installation are described further.
Refer to Fig. 1, the formation method of embodiment of the present invention comprises the following steps:
S1, imageing sensor is provided, imageing sensor comprises photosensitive pixel array and is arranged at the filter on photosensitive pixel array, filter comprises filter unit array, filter unit comprises infrared filtering district and colorized optical filtering district, infrared filtering district covers a photosensitive pixel, and colorized optical filtering district covers at least one photosensitive pixel, and the photosensitive pixel that same filter unit covers forms merging pixel.
S2, reads the output of photosensitive pixel array, and the pixel value calculating merging pixel according to the output of the photosensitive pixel of same merging pixel merges image to generate.
The colorized optical filtering district of the filter unit in the formation method of embodiment of the present invention is for obtaining the color information merging pixel, and infrared filtering district is used for the monochrome information of acquisition merging pixel under low-light (level) and this monochrome information noise is less.So, the pixel value merging image had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color merging image is complete, and brightness and definition are all better, and noise is few.
Please refer to the drawing 8, in some embodiments, each filter unit covers 2*2 photosensitive pixel.
In the present embodiment, merge the pixel value of pixel and comprise color pixel values, color pixel values be the output of the photosensitive pixel that colorized optical filtering district covers mean value or and.The output of the photosensitive pixel that colored filter covers by hardware or software approach obtain mean value or and.Hardware approach comprises charge signal parallel summation etc., and software approach is as external chip ISP (image signal processing chip) averaging or suing for peace digital signal.Merged by signal, the signal to noise ratio of the color pixel values obtained is higher.
Concrete, in some embodiments, imageing sensor comprises control module, control module be used for control chart image-position sensor export mean value that photosensitive pixel that colorized optical filtering district covers exports or and.
This is hardware merging method, settling signal merging treatment in the internal circuit of imageing sensor, but not the software process of ISP chip.The processing speed of hardware approach is very fast.
In formation method in the present embodiment, imageing sensor comprises digital to analog converter, and digital to analog converter is used for the output of photosensitive pixel being converted to digital signal, please refer to the drawing 2, and step S2 comprises further:
S21: calculate colorized optical filtering district cover photosensitive pixel digital signal mean value or and as merging pixel color pixel values.
This is software approach, namely utilizes external chip processing digital signal.The method can retain original signal data, as the output of each photosensitive pixel that colorized optical filtering district covers.
Please refer to the drawing 3, in some embodiments, merges pixel and comprises color pixel values and infrared image element value.Step S2 comprises further:
S23: using color pixel values, color pixel values deducts infrared image element value or color pixel values adds that infrared image element value is as the pixel value merging pixel.
Like this, illumination that can be environmentally different, carries out suitable process by color pixel values and infrared image element value, to generate the complete true to nature and merging image that definition is high of color.
The formation method of embodiment of the present invention can be realized by the imageing sensor of embodiment of the present invention.
Refer to Fig. 4 and Fig. 5, the imageing sensor 10 of embodiment of the present invention comprises photosensitive pixel array 11 and is arranged at the filter 13 on photosensitive pixel array 11.Filter 13 comprises filter unit array 131, and each filter unit 1311 comprises infrared filtering district 1313 and colorized optical filtering district 1315, and infrared filtering district 1313 covers a photosensitive pixel 111, and colorized optical filtering district 1315 covers at least one photosensitive pixel 111.Such as, in Fig. 5, colorized optical filtering district 1315 is green filter district, covers 3 photosensitive pixels.The photosensitive pixel 111 that same filter unit 1311 covers forms merging pixel.Extraneous light is irradiated to the photosensitive part 1111 of photosensitive pixel 111 to produce the signal of telecommunication by filter 13, i.e. the output of photosensitive pixel 111.
The colorized optical filtering district 1315 of the filter unit 1311 of the imageing sensor of embodiment of the present invention is for obtaining the color information merging pixel, and infrared filtering district 1313 merges the monochrome information of pixel for acquisition under low-light (level) and this monochrome information noise is less.The pixel value of the merging image generated with this had not only comprised color information but also had comprised the monochrome information of low perceived noisiness, and the color merging image is complete, and brightness and definition are all better, and noise is few.
Refer to Fig. 6, in some embodiments, colorized optical filtering district forms Bayer array (Bayerpattern).Bayer array comprises filtering structure 1317, and each filtering structure 1317 comprises 2*2 filter unit 1311, is green, red, blue, green filter unit 1311 respectively.
Adopt Bayer structure can adopt conventional needle to the algorithm of Bayer structure to process picture signal, thus do not need hardware configuration does large adjustment.
In traditional filter unit array structure, the corresponding photosensitive pixel of each filter unit and image pixel.Refer to Fig. 7, in the present embodiment, filter unit array 131 adopts Bayer structure, comprise filtering structure 1317, each filtering structure 1317 comprises green, redness, blueness, green filter unit 1311, and unlike, the corresponding multiple photosensitive pixel 111 of each filter unit 1311, wherein, the corresponding photosensitive pixel 111 in infrared filtering district 1313, colorized optical filtering district 1315 at least one photosensitive pixel 111 corresponding.
Refer to Fig. 8 and Fig. 7, in some embodiments, each filter unit 1311 covers 2*2 photosensitive pixel 111 and merges pixel to be formed.
Except 2*2 structure, also has 3*3,4*4, or even any structure (n such as n*m, m is natural number), be appreciated that, on photosensitive pixel array 11, the number of sequencable photosensitive pixel 111 is limited, the words that the photosensitive pixel 111 that each merging pixel comprises is too much, the resolution sizes of image can be restricted, e.g., if the pixel value of photosensitive pixel array 11 is 16M, adopt the merging dot structure of 2*2 can obtain the merging image that resolution is 4M, and adopt 4*4 structure just can only obtain merging image that resolution is 1M.Therefore the merging dot structure of 2*2 is a preferred arrangement mode, under sacrificing the prerequisite of resolution less, promote image brightness, contrast and definition as far as possible.Meanwhile, adopt 2*2 structure to facilitate hardware realizes reading and merging treatment that photosensitive pixel is exported.
Refer to Fig. 9, in some embodiments, imageing sensor also comprises control module 17, and control module 17 exposes line by line for controlling photosensitive pixel array 11.
Concrete, control module 17 is connected with row and selects logical block 171 and column selection logical block 173, to control to process the output of photosensitive pixel 111 line by line.
To expose line by line and the mode exported more easily realizes on hardware.
See also Fig. 9, in the present embodiment, imageing sensor 10 also comprises register 19, control module 17 for the photosensitive pixel 111 of the row k that gathers current exposure successively and complete and kth+1 row output and stored in register 19, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of photosensitive pixel array 11.
Concrete, refer to Figure 10 and Fig. 9, imageing sensor 10 comprises the control module 17 selecting logical block 171 and column selection logical block 173 to be connected with row.Row selects logical block 171 and column selection logical block 173 switching tube 1115 corresponding with each photosensitive pixel 111 to connect, control module 17 for control lines selection logical block 171 and column selection logical block 173 with the switching tube 1115 of the photosensitive pixel 111 of gating ad-hoc location.
Refer to Figure 11, in some embodiments, imageing sensor 10 comprises the micro mirror array 23 be arranged on filter 13, and each micro mirror 231 is corresponding with a photosensitive pixel 111.
Concrete, each micro mirror 231 is corresponding with a photosensitive pixel 111, comprises size, position is corresponding.In some embodiments, the corresponding 2*2 of each filter unit 1311 photosensitive pixel 111 and 2*2 micro mirror 231.Along with technical development, in order to obtain the higher image of resolution, photosensitive pixel 111 on sensitive film gets more and more, arrange more and more intensive, single photosensitive pixel 111 is also more and more less, and its light is affected, and photosensitive part 1111 area of photosensitive pixel 111 is limited, light can be gathered photosensitive part 1111 by micro mirror 231, thus the light reception intensity of promotion feeling light pixel 111 is to improve image quality.
To sum up, the each filter unit of imageing sensor in embodiment of the present invention comprises infrared filtering district and colorized optical filtering district, make the pixel value of merging pixel not only comprise color information but also comprise the monochrome information of low perceived noisiness, generating the complete and merging image that signal to noise ratio is high of color to facilitate subsequent conditioning circuit.
Please refer to the drawing 12, the present invention also provides a kind of imaging device 100, and it comprises outside the imageing sensor 10 of embodiment of the present invention, also comprises the image processing module 50 be connected with imageing sensor 10.
Image processing module 50 for image processing module for reading the output of photosensitive pixel array, and calculate according to the output of the photosensitive pixel of same merging pixel merge pixel pixel value to generate merging image.
Concrete, the imageing sensor of embodiment of the present invention can comprise control module 17, row selects logical block 171, column selection logical block 173, analog to digital converter array 21, register 19 etc., the output of photosensitive pixel array 11 is converted to digital signal through analog to digital converter array 21, be stored in register 19 line by line and be sent to image processing module 50 and process, until the output of all photosensitive pixels is processed merge image to generate.
So, image processing module 50 merges pixel value according to the colour corresponding with colorized optical filtering district and generates the complete colour of color information and merge image, and the infrared image element value corresponding according to infrared filtering district to generate brightness higher, the infrared image that noise is less.
See also Figure 12 and Figure 10, in some embodiments, imageing sensor 10 comprises analog to digital converter 21 array, and each photosensitive pixel 111 is connected with an analog to digital converter 17 respectively.Analog to digital converter 17 for the analog signal output of photosensitive pixel 111 is converted to digital signal export, and for calculate colorized optical filtering district cover photosensitive pixel digital signal mean value or and as merging pixel color pixel values.Photosensitive pixel 111 in present embodiment comprises photodiode 1113.Photodiode 1113 is for being converted into electric charge by illumination, and the electric charge produced and the proportional relation of intensity of illumination.Switching tube 1115 is for selecting the control signal of logical block 171 and column selection logical block 173 to come conducting and the disconnection of control circuit according to row, when circuit turn-on, source follower 1117 (sourcefollower) is converted into voltage signal for the charge signal produced through illumination by photodiode 1113.Analog to digital converter 211 (Analog-to-digitalconverter) for voltage signal is converted to digital signal, to transfer to subsequent conditioning circuit process.
This output processing mode makes the output of photosensitive pixel be converted into digital signal, processes in following digital circuit or in the chips with software.Therefore the output information of each photosensitive pixel can be retained, such as, for the imageing sensor of 16M pixel, the formation method of embodiment of the present invention can retain the information of 16M pixel (before namely merging image), obtains the merging image of 4M pixel or the image of other resolution on this basis through process.Final synthetic image occurs that the probability of bad point is lower.In addition, the noise of this output processing mode is less, and signal to noise ratio is higher.Please join Figure 10 in the lump, in the present embodiment, imageing sensor comprises the source follower 1117 be connected with photosensitive pixel 111, and source follower 1117 is connected with analog to digital converter 211.Source follower 1117 for the charge signal of photosensitive pixel 111 is converted to voltage signal, to be converted to digital signal by analog to digital converter 211 further.
The output of photosensitive pixel that colorized optical filtering district covers can also adopt hardware to merge mode, according to the connection of photosensitive pixel with source follower, has two kinds of hardware merging modes.
Please refer to the drawing 13, in some embodiments, each photosensitive pixel 111 is connected 1117 with a source follower, and the source follower 1117 of photosensitive pixel 111 correspondence of colorized optical filtering district 1315 covering of same merging pixel is connected with an analog to digital converter 211.Namely each photodiode 1113 is connected with a source follower 1117, there are several source followers 1117 and is connected with analog to digital converter 211.
Compared with the execution mode that this hardware merges merges mode with software, the signal output intensity of the circuit structure of photosensitive pixel 111 is identical with it, and photodiode 1113 noise, source follower 1117 noise are all lower, therefore signal to noise ratio is higher generally, and the image of generation is more clear.
Please refer to the drawing 14, in some other execution mode, the photosensitive pixel 111 that the colorized optical filtering district 1315 of same merging pixel covers is connected with a source follower 1117.
Namely multiple photodiode 1113 is connected with a source follower 1117, and each source follower 1117 is connected with an analog to digital converter 211.Compared with the execution mode that this hardware merges merges mode with software, though output noise is slightly high, output intensity is its n times, and n is photosensitive pixel 111 number of common source follower 1117, and thus signal to noise ratio is higher generally, and the image of generation is more clear.
No matter be that hardware merges or the processing mode that software merges, the output of multiple photosensitive pixel merged, the signal noise ratio (snr) of image that the merging pixel of formation is corresponding is higher.Such as, assuming that the output of original each photosensitive pixel is S, noise is N, and merge pixel and comprise m color sensitive pixels, then the pixel value merging pixel is m*S, and the noise merging pixel is
m be more than or equal to 1 natural number.Be appreciated that when m>1, the noise merging pixel is less than the noise sum merging front each color sensitive pixels and export.And the output merging pixel exports sum for merging front each color sensitive pixels, therefore merge noise decline signal to noise ratio in integral image and improve, definition promotes.
In some embodiments, the output of the photosensitive pixel that the output that image processing module is used for the photosensitive pixel covered in the colorized optical filtering district of same merging pixel covers with infrared filtering district is added the pixel value obtaining merging pixel.After obtaining colored merging pixel, the output of its photosensitive pixel covered with infrared filtering district is added, was both comprised color information, comprise again the merging pixel of infrared photosensitive information thus generate merging image.Merge the signal to noise ratio of image (as 4M resolution) higher than the image (as 16M resolution) of nonjoinder, and color is complete, brightness under low-light (level), contrast and definition higher.
The present invention also provides a kind of electronic installation applying imaging device.In some embodiments, electronic installation comprises imaging device.Therefore, electronic installation has camera function and to generate color under low-light (level) complete, and signal to noise ratio is high, the merging image that definition is high.
Electronic installation can be mobile phone.
In some embodiments, imaging device can be the Front camera of mobile phone.Because Front camera is used for autodyning, and the definition of General Requirements to image of autodyning has requirement and not high to image resolution requirement, adopts the electronic installation of present embodiment can meet this requirement.
Refer to Figure 15, in some embodiments, electronic installation 200 comprises the central processing unit 81 and external memory 83 that are connected with imaging device 100, and central processing unit 81 stores merging image for controlling external memory 83.
Like this, the merging image of generation can be stored, and checks, uses or shifts after convenient.External memory 83 comprises SM (SmartMedia) card and CF (CompactFlash) card etc.
Refer to Figure 16, in some embodiments, electronic installation 200 also comprises the central processing unit 81 and display unit 85 that are connected with imaging device 100, and central processing unit 81 shows merging image for controlling display unit 85.Like this, the image that electronic installation 200 is taken can be shown in display unit and check for user.Display unit comprises light-emitting diode display etc.
To sum up, adopt the electronic installation of embodiment of the present invention, have camera function and to generate color under low-light (level) complete, signal to noise ratio is high, the merging image that definition is high.Especially, when this electronic installation is the Front camera of mobile phone, the brightness of image of autodyning under promoting low-light (level) and definition, reduce noise.
The part do not launched in formation method and electronic installation in embodiment of the present invention, can join the imageing sensor of above execution mode and the corresponding part of imaging device, launch no longer in detail at this.
In the description of this specification, specific features, structure, material or feature that the description of reference term " execution mode ", " some execution modes ", " exemplary embodiment ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with described execution mode or example are contained at least one execution mode of the present invention or example.In this manual, identical execution mode or example are not necessarily referred to the schematic representation of above-mentioned term.And the specific features of description, structure, material or feature can combine in an appropriate manner in any one or more execution mode or example.
Describe and can be understood in flow chart or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by embodiments of the invention person of ordinary skill in the field.
In flow charts represent or in this logic otherwise described and/or step, such as, the sequencing list of the executable instruction for realizing logic function can be considered to, may be embodied in any computer-readable medium, for instruction execution system, device or equipment (as computer based system, comprise the system of processor or other can from instruction execution system, device or equipment instruction fetch and perform the system of instruction) use, or to use in conjunction with these instruction execution systems, device or equipment.With regard to this specification, " computer-readable medium " can be anyly can to comprise, store, communicate, propagate or transmission procedure for instruction execution system, device or equipment or the device that uses in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electrical connection section (electronic installation) with one or more wiring, portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasablely edit read-only memory (EPROM or flash memory), fiber device, and portable optic disk read-only memory (CDROM).In addition, computer-readable medium can be even paper or other suitable media that can print described program thereon, because can such as by carrying out optical scanner to paper or other media, then carry out editing, decipher or carry out process with other suitable methods if desired and electronically obtain described program, be then stored in computer storage.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple step or method can with to store in memory and the software performed by suitable instruction execution system or firmware realize.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: the discrete logic with the logic gates for realizing logic function to data-signal, there is the application-specific integrated circuit (ASIC) of suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, also can be that the independent physics of unit exists, also can be integrated in a module by two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
The above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.
Although illustrate and describe embodiments of the invention above, be understandable that, above-described embodiment is exemplary, can not be interpreted as limitation of the present invention, and those of ordinary skill in the art can change above-described embodiment within the scope of the invention, revises, replace and modification.
Claims (23)
1. a formation method, is characterized in that, comprises the following steps:
There is provided imageing sensor, described imageing sensor comprises photosensitive pixel array and is arranged at the filter on described photosensitive pixel array, and described filter comprises filter unit array, and described filter unit comprises infrared filtering district and colorized optical filtering district; Described infrared filtering district covers a described photosensitive pixel; Described colorized optical filtering district covers photosensitive pixel described at least one; The described photosensitive pixel that same described filter unit covers forms merging pixel; And
Read the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.
2.
as claimformation method described in 1, is characterized in that, each described filter unit covers 2*2 described photosensitive pixel.
3.
as claimformation method described in 1, is characterized in that, the pixel value of described merging pixel comprises color pixel values, described color pixel values be described colorized optical filtering district cover described photosensitive pixel output mean value or and.
4.
as claimformation method described in 3, is characterized in that, described imageing sensor comprises control module, described control module for control described imageing sensor export mean value that described photosensitive pixel that described colorized optical filtering district covers exports or and.
5.
as claimformation method described in 3, is characterized in that, described imageing sensor comprises digital to analog converter, and described digital to analog converter is used for the output of described photosensitive pixel to be converted to digital signal;
Described read step comprises further:
Calculate the described digital signal of the described photosensitive pixel that described colorized optical filtering district covers mean value or with as the described color pixel values of described merging pixel.
6.
as claimformation method described in 1, is characterized in that, described merging pixel comprises color pixel values and infrared image element value, and described read step comprises further:
Using described color pixel values, described color pixel values deducts described infrared image element value or described color pixel values adds the pixel value of described infrared image element value as described merging pixel.
7. an imageing sensor, is characterized in that, comprising:
Photosensitive pixel array; And
Be arranged at the filter on described photosensitive pixel array;
Described filter comprises filter unit array, and each described filter unit comprises infrared filtering district and colorized optical filtering district; Described infrared filtering district covers a described photosensitive pixel; Described colorized optical filtering district covers n-1 described photosensitive pixel, and n is the number of the described photosensitive pixel that a described filter unit covers;
The described photosensitive pixel that same described filter unit covers forms merging pixel.
8.
as claimimageing sensor described in 7, is characterized in that, described colorized optical filtering district forms Bayer array.
9.
as claimimageing sensor described in 7, is characterized in that, each described filter unit comprises 2*2 described photosensitive pixel.
10.
as claimimageing sensor described in 9, is characterized in that, described imageing sensor comprises control module, and described control module exposes line by line for controlling described photosensitive pixel array.
11.
as claimimageing sensor described in 10, it is characterized in that, described imageing sensor also comprises register, described control module be used for the described photosensitive pixel gathering the row k that completes of current exposure and kth+1 row successively output and stored in described register, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of described photosensitive pixel array.
12.
as claimimageing sensor described in 7, is characterized in that, described imageing sensor comprises the micro mirror array be arranged on filter, and each described micro mirror is corresponding with a described photosensitive pixel.
13. 1 kinds of imaging devices, is characterized in that comprising
as claimimageing sensor described in 7-12 any one;
Described imaging device also comprises the image processing module be connected with described imageing sensor;
Described image processing module is for reading the output of described photosensitive pixel array, and the pixel value calculating described merging pixel according to the output of the described photosensitive pixel of same described merging pixel merges image to generate.
14.
as claimimaging device described in 13, is characterized in that, described imageing sensor comprises analog to digital converter array, and each described analog to digital converter is connected with a described photosensitive pixel;
Described image processing module is used for the analog signal output that described photosensitive pixel produces being converted to digital signal and exports, and for the mean value of the described digital signal that calculates the described photosensitive pixel that described colorized optical filtering district covers or with as the described color pixel values of described merging pixel.
15.
as claimimaging device described in 13, is characterized in that, described imageing sensor comprises the source follower be connected with described photosensitive pixel;
Described source follower is connected with described analog to digital converter.
16.
as claimimaging device described in 15, is characterized in that, each described photosensitive pixel is connected with a described source follower; The described source follower that the described photosensitive pixel of the described colorized optical filtering district covering of same described merging pixel is corresponding is connected with a described analog to digital converter.
17.
as claimimaging device described in 15, is characterized in that, the described photosensitive pixel that the described colorized optical filtering district of same described merging pixel covers is connected with a described source follower.
18.
as claimimaging device described in 13, it is characterized in that, the output of the described photosensitive pixel that the output that described image processing module is used for the described photosensitive pixel covered in the described colorized optical filtering district of same described merging pixel covers with described infrared filtering district is added to obtain the pixel value of described merging pixel.
19. 1 kinds of electronic installations, is characterized in that, comprise
as claimimaging device described in 16-18 any one.
20.
as claimelectronic installation described in 19, is characterized in that, described electronic installation comprises mobile phone.
21.
as claimelectronic installation described in 20, is characterized in that, described imaging device comprises the Front camera of described mobile phone.
22.
as claimelectronic installation described in 19, is characterized in that, described electronic installation comprises the central processing unit and external memory that are connected with described imaging device, and described central processing unit stores described merging image for controlling described external memory.
23.
as claimelectronic installation described in 19, is characterized in that, described electronic installation also comprises the central processing unit and display unit that are connected with described imaging device, and described central processing unit shows described merging image for controlling described display unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963729.3A CN105430360B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic installation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510963729.3A CN105430360B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic installation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105430360A true CN105430360A (en) | 2016-03-23 |
| CN105430360B CN105430360B (en) | 2018-01-23 |
Family
ID=55508259
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510963729.3A Active CN105430360B (en) | 2015-12-18 | 2015-12-18 | Imaging method, imaging sensor, imaging device and electronic installation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105430360B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017101451A1 (en) * | 2015-12-18 | 2017-06-22 | 广东欧珀移动通信有限公司 | Imaging method, imaging device, and electronic device |
| CN107370917A (en) * | 2017-06-30 | 2017-11-21 | 广东欧珀移动通信有限公司 | Control method, electronic installation and computer-readable recording medium |
| WO2021174529A1 (en) * | 2020-03-06 | 2021-09-10 | Oppo广东移动通信有限公司 | Image sensor, imaging apparatus, electronic device, image processing system and signal processing method |
| CN114125243A (en) * | 2021-11-30 | 2022-03-01 | 维沃移动通信有限公司 | Image sensor, camera module, electronic equipment and pixel information acquisition method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1971927A (en) * | 2005-07-21 | 2007-05-30 | 索尼株式会社 | Physical information acquiring method, physical information acquiring device and semiconductor device |
| US20070145273A1 (en) * | 2005-12-22 | 2007-06-28 | Chang Edward T | High-sensitivity infrared color camera |
| CN101233762A (en) * | 2005-07-28 | 2008-07-30 | 伊斯曼柯达公司 | Image sensor with improved lightsensitivity |
| CN102857708A (en) * | 2011-10-17 | 2013-01-02 | 北京瑞澜联合通信技术有限公司 | Image sensor, photographing device and image data generation method |
| CN104350744A (en) * | 2012-06-07 | 2015-02-11 | 三星泰科威株式会社 | Camera system with multi-spectral filter array and image processing method thereof |
| CN104937928A (en) * | 2012-11-23 | 2015-09-23 | Lg电子株式会社 | RGB-IR sensor, and method and apparatus for obtaining 3D image by using same |
-
2015
- 2015-12-18 CN CN201510963729.3A patent/CN105430360B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1971927A (en) * | 2005-07-21 | 2007-05-30 | 索尼株式会社 | Physical information acquiring method, physical information acquiring device and semiconductor device |
| CN101233762A (en) * | 2005-07-28 | 2008-07-30 | 伊斯曼柯达公司 | Image sensor with improved lightsensitivity |
| US20070145273A1 (en) * | 2005-12-22 | 2007-06-28 | Chang Edward T | High-sensitivity infrared color camera |
| CN102857708A (en) * | 2011-10-17 | 2013-01-02 | 北京瑞澜联合通信技术有限公司 | Image sensor, photographing device and image data generation method |
| CN104350744A (en) * | 2012-06-07 | 2015-02-11 | 三星泰科威株式会社 | Camera system with multi-spectral filter array and image processing method thereof |
| CN104937928A (en) * | 2012-11-23 | 2015-09-23 | Lg电子株式会社 | RGB-IR sensor, and method and apparatus for obtaining 3D image by using same |
Non-Patent Citations (2)
| Title |
|---|
| 李东明: "《天体测量方法 历史、现状和未来》", 31 August 2006 * |
| 许强: "《军用紫外探测技术及应用》", 1 May 2010 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017101451A1 (en) * | 2015-12-18 | 2017-06-22 | 广东欧珀移动通信有限公司 | Imaging method, imaging device, and electronic device |
| US10257447B2 (en) | 2015-12-18 | 2019-04-09 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging method, imaging device, and electronic device |
| CN107370917A (en) * | 2017-06-30 | 2017-11-21 | 广东欧珀移动通信有限公司 | Control method, electronic installation and computer-readable recording medium |
| WO2021174529A1 (en) * | 2020-03-06 | 2021-09-10 | Oppo广东移动通信有限公司 | Image sensor, imaging apparatus, electronic device, image processing system and signal processing method |
| CN115280766A (en) * | 2020-03-06 | 2022-11-01 | Oppo广东移动通信有限公司 | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method |
| CN115280766B (en) * | 2020-03-06 | 2024-05-03 | Oppo广东移动通信有限公司 | Image sensor, imaging device, electronic apparatus, image processing system, and signal processing method |
| CN114125243A (en) * | 2021-11-30 | 2022-03-01 | 维沃移动通信有限公司 | Image sensor, camera module, electronic equipment and pixel information acquisition method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105430360B (en) | 2018-01-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105430359A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105578072A (en) | Imaging method, imaging device and electronic device | |
| CN105430361A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105592303B (en) | imaging method, imaging device and electronic device | |
| CN105578076A (en) | Imaging method, imaging device and electronic device | |
| CN105578080A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105611185B (en) | image generating method, device and terminal device | |
| CN105430362A (en) | Imaging method, imaging device and electronic device | |
| CN105578067B (en) | image generating method, device and terminal device | |
| CN105578066A (en) | Imaging method, imaging device and electronic device | |
| CN105472266A (en) | High dynamic range image generation method, photographing device and terminal | |
| CN105430363A (en) | Imaging method, imaging device and electronic device | |
| CN105578006A (en) | Imaging method, imaging device and electronic device | |
| CN105578081A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105578078A (en) | Image sensor, imaging device, mobile terminal and imaging method | |
| CN105611257B (en) | Imaging method, imaging sensor, imaging device and electronic device | |
| CN105611125B (en) | Imaging method, imaging device and electronic installation | |
| CN105578075A (en) | Method for generating high-dynamic range image, photographing device and terminal | |
| CN105611123B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105516697A (en) | Image sensor, imaging device, mobile terminal and imaging method | |
| CN105430360A (en) | Imaging method, image sensor, imaging device and electronic device | |
| CN105635532B (en) | imaging method, image sensor, imaging device and electronic device | |
| CN105578079A (en) | Image sensor, method for adjusting imaging quality of image sensor and imaging device | |
| CN105578065A (en) | Method for generating high-dynamic range image, photographing device and terminal | |
| CN105578077A (en) | Imaging method, imaging device and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. Address before: Changan town in Guangdong province Dongguan 523859 usha Beach Road No. 18 Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., Ltd. |