CN105578077A - Imaging method, imaging device and electronic device - Google Patents

Imaging method, imaging device and electronic device Download PDF

Info

Publication number
CN105578077A
CN105578077A CN201510964386.2A CN201510964386A CN105578077A CN 105578077 A CN105578077 A CN 105578077A CN 201510964386 A CN201510964386 A CN 201510964386A CN 105578077 A CN105578077 A CN 105578077A
Authority
CN
China
Prior art keywords
pixel
photosensitive pixel
image
merging
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510964386.2A
Other languages
Chinese (zh)
Inventor
雷辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201510964386.2A priority Critical patent/CN105578077A/en
Publication of CN105578077A publication Critical patent/CN105578077A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • H04N25/57Control of the dynamic range

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses an imaging method. First, an image sensor is provided, which includes a photosensitive pixel array and an optical filter arranged on the photosensitive pixel array, the optical filter includes a filtering unit array, each filtering unit covers a plurality of photosensitive pixels which form a merged pixel. Then, an output of the photosensitive pixel array is read, and outputs of a different quantity of photosensitive pixels of a same merged pixel are added to obtain pixel values of different brightness levels of the merged pixel, thereby generating material images of different brightness levels. Finally, the material images of different brightness levels are merged to obtain a merged image of a high dynamic range. By adoption of the imaging method provided by the embodiment of the invention, exposure is needed for only once to generate an image, the image is split and the merged image is generated through combination, image generation is fast in speed, and time is saved. The invention also provides an imaging device and electronic device.

Description

Formation method, imaging device and electronic installation
Technical field
The present invention relates to imaging technique, particularly a kind of formation method, imaging device and electronic installation.
Background technology
Wide dynamic range (highdynamicrange, HDR) shoot function in tradition photographing device refers to that exposure generates three images that brightness ratio is 1:2:4 three times respectively, then is synthesized by software.Due to needs exposure three times, therefore image taking speed is slower.
Summary of the invention
The present invention is intended at least to solve one of technical problem existed in prior art.For this reason, the present invention needs to provide a kind of formation method, imaging device and electronic installation.
The formation method of embodiment of the present invention comprises the following steps:
There is provided imageing sensor, described imageing sensor comprises photosensitive pixel array and is arranged on the filter on described photosensitive pixel array, and described filter comprises filter unit array, and each described filter unit covers multiple described photosensitive pixel and forms and merges pixel;
Read the output of described photosensitive pixel array, and the output of the described photosensitive pixel of the different numbers of same described merging pixel be added with the pixel value obtaining the different gray scale of described merging pixel thus generate the material image of different gray scale; And
The described material image of different gray scale is carried out the merging image merging to obtain high dynamic range.
Formation method in embodiment of the present invention only needs single exposure to generate an image, then is split and combine to generate multistage material image, more multistage material image is synthesized merging image.This method does not need in image processing and tracking unit process the time waiting for multiexposure, multiple exposure, and image generation speeds is fast, saves time.
Present invention also offers a kind of imaging device that can be used for realizing above-mentioned formation method, it comprises:
Imageing sensor, described imageing sensor comprises:
Photosensitive pixel array; And
Be arranged at the filter on described photosensitive pixel array;
Described filter comprises filter unit array, and each described filter unit covers multiple described photosensitive pixel and forms and merges pixel;
Described imaging device also comprises image processing module;
Described image processing module for reading the output of described photosensitive pixel array, and is added with the pixel value obtaining the different gray scale of described merging pixel for the output of the described photosensitive pixel of the different numbers by same described merging pixel thus generates the material image of different gray scale.
Described image processing module is also for carrying out the described material image of different gray scale the merging image merging to obtain high dynamic range.
Present invention also offers a kind of electronic installation comprising above-mentioned imaging device.
Additional aspect of the present invention and advantage will part provide in the following description, and part will become obvious from the following description, or be recognized by practice of the present invention.
Accompanying drawing explanation
Above-mentioned and/or additional aspect of the present invention and advantage will become obvious and easy understand from accompanying drawing below combining to the description of execution mode, wherein:
Fig. 1 is the schematic flow sheet of the formation method of embodiment of the present invention.
Fig. 2 is the schematic flow sheet of the read step of embodiment of the present invention formation method.
Fig. 3 is the schematic flow sheet of embodiment of the present invention formation method.
Fig. 4 is the structural representation of the imaging device of embodiment of the present invention.
Fig. 5 is the perspective view of the imageing sensor of embodiment of the present invention.
Fig. 6 is the filter unit array of embodiment of the present invention and the corresponding relation schematic diagram of multistage material image.
Fig. 7 is the filter unit array schematic diagram of Bayer structure.
Fig. 8 is the high-level schematic functional block diagram of the imaging device of embodiment of the present invention.
Fig. 9 is the photosensitive pixel circuit structural representation of the imaging device of embodiment of the present invention.
Figure 10 is the perspective view of the imageing sensor of embodiment of the present invention.
Figure 11 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Figure 12 is the high-level schematic functional block diagram of the electronic installation of embodiment of the present invention.
Embodiment
Be described below in detail the execution mode of embodiments of the present invention, the example of described execution mode is shown in the drawings, and wherein same or similar label represents same or similar element or has element that is identical or similar functions from start to finish.Being exemplary below by the execution mode be described with reference to the drawings, only for explaining embodiments of the present invention, and the restriction to embodiments of the present invention can not being interpreted as.
Below in conjunction with accompanying drawing, the formation method of embodiments of the present invention, imageing sensor, imaging device and electronic installation are described further.
High dynamic range images (High-DynamicRange is called for short HDR), compares common image, can provide more dynamic range and image detail.Its principle is according to the image not exposing brightness, and utilize the part of each image detail the best to merge image to synthesize final HDR, the contrast and the details that merge image parts are good, are convenient to eye recognition.
Embodiment of the present invention provides a kind of formation method to generate the merging image of high dynamic range.
Refer to Fig. 1, the formation method of embodiment of the present invention comprises the following steps:
S1, provides imageing sensor, and imageing sensor comprises photosensitive pixel array and is arranged on the filter on photosensitive pixel array, and filter comprises filter unit array, and each filter unit covers multiple photosensitive pixel and forms and merges pixel.
S2, reads the output of photosensitive pixel array, and the output of the photosensitive pixel of the different numbers of same merging pixel is added with the pixel value obtaining merging the different gray scale of pixel thus generates the material image of different gray scale.
S3, carries out the merging image merging to obtain high dynamic range by the material image of different gray scale.
Be different from traditional multiexposure, multiple exposure that carries out to generate the image of the different brightness of multiframe, then the mode merged, adopt the formation method of embodiment of the present invention, only need single exposure to generate an image, then split and combine to generate merging image.This formation method does not need in image processing and tracking unit process the time waiting for multiexposure, multiple exposure, has therefore obviously saved the time.
In the present embodiment, three gray scales of different gray scale can be brightness be 1:2:4 proportionate relationship.
The addition that the photosensitive pixel covered by same filter unit is exported can obtain different gray scales, such as, by two and four photosensitive pixels are exported the image being added and can obtaining 2 times and 4 times brightness respectively.
In the present embodiment, filter unit array can be Bayer array.
In the present embodiment, each filter unit can cover 2*2 photosensitive pixel.
In the present embodiment, material image can comprise and merge three grades of material image that pixel is the one-level material image of the output of a photosensitive pixel, the secondary material image of the output of two photosensitive pixels and the output of four photosensitive pixels.
Like this, just can obtain brightness ratio is that three material image of 1:2:4 are to synthesize further.
Can cover at filter unit in the execution mode of 2*2 photosensitive pixel, step S2 comprises further:
S201, gathers the output of the photosensitive pixel of row k and kth+1 row and stored in register, wherein k=2n-1, n are natural number, and k+1 is less than or equal to total line number of photosensitive pixel array.
S203, the output of extracting the photosensitive pixel of row k and kth+1 row from register obtains merging the pixel value of the different gray scale of pixel with process.
Because the number of photosensitive pixel is too many, once export more infeasible, to expose line by line and the mode exported more easily realizes on hardware.And the photosensitive pixel that same filter unit covers is distributed in two row, therefore two row two row ground read and are convenient to subsequent conditioning circuit and export the photosensitive pixel that same filter unit covers and carry out calculating operation.
In some embodiments, each photosensitive pixel is connected with an analog to digital converter respectively.
Formation method comprises further:
S205, is converted to digital signal by the analog signal output that photosensitive pixel exports and exports.
S301, the digital signal exported by the photosensitive pixel of the different numbers of same merging pixel is added the pixel value to obtain merging the different gray scale of pixel.
Also provide a kind of imaging device that can be used to realize formation method of the present invention in embodiment of the present invention, refer to Fig. 4 and Fig. 5, imaging device 100 can comprise imageing sensor 10 and image processing module 50.Imageing sensor comprises photosensitive pixel array 11 and is arranged at the filter 13 on photosensitive pixel array 11, and filter 13 comprises filter unit array 131, and each filter unit 1311 covers multiple photosensitive pixel 111 and forms and merges pixel.
Image processing module 50 for reading the output of photosensitive pixel array 11, and is added with the pixel value obtaining merging the different gray scale of pixel for the output of the photosensitive pixel 111 of the different numbers by same merging pixel thus generates the material image of different gray scale.Image processing module 50 is also for carrying out the merging image merging to obtain high dynamic range by the material image of different gray scale.
Traditional imaging device, as mobile phone camera, generally carries out multiexposure, multiple exposure to generate the image of the different brightness of multiframe, then is merged.And adopt the imaging device 100 of embodiment of the present invention, only need single exposure to generate an image, then split and combine to generate merging image.This imaging device 100 does not need to wait for multiexposure, multiple exposure in image processing and tracking unit process, has therefore obviously saved the time.
Such as, per secondly expose 8 times, if adopt three exposures to remerge, wait the time to be exposed to be 3/8 that is 0.375 second, and adopt the imaging device 100 of embodiment of the present invention, only need the 0.125 second time of wait single exposure.
In the present embodiment, different gray scale can comprise three gray scales that brightness is 1:2:4 proportionate relationship.
The addition that the photosensitive pixel 111 covered by same filter unit 1311 exports can obtain different gray scales, because the distance between the photosensitive pixel 111 that same filter unit covers 1311 is very near, the photosensitive output of base is roughly equal, therefore, if the output of a certain photosensitive pixel 111 covered by same filter unit 1311 is used as one times, the photosensitive pixel 111 of different number is added the output that can obtain different multiples, i.e. corresponding different gray scale.
Such as, refer to Fig. 6, in the present embodiment, material image comprises and merges pixel is the secondary material image 93 of output of one-level material image 91, two photosensitive pixels 111 of the output of a photosensitive pixel 111 and three grades of material image 95 of the output of four photosensitive pixels 111.
The specific photosensitive pixel 111 of certain or certain the several position obtaining that photosensitive pixel 111 that material image adopts is not limited to that same filter unit 1311 covers.The such as red pixel of secondary material image 93, can be obtained by R1+R2, also can be R1+R3 or R2+R4 etc.
Be appreciated that the output of the corresponding multiple photosensitive pixel 111 of an image pixel of secondary material image 93 and three grades of material image 95, this merging can promote the signal to noise ratio of material image and then promote the image quality merging image.
Such as, assuming that the output of original each photosensitive pixel 111 is S, noise is N, and corresponding m the photosensitive pixel 111 of the image pixel after merging, then after merging, the pixel value of image pixel is m*S, and after merging, the noise of image pixel is m be more than or equal to 1 natural number.Be appreciated that when m>1, after merging, the noise of image pixel is less than the noise sum merging front each photosensitive pixel 111 and export.And the output of image pixel exports sum for merging front each color sensitive pixels 111 after merging, after therefore merging, in integral image, noise decline signal to noise ratio improves, and definition promotes.
Refer to Fig. 7 and Fig. 6, in the present embodiment, filter unit array 131 can be Bayer array.Namely each Bayer structure comprises, and is two green filter unit (Gr and Gb), a red filter unit (R) and a blue filter unit (B) respectively.
Adopt Bayer structure can adopt conventional needle to the algorithm of Bayer structure to process picture signal, thus do not need hardware configuration does large adjustment.
See also Fig. 6, in the present embodiment, each filter unit 1311 can cover 2*2 photosensitive pixel 111.
Except 2*2 structure, also has 3*3,4*4, or even any structure (n such as n*m, m is natural number), be appreciated that, on photosensitive pixel array 11, the number of sequencable photosensitive pixel 111 is limited, the words that the photosensitive pixel 111 that each merging pixel comprises is too much, the resolution sizes of image can be restricted, e.g., if the pixel value of photosensitive pixel array 11 is 16M, adopt the merging dot structure of 2*2 can obtain the merging image that resolution is 4M, and adopt 4*4 structure just can only obtain multistage material image that resolution is 1M.Therefore the structure of 2*2 is a preferred arrangement mode, under sacrificing the prerequisite of resolution less, promote material image brightness and definition as far as possible.Meanwhile, adopt 2*2 structure to facilitate hardware realizes reading and merging treatment that photosensitive pixel 111 is exported.
Please refer to the drawing 8, in the execution mode comprising 2*2 structure, imaging device 100 can comprise control module 17, and control module 17 exposes line by line for controlling photosensitive pixel array 11.
Further, control module 17 can connected row select logical block 171 and column selection logical block 173 to control to process the output of photosensitive pixel 111 line by line.To expose line by line and the mode exported more easily realizes on hardware.
See also Fig. 7, in addition, imaging device 100 also comprises register 19.
Control module 17 for the photosensitive pixel 111 of the row k that gathers current exposure successively and complete and kth+1 row output and stored in register 19, wherein k=2n-1, n are natural number, k+1 is less than or equal to total line number of photosensitive pixel array 11.
Image processing module 50 for extracting the output of the photosensitive pixel 111 of row k and kth+1 row to process the pixel value obtaining merging the different gray scale of pixel from register 19.
See also Fig. 8, in the present embodiment, control module 17 for the photosensitive pixel 111 of the row k that gathers current exposure successively and complete and kth+1 row output and stored in register 19, wherein k=2n-1, n is natural number, and k+1 is less than or equal to total line number of photosensitive pixel array 11.
Because the number of photosensitive pixel 111 is too many, once export more infeasible, to expose line by line and the mode exported more easily realizes on hardware.And the photosensitive pixel 111 that same filter unit 1311 covers is distributed in two row, therefore two row two row ground read and are convenient to subsequent conditioning circuit and carry out calculating operation to photosensitive pixel 111 output that same filter unit 1311 covers.
Concrete, refer to Fig. 9, imageing sensor 10 comprises the control module 17 selecting logical block 171 and column selection logical block 173 to be connected with row.Row selects logical block 171 and column selection logical block 173 switching tube 1115 corresponding with each photosensitive pixel 111 to connect, control module 17 for control lines selection logical block 171 and column selection logical block 173 with the switching tube 1115 of the photosensitive pixel 111 of gating ad-hoc location.
Control module 17 first gather the photosensitive pixel 111 of the first row and the second row output and stored in register 19.Position coordinates is the pixel value that the output of four photosensitive pixels 111 of 1-1,1-2,2-1,2-2 is carried out processing to obtain multistage material image by subsequent conditioning circuit.Wherein the left side digitized representation of position coordinates is capable, digits right representative row.
Be the output processing of four photosensitive pixels 111 of 1-3,1-4,2-3,2-4 again by coordinate.
By that analogy, until process last group four photosensitive pixels 111 of the first row and the second row.
By above processing mode, the output of the photosensitive pixel 111 of the third line and fourth line, fifth line and the 6th row etc. is processed, until all the output of photosensitive pixel 111 has all processed.
Refer to Fig. 9, in some embodiments, imageing sensor 10 comprises analog to digital converter 211, and each photosensitive pixel 111 is connected with an analog to digital converter 211 respectively.
Analog to digital converter 211 exports for the analog signal output of photosensitive pixel 111 being converted to digital signal.
Concrete, the photosensitive pixel 111 in present embodiment comprises photodiode 1113.Photodiode 1113 is for being converted into electric charge by illumination, and the electric charge produced and the proportional relation of intensity of illumination.Switching tube 1115 is for selecting the control signal of logical block 171 and column selection logical block 173 to come conducting and the disconnection of control circuit according to row, when circuit turn-on, source follower 1117 (sourcefollower) is converted into voltage signal for the charge signal produced through illumination by photodiode 1113.Analog to digital converter 211 (Analog-to-digitalconverter), for voltage signal is converted to digital signal, processes to transfer to image processing module 50.
This output processing mode makes the output of photosensitive pixel 111 be converted into digital signal, processes in the chip of image processing module 50 with software mode.The noise of this output processing mode is less, and signal to noise ratio is higher.The more important thing is, the output of this processing mode complete reservation initial data of energy and each photosensitive pixel 111.Then repeatedly process to obtain multistage material image to this initial data, and many algorithms can be attempted in software different process is carried out to initial data.If directly merge to generate multistage material image to the output of photosensitive pixel 111 in circuit, circuit structure is more complicated, and can not retain the output information of each photosensitive pixel 111, therefore, first analog-to-digital conversion is adopted in embodiment of the present invention, then the mode of software process.
Refer to Figure 10, in some embodiments, imageing sensor 10 comprises the micro mirror array 23 be arranged on filter 13, and each micro mirror 231 is corresponding with a photosensitive pixel 111.
Concrete, each micro mirror 231 is corresponding with a photosensitive pixel 111, comprises size, position is corresponding.In some embodiments, the corresponding 2*2 of each filter unit 1311 photosensitive pixel 111 and 2*2 micro mirror 191.Along with technical development, in order to obtain the higher image of resolution, photosensitive pixel 111 on photosensitive pixel array gets more and more, arrange more and more intensive, single photosensitive pixel 111 is also more and more less, and its light is affected, and photosensitive part 1111 area of photosensitive pixel 111 is limited, light can be gathered photosensitive part 1111 by micro mirror 191, thus the light reception intensity of promotion feeling light pixel 111 is to improve image quality.
To sum up, the imaging device in embodiment of the present invention only needs single exposure to generate an image, then is split and combine to generate multistage material image, more multistage material image is synthesized merging image.This imaging device 100 does not need in image processing and tracking unit process the time waiting for multiexposure, multiple exposure, and image generation speeds is fast, has obviously saved the time.
In addition, the output of the corresponding multiple photosensitive pixel 111 of an image pixel of some multipole material image of generation, this merging can promote the signal to noise ratio of material image and then promote the image quality merging image.
The present invention also provides a kind of electronic installation 200 applying imaging device 100.In some embodiments, electronic installation 200 comprises imaging device 100.Therefore, electronic installation 200 has camera function and to generate color under low-light (level) complete, and signal to noise ratio is high, the merging image that definition is high.
Electronic installation 200 can be mobile phone.
In some embodiments, imaging device 100 can be the Front camera of mobile phone.Because Front camera is used for autodyning, and the definition of General Requirements to image of autodyning has requirement and not high to image resolution requirement, adopts the electronic installation 200 of present embodiment can meet this requirement.
Refer to Figure 11, in some embodiments, electronic installation 200 comprises the central processing unit 81 and external memory 83 that are connected with imaging device 100, and central processing unit 81 stores merging image for controlling external memory 83.
Like this, the merging image of generation can be stored, and checks, uses or shifts after convenient.External memory 83 comprises SM (SmartMedia) card and CF (CompactFlash) card etc.
Refer to Figure 12, in some embodiments, electronic installation 200 also comprises the central processing unit 81 and display unit 85 that are connected with imaging device 100, and central processing unit 81 shows merging image for controlling display unit 85.Like this, the image that electronic installation 200 is taken can be shown in display unit and check for user.Display unit comprises light-emitting diode display etc.
To sum up, adopt the electronic installation 200 of embodiment of the present invention, the image that the good details of contrast is good can be generated fast.
The part do not launched in formation method and electronic installation 200 in embodiment of the present invention, can join the imageing sensor 10 of above execution mode and the corresponding part of imaging device 100, launch no longer in detail at this.
In the description of this specification, specific features, structure, material or feature that the description of reference term " execution mode ", " some execution modes ", " exemplary embodiment ", " example ", " concrete example " or " some examples " etc. means to describe in conjunction with described execution mode or example are contained at least one execution mode of the present invention or example.In this manual, identical execution mode or example are not necessarily referred to the schematic representation of above-mentioned term.And the specific features of description, structure, material or feature can combine in an appropriate manner in any one or more execution mode or example.
Describe and can be understood in flow chart or in this any process otherwise described or method, represent and comprise one or more for realizing the module of the code of the executable instruction of the step of specific logical function or process, fragment or part, and the scope of the preferred embodiment of the present invention comprises other realization, wherein can not according to order that is shown or that discuss, comprise according to involved function by the mode while of basic or by contrary order, carry out n-back test, this should understand by embodiments of the invention person of ordinary skill in the field.
In flow charts represent or in this logic otherwise described and/or step, such as, the sequencing list of the executable instruction for realizing logic function can be considered to, may be embodied in any computer-readable medium, for instruction execution system, device or equipment (as computer based system, comprise the system of processor or other can from instruction execution system, device or equipment instruction fetch and perform the system of instruction) use, or to use in conjunction with these instruction execution systems, device or equipment.With regard to this specification, " computer-readable medium " can be anyly can to comprise, store, communicate, propagate or transmission procedure for instruction execution system, device or equipment or the device that uses in conjunction with these instruction execution systems, device or equipment.The example more specifically (non-exhaustive list) of computer-readable medium comprises following: the electrical connection section (electronic installation) with one or more wiring, portable computer diskette box (magnetic device), random access memory (RAM), read-only memory (ROM), erasablely edit read-only memory (EPROM or flash memory), fiber device, and portable optic disk read-only memory (CDROM).In addition, computer-readable medium can be even paper or other suitable media that can print described program thereon, because can such as by carrying out optical scanner to paper or other media, then carry out editing, decipher or carry out process with other suitable methods if desired and electronically obtain described program, be then stored in computer storage.
Should be appreciated that each several part of the present invention can realize with hardware, software, firmware or their combination.In the above-described embodiment, multiple step or method can with to store in memory and the software performed by suitable instruction execution system or firmware realize.Such as, if realized with hardware, the same in another embodiment, can realize by any one in following technology well known in the art or their combination: the discrete logic with the logic gates for realizing logic function to data-signal, there is the application-specific integrated circuit (ASIC) of suitable combinational logic gate circuit, programmable gate array (PGA), field programmable gate array (FPGA) etc.
Those skilled in the art are appreciated that realizing all or part of step that above-described embodiment method carries is that the hardware that can carry out instruction relevant by program completes, described program can be stored in a kind of computer-readable recording medium, this program perform time, step comprising embodiment of the method one or a combination set of.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, also can be that the independent physics of unit exists, also can be integrated in a module by two or more unit.Above-mentioned integrated module both can adopt the form of hardware to realize, and the form of software function module also can be adopted to realize.If described integrated module using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.
The above-mentioned storage medium mentioned can be read-only memory, disk or CD etc.
Although illustrate and describe embodiments of the invention above, be understandable that, above-described embodiment is exemplary, can not be interpreted as limitation of the present invention, and those of ordinary skill in the art can change above-described embodiment within the scope of the invention, revises, replace and modification.

Claims (21)

1. a formation method, is characterized in that, comprises the following steps:
There is provided imageing sensor, described imageing sensor comprises photosensitive pixel array and is arranged on the filter on described photosensitive pixel array, and described filter comprises filter unit array, and each described filter unit covers multiple described photosensitive pixel and forms and merges pixel;
Read the output of described photosensitive pixel array, and the output of the described photosensitive pixel of the different numbers of same described merging pixel be added with the pixel value obtaining the different gray scale of described merging pixel thus generate the material image of different gray scale; And
The described material image of different gray scale is carried out the merging image merging to obtain high dynamic range.
2. formation method as claimed in claim 1, it is characterized in that, described different gray scale comprises three described gray scales that brightness is 1:2:4 proportionate relationship.
3. formation method as claimed in claim 1, it is characterized in that, described filter unit array comprises Bayer array.
4. formation method as claimed in claim 1, is characterized in that, each described filter unit covers 2*2 described photosensitive pixel.
5. formation method as claimed in claim 4, it is characterized in that, described material image comprises three grades of material image that described merging pixel is the one-level material image of the output of a described photosensitive pixel, the secondary material image of the output of two described photosensitive pixels and the output of four described photosensitive pixels.
6. formation method as claimed in claim 4, it is characterized in that, described read step comprises further:
Gather the output of the described photosensitive pixel of row k and kth+1 row and stored in register, wherein k=2n-1, n are natural number, k+1 is less than or equal to total line number of described photosensitive pixel array; And
The output of extracting the described photosensitive pixel of described row k and kth+1 row from described register obtains the pixel value of the different gray scale of described merging pixel with process.
7. formation method as claimed in claim 1, it is characterized in that, each described photosensitive pixel is connected with an analog to digital converter respectively;
Described formation method comprises further:
The analog signal output that described photosensitive pixel exports is converted to digital signal to export; And
The described digital signal that the described photosensitive pixel of the different numbers of same described merging pixel exports is added the pixel value to obtain the different gray scale of described merging pixel.
8. an imaging device, is characterized in that, comprising:
Imageing sensor, described imageing sensor comprises:
Photosensitive pixel array; And
Be arranged at the filter on described photosensitive pixel array;
Described filter comprises filter unit array, and each described filter unit covers multiple described photosensitive pixel and forms and merges pixel;
Described imaging device also comprises image processing module;
Described image processing module for reading the output of described photosensitive pixel array, and is added with the pixel value obtaining the different gray scale of described merging pixel for the output of the described photosensitive pixel of the different numbers by same described merging pixel thus generates the material image of different gray scale.
Described image processing module is also for carrying out the described material image of different gray scale the merging image merging to obtain high dynamic range.
9. formation method as claimed in claim 8, it is characterized in that, described different gray scale comprises three described gray scales that brightness is 1:2:4 proportionate relationship.
10. imaging device as claimed in claim 8, it is characterized in that, described filter unit array comprises Bayer array.
11. imaging devices as claimed in claim 8, is characterized in that, each described filter unit covers 2*2 described photosensitive pixel.
12. imaging devices as claimed in claim 11, it is characterized in that, described material image comprises three grades of material image that described merging pixel is the one-level material image of the output of a described photosensitive pixel, the secondary material image of the output of two described photosensitive pixels and the output of four described photosensitive pixels.
13. imaging devices as claimed in claim 11, it is characterized in that, described imaging device comprises control module, and described control module exposes line by line for controlling described photosensitive pixel array.
14. imaging devices as claimed in claim 13, it is characterized in that, described imaging device also comprises register;
Described control module is used for the output of the described photosensitive pixel gathering the row k that completes of current exposure and kth+1 row successively and stored in described register, wherein k=2n-1, n are natural number, and k+1 is less than or equal to total line number of described photosensitive pixel array.
Described image processing module is used for the output of the described photosensitive pixel extracting described row k and kth+1 row from described register to process the pixel value obtaining the different gray scale of described merging pixel.
15. imaging devices as claimed in claim 8, it is characterized in that, described imageing sensor comprises analog to digital converter, and each described photosensitive pixel is connected with a described analog to digital converter respectively.
16. imaging devices as claimed in claim 8, it is characterized in that, described imageing sensor comprises the micro mirror array be arranged on described filter, and each described micro mirror is corresponding with a described photosensitive pixel.
17. 1 kinds of electronic installations, is characterized in that, comprise the imaging device as described in claim 8-16 any one.
18. electronic installations as claimed in claim 17, it is characterized in that, described electronic installation comprises mobile phone.
19. electronic installations as claimed in claim 18, it is characterized in that, described imaging device comprises the Front camera of described mobile phone.
20. electronic installations as claimed in claim 17, is characterized in that, described electronic installation comprises the central processing unit and external memory that are connected with described imaging device, and described central processing unit stores described merging image for controlling described external memory.
21. electronic installations as claimed in claim 17, is characterized in that, described electronic installation also comprises the central processing unit and display unit that are connected with described imaging device, and described central processing unit shows described merging image for controlling described display unit.
CN201510964386.2A 2015-12-18 2015-12-18 Imaging method, imaging device and electronic device Pending CN105578077A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510964386.2A CN105578077A (en) 2015-12-18 2015-12-18 Imaging method, imaging device and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510964386.2A CN105578077A (en) 2015-12-18 2015-12-18 Imaging method, imaging device and electronic device

Publications (1)

Publication Number Publication Date
CN105578077A true CN105578077A (en) 2016-05-11

Family

ID=55887683

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510964386.2A Pending CN105578077A (en) 2015-12-18 2015-12-18 Imaging method, imaging device and electronic device

Country Status (1)

Country Link
CN (1) CN105578077A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106506984A (en) * 2016-11-29 2017-03-15 广东欧珀移动通信有限公司 Image processing method and device, control method and device, imaging and electronic installation
WO2017101451A1 (en) * 2015-12-18 2017-06-22 广东欧珀移动通信有限公司 Imaging method, imaging device, and electronic device
CN111885312A (en) * 2020-07-27 2020-11-03 展讯通信(上海)有限公司 HDR image imaging method, system, electronic device and storage medium
CN114338988A (en) * 2021-12-29 2022-04-12 Oppo广东移动通信有限公司 Image generation method and device, electronic equipment and computer-readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070206241A1 (en) * 2006-03-06 2007-09-06 Micron Technology, Inc. Fused multi-array color image sensor
CN101176338A (en) * 2005-06-17 2008-05-07 卡西欧计算机株式会社 Image pick-up apparatus
CN102460700A (en) * 2009-06-23 2012-05-16 诺基亚公司 Color filters for sub-diffraction limit sensors
CN103685992A (en) * 2013-12-31 2014-03-26 上海集成电路研发中心有限公司 Method for generating high dynamic range image and image sensor

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101176338A (en) * 2005-06-17 2008-05-07 卡西欧计算机株式会社 Image pick-up apparatus
US20070206241A1 (en) * 2006-03-06 2007-09-06 Micron Technology, Inc. Fused multi-array color image sensor
CN102460700A (en) * 2009-06-23 2012-05-16 诺基亚公司 Color filters for sub-diffraction limit sensors
CN103685992A (en) * 2013-12-31 2014-03-26 上海集成电路研发中心有限公司 Method for generating high dynamic range image and image sensor

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017101451A1 (en) * 2015-12-18 2017-06-22 广东欧珀移动通信有限公司 Imaging method, imaging device, and electronic device
US10257447B2 (en) 2015-12-18 2019-04-09 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Imaging method, imaging device, and electronic device
CN106506984A (en) * 2016-11-29 2017-03-15 广东欧珀移动通信有限公司 Image processing method and device, control method and device, imaging and electronic installation
CN106506984B (en) * 2016-11-29 2019-05-14 Oppo广东移动通信有限公司 Image processing method and device, control method and device, imaging and electronic device
CN111885312A (en) * 2020-07-27 2020-11-03 展讯通信(上海)有限公司 HDR image imaging method, system, electronic device and storage medium
CN111885312B (en) * 2020-07-27 2021-07-09 展讯通信(上海)有限公司 HDR image imaging method, system, electronic device and storage medium
CN114338988A (en) * 2021-12-29 2022-04-12 Oppo广东移动通信有限公司 Image generation method and device, electronic equipment and computer-readable storage medium

Similar Documents

Publication Publication Date Title
CN105578076A (en) Imaging method, imaging device and electronic device
CN105578072A (en) Imaging method, imaging device and electronic device
TWI662842B (en) Image sensor, pixel information output method of the image sensor, phase focusing method, imaging device, and mobile device
CN105592303B (en) imaging method, imaging device and electronic device
CN105611124B (en) Imaging sensor, imaging method, imaging device and terminal
CN105430359B (en) Imaging method, imaging sensor, imaging device and electronic device
CN105430361A (en) Imaging method, image sensor, imaging device and electronic device
CN105578075A (en) Method for generating high-dynamic range image, photographing device and terminal
CN105472266A (en) High dynamic range image generation method, photographing device and terminal
CN105578080A (en) Imaging method, image sensor, imaging device and electronic device
CN105578067B (en) image generating method, device and terminal device
CN105611123B (en) imaging method, image sensor, imaging device and electronic device
CN105578078A (en) Image sensor, imaging device, mobile terminal and imaging method
CN105516697A (en) Image sensor, imaging device, mobile terminal and imaging method
CN105578066B (en) Imaging method, imaging device and electronic installation
CN105430362B (en) Imaging method, imaging device and electronic installation
CN105611257B (en) Imaging method, imaging sensor, imaging device and electronic device
CN105578077A (en) Imaging method, imaging device and electronic device
CN105430363A (en) Imaging method, imaging device and electronic device
CN105578081A (en) Imaging method, image sensor, imaging device and electronic device
CN105578065A (en) Method for generating high-dynamic range image, photographing device and terminal
CN105430360A (en) Imaging method, image sensor, imaging device and electronic device
CN105635702A (en) Imaging method, image sensor, imaging device and electronic device
CN105554485A (en) Imaging method, imaging device and electronic device
CN104010134B (en) For forming the system and method with wide dynamic range

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160511