CN103297701A - Imaging method and imaging device - Google Patents
Imaging method and imaging device Download PDFInfo
- Publication number
- CN103297701A CN103297701A CN2012100459511A CN201210045951A CN103297701A CN 103297701 A CN103297701 A CN 103297701A CN 2012100459511 A CN2012100459511 A CN 2012100459511A CN 201210045951 A CN201210045951 A CN 201210045951A CN 103297701 A CN103297701 A CN 103297701A
- Authority
- CN
- China
- Prior art keywords
- image
- pixel
- time
- voltage
- output voltage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 56
- 238000000034 method Methods 0.000 claims abstract description 40
- 230000003287 optical effect Effects 0.000 claims abstract description 24
- 230000033001 locomotion Effects 0.000 claims description 14
- 230000004044 response Effects 0.000 claims description 14
- 230000015572 biosynthetic process Effects 0.000 claims description 13
- 238000000926 separation method Methods 0.000 claims description 5
- 230000003321 amplification Effects 0.000 claims description 3
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 18
- 239000003086 colorant Substances 0.000 description 8
- 230000006698 induction Effects 0.000 description 7
- 238000005070 sampling Methods 0.000 description 7
- 108010076504 Protein Sorting Signals Proteins 0.000 description 5
- 238000009825 accumulation Methods 0.000 description 5
- 238000009792 diffusion process Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000009977 dual effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000007115 recruitment Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- IXSZQYVWNJNRAL-UHFFFAOYSA-N etoxazole Chemical compound CCOC1=CC(C(C)(C)C)=CC=C1C1N=C(C=2C(=CC=CC=2F)F)OC1 IXSZQYVWNJNRAL-UHFFFAOYSA-N 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
Abstract
The invention relates to an imaging method and an imaging device. According to the imaging method, a whole pixel array is exposed at different time or the pixel array is divided into a plurality of portions, the portions are exposed at different time, images obtained at different exposing time are combined, and therefore an optical dynamic range of the imaging device is enlarged. Correspondingly, the invention provides the imaging method and a method for conducting HDR image combination.
Description
Technical field
The present invention relates to imaging field, relate to a kind of formation method and imaging device especially.
Background technology
Requirement for picture quality constantly improves all the time.Along with the degree of integration of pixel of imaging device is more and more higher, the resolution of image no longer has been the of paramount importance problem of imaging field, and image expressive force has in other respects obtained more concern.Particularly do not obtain the striving direction that high-quality image becomes present imaging field R﹠D work especially by baroque hardware.For example, obtain high-quality photo at the portable imaging device as the card form camera.
Imaging device generally has pel array.Each pixel in the pel array comprises sensor devices, for example photodiode, optical switch etc.Each sensor devices receives the ability difference of light.The difference of this ability is reflected to and makes imaging device have different optical dynamic ranges on the imaging device, and namely the imaging device can receive the scope of light.When the optical dynamic range of imaging device during less than the variation of ambient light intensity, extraneous scene just can't be reflected in the image that obtains fully.Wish in this area to have a kind of easy mode to address this problem always.
Summary of the invention
At problems of the prior art, according to an aspect of the present invention, a kind of formation method is proposed, comprising: in the very first time, the pixel in the pel array is exposed, draw first image; In second time, the described pixel in the described pel array is exposed, draw second image, wherein, the very first time was different from for second time; And make up first image and second image.
According to another aspect of the present invention, propose a kind of formation method, comprising: in the very first time, the pixel in the first pixel group in the pel array is exposed, draw first image; In second time, the pixel in the second pixel group in the described pel array is exposed, draw second image, wherein, the very first time was different from for second time; Read described first image and described second image simultaneously; And make up described first image and described second image.
According to another aspect of the present invention, propose a kind of imaging device, comprising: pel array, it comprises a plurality of pixels that are arranged in rows and columns; Control circuit is controlled described pel array; Wherein, described pel array comprises the first pixel group, and it exposed in the very first time, drew first image; Described pel array comprises the second pixel group, and it exposed in second time, draws second image, and wherein, the very first time was different from for second time; Wherein, described control circuit further reads described first image and described second image simultaneously; And image processor, it makes up described first image and described second image.
Description of drawings
Fig. 1 has represented a kind of schematic diagram of structure of imaging device;
Fig. 2 is the schematic diagram of having represented a kind of representative pixels structure;
Fig. 3 is the flow chart of a kind of formation method according to an embodiment of the invention;
Fig. 4 is the flow chart of a kind of formation method according to another embodiment of the invention;
Fig. 5 is the schematic diagram of pel array according to an embodiment of the invention;
Fig. 6 is according to one embodiment of present invention, the sequential chart of pel array pickup image;
The schematic diagram of Fig. 7 pel array according to another embodiment of the invention;
Fig. 8 is according to another embodiment of the invention, the sequential chart of pel array pickup image;
The schematic diagram of Fig. 9 pel array according to another embodiment of the invention;
Figure 10 is according to another embodiment of the invention, the sequential chart of pel array pickup image;
Figure 11 is according to one embodiment of present invention, the schematic diagram of the HDR method of the image of combination double exposure;
Figure 12 is according to one embodiment of present invention, makes up the schematic diagram of the HDR method of the image that exposes for four times;
Figure 13 is the schematic diagram of optical response plot separately of each time for exposure of T1, T2, T3 and T4;
Figure 14 be finished to the induction curve behind the composition algorithm of four time for exposure and the schematic diagram of SNR curve;
Figure 15 is to the schematic diagram of the influence of SNR curve when adopting different mask coefficients;
Figure 16 adopts to expose and double expose the influence of SNR for four times;
Figure 17 is the schematic diagram of system according to an embodiment of the invention.
Embodiment
In the following detailed description, can be referring to each Figure of description of the specific embodiment that is used for illustrating the application as the application's part.In the accompanying drawings, similar Reference numeral is described substantially similarly assembly in difference is graphic.Each specific embodiment of the application has carried out enough detailed description following, makes the those of ordinary skill that possesses this area relevant knowledge and technology can implement the application's technical scheme.Should be appreciated that and to utilize other embodiment or the application's embodiment is carried out structure, logic or electrical change.
The electronic component that term " pixel " word refers to contain sensor devices or is used for electromagnetic signal is converted to other devices of the signal of telecommunication.For illustrative purposes, Fig. 1 has described a kind of representative imaging device, and it comprises a pel array.Describe a kind of representational pixel among Fig. 2, and all pixels in the pel array will be made in a similar fashion all usually.
Fig. 1 has represented a kind of schematic diagram of structure of imaging device.Imaging device 100 shown in Figure 1, for example the cmos imaging device comprises pel array 110.Pel array 110 comprises a plurality of pixels that are arranged in rows and columns.Each row pixel selects line all to connect simultaneously by row in the pel array 110, and each row pixel is respectively by the output of column selection line options ground.Each pixel has row address and column address.The row address of pixel is selected line corresponding to the row that is driven by row decoding and drive circuit 120, and the column address of pixel is selected line corresponding to the row that is driven by row decoding and drive circuit 130.Control circuit 140 control row decodings and drive circuit 120 and row decoding and drive circuit 130 are selectively to read the pixel output signal of row and column correspondence suitable in the pel array.
Pixel output signal comprises pixel reset signal V
RstWith pixel image signal V
SigPixel reset signal V
RstThe signal that obtains from floating diffusion region when representing the floating diffusion region of reseting sensor devices (as photodiode).Pixel image signal V
SigRepresentative is transferred to the signal that obtains behind the floating diffusion region by the electric charge of the representative image that sensor devices obtains.Pixel reset signal V
RstWith pixel image signal V
SigRead by row sampling and holding circuit 150, and subtract each other through differential amplifier 160.The V that differential amplifier 160 is exported
Rst-V
SigSignal is namely represented the picture signal that sensor devices obtains.Be converted to digital signal behind this picture signal process analog to digital converter ADC170, be further processed by image processor 180 then, to export digitized image.Image processor 180 both can be independent processor, also can be central processing unit or other processors of system.
Fig. 2 is the schematic diagram of having represented a kind of representative pixels structure.The pixel 200 of Fig. 2 comprises photodiode 202, and transfering transistor 204 is reseted transistor 206, and source electrode is followed transistor 208 and row selecting transistor 210.Photodiode 202 is connected to the source electrode of transfering transistor 204.Transfering transistor 204 is controlled by signal TX.When TX controlled transfering transistor to " on " state, the electric charge that accumulates in the photodiode was transferred in the storage area 21.Simultaneously, photodiode 202 is reset.The grid that source electrode is followed transistor 208 is connected to storage area 21.Source electrode is followed transistor 208 and is amplified the signal that receives from storage area 21.Reset transistor 206 source electrodes and also be connected to storage area 21.Reset transistor 206 by signal RST control, be used for reseting storage area 21.Pixel 200 also further comprises by row selecting transistor 210.Row selecting transistor 210 is followed transistor 208 amplifying signals with source electrode and is outputed to output line V by signal RowSel control
Out
Adopt the double exposure of different exposure time can increase the optical dynamic range of imaging device for same image.If the time for exposure long enough, part darker in the image can be reflected in the image of final acquisition fully; But if the intensity variation of image has surpassed the dynamic range of imaging device, to be reflected on the image of final acquisition will all be white to brighter part in the image.That is to say that this part the intensity variation information that surpasses the imaging device photoperceptivity will be lost.If the time for exposure is enough short, the strongest luminous intensity does not also surpass the photoperceptivity of imaging device in the image, and the intensity variation information of brighter part will keep in the image; Yet, because the time for exposure is too short, lacking enough samplings, the information than dark-part in the image will be lost.Employing different exposure time of the present invention increases the method for imaging device optical dynamic range and has just taken all factors into consideration above-mentioned two kinds of situations.For same image, adopt the different time for exposure to double expose; Then in the subsequent processes of image, thereby the result who takes all factors into consideration double exposure is reflected in the image information that double exposure obtains in the image of final acquisition.Because the final image that obtains had both kept the information of dividing than highlights in the image, also kept in the image information than dark-part, so image has reflected wider intensity variation.Thus, under the prerequisite that does not increase any hardware costs, improved the optical dynamic range of imaging device.
Can adopt dual mode to finish double exposure.First kind of mode is to adopt the short time exposure earlier for entire pixel array, reads entire image then; Adopt time exposure again, read entire image then; Two images that will draw again make up and draw final image.This mode implements the simplest, does not need to carry out the complicated hardware change, even can be finished by software control fully.The second way is to carry out the exposure of subregion length for entire pixel array.For example, one part of pixel in the pel array is begun time exposure, directly begin the short time exposure to another part pixel in the pel array after a period of time, the double exposure imaging results of reading simultaneously, and twice imaging results made up, thereby draw final image.Adopt earlier mode that the short time exposure adopts time exposure then similarly, repeat no more.Do not read double exposure result's mode simultaneously similarly yet, do not giving unnecessary details.
In conjunction with following examples of the present invention, describe in detail with regard to this dual mode respectively.
Fig. 3 is the flow chart of a kind of formation method according to an embodiment of the invention.As shown in Figure 3, formation method 300 adopts the imaging device pickup image that comprises pel array.This imaging device has predetermined optical dynamic range.In step 310, judge whether that the intensity variation of image to be absorbed has surpassed the optical dynamic range of imaging device, if surpass, then start high optical dynamic range pattern, otherwise adopt the normal mode pickup image.Existing imaging device, for example digital camera much all has a display screen, to show the camera lens target pointed of imaging device in real time to the user.Can resolution image whether cross brightly or dark excessively by realtime graphic, whether reflected and wished the details paid close attention to, thereby can directly differentiate the high optical dynamic range pattern of whether should enabling.The display screen that should be noted that imaging device only is illustration purpose.Imaging device of the present invention or formation method also do not require and comprise display screen.
Can also adopt several different methods to judge whether the luminous intensity of image to be absorbed exceeds the optical dynamic range of imaging device.For example, can be by the mean flow rate of computed image, contrast, perhaps the relation in region-of-interest brightness or contrast and other zones is judged.For example, generally speaking, image all can have a region-of-interest (ROI, Region Of Interest).The image of picked-up should reflect the details of region-of-interest as far as possible.Under the situation that the details of region-of-interest is preferably handled, judge whether other zones of image are excessively bright or dark excessively, thereby can determine whether intensity variation exceeds the optical dynamic range of imaging device.
In step 320, judge whether further whether image to be absorbed comprises the scenery that is among the motion.The main cause of carrying out this judgement is, if comprised motion scenery in the image, owing to be to have read behind short exposure in whole pel arrays all that pixels just begin long the exposure, the scenery that time between the two may cause moving is being in the diverse location in the image in the exposure for the second time, cause thus in the image of final combination, occur superimposed image around the motion scenery, form " ghost ".Because " ghost " is difficult in follow-up image combination and the processing procedure and eliminates, so need judge in advance.
Several different methods can be used for judging the speed whether scenery moves and move.For example, can use for reference the concept of the motion vector in the video coding or directly relatively in the image of different time the position of same scene judge.Different with the video coding, judge scenery need not more continuous different frame image or contiguous image when whether moving.Scenery and the corresponding speed that whether has comprised motion in the image is judged in the position that can relatively have same scene in two two field pictures of a predetermined time interval.If the movement velocity of scenery surpasses predetermined threshold value, namely can reach a conclusion, may " ghost " appear in image, and then point out the user not adopt the high optical dynamic range pattern of this kind or prevention user to operate the imaging device pickup image.The mode whether another kind of interpretation " ghost " occur is that the position of the characteristic area of the image that generates by double exposure back before and after relatively judges whether to have occurred " ghost ".Produce characteristic area by artificial appointment or automatic mode (as smiling face's identification).Whether the position that relatively generates characteristic area in the image after the double exposure has taken place to change judges whether to have comprised motion scenery and corresponding movement velocity.Be enough to produce " ghost " if comprised the scenery of motion and movement velocity in the image to be absorbed really, then must employing can not produce the high photokinesis pattern pattern of " ghost " " anti-ghost ".This will describe in detail in follow-up embodiment.
In step 330, the entire pixel array of imaging device was exposed in the very first time.According to one embodiment of present invention, the time for exposure of the very first time is shorter, for example: 10 milliseconds.In step 340, read entire pixel array line by line, draw first image that in the very first time, exposes.Because this process and general image capture process do not have the difference of essence, so detailed description no longer herein.
In step 350, the entire pixel array of imaging device was exposed in second time.According to one embodiment of present invention, the time for exposure of second time is long, for example: 40 milliseconds.In step 360, read entire pixel array line by line, draw second image that in second time, exposes.Because this process and general image capture process do not have the difference of essence, so detailed description no longer herein.
In step 370, first image and first image are combined to draw final image.Both comprise the information that treating in the pickup image of comprising in first image divided than highlights in the final image, also comprised the information than dark-part treated in the pickup image that comprises in second image.Thus, obtained the optical dynamic range bigger than imaging device itself in the final image.When the combination of image, can be in different ways.For example, the simplest respective pixel is averaged as the result of this pixel in the final image.In order to obtain the compound mode that better contrast, sharpening degree or color expressive force can adopt other.
Fig. 4 is the flow chart of a kind of formation method according to another embodiment of the invention.As shown in Figure 4, formation method 400 adopts the imaging device pickup image that comprises pel array.This imaging device has predetermined optical dynamic range.As mentioned above, a problem facing of embodiment shown in Figure 3 is " ghost " can occur for motion scenery.The main cause that " ghost " occur is that entire pixel array has been carried out 2 times to be read, and the time interval between reading for 2 times equals the time of a frame, for example about 30 milliseconds.This time interval is enough to allow the position of motion scenery in image occur changing.Embodiment shown in Figure 4 has adopted the mode that entire pixel array is only once read to solve this problem.Entire pixel array has been divided into 2 parts, adopt the different time for exposure at different parts, and then the result that will obtain makes up to draw final image.In the embodiment shown in fig. 4, sacrifice the resolution of image and obtained higher optical dynamic range.
In step 410, judge whether that the intensity variation of image to be absorbed has surpassed the optical dynamic range of imaging device, if surpass, then start high optical dynamic range pattern, otherwise adopt the normal mode pickup image.Step 310 among step 410 and Fig. 3 embodiment is similar, is not described in detail in this.Should be noted that no matter be to Fig. 3 or the embodiment of Fig. 4, judging whether to start high optical dynamic range pattern all is an optional step.
In step 420, in the very first time to first group's pixel exposure in the entire pixel array.First group's pixel is the one part of pixel in the entire pixel array.According to one embodiment of present invention, first group's pixel is evenly distributed in the entire pixel array as far as possible, to reflect the image that is ingested as far as possible.According to one embodiment of present invention, the time for exposure of the very first time is relatively long, for example: 40 milliseconds.In step 430, in second time to entire pixel array in second group's pixel exposure.Second group's pixel is the one part of pixel in the entire pixel array.According to one embodiment of present invention, second group's pixel is evenly distributed in the entire pixel array as far as possible, to reflect the image that is ingested as far as possible.According to one embodiment of present invention, the time for exposure of second time is relatively to lack, for example: 10 milliseconds.
In step 440, the whole pixels in the entire pixel array all are read out.The image that first group's pixel and second group's pixel obtain is combined to draw final image.What both comprised in the final image that first group's pixel obtains treats in the pickup image than the information of dark-part, the information that treating of having comprised also that second group's pixel obtains divided than highlights in the pickup image.Thus, obtained the optical dynamic range bigger than imaging device itself in the final image.And first group's pixel and the time interval between second group's pixel exposure time are very short, probably equal the time that delegation reads, and for example therefore 10 microseconds can not produce " ghost " in final image.
In the second way, entire pixel array has been divided into 2 or more part, and how dividing pel array and how reducing owing to the division pel array brings edge effect and reduces signal to noise ratio all is the problem that needs consideration.
Fig. 5 is the schematic diagram of pel array according to an embodiment of the invention.As shown in Figure 5, pel array 500 is colorful array of pixels, and R, G, Gb and B represent different colors respectively.The pixel of white represents the pixel that the time for exposure is T1 respectively as R1, G1, Gb1 and B1; And the pixel of oblique line represents the pixel that the time for exposure is T2 respectively as R2, G2, Gb2 and B2.T1 is different from T2.Generally speaking, the pixel 501,502 of one group of different colours, 503 and 504 represents the different colours value of a pixel in the colorful array of pixels among Fig. 5.Therefore, they should have the identical time for exposure.As can be seen from Figure 5, first group's pixel with different exposure time, as R1, G1, Gb1 and B1 and second group's pixel, as R2, G2, Gb2 and B2 by two between-line spacings be distributed in the entire pixel array, that is to say that first group's pixel and second group's pixel separation, two line interlacings distribute.
Fig. 6 is according to one embodiment of present invention, the sequential chart of pel array pickup image.Sequential chart shown in Figure 6 can be applied among the embodiment shown in Figure 5.In pel array 500, Tx, RST and RowSel signal are by being shared with delegation's pixel.Therefore, with delegation's pixel stored charge in the identical time.
R1/G1 for pixel 501 and 502 places is capable, at first provides a pulse to select this row on the RowSel line.Provide a pulse to reset storage area at the RST line, for example the storage area among Fig. 2 21.Next, provide a pulse to come the sampling of the storage area after reseting is produced V at the SHR line
RstSignal.The Tx line provide a pulse signal R1/G1 is capable on electric charge on the sensor devices (as the photodiode 202 among Fig. 2) of each R1 and G1 pixel transfer on its storage area separately.Provide a pulse signal at the SHS line then, on sampling R1/G1 is capable on the storage area of each R1 and G1 pixel charge stored to produce V
SigSignal.
R2/G2 for pixel 505 places is capable, and is capable similar with R1/G1, at first provides a pulse to select this row on the RowSel line.Provide a pulse to reset storage area at the RST line, produce V
RstSignal.Provide a pulse signal electric charge to be transferred on its storage area separately at the Tx line, provide a pulse signal at the SHS line then, on sampling R2/G2 is capable on the storage area of each pixel charge stored to produce V
SigSignal.Gb2/B2 for pixel 506 places is capable, because it has the identical time for exposure with R2/G2 is capable, so Gb2/B2 is capable can share the capable control signal of R2/G2.
As can be seen, though R1/G1 and Gb1/B1 pixel capable and on R2/G2 and Gb2/B2 are capable belongs to different pixel group of time for exposure, they are to be sampled simultaneously and to produce picture signal.
Next, when being high, provide a pulse to reset the sensor devices of R1/G1 and Gb1/B1 capable separately pixel at R1/G1 and the capable Tx line of Gb1/B1 at the RST line.In the different moment, when same RST line is high, provide another pulse to reset the sensor devices of the capable pixel separately of R2/G2 and Gb2/B2 at R2/G2 and the capable Tx line of Gb2/B2.Photo-sensitive cell begins stored charge after reseting.Because the capable pixel with on R2/G2 and Gb2/B2 are capable of R1/G1 and Gb1/B1 begins stored charge from the different moment; And as previously mentioned, they almost are sampled simultaneously, and therefore, the R1/G1 that belongs to first group and Gb1/B1 are capable with the R2/G2 that belongs to second group with Gb2/B2 is capable has different charge accumulation times, thereby have had the different time for exposure.
Gb1/B1 for pixel 503 and 504 places is capable, because it has the identical time for exposure with R1/G1 is capable, so Gb1/B1 is capable can adopt the capable identical control signal with R1/G1.
The schematic diagram of Fig. 7 pel array according to another embodiment of the invention.As shown in Figure 7, pel array 700 is colorful array of pixels, and R, G, Gb and B represent different colors respectively.The pixel of white represents the pixel that the time for exposure is T1 respectively as R1, G1, Gb1 and B1; And the pixel of oblique line represents the pixel that the time for exposure is T2 respectively as R2, G2, Gb2 and B2.T1 is different from T2.Generally speaking, the pixel 701,702 of one group of different colours, 703 and 704 represents the different colours value of a pixel in the final image in the colorful array of pixels among Fig. 7.Therefore, they should have the identical time for exposure.As can be seen from Figure 7, for first group's pixel with different exposure time and second group's pixel, two line interlacings are arranged at interval on both direction.That is to say that do as a wholely if will belong to same group different colours pixel, each group pixel is all adjacent with another group pixel with different exposure time.
Among the embodiment shown in Figure 7, owing to need have the different time for exposure with delegation's pixel, thus can not share the Tx signal with delegation's pixel, but they still can share RST and RowSel signal.Therefore, must provide 2 groups of Tx signals to transmit different signals for each row pixel.By the control of Tx signal, can be so that the pixel on the same row has the different time for exposure.The tangible advantage that has that the pel array packet mode of embodiment shown in Figure 7 is compared to the packet mode of Fig. 5 is to reduce the edge sawtooth effect of composograph.
Fig. 8 is according to one embodiment of present invention, the sequential chart of pel array pickup image.Sequential chart shown in Figure 8 can be applied among the embodiment shown in Figure 7.
With reference to the first half of figure 8, capable for the R1/G1/R2/G2 at pixel 701,702,705 and 706 places, at first provide a pulse to select this row at the RowSel line.The RST line provide a pulse reset R1/G1/R2/G2 capable on the storage area of each pixel.Next, provide a pulse to come the sampling of the storage area after each pixel reset is produced V at the SHR line
RstSignal.
Next, provide the one part of pixel of a pulse signal on R1/G1/R2/G2 is capable at the TxA line, for example comprise that the electric charge on the sensor devices of white pixel R1/G1 of pixel 701 and 702 is transferred on its storage area separately.Meanwhile, provide another part pixel of a pulse signal on R1/G1/R2/G2 is capable at the TxB line, for example comprise that the electric charge on the sensor devices of oblique line pixel R2/G2 of pixel 703 and 704 is transferred on its storage area separately.
Provide a pulse signal at the SHS line, on sampling R1/G1/R2/G2 is capable on the storage area of each pixel charge stored to produce V
SigSignal.As can be seen, though the pixel on capable for R1/G1/R2/G2 belongs to different pixel group of time for exposure, they are to be sampled simultaneously and to produce picture signal.
Next, when being high, provide a pulse to reset the sensor devices of the white pixel R1/G1 that comprise pixel 701 and 702 at the capable TxA line of R1/G1/R2/G2 at the RST line.In the different moment, when same RST line is high, provide another pulse to reset the sensor devices of the oblique line pixel R2/G2 that comprises pixel 703 and 704 at the capable TxB line of R1/G1/R2/G2.Photo-sensitive cell begins stored charge after reseting.Because white pixel R1/G1 and oblique line pixel R2/G2 begin stored charge from the different moment; And as previously mentioned, they almost are sampled simultaneously, and therefore, the white pixel R1/G1 that belongs to first group has different charge accumulation times with the oblique line pixel R2/G2 that belongs to second group, thereby has had the different time for exposure.
Gb1/B1/Gb2/B2 for pixel 703,704,707 and 708 places is capable, and owing to it has the identical time for exposure with R1/G1/R2/G2 is capable, so the two can adopt identical control signal.
For the 3rd in the pel array shown in Figure 7 row, i.e. the 4th row of capable and this pel array of R2/G2/R1/G1, namely Gb2/B2/Gb1/B1 is capable, and its signal sequence is with reference to the latter half among the figure 8.As can be seen from the figure, the signal sequence that R2/G2/R1/G1 is capable and Gb2/B2/Gb1/B1 is capable and R1/G1/R2/G2 described above signal sequence capable and that Gb1/B1/Gb2/B2 is capable is very similar.The difference of the two is: capable and Gb2/B2/Gb1/B1 is capable for R2/G2/R1/G1, reset the TxA signal of R2/G2 after reseting the TxB signal of R1/G1.Thus, R2/G2 and Gb2/B2 have short charge accumulation time equally, and R1/G1 and Gb1/B1 have long charge accumulation time.Other parts are identical with Fig. 8 the first half, repeat no more here.
Owing to adopted the mode of multiexposure, multiple exposure, how to reduce in exposure conversion place influence on signal-to-noise ratio (SNR), improving the high-dynamics image quality is that needs are considered problem.The present invention proposes a kind of exposure frequency that passes through to increase, for example 4 exposures, and a kind of specific HDR (High Dynamic Range) algorithm solves this problem.
The schematic diagram of Fig. 9 pel array according to another embodiment of the invention.As shown in Figure 9, pel array 900 is colorful array of pixels, and R, G, Gb and B represent different colors respectively.The pixel of white represents the pixel that the time for exposure is T1 respectively as R1, G1, Gb1 and B1; The pixel of oblique line represents the pixel that the time for exposure is T2 respectively as R2, G2, Gb2 and B2; The pixel of grid line represents the pixel that the time for exposure is T3 respectively as R3, G3, Gb3 and B3; And the pixel of vertical line represents the pixel that the time for exposure is T4 respectively as R4, G4, Gb4 and B4.T 1, T2, T3 and T4 have nothing in common with each other.As can be seen from Figure 9, for first group's pixel with different exposure time, second group's pixel, the 3rd group's pixel and four group group pixel, arrange by two line interlacings.
Among the embodiment shown in Figure 9, owing to need have the different time for exposure with delegation's pixel, thus can not share the Tx signal with delegation's pixel, but they still can share RST and RowSel signal.Therefore, must provide 2 groups of Tx signals to transmit different signals for each row pixel.By the control of Tx signal, can be so that the pixel on the same row has the different time for exposure.
Figure 10 is according to one embodiment of present invention, the sequential chart of pel array pickup image.Sequential chart shown in Figure 10 can be applied among the embodiment shown in Figure 9.The first half of Figure 10 is the signal sequence that first row and second row adopt; The latter half of Figure 10 is the signal sequence that the third line and fourth line adopt.Wherein, corresponding to reseting 1, reset 2, reseting 3 and reset 4 TxA and the signal on the TxB has nothing in common with each other, make the pixel of four groups have different electric charge accumulation zero-times respectively thus.Because these pixels almost are sampled at the same time, so the pixel of four groups has just had the different time for exposure.
The division of 2 Exposure modes that adopt in above-described embodiment and 4 Exposure modes and pel array, the present invention can also adopt the multiexposure, multiple exposure mode greater than 2 times, perhaps adopts other pel array dividing mode.For example, the present invention can use 9 different time for exposure.This is fully feasible for the very high pel array of resolution.In addition, to four times the exposure, T1, T2, T3, T4 can be arranged at in delegation's pixel, and use TxA respectively, TxB, TxC, TxD control the different time for exposure; And the division of pel array also can be adopted the pixel arrangement mode of 3x3.
Figure 11 is according to one embodiment of present invention, the HDR method of the image of combination double exposure, and wherein first pixel has the different time for exposure with second pixel, and reads first pixel and draw first output voltage, reads second pixel and draws second output voltage.In the present embodiment, first and second output voltages that first pixel and second pixel are drawn make up to draw final output voltage.As shown in figure 11, in step 1120, at first read first output voltage V 1 of first pixel.First output voltage V 1 that reads can remain in the memory 1.In step 1140, first output voltage V 1 is amplified predetermined multiple.This predetermined multiple is the ratio of second pixel and the first pixel exposure time.For example, if the time for exposure of second pixel is 2 times of the first pixel exposure time, this multiplication factor is exactly 2.Multiplication factor also can be less than 1.In step 1150, determine whether first output voltage V 1 through amplifying surpasses a predetermined threshold value.This predetermined threshold value is less than or equal to saturation voltage.Usually multiply by a mask coefficient (mask) by saturation voltage determines.The mask coefficient is to be less than or equal to 1 mark, for example 1/2,3/4, or 1.In step 1160,, first output voltage V 1 through amplifying reads and keeps second output voltage V 2 of second pixel if greater than threshold value, then giving up first output voltage V 1.In step 1170,, first output voltage V 1 through amplifying keeps first output voltage V 1 of first pixel if less than threshold value, then giving up second output voltage V 2 of second pixel.In step 1180, the voltage that output keeps is as the final voltage after making up.
Figure 12 is according to one embodiment of present invention, make up the HDR method of the image of four exposures, wherein first pixel, second pixel, the 3rd pixel and the 4th pixel have the different time for exposure, and read first pixel and draw first output voltage, read second pixel and draw second output voltage, read the 3rd pixel and draw the 3rd output voltage, and read the 4th pixel and draw the 4th output voltage.In the present embodiment, at first with first pixel and second combination of pixels, simultaneously with the 3rd pixel and the 4th combination of pixels, and then the result after the result after first and second combination of pixels and third and fourth combination of pixels made up to draw final output voltage.The mode of each combination is all similar with the described mode of the embodiment of Figure 11.
As shown in figure 12, in step 1202, at first read first output voltage V 1 of first pixel.First output voltage V 1 that reads can remain in the memory 1.In step 1204, first output voltage V 1 is amplified predetermined multiple.This predetermined multiple is the ratio of second pixel and the first pixel exposure time.In step 1205, determine whether first output voltage V 1 through amplifying surpasses a predetermined threshold value.This predetermined threshold value is less than or equal to saturation voltage.Usually multiply by a mask coefficient (mask) by saturation voltage determines.The mask coefficient is to be less than or equal to 1 mark, for example 1/2,3/4, or 1.In step 1206,, first output voltage V 1 through amplifying reads and keeps second output voltage V 2 of second pixel if greater than threshold value, then giving up first output voltage V 1.In step 1207,, first output voltage V 1 through amplifying keeps first output voltage V 1 of first pixel if less than threshold value, then giving up second output voltage V 2 of second pixel.In step 1208, the result of the voltage that output keeps after as combination, i.e. first voltage as a result.
In step 1220, read the 3rd output voltage V 3 of the 3rd pixel.First output voltage V 3 that reads can remain in the memory 2.In step 1240, first output voltage V 3 is amplified predetermined multiple.This predetermined multiple is the ratio of the 4th pixel and the 3rd pixel exposure time.In step 1250, determine whether the 3rd output voltage V 3 through amplifying surpasses predetermined threshold value.This predetermined threshold value is less than or equal to saturation voltage.Usually multiply by mask coefficient (mask) by saturation voltage determines.The mask coefficient is to be less than or equal to 1 mark, for example 1/2,3/4, or 1.In step 1260,, the 3rd output voltage V 3 through amplifying reads and keeps the 4th output voltage V 4 of the 4th pixel if greater than threshold value, then giving up the 3rd output voltage V 3.In step 1270,, the 3rd output voltage V 3 through amplifying keeps the 3rd output voltage V 3 of the 3rd pixel if less than threshold value, then giving up the 4th output voltage V 4 of the 4th pixel.In step 1280, the result of the voltage that output keeps after as combination, i.e. second voltage as a result.
Next, make up first voltage and second voltage as a result as a result.In step 1290, the multiple that first voltage amplification as a result is predetermined.This predetermined multiple is second pixel and the ratio of the first pixel exposure time and the product of the 4th pixel and the ratio of the 3rd pixel exposure time.In step 1291, determine through amplifying first as a result voltage whether surpass predetermined threshold value.This predetermined threshold value be multiply by by saturation voltage usually that mask coefficient (mask) multiply by second pixel again and the ratio of the first pixel exposure time is determined with the average of the 4th pixel and the ratio of the 3rd pixel exposure time.The mask coefficient is to be less than or equal to 1 mark, for example 1/2,3/4, or 1.In step 1292, read if first voltage through amplifying greater than threshold value, is then given up first voltage and keep second output voltage.In step 1293, if first voltage through amplifying less than threshold value, is then given up second output voltage and kept first output voltage.In step 1280, the voltage that output keeps is as the result's output after making up.Usually get second pixel and the ratio of the first pixel exposure time is identical with the ratio of the 3rd pixel exposure time with the 4th pixel, positive integer n for example, n=2,4,6,8.Thus, voltage and second is as a result during voltage as a result in combination first, and the multiplication factor of reservation is n
2, multiply by saturation voltage and multiply by the mask coefficient again and threshold value is n.
Below by a concrete example calculating and the SNR (Signal Noise Ratio) of the dynamic range that HDR is synthetic are described.Present embodiment be with the image sensor application of a 1.4um pixel of the present invention four times the exposure composition algorithms example.Ratio row between these four different exposure time can be 2 multiples, for example 1: 2: 4: 8.That is, the pass between four time for exposure is:
T1∶T2∶T3∶T4＝1∶2∶4∶8
Ratio between time for exposure also can be different, and this is to depend on that the requirement to the dynamic range of the image after synthetic decides.Ratio is more big, and dynamic range is more big.
For simplicity, the ratio of time for exposure in this example we use n=2.
The every index of other of pixel is as shown in the table:
Figure 13 has represented the optical response plot separately of each time for exposure of T1, T2, T3 and T4.The induction curve slope little (as T1) of the pixel that the time for exposure is short.The pixel induction curve slope big (as T4) that time for exposure is long.Figure 14 represented finished to the induction curve behind the composition algorithm of four time for exposure and the SNR curve.As can be seen from Figure 14, final resultant curve remains straight line.And the saturation voltage of final whole response curve is equivalent to rise to 12.8V from 1.6V before.The dynamic range of the curve after synthetic is only compared can be by following computing formula with the recruitment of a time for exposure:
delta?DR＝20log(T4/T1)
For the present embodiment, the recruitment of dynamic range is 20log (8: 1), i.e. 18dB.
It can also be seen that from Figure 14 SNR (signal to noise ratio) curve is a breakover point that is converted to the multistage induction point that interlocks up and down.Have the low ebb of a SNR at breakover point, near the noise ratio of this key diagram picture this point is bigger.The digital processing of adopting HDR algorithm of the present invention to carry out image can allow near the curve of breakover point more level and smooth to reduce noise, avoids the inhomogeneities in the saturation region.In above example, making up employed mask coefficient is 3/4.
When Figure 15 has represented to adopt different mask coefficients to the influence of SNR curve.As shown in figure 15, when the mask coefficient be respectively 1,3/4,1/2.The mask coefficient is more near saturation voltage, and the SNR of induction curve is more high.So the mask coefficient selection also need be optimized afterwards at balance SNR and saturation voltage inhomogeneities.If but the mask coefficient is too high, though signal to noise ratio snr is higher, the inhomogeneities of the pixel zone of saturation induction that some undesirable factors cause easily, and then have influence on pixel in the response of saturation region.Therefore, generally can not select for use saturation point as the synthetic commit point of curve.Otherwise, can produce huge FPN (fixed pattern noise) at the flex point place of T0 and T1, influence picture quality.So the mask coefficient selection can be too near 1.Preferred mask coefficient is 3/4.
Figure 16 has represented to adopt four exposures and has double exposed to the influence of SNR.As shown in figure 16, four exposures (T1, T2, T3, T4) and double exposure (T0, both are the same for the dynamic ranges after the SNR curve behind T3) synthetic synthesizes, but their SNR is different.Double exposure is much lower when the SNR of curve break exposes than four times.Like this to picture quality to influence meeting very big.Therefore, four exposures are better than the picture quality of double exposure, though this can further reduce the resolution of image.
Figure 17 is the schematic diagram of system according to an embodiment of the invention.Figure 17 explanation comprises the processor system 1700 of imageing sensor 1710.Wherein, imageing sensor 1710 as imageing sensor described in the invention.Described processor system 1700 exemplary illustration have the system of the digital circuit that can comprise image sensor apparatus.Under the situation that does not add restriction, this system can comprise computer system, camera system, scanner, machine vision, automobile navigation, visual telephone, surveillance, autofocus system, celestial body tracker system, movement detection systems, image stabilization system and data compression system.
Processor system 1700 (for example, camera system) generally includes CPU (CPU) 1740 (for example microprocessor), and it is communicated by letter with I/O (I/O) device 1720 via bus 1701.Imageing sensor 1710 is also communicated by letter with CPU 1740 via bus 1701.System 1700 based on processor also comprises random-access memory (ram) 1730, and can comprise removable memory 1750 (for example flash memory), and it is also communicated by letter with CPU 1740 via bus 1701.Imageing sensor 1710 can with processor (for example CPU, digital signal processor or microprocessor) combination, single integrated circuit or be different from the chip of described processor and can be with or without memory storage apparatus.Image combination and the calculating of handling can be carried out by imageing sensor 1710 or by CPU 1740.
Technology contents of the present invention and technical characterstic disclose as above, yet one of ordinary skill in the art still may make all substituting and revising of spirit of the present invention that do not deviate from based on teaching of the present invention and disclosure.Therefore, protection scope of the present invention should be not limited to the content that embodiment discloses, and should comprise various of the present invention the substituting and correction of not deviating from, and is contained by the aforesaid right claim.
Claims (20)
1. formation method comprises:
In the very first time, the pixel in the pel array is exposed, draw first image;
In second time, the described pixel in the described pel array is exposed, draw second image, wherein, the very first time was different from for second time; And
Make up first image and second image.
2. method according to claim 1 further comprises:
Determine whether the intensity variation of image to be absorbed has surpassed the optical dynamic range of the described pixel in the described pel array.
3. method according to claim 1 and 2 further comprises:
Determining whether image to be absorbed comprises is among the motion.
4. formation method comprises:
In the very first time, the pixel in the first pixel group in the pel array is exposed, draw first image;
In second time, the pixel in the second pixel group in the described pel array is exposed, draw second image, wherein, the very first time was different from for second time;
Read described first image and described second image simultaneously; And
Make up described first image and described second image.
5. method according to claim 4, wherein:
Described pixel separation two line interlacings in described pixel in the described first pixel group and the described second pixel group are arranged.
6. method according to claim 4, wherein:
Described pixel separation two in described pixel in the described first pixel group and the described second pixel group is gone and is staggered at both direction.
7. method according to claim 4 further comprises:
In the 3rd time, the pixel in the 3rd pixel group in the described pel array is exposed, draw the 3rd image;
In the 4th time, the pixel in the 4th pixel group in the described pel array is exposed, draw the 4th image, wherein, the described very first time, described second time, described the 3rd time and described the 4th time have nothing in common with each other;
When reading described first image and described second image, read described the 3rd image and described the 4th image; And
Make up first image, second image, described the 3rd image and described the 4th image.
8. method according to claim 4, wherein, make up described first image and described second image comprises:
At second pixel in first pixel in described first image and described second image,
First output voltage of described first pixel is amplified predetermined multiple;
Determine whether described first output voltage through amplifying surpasses threshold value;
In response to surpassing threshold value, give up described first output voltage, keep second output voltage of described second pixel;
In response to not surpassing threshold value, keep described first output voltage, give up second output voltage of described second pixel.
9. method according to claim 8, wherein:
The time for exposure that described predetermined multiple is described second pixel and the ratio of the time for exposure of described first pixel.
10. according to Claim 8 or 9 described methods, wherein:
Described threshold value is the product of saturation voltage and mask coefficient, and wherein said mask coefficient is less than 1.
11. method according to claim 10, wherein:
Described mask coefficient is 3/4.
12. method according to claim 7 wherein, makes up described the 3rd image and described the 4th image comprises:
At the 4th pixel in the 3rd pixel in described the 3rd image and described the 4th image,
The 3rd output voltage of described the 3rd pixel is amplified another predetermined multiple;
Determine whether described the 3rd output voltage through amplifying surpasses another threshold value;
In response to surpassing another threshold value, give up described the 3rd output voltage, keep the 4th output voltage of described the 4th pixel;
In response to not surpassing threshold value, keep described the 3rd output voltage, give up the 4th output voltage of described the 4th pixel.
13. method according to claim 12, wherein:
Described combination first image, second image, described the 3rd image and described the 4th image comprise:
Make up first image and second image, draw first voltage as a result;
Make up the 3rd image and the 4th image, draw second voltage as a result;
The described prearranged multiple of described first voltage amplification as a result be multiply by described another predetermined multiple;
Determine whether described the 3rd output voltage through amplifying surpasses the product of the average of saturation voltage and described threshold value and described another threshold value;
In response to surpassing, give up described first voltage as a result, keep described second voltage as a result;
In response to not surpassing, keep described second voltage as a result, give up described first voltage as a result.
14. method according to claim 13, wherein:
Described prearranged multiple is identical with described another predetermined multiple; And the average of described threshold value and described another threshold value is identical.
15. an imaging device comprises:
Pel array, it comprises a plurality of pixels that are arranged in rows and columns;
Control circuit is controlled described pel array; Wherein,
Described pel array comprises the first pixel group, and it exposed in the very first time, draws first image;
Described pel array comprises the second pixel group, and it exposed in second time, draws second image,
Wherein, the very first time was different from for second time;
Wherein, described control circuit further reads described first image and described second image simultaneously; And
Image processor, it makes up described first image and described second image.
16. imaging device according to claim 15, wherein:
In described pel array, described pixel separation two line interlacings in the described pixel in the described first pixel group and the described second pixel group are arranged.
17. imaging device according to claim 15, wherein:
In described pel array, the described pixel separation two in the described pixel in the described first pixel group and the described second pixel group is gone and is staggered at both direction.
18. imaging device according to claim 15 further comprises:
Described pel array comprises the 3rd pixel group, and it exposed in the 3rd time, draws the 3rd image;
Described pel array comprises the 4th pixel group, and it exposed in the 4th time, draws the 4th image, and wherein, the described very first time, described second time, described the 3rd time and described the 4th time have nothing in common with each other;
Wherein, described control circuit further reads described the 3rd image and described the 4th image when reading described first image and described second image; And
Described image processor makes up first image, second image, described the 3rd image and described the 4th image.
19. imaging device according to claim 18, wherein, described image processor is further
Make up first image and second image, draw first voltage as a result;
Make up the 3rd image and the 4th image, draw second voltage as a result;
With described first as a result the voltage amplification prearranged multiple multiply by another predetermined multiple;
Determine whether described the 3rd output voltage through amplifying surpasses the product of the average of saturation voltage and described threshold value and described another threshold value;
In response to surpassing, give up described first voltage as a result, keep described second voltage as a result;
In response to not surpassing, keep described second voltage as a result, give up described first voltage as a result.
20. imaging device according to claim 15, wherein, described image processor is further
At second pixel in first pixel in described first image and described second image,
First output voltage of described first pixel is amplified predetermined multiple, the time for exposure that described predetermined multiple is described second pixel and the ratio of the time for exposure of described first pixel;
Determine whether described first output voltage through amplifying surpasses threshold value, and described threshold value is the product of saturation voltage and mask coefficient, and wherein said mask coefficient is less than 1;
In response to surpassing threshold value, give up described first output voltage, keep second output voltage of described second pixel;
In response to not surpassing threshold value, keep described first output voltage, give up second output voltage of described second pixel.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210045951.1A CN103297701B (en) | 2012-02-27 | 2012-02-27 | Formation method and imaging device |
| PCT/CN2013/071940 WO2013127338A1 (en) | 2012-02-27 | 2013-02-27 | Imaging method and imaging device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210045951.1A CN103297701B (en) | 2012-02-27 | 2012-02-27 | Formation method and imaging device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103297701A true CN103297701A (en) | 2013-09-11 |
| CN103297701B CN103297701B (en) | 2016-12-14 |
Family
ID=49081640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210045951.1A Active CN103297701B (en) | 2012-02-27 | 2012-02-27 | Formation method and imaging device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN103297701B (en) |
| WO (1) | WO2013127338A1 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105516700A (en) * | 2015-12-18 | 2016-04-20 | 广东欧珀移动通信有限公司 | Imaging method of image sensor, imaging device and electronic device |
| CN106162131A (en) * | 2015-04-28 | 2016-11-23 | 艾韬 | A kind of real time image processing |
| CN107409180A (en) * | 2015-03-09 | 2017-11-28 | 三星电子株式会社 | Electronic installation with camera model and the image processing method for electronic installation |
| CN107809602A (en) * | 2016-09-09 | 2018-03-16 | 豪威科技股份有限公司 | Terrible artifact removes system and method |
| CN111193882A (en) * | 2018-11-15 | 2020-05-22 | 格科微电子（上海）有限公司 | Method for realizing single-frame high dynamic range image sensor |
| CN113225494A (en) * | 2021-04-29 | 2021-08-06 | 深圳市阿达视高新技术有限公司 | Progressive exposure image generation method, system, image processing apparatus, and medium |
| CN113676635A (en) * | 2021-08-16 | 2021-11-19 | Oppo广东移动通信有限公司 | Method and device for generating high dynamic range image, electronic equipment and storage medium |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017197651A1 (en) * | 2016-05-20 | 2017-11-23 | SZ DJI Technology Co., Ltd. | Systems and methods for rolling shutter correction |
| US11671715B2 (en) * | 2021-01-14 | 2023-06-06 | Qualcomm Incorporated | High dynamic range technique selection for image processing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040141075A1 (en) * | 2003-01-22 | 2004-07-22 | Xiangchen Xu | Image sensor having dual automatic exposure control |
| CN101083724A (en) * | 2006-05-31 | 2007-12-05 | Ess技术公司 | CMOS imager system with interleaved readout for providing an image with increased dynamic range |
| CN101095339A (en) * | 2004-12-29 | 2007-12-26 | 英特尔公司 | Technique for increased exposure range in image sensors |
| CN202535464U (en) * | 2012-02-27 | 2012-11-14 | 徐辰 | Imaging device |
-
2012
- 2012-02-27 CN CN201210045951.1A patent/CN103297701B/en active Active
-
2013
- 2013-02-27 WO PCT/CN2013/071940 patent/WO2013127338A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040141075A1 (en) * | 2003-01-22 | 2004-07-22 | Xiangchen Xu | Image sensor having dual automatic exposure control |
| CN101095339A (en) * | 2004-12-29 | 2007-12-26 | 英特尔公司 | Technique for increased exposure range in image sensors |
| CN101083724A (en) * | 2006-05-31 | 2007-12-05 | Ess技术公司 | CMOS imager system with interleaved readout for providing an image with increased dynamic range |
| CN202535464U (en) * | 2012-02-27 | 2012-11-14 | 徐辰 | Imaging device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107409180A (en) * | 2015-03-09 | 2017-11-28 | 三星电子株式会社 | Electronic installation with camera model and the image processing method for electronic installation |
| CN107409180B (en) * | 2015-03-09 | 2020-08-28 | 三星电子株式会社 | Electronic device with camera module and image processing method for electronic device |
| CN106162131A (en) * | 2015-04-28 | 2016-11-23 | 艾韬 | A kind of real time image processing |
| CN106162131B (en) * | 2015-04-28 | 2018-08-28 | 深圳市易瞳科技有限公司 | A kind of real time image processing |
| CN105516700A (en) * | 2015-12-18 | 2016-04-20 | 广东欧珀移动通信有限公司 | Imaging method of image sensor, imaging device and electronic device |
| CN107809602A (en) * | 2016-09-09 | 2018-03-16 | 豪威科技股份有限公司 | Terrible artifact removes system and method |
| CN111193882A (en) * | 2018-11-15 | 2020-05-22 | 格科微电子（上海）有限公司 | Method for realizing single-frame high dynamic range image sensor |
| CN113225494A (en) * | 2021-04-29 | 2021-08-06 | 深圳市阿达视高新技术有限公司 | Progressive exposure image generation method, system, image processing apparatus, and medium |
| CN113225494B (en) * | 2021-04-29 | 2022-03-08 | 深圳市阿达视高新技术有限公司 | Progressive exposure image generation method, system, image processing apparatus, and medium |
| CN113676635A (en) * | 2021-08-16 | 2021-11-19 | Oppo广东移动通信有限公司 | Method and device for generating high dynamic range image, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2013127338A1 (en) | 2013-09-06 |
| CN103297701B (en) | 2016-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103297701A (en) | Imaging method and imaging device | |
| US10110827B2 (en) | Imaging apparatus, signal processing method, and program | |
| CN110381263B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US8462220B2 (en) | Method and apparatus for improving low-light performance for small pixel image sensors | |
| EP2415254B1 (en) | Exposing pixel groups in producing digital images | |
| US8405750B2 (en) | Image sensors and image reconstruction methods for capturing high dynamic range images | |
| US7777804B2 (en) | High dynamic range sensor with reduced line memory for color interpolation | |
| US8035709B2 (en) | Image pickup apparatus provided with a solid-state image pickup device | |
| CN104038702B (en) | Picture pick-up device and its control method | |
| US8391629B2 (en) | Method and apparatus for image noise reduction using noise models | |
| CN202535464U (en) | Imaging device | |
| CN102970487A (en) | Image processing apparatus, image processing method, and program | |
| TW200836553A (en) | Solid state photographing device including image sensors of CMOS type | |
| CN110266954B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US9025065B2 (en) | Solid-state imaging device, image processing method, and camera module for creating high dynamic range images | |
| US7619195B2 (en) | Imaging device driver, imaging device driving method, and image signal processor | |
| CN104660925A (en) | High Dynamic Range Image Sensor Read Out Architecture | |
| JP2010136224A (en) | Imaging apparatus and imaging method | |
| US8547452B2 (en) | Image processing apparatus, image processing method, and image processing program | |
| JPS60142683A (en) | Solid-state image pick up device | |
| JP2019161577A (en) | Imaging device, pixel correction processing circuit, and pixel correction processing method | |
| CN110012227B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| JP2007208885A (en) | Imaging unit and image sensor | |
| CN110278386B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US10283538B2 (en) | Imaging device and method of driving imaging device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20151012 Address after: Four road 215513 Jiangsu Province along the Yangtze River in Changshou City Development Zone No. 11 Branch Park Room 301 Applicant after: JIANGSU SMARTSENS TECHNOLOGY, LTD. Address before: Four road 215513 Jiangsu Province along the Yangtze River in Changshou City Development Zone No. 11 Branch Park Room 301 Applicant before: Xu Chen |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20181012 Address after: 200233, 11 floor, innovation building, 1009 Yishan Road, Xuhui District, Shanghai. Patentee after: Shanghai Ye Core Electronic Technology Co. Ltd. Address before: 215513 Room 301, four Chuang Chuang, four sea road, Changshou City Development Zone, Jiangsu Patentee before: JIANGSU SMARTSENS TECHNOLOGY, LTD. |
|
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: Room 612, 6th floor, No. 111 Building, Kexiang Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai, 2001 Patentee after: STEVE (SHANGHAI) ELECTRONIC TECHNOLOGY CO., LTD Address before: 200233, 11 floor, innovation building, 1009 Yishan Road, Xuhui District, Shanghai. Patentee before: Shanghai Ye Core Electronic Technology Co. Ltd. |
|
| CP01 | Change in the name or title of a patent holder | ||
| CP01 | Change in the name or title of a patent holder |
Address after: Room 612, 6th floor, No. 111 Building, Kexiang Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai, 2001 Patentee after: Starway (Shanghai) Electronic Technology Co.,Ltd. Address before: Room 612, 6th floor, No. 111 Building, Kexiang Road, China (Shanghai) Free Trade Pilot Area, Pudong New Area, Shanghai, 2001 Patentee before: Siteway (Shanghai) Electronic Technology Co.,Ltd. |