CN101686353A - Method for generating image frame gain - Google Patents
Method for generating image frame gain Download PDFInfo
- Publication number
- CN101686353A CN101686353A CN200810168784A CN200810168784A CN101686353A CN 101686353 A CN101686353 A CN 101686353A CN 200810168784 A CN200810168784 A CN 200810168784A CN 200810168784 A CN200810168784 A CN 200810168784A CN 101686353 A CN101686353 A CN 101686353A
- Authority
- CN
- China
- Prior art keywords
- image frame
- gain
- image
- average value
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000035945 sensitivity Effects 0.000 claims abstract 3
- 230000003287 optical effect Effects 0.000 claims description 8
- 239000004973 liquid crystal related substance Substances 0.000 claims 4
- 238000012935 Averaging Methods 0.000 abstract description 2
- 238000005286 illumination Methods 0.000 description 38
- 238000005375 photometry Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 6
- 230000005611 electricity Effects 0.000 description 3
- 239000011800 void material Substances 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Landscapes
- Image Processing (AREA)
Abstract
The method comprises establishing a gain value look-up table according to the sensitivity of human eyes to light, and generating image gain according to the gain value look-up table. The method comprises the following steps: setting the gain of an image picture to 1; scanning the images of a plurality of rows in front of the image picture; averaging the previous multiple rows of images to obtain an average value of the previous multiple rows of images; according to the average value, searching a corresponding gain value from the gain value table look-up; and adjusting the information of the image frame residual row according to the corresponding gain value to generate an image of the image frame residual row.
Description
Technical field
The invention relates to a kind of method that produces image picture gain, refer to especially a kind ofly can produce the method for this image picture gain according to the susceptibility of human eye to light.
Background technology
Generally speaking, when the mankind's vision system when watching things, be simultaneously in the resolution of the resolution of carrying out two kinds of resolutions----color and illumination (luminance).Yet the ability of these two kinds of resolutions is subjected to the influence of surrounding environment illumination again easily.For example ought be under the environment of very bright (illumination is very high), human vision system can improve the susceptibility of color, that is human vision system is under the very high environment of illumination, easier discover color fine difference each other; But the susceptibility to illumination can reduce, that is human vision system is discovered the difference that between the light and shade not too easily under the very high environment of illumination.Otherwise under the environment of very dark when being in (illumination is very low), human vision system can weaken the susceptibility of color, that is human vision system is under the very low environment of illumination, is not easy to discover color difference each other; But the susceptibility to illumination can improve, that is human vision system is easier to discover the fine variation that between the light and shade under the very low environment of illumination.Please referring to Fig. 1.Fig. 1 is the sensing curves of three different human eyes to the illumination of image frame.The longitudinal axis of Fig. 1 represent the real image picture illumination (unit: candle light/square centimeter), transverse axis represent the GTG value that human eye experiences (least significant bit, LeastSignificant Bit, LSB).When the illumination of real image picture is changed to 50 candle lights/square centimeter by 0, GTG value that the human eye of these three curve representatives is experienced changes approximately between 110 (article one curve: (curve the 3rd: 1 to 151) 1 to 111) to 150, and when the illumination of real image picture was changed to 200 candle lights/square centimeter by 150, the GTG value that the human eye of these three curve representatives is experienced only changed approximately between 20 (curve the 3rd: 221 to 241) to 30 (article one curves: 201 to 231).Therefore, all can find out by the variation of any curve among Fig. 1: when human eye when image frame illumination is low, very sensitive to illumination; When image frame illumination is high, more insensitive to illumination.
And the present imageing sensor (CMOS image sensor) of the complementary metal oxide semiconductors (CMOS)s of a large amount of uses of institute in optical element, have fixed mode noise (fixed pattern noise, FPN) problem, this fixed mode noise is by in this optical element, and each element difference each other causes.Please referring to Fig. 2.Fig. 2 is the image frame figure with fixed mode noise of 2.41%.By finding out among Fig. 2, the potential difference that the fixed mode noise is caused can cause the differences of illumination intensities between each ranks of image frame, and can not cause the variation on the color.
Traditional optical element, digital camera for example is before the image frame that desire is taken, must carry out the operation of photometry and focusing earlier, some camera even have the photometry district in addition is to measure the illumination of the scene that desire takes, to determine the gain of the image frame that this desire is taken.And image is play element, and for example LCD TV will be play the illumination that an image frame comes the measurement image picture usually earlier, and to determine the next gain of the key frame of desire broadcast, then the key frame of playing subsequently promptly adjusts according to this gain.No matter be camera or LCD TV, all must waste an image frame or a photometry district earlier on the practice of photometry, to reach the purpose of measurement image picture illumination, not the practice of a very economical on the efficient, on the resource, and by the image frame of photometry, be not the image frame that actual desire is taken or play, so this traditional method can not be called real real-time (real-time) and effective.
After the photometry,,, choose yield value, adjust the key frame that next will take or play by tabling look-up according to the illumination of this measured image frame.In conventional practice, this is tabled look-up is a screening-mode that corresponds in the optical element, sets up based on averaging method.Yet, during these are tabled look-up, the factor of the susceptibility of light is not listed human eye in consideration, to such an extent as under high light or very dark environment, can not cooperate the illumination of environment, provide best yield value operation.
Summary of the invention
Embodiments of the invention are to disclose a kind of method that produces image picture gain, and the gain that comprises image frame is made as 1; Scan the image of the preceding multiple row of this image frame; On average should before the image of multiple row, in the hope of the mean value of the image of this preceding multiple row; According to this mean value, produce corresponding gain; Reach information, produce the image of this image frame remaining columns according to this corresponding gain and this image frame remaining columns.
Another embodiment of the present invention is to disclose a kind of method that produces image picture gain, comprises the image of the preceding multiple row of scan image picture; On average should before the image of multiple row, in the hope of the mean value of the image of this preceding multiple row; According to the gain of this mean value and this image frame, produce corresponding gain; Reach information, produce the image of this image frame remaining columns according to this corresponding gain and this image frame remaining columns.
Description of drawings
Fig. 1 curve chart that to be three different human eyes constituted the sensing curve of the illumination of image frame.
Fig. 2 one has the image frame figure of 2.4% fixed mode noise.
Fig. 3 is the block diagram that concerns of the gain controlled of a programmable-gain control amplifier and fixed mode noise.
Fig. 4 is the graph of a relation of input voltage and the adjusted output voltage of process gain.
Fig. 5 is the flow chart of first embodiment of the present invention method.
Fig. 6 is a conspectus of the present invention.
Fig. 7 is the flow chart of second embodiment of the present invention method.
[main element label declaration]
| ??100 | Pel array |
| ??102，104 | Orthoscanner |
| ??106，108 | The electric capacity electricity storage module |
| ??110，112 | Horizontal scanner |
| ??114，116 | The programmable-gain control amplifier |
| ??10，12，14，16，18，20，30，32 ??，34，36，38，40 | Step |
Embodiment
Shortcoming at conventional practice, the present invention proposes one utilizes the void row (dummy row) of present image frame to carry out photometry, and do not need to use in addition an image frame or a photometry district, and the susceptibility of human eye to light then considered in the foundation of tabling look-up, in the hope of the practice of a preferable yield value, improve the shortcoming of conventional practice.
If aforesaid theories of vision is applied in the image processing, when the illumination of image frame is very high, just the gain with this image frame integral body strengthens; On the contrary, if the illumination of image frame is very low, then the gain with this image frame integral body reduces.This gain is that (ProgrammableGain Amplifier PGA) controls by the programmable-gain control amplifier.After the gain of this image frame integral body was strengthened, the illumination of image frame increased, and color contrast increases, and the fixed mode noise also can be exaggerated.But if the illumination of this image frame is very high, though the fixed mode noise is strengthened, human vision system and being not easy is discovered the differences of illumination intensities between each ranks of image frame that this fixed mode noise caused, but can discover the effect after color contrast increases easily, and this image frame is produced more riotous with colour illusion.On the contrary, after the gain of image frame was reduced, the illumination of this image frame can reduce, and color contrast reduces, and the fixed mode noise also can reduce.But if the illumination of this image frame is original just very low, this moment, human vision system was easy to discover the variation of image frame illumination, therefore the fixed mode noise is lowered, and can reduce human visual system's awareness fixed mode noise to interference that this image frame brought.Please referring to Fig. 3.Gain that Fig. 3 is controlled for the programmable-gain control amplifier and fixed mode noise concern block diagram.The longitudinal axis of Fig. 3 is the percentage of fixed mode noise, and transverse axis is the yield value of programmable-gain control amplifier.Each yield value is to there being two long columns among Fig. 3, and a long column is represented the percentage of the fixed mode noise of being predicted, another long column is represented the percentage of the fixed mode noise of actual test gained.By finding out among the figure that the fixed mode noise is to be directly proportional with the gain of this programmable-gain control amplifier.Next please referring to Fig. 4.Fig. 4 is the graph of a relation of input voltage and the adjusted output voltage of process gain.The slope of every bit is the yield value of programmable-gain control amplifier on the curve among this figure.This yield value is to produce according to the susceptibility of human eye to light.In brief, picture is healed when dark, and yield value is more little; Picture is healed when bright, and yield value is big more.The basis that this figure that is yield value of the present invention are tabled look-up and set up.
Please referring to Fig. 5.Fig. 5 produces the flow chart of the method for image picture gain for the first embodiment of the present invention.Step among Fig. 5 comprises:
Step 10: the yield value of setting the programmable-gain control amplifier is 1.
Step 12: begin by the column scan image frame.
Step 14:, obtain the image of the empty row of preceding 18 row of this image frame by by column scan.
Step 16: on average be somebody's turn to do the image of the empty row of preceding 18 row, produce mean value.
Step 18:, in the yield value of having set up is tabled look-up, seek corresponding yield value according to this mean value.
Step 20: continue the column scan of pursuing of this image frame remaining columns (being key frame), and, adjust information, to produce the image of this key frame by this key frame of column scan gained according to this corresponding yield value.
In the middle of this first embodiment, at first before scan image picture not, the yield value with the programmable-gain control amplifier is made as 1 earlier, makes that the information of image frame of scanning gained is identical with the image of the adjusted image frame of this yield value of process.Then begin by the column scan image frame, and obtain the image of the empty row of preceding 18 row of this image frame.Please note: the empty row of selected preceding 18 row in the present embodiment are to illustrate for example, are not to be used for limiting the present invention, and the choosing of empty column number is that resolution or the like the situation according to this image frame is decided." empty row " are the edges that is positioned at image frame, the view data that " empty row " are comprised, because the initial all effects in edge, and can't use as key frame, but if be used to measure the illumination of this image frame, real is enough.Selected empty column number is many more, the information of scanning gained is more near the entire image picture, and the yield value of the back gained of tabling look-up can be adjusted into preferable state with this image frame more, but relatively, the columns of key frame (this image frame remaining columns) reduces, and resolution reduces; Otherwise if selected empty column number is few more, the information of scanning gained is kept off the entire image picture more, the yield value of gained is difficult to this image frame is adjusted into preferable state more after tabling look-up, but relatively, the columns of key frame (this image frame remaining columns) increases, and resolution improves.Therefore, how between empty column number and resolution, try to achieve a balance, end relies designer individual to judge voluntarily.
Then on average be somebody's turn to do the image of the empty row of preceding 18 row, produce mean value, and, in the yield value of having set up is tabled look-up, seek corresponding yield value according to this mean value.Please note: of the present invention tabling look-up is according to human eye the susceptibility of light to be set up, by average method, weighted average or the like for example, with different human eyes to tabling look-up that the curve optimization of the susceptibility of light is set up, when lower image frame illumination, correspond to lower gain, during higher image frame illumination, correspond to higher gain.As described above, the image picture gain value of gained in originally tabling look-up when image frame illumination is low, can reduce the influence of fixed mode noise to image frame; When image frame illumination is high,, also be unlikely to experience too consumingly of the influence of amplification fixed mode noise to image frame because of the relation of human eye to the susceptibility of light.In the optical system of the present invention, tabling look-up to have many, and each is opened corresponding to screening-modes different in this optical element, for example: night screening-mode, automatic shooting pattern or the like.Then continue information again, and, adjust information, to produce the image of this key frame by this key frame of column scan gained according to yield value selected in tabling look-up by this image frame remaining columns of column scan (being key frame).Please note: be used for the sequence of steps that illustrates in the present embodiment, just an example is not to be used for limiting the present invention, does not allly depart from spirit of the present invention, can reach the sequence of steps of same purpose, also should belong to the category that the present invention is contained.
Please referring to Fig. 6.Fig. 6 is the conspectus of the embodiment of the invention.The pel array (pixel array) 100 that comprises 640*488 (VGA resolution) among Fig. 6, orthoscanner (vertical scanner) 102,104, electric capacity electricity storage module (capacitor bank) 106,108, horizontal scanner (horizontalscanner) 110,112 (that is shift registers, and programmable-gain control amplifier 114,116 shift register).Orthoscanner 102 is scanning element array 100 from lower to upper, earlier by the empty data that are listed as of preceding 18 row of column scan, be stored in the electric capacity electricity storage module 106 after the data of scanning first row, again by horizontal scanner 110 according to the sequential of being imported, mode with sequence sends out, and adjusts back output through programmable-gain control amplifier 114.After the data of first row were all exported and finished, orthoscanner carried out the scanning of secondary series data again, was listed as all been scanned of empty columns certificate up to preceding 18.In the middle of the first embodiment of the present invention, the gain with the programmable-gain control amplifier earlier is made as 1, scans, so the data of the empty row of preceding 18 row of scanning gained equal the image of programmable-gain control amplifier output again.Columns is according to after sequence output, and the operation that outside line promptly averages synchronously is as the step 16 among Fig. 5, on average be somebody's turn to do the image of the empty row of preceding 18 row synchronously, produce mean value, and according to this mean value, in the yield value of having set up is tabled look-up, seek corresponding yield value.After finding this corresponding yield value, orthoscanner continues from lower to upper by column scan key frame (this image frame remaining columns) partial data, and according to same flow process, export the programmable-gain control amplifier to, the programmable-gain control amplifier is exported after the data of adjustment scanning gained key frame then according to this corresponding yield value.
If before scan image picture not, the yield value of programmable-gain control amplifier is not made as 1 earlier, then Once you begin by after the column scan, the image of the empty row of preceding 18 row of this image frame that is obtained, through on average obtaining after the mean value, need again yield value, to obtain the mean value of the data of the empty row of 18 row before the original image frame divided by this programmable-gain control amplifier.Obtain again via tabling look-up, to find out corresponding yield value after the mean value of the empty data that are listed as of preceding 18 row of original image frame.Then, adjust the information that continues by this key frame (this image frame remaining columns) of column scan gained, to produce the image of this key frame according to this corresponding yield value.Please refer to Fig. 7.Fig. 7 produces the flow chart of the method for image picture gain for the second embodiment of the present invention.Step among Fig. 7 comprises:
Step 30: begin by the column scan image frame.
Step 32:, obtain the image of the empty row of preceding 18 row of this image frame by by column scan.
Step 34: on average be somebody's turn to do the image of the empty row of preceding 18 row, produce mean value.
Step 36: with the yield value of this mean value, to obtain the mean value of the data of the empty row of 18 row before original this image frame divided by the programmable-gain control amplifier.
Step 38:, in the yield value of having set up is tabled look-up, seek corresponding yield value according to the mean value of the data of the empty row of 18 row before original this image frame.
Step 40: continue the column scan of pursuing of this image frame remaining columns (being key frame), and, adjust information, to produce the image of this key frame by this key frame of column scan gained according to this corresponding yield value.
Please note: be used for the sequence of steps that illustrates in the present embodiment, just an example is not to be used for limiting the present invention, does not allly depart from spirit of the present invention, can reach the sequence of steps of same purpose, also should belong to the category that the present invention is contained.
When setting up yield value among the present invention and tabling look-up,, also must consider the disposing way of lenticule (microlens) of LCD TV pel array top and mode of processing procedure or the like except considering the susceptibility of human eye to light.The lenticular disposing way of different pel array tops, for example lenticule or the like is put in the top of putting a lenticule or four pixels, the top of a pixel, and different processing procedure mode, for example 0. 13 processing procedures, 0. 18 processing procedures or the like all can influence the method for building up of tabling look-up among the present invention.
Generally speaking, the present invention provides a kind of void row of image frame that utilize and scans, try to achieve the mean value of image of the void row of this image frame, and according to this mean value, from according to human eye to tabling look-up that the susceptibility of light is set up, seek corresponding yield value, again according to this corresponding yield value, adjust the data of the key frame of this image frame, in the hope of the method for the image of this key frame.The present invention does not need to use in addition image frame to scan, or set up the photometry district in addition, and the data by the column scan gained are same picture, than the tool reference value, and tabling look-up of institute's basis more can provide suitable yield value, key frame being adjusted into preferable state, carrying out image processing in order to the rear end, is an effective method of not wasting system resource again in fact.
The above only is preferred embodiment of the present invention, and all equalizations of being done according to claim scope of the present invention change and modify, and all should belong to covering scope of the present invention.
Claims (21)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810168784 CN101686353B (en) | 2008-09-28 | 2008-09-28 | Method for generating image frame gain |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200810168784 CN101686353B (en) | 2008-09-28 | 2008-09-28 | Method for generating image frame gain |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101686353A true CN101686353A (en) | 2010-03-31 |
| CN101686353B CN101686353B (en) | 2013-07-10 |
Family
ID=42049280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200810168784 Active CN101686353B (en) | 2008-09-28 | 2008-09-28 | Method for generating image frame gain |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101686353B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6642962B1 (en) * | 1999-09-01 | 2003-11-04 | Neomagic Corp. | Merged pipeline for color interpolation and edge enhancement of digital images |
| US20070046596A1 (en) * | 2005-08-10 | 2007-03-01 | Seiko Epson Corporation | Image display apparatus and image adjusting method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100453038B1 (en) * | 2001-12-24 | 2004-10-15 | 삼성전자주식회사 | An apparatus and method for saturation correction in color image |
-
2008
- 2008-09-28 CN CN 200810168784 patent/CN101686353B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6642962B1 (en) * | 1999-09-01 | 2003-11-04 | Neomagic Corp. | Merged pipeline for color interpolation and edge enhancement of digital images |
| US20070046596A1 (en) * | 2005-08-10 | 2007-03-01 | Seiko Epson Corporation | Image display apparatus and image adjusting method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101686353B (en) | 2013-07-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105828003B (en) | The control method of picture pick-up device and picture pick-up device | |
| US7430011B2 (en) | Image sensor having dual automatic exposure control | |
| US8564696B2 (en) | Image processing apparatus and method for controlling the same | |
| CN101394483B (en) | Image capturing device and control method therefor | |
| US6965395B1 (en) | Methods and systems for detecting defective imaging pixels and pixel values | |
| JP6159105B2 (en) | Imaging apparatus and control method thereof | |
| WO2004098167A3 (en) | A system and process for generating high dynamic range video | |
| JP2003177727A (en) | Image display device and light quantity adjusting method | |
| JP5174837B2 (en) | Display device, luminance unevenness correction method, correction data creation device, and correction data creation method | |
| JP2015181217A (en) | Image processing apparatus and image processing method, and image display device | |
| CN102883105A (en) | Image sensing apparatus and control method thereof | |
| US9373158B2 (en) | Method for reducing image artifacts produced by a CMOS camera | |
| US8159557B2 (en) | Method of generating a gain of an image frame | |
| CN100401749C (en) | Image processing apparatus and method | |
| CN101686353A (en) | Method for generating image frame gain | |
| TW202011729A (en) | Video recording device and video operation method | |
| TWI507044B (en) | Method of generating a gain of an image frame | |
| US11336846B1 (en) | CMOS image sensor with image black level compensation and method | |
| WO2013128817A1 (en) | Solid-state image capture device | |
| JPH0622207A (en) | Image pickup device | |
| JP7020463B2 (en) | Imaging device | |
| US20080012958A1 (en) | White balance system and the method thereof | |
| JP2000132155A (en) | Image quality improving device and image quality improving method | |
| JPS6335082A (en) | Light quantity correcting device for video camera | |
| JPH04318515A (en) | Liquid crystal display device having gradation correcting function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |