CN101686353A - Method for generating image picture gain - Google Patents
Method for generating image picture gain Download PDFInfo
- Publication number
- CN101686353A CN101686353A CN200810168784A CN200810168784A CN101686353A CN 101686353 A CN101686353 A CN 101686353A CN 200810168784 A CN200810168784 A CN 200810168784A CN 200810168784 A CN200810168784 A CN 200810168784A CN 101686353 A CN101686353 A CN 101686353A
- Authority
- CN
- China
- Prior art keywords
- image frame
- image
- gain
- mean value
- remaining columns
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The invention discloses a method which is realized by establishing a gain value look-up table according to sensitivity of human eyes to light, and generating an image picture gain according to the look-up table. The method comprises the steps of: setting the gain of the image picture as 1; scanning the multiple rows of images in front of the image picture; averaging the multiple rows of images toobtain an average value thereof; according to the average value, searching for a corresponding gain value in the gain value look-up table; and according to the corresponding gain value, regulating theinformation of the residual rows of the image picture so as to generate the images of the residual rows of the image picture.
Description
Technical field
The invention relates to a kind of method that produces image picture gain, refer to especially a kind ofly can produce the method for this image picture gain according to the susceptibility of human eye to light.
Background technology
Generally speaking, when the mankind's vision system when watching things, be simultaneously in the resolution of the resolution of carrying out two kinds of resolutions----color and illumination (luminance).Yet the ability of these two kinds of resolutions is subjected to the influence of surrounding environment illumination again easily.For example ought be under the environment of very bright (illumination is very high), human vision system can improve the susceptibility of color, that is human vision system is under the very high environment of illumination, easier discover color fine difference each other; But the susceptibility to illumination can reduce, that is human vision system is discovered the difference that between the light and shade not too easily under the very high environment of illumination.Otherwise under the environment of very dark when being in (illumination is very low), human vision system can weaken the susceptibility of color, that is human vision system is under the very low environment of illumination, is not easy to discover color difference each other; But the susceptibility to illumination can improve, that is human vision system is easier to discover the fine variation that between the light and shade under the very low environment of illumination.Please referring to Fig. 1.Fig. 1 is the sensing curves of three different human eyes to the illumination of image frame.The longitudinal axis of Fig. 1 represent the real image picture illumination (unit: candle light/square centimeter), transverse axis represent the GTG value that human eye experiences (least significant bit, LeastSignificant Bit, LSB).When the illumination of real image picture is changed to 50 candle lights/square centimeter by 0, GTG value that the human eye of these three curve representatives is experienced changes approximately between 110 (article one curve: (curve the 3rd: 1 to 151) 1 to 111) to 150, and when the illumination of real image picture was changed to 200 candle lights/square centimeter by 150, the GTG value that the human eye of these three curve representatives is experienced only changed approximately between 20 (curve the 3rd: 221 to 241) to 30 (article one curves: 201 to 231).Therefore, all can find out by the variation of any curve among Fig. 1: when human eye when image frame illumination is low, very sensitive to illumination; When image frame illumination is high, more insensitive to illumination.
And the present imageing sensor (CMOS image sensor) of the complementary metal oxide semiconductors (CMOS)s of a large amount of uses of institute in optical element, have fixed mode noise (fixed pattern noise, FPN) problem, this fixed mode noise is by in this optical element, and each element difference each other causes.Please referring to Fig. 2.Fig. 2 is the image frame figure with fixed mode noise of 2.41%.By finding out among Fig. 2, the potential difference that the fixed mode noise is caused can cause the differences of illumination intensities between each ranks of image frame, and can not cause the variation on the color.
Traditional optical element, digital camera for example is before the image frame that desire is taken, must carry out the operation of photometry and focusing earlier, some camera even have the photometry district in addition is to measure the illumination of the scene that desire takes, to determine the gain of the image frame that this desire is taken.And image is play element, and for example LCD TV will be play the illumination that an image frame comes the measurement image picture usually earlier, and to determine the next gain of the key frame of desire broadcast, then the key frame of playing subsequently promptly adjusts according to this gain.No matter be camera or LCD TV, all must waste an image frame or a photometry district earlier on the practice of photometry, to reach the purpose of measurement image picture illumination, not the practice of a very economical on the efficient, on the resource, and by the image frame of photometry, be not the image frame that actual desire is taken or play, so this traditional method can not be called real real-time (real-time) and effective.
After the photometry,,, choose yield value, adjust the key frame that next will take or play by tabling look-up according to the illumination of this measured image frame.In conventional practice, this is tabled look-up is a screening-mode that corresponds in the optical element, sets up based on averaging method.Yet, during these are tabled look-up, the factor of the susceptibility of light is not listed human eye in consideration, to such an extent as under high light or very dark environment, can not cooperate the illumination of environment, provide best yield value operation.
Summary of the invention
Embodiments of the invention are to disclose a kind of method that produces image picture gain, and the gain that comprises image frame is made as 1; Scan the image of the preceding multiple row of this image frame; On average should before the image of multiple row, in the hope of the mean value of the image of this preceding multiple row; According to this mean value, produce corresponding gain; Reach information, produce the image of this image frame remaining columns according to this corresponding gain and this image frame remaining columns.
Another embodiment of the present invention is to disclose a kind of method that produces image picture gain, comprises the image of the preceding multiple row of scan image picture; On average should before the image of multiple row, in the hope of the mean value of the image of this preceding multiple row; According to the gain of this mean value and this image frame, produce corresponding gain; Reach information, produce the image of this image frame remaining columns according to this corresponding gain and this image frame remaining columns.
Description of drawings
Fig. 1 curve chart that to be three different human eyes constituted the sensing curve of the illumination of image frame.
Fig. 2 one has the image frame figure of 2.4% fixed mode noise.
Fig. 3 is the block diagram that concerns of the gain controlled of a programmable-gain control amplifier and fixed mode noise.
Fig. 4 is the graph of a relation of input voltage and the adjusted output voltage of process gain.
Fig. 5 is the flow chart of first embodiment of the present invention method.
Fig. 6 is a conspectus of the present invention.
Fig. 7 is the flow chart of second embodiment of the present invention method.
[main element label declaration]
??100 | Pel array |
??102,104 | Orthoscanner |
??106,108 | The electric capacity electricity storage module |
??110,112 | Horizontal scanner |
??114,116 | The programmable-gain control amplifier |
??10,12,14,16,18,20,30,32 ??,34,36,38,40 | Step |
Embodiment
Shortcoming at conventional practice, the present invention proposes one utilizes the void row (dummy row) of present image frame to carry out photometry, and do not need to use in addition an image frame or a photometry district, and the susceptibility of human eye to light then considered in the foundation of tabling look-up, in the hope of the practice of a preferable yield value, improve the shortcoming of conventional practice.
If aforesaid theories of vision is applied in the image processing, when the illumination of image frame is very high, just the gain with this image frame integral body strengthens; On the contrary, if the illumination of image frame is very low, then the gain with this image frame integral body reduces.This gain is that (ProgrammableGain Amplifier PGA) controls by the programmable-gain control amplifier.After the gain of this image frame integral body was strengthened, the illumination of image frame increased, and color contrast increases, and the fixed mode noise also can be exaggerated.But if the illumination of this image frame is very high, though the fixed mode noise is strengthened, human vision system and being not easy is discovered the differences of illumination intensities between each ranks of image frame that this fixed mode noise caused, but can discover the effect after color contrast increases easily, and this image frame is produced more riotous with colour illusion.On the contrary, after the gain of image frame was reduced, the illumination of this image frame can reduce, and color contrast reduces, and the fixed mode noise also can reduce.But if the illumination of this image frame is original just very low, this moment, human vision system was easy to discover the variation of image frame illumination, therefore the fixed mode noise is lowered, and can reduce human visual system's awareness fixed mode noise to interference that this image frame brought.Please referring to Fig. 3.Gain that Fig. 3 is controlled for the programmable-gain control amplifier and fixed mode noise concern block diagram.The longitudinal axis of Fig. 3 is the percentage of fixed mode noise, and transverse axis is the yield value of programmable-gain control amplifier.Each yield value is to there being two long columns among Fig. 3, and a long column is represented the percentage of the fixed mode noise of being predicted, another long column is represented the percentage of the fixed mode noise of actual test gained.By finding out among the figure that the fixed mode noise is to be directly proportional with the gain of this programmable-gain control amplifier.Next please referring to Fig. 4.Fig. 4 is the graph of a relation of input voltage and the adjusted output voltage of process gain.The slope of every bit is the yield value of programmable-gain control amplifier on the curve among this figure.This yield value is to produce according to the susceptibility of human eye to light.In brief, picture is healed when dark, and yield value is more little; Picture is healed when bright, and yield value is big more.The basis that this figure that is yield value of the present invention are tabled look-up and set up.
Please referring to Fig. 5.Fig. 5 produces the flow chart of the method for image picture gain for the first embodiment of the present invention.Step among Fig. 5 comprises:
Step 10: the yield value of setting the programmable-gain control amplifier is 1.
Step 12: begin by the column scan image frame.
Step 14:, obtain the image of the empty row of preceding 18 row of this image frame by by column scan.
Step 16: on average be somebody's turn to do the image of the empty row of preceding 18 row, produce mean value.
Step 18:, in the yield value of having set up is tabled look-up, seek corresponding yield value according to this mean value.
Step 20: continue the column scan of pursuing of this image frame remaining columns (being key frame), and, adjust information, to produce the image of this key frame by this key frame of column scan gained according to this corresponding yield value.
In the middle of this first embodiment, at first before scan image picture not, the yield value with the programmable-gain control amplifier is made as 1 earlier, makes that the information of image frame of scanning gained is identical with the image of the adjusted image frame of this yield value of process.Then begin by the column scan image frame, and obtain the image of the empty row of preceding 18 row of this image frame.Please note: the empty row of selected preceding 18 row in the present embodiment are to illustrate for example, are not to be used for limiting the present invention, and the choosing of empty column number is that resolution or the like the situation according to this image frame is decided." empty row " are the edges that is positioned at image frame, the view data that " empty row " are comprised, because the initial all effects in edge, and can't use as key frame, but if be used to measure the illumination of this image frame, real is enough.Selected empty column number is many more, the information of scanning gained is more near the entire image picture, and the yield value of the back gained of tabling look-up can be adjusted into preferable state with this image frame more, but relatively, the columns of key frame (this image frame remaining columns) reduces, and resolution reduces; Otherwise if selected empty column number is few more, the information of scanning gained is kept off the entire image picture more, the yield value of gained is difficult to this image frame is adjusted into preferable state more after tabling look-up, but relatively, the columns of key frame (this image frame remaining columns) increases, and resolution improves.Therefore, how between empty column number and resolution, try to achieve a balance, end relies designer individual to judge voluntarily.
Then on average be somebody's turn to do the image of the empty row of preceding 18 row, produce mean value, and, in the yield value of having set up is tabled look-up, seek corresponding yield value according to this mean value.Please note: of the present invention tabling look-up is according to human eye the susceptibility of light to be set up, by average method, weighted average or the like for example, with different human eyes to tabling look-up that the curve optimization of the susceptibility of light is set up, when lower image frame illumination, correspond to lower gain, during higher image frame illumination, correspond to higher gain.As described above, the image picture gain value of gained in originally tabling look-up when image frame illumination is low, can reduce the influence of fixed mode noise to image frame; When image frame illumination is high,, also be unlikely to experience too consumingly of the influence of amplification fixed mode noise to image frame because of the relation of human eye to the susceptibility of light.In the optical system of the present invention, tabling look-up to have many, and each is opened corresponding to screening-modes different in this optical element, for example: night screening-mode, automatic shooting pattern or the like.Then continue information again, and, adjust information, to produce the image of this key frame by this key frame of column scan gained according to yield value selected in tabling look-up by this image frame remaining columns of column scan (being key frame).Please note: be used for the sequence of steps that illustrates in the present embodiment, just an example is not to be used for limiting the present invention, does not allly depart from spirit of the present invention, can reach the sequence of steps of same purpose, also should belong to the category that the present invention is contained.
Please referring to Fig. 6.Fig. 6 is the conspectus of the embodiment of the invention.The pel array (pixel array) 100 that comprises 640*488 (VGA resolution) among Fig. 6, orthoscanner (vertical scanner) 102,104, electric capacity electricity storage module (capacitor bank) 106,108, horizontal scanner (horizontalscanner) 110,112 (that is shift registers, and programmable-gain control amplifier 114,116 shift register).Orthoscanner 102 is scanning element array 100 from lower to upper, earlier by the empty data that are listed as of preceding 18 row of column scan, be stored in the electric capacity electricity storage module 106 after the data of scanning first row, again by horizontal scanner 110 according to the sequential of being imported, mode with sequence sends out, and adjusts back output through programmable-gain control amplifier 114.After the data of first row were all exported and finished, orthoscanner carried out the scanning of secondary series data again, was listed as all been scanned of empty columns certificate up to preceding 18.In the middle of the first embodiment of the present invention, the gain with the programmable-gain control amplifier earlier is made as 1, scans, so the data of the empty row of preceding 18 row of scanning gained equal the image of programmable-gain control amplifier output again.Columns is according to after sequence output, and the operation that outside line promptly averages synchronously is as the step 16 among Fig. 5, on average be somebody's turn to do the image of the empty row of preceding 18 row synchronously, produce mean value, and according to this mean value, in the yield value of having set up is tabled look-up, seek corresponding yield value.After finding this corresponding yield value, orthoscanner continues from lower to upper by column scan key frame (this image frame remaining columns) partial data, and according to same flow process, export the programmable-gain control amplifier to, the programmable-gain control amplifier is exported after the data of adjustment scanning gained key frame then according to this corresponding yield value.
If before scan image picture not, the yield value of programmable-gain control amplifier is not made as 1 earlier, then Once you begin by after the column scan, the image of the empty row of preceding 18 row of this image frame that is obtained, through on average obtaining after the mean value, need again yield value, to obtain the mean value of the data of the empty row of 18 row before the original image frame divided by this programmable-gain control amplifier.Obtain again via tabling look-up, to find out corresponding yield value after the mean value of the empty data that are listed as of preceding 18 row of original image frame.Then, adjust the information that continues by this key frame (this image frame remaining columns) of column scan gained, to produce the image of this key frame according to this corresponding yield value.Please refer to Fig. 7.Fig. 7 produces the flow chart of the method for image picture gain for the second embodiment of the present invention.Step among Fig. 7 comprises:
Step 30: begin by the column scan image frame.
Step 32:, obtain the image of the empty row of preceding 18 row of this image frame by by column scan.
Step 34: on average be somebody's turn to do the image of the empty row of preceding 18 row, produce mean value.
Step 36: with the yield value of this mean value, to obtain the mean value of the data of the empty row of 18 row before original this image frame divided by the programmable-gain control amplifier.
Step 38:, in the yield value of having set up is tabled look-up, seek corresponding yield value according to the mean value of the data of the empty row of 18 row before original this image frame.
Step 40: continue the column scan of pursuing of this image frame remaining columns (being key frame), and, adjust information, to produce the image of this key frame by this key frame of column scan gained according to this corresponding yield value.
Please note: be used for the sequence of steps that illustrates in the present embodiment, just an example is not to be used for limiting the present invention, does not allly depart from spirit of the present invention, can reach the sequence of steps of same purpose, also should belong to the category that the present invention is contained.
When setting up yield value among the present invention and tabling look-up,, also must consider the disposing way of lenticule (microlens) of LCD TV pel array top and mode of processing procedure or the like except considering the susceptibility of human eye to light.The lenticular disposing way of different pel array tops, for example lenticule or the like is put in the top of putting a lenticule or four pixels, the top of a pixel, and different processing procedure mode, for example 0. 13 processing procedures, 0. 18 processing procedures or the like all can influence the method for building up of tabling look-up among the present invention.
Generally speaking, the present invention provides a kind of void row of image frame that utilize and scans, try to achieve the mean value of image of the void row of this image frame, and according to this mean value, from according to human eye to tabling look-up that the susceptibility of light is set up, seek corresponding yield value, again according to this corresponding yield value, adjust the data of the key frame of this image frame, in the hope of the method for the image of this key frame.The present invention does not need to use in addition image frame to scan, or set up the photometry district in addition, and the data by the column scan gained are same picture, than the tool reference value, and tabling look-up of institute's basis more can provide suitable yield value, key frame being adjusted into preferable state, carrying out image processing in order to the rear end, is an effective method of not wasting system resource again in fact.
The above only is preferred embodiment of the present invention, and all equalizations of being done according to claim scope of the present invention change and modify, and all should belong to covering scope of the present invention.
Claims (21)
1. method that produces image picture gain comprises:
The gain of image frame is made as 1;
Scan the image of the preceding multiple row of this image frame;
On average should before the image of multiple row, in the hope of the mean value of the image of this preceding multiple row;
According to this mean value, produce corresponding gain; And
According to the information of this corresponding gain and this image frame remaining columns, produce the image of this image frame remaining columns.
2. method according to claim 1, the image that wherein scans the preceding multiple row of this image frame are the image that the void of the preceding multiple row of this image frame of scanning is listed as.
3. method according to claim 1, wherein according to this mean value, producing this corresponding gain is according to this mean value, produces this corresponding gain in the mode of tabling look-up.
4. method according to claim 3, wherein this mode of tabling look-up is looked into tables look-up is predetermined operations pattern corresponding in the existing optical system of this image frame.
5. method according to claim 4, wherein this to table look-up be according to human eye the susceptibility of light to be set up.
6. method according to claim 1, wherein lower mean value are to correspond to lower gain.
7. method according to claim 1, wherein higher mean value are to correspond to higher gain.
8. method according to claim 1, wherein this image frame is the image frame that LCD TV is play.
9. method according to claim 1, wherein this image frame is the shown image frame of liquid crystal panel of digital camera.
10. method according to claim 1, wherein according to the information of this corresponding gain and this image frame remaining columns, the image that produces this image frame remaining columns is the product according to the information of each pixel of this corresponding gain and this image frame remaining columns, produces the image of this image frame remaining columns.
11. a method that produces image picture gain comprises:
The image of the preceding multiple row of scan image picture;
On average should before the image of multiple row, in the hope of the mean value of the image of this preceding multiple row;
According to the gain of this mean value and this image frame, produce corresponding gain; And
According to the information of this corresponding gain and this image frame remaining columns, produce the image of this image frame remaining columns.
12. method according to claim 11, the image that wherein scans the preceding multiple row of this image frame are the image that the void of the preceding multiple row of this image frame of scanning is listed as.
13. method according to claim 11, wherein according to this mean value, producing this corresponding gain is according to this mean value, produces this corresponding gain in the mode of tabling look-up.
14. method according to claim 13, wherein this mode of tabling look-up is looked into tables look-up is predetermined operations pattern corresponding in the existing optical system of this image frame.
15. method according to claim 14, wherein this to table look-up be according to human eye the susceptibility of light to be set up.
16. method according to claim 11, wherein lower mean value are to correspond to lower gain.
17. method according to claim 11, wherein higher mean value are to correspond to higher gain.
18. method according to claim 11, wherein this image frame is the image frame that LCD TV is play.
19. method according to claim 11, wherein this image frame is the shown image frame of liquid crystal panel of digital camera.
20. method according to claim 11, wherein according to the information of this corresponding gain and this image frame remaining columns, the image that produces this image frame remaining columns is the product according to the information of each pixel of this corresponding gain and this image frame remaining columns, produces the image of this image frame remaining columns.
21. method according to claim 11, wherein according to this gain of this mean value and this image frame, producing this corresponding gain is with this gain divided by this image frame of this mean value, to produce this corresponding gain.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200810168784 CN101686353B (en) | 2008-09-28 | 2008-09-28 | Method for generating image picture gain |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN 200810168784 CN101686353B (en) | 2008-09-28 | 2008-09-28 | Method for generating image picture gain |
Publications (2)
Publication Number | Publication Date |
---|---|
CN101686353A true CN101686353A (en) | 2010-03-31 |
CN101686353B CN101686353B (en) | 2013-07-10 |
Family
ID=42049280
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN 200810168784 Active CN101686353B (en) | 2008-09-28 | 2008-09-28 | Method for generating image picture gain |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN101686353B (en) |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6642962B1 (en) * | 1999-09-01 | 2003-11-04 | Neomagic Corp. | Merged pipeline for color interpolation and edge enhancement of digital images |
US20070046596A1 (en) * | 2005-08-10 | 2007-03-01 | Seiko Epson Corporation | Image display apparatus and image adjusting method |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100453038B1 (en) * | 2001-12-24 | 2004-10-15 | 삼성전자주식회사 | An apparatus and method for saturation correction in color image |
-
2008
- 2008-09-28 CN CN 200810168784 patent/CN101686353B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6642962B1 (en) * | 1999-09-01 | 2003-11-04 | Neomagic Corp. | Merged pipeline for color interpolation and edge enhancement of digital images |
US20070046596A1 (en) * | 2005-08-10 | 2007-03-01 | Seiko Epson Corporation | Image display apparatus and image adjusting method |
Also Published As
Publication number | Publication date |
---|---|
CN101686353B (en) | 2013-07-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105828003B (en) | The control method of picture pick-up device and picture pick-up device | |
US7430011B2 (en) | Image sensor having dual automatic exposure control | |
US6965395B1 (en) | Methods and systems for detecting defective imaging pixels and pixel values | |
JP3976754B2 (en) | Wide dynamic range imaging device with selective reading | |
CN101350933B (en) | Method for regulating lighteness of filmed display screen based on image inductor | |
US10311915B2 (en) | Image processing apparatus and method for controlling the same | |
CN102326392B (en) | Adjusting auto white balance | |
US20030142223A1 (en) | Method of fast automatic exposure or gain control in a MOS image sensor | |
CN101983510B (en) | The System and method for of adaptive local white balance adjusting | |
CN101115149B (en) | Image processing method | |
CN101207709A (en) | Method, device and equipment for regulating gamma curviline | |
CN101197942B (en) | Multi-exposure control method and multi-exposure control device | |
JP2004112742A (en) | Image sensor with image distortion suppressed | |
JP2011158717A (en) | Display device, luminance unevenness correction method, correction data creation device, and correction data creation method | |
CN102883105A (en) | Image sensing apparatus and control method thereof | |
CN100401749C (en) | Image processing apparatus and method | |
CN113611237A (en) | Method and system for adjusting MINI LED backlight display picture | |
CN101686353B (en) | Method for generating image picture gain | |
WO2012015628A2 (en) | Method for reducing image artifacts produced by a cmos camera | |
US8159557B2 (en) | Method of generating a gain of an image frame | |
TW202011729A (en) | Video recording device and video operation method | |
CN113176074B (en) | Non-contact Demura-Gamma-Flicker three-in-one measuring system and method | |
TWI507044B (en) | Method of generating a gain of an image frame | |
JP2002251171A (en) | Device for improving gray scale of image | |
US9025046B2 (en) | Method for white balance adjustment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |