CN102881260A

CN102881260A - Image processing method and device

Info

Publication number: CN102881260A
Application number: CN2012103357204A
Authority: CN
Inventors: 郑丁元
Original assignee: Primax Electronics Ltd
Current assignee: Primax Electronics Ltd
Priority date: 2009-09-16
Filing date: 2009-09-16
Publication date: 2013-01-16
Anticipated expiration: 2029-09-16
Also published as: CN102881260B

Abstract

The invention provides an image processing method and an image processing device for determining an environmental brightness value. The environmental brightness value is analyzed from three different environments, namely a static environment, a dynamic environment and a backlight environment. The method and the device are implemented mainly by receiving an image in an image flow, averaging brightness values of a part of pixels in the image under different selection conditions to generate a plurality of different brightness average value, and determining the environmental brightness value from the brightness average values. An environmental light source can be analyzed in an image processing way, and a sensing effect the same as that of an environmental light source sensor is achieved.

Description

Image processing method and device

The application is that application number is 200910173431.7, and the applying date is on 09 16th, 2009, and name is called the dividing an application of application for a patent for invention of " image processing method and device ".

Technical field

The present invention relates to image processing techniques, especially relate to a kind of image processing method and device that utilizes the corresponding monochrome information of pixel in the analysis image and then obtain ambient brightness value, wherein ambient brightness value also can further be used for controlling the setting (for example output brightness) of other hardware unit.

Background technology

Even to this day, user's demand and environment for use often more pressed close in the design of electronic product, and for example, in order to reach better result of use under the different light rays environment, electronic product provides the control device of adjustable light source output element.For instance, liquid crystal display can be adjusted along with the intensity of environment light source the output brightness of backlight module, therefore, the at present liquid crystal display of part meeting configuration surroundings light sensor (Ambient Light Sensor), see through this ambient light sensor, the internal control device device of liquid crystal display just can dynamically be adjusted according to the variation of environment light source the output brightness of backlight module, and then obtains better display effect.In addition, in mobile computer, for ease of the user in the dark (that is than low environment light source brightness part) also can utilize easily keyboard input, manufacturer also begins to install backlight at the keyboard of mobile computer, so that when the user in the dark uses mobile computer, also can provide enough light to come symbol on the clear resolution keyboard.But power consumption also is to need the emphatically one side of consideration in the mobile computer design usually; therefore when keyboard backlight is provided; manufacturer also can add the control device that comes the switchboards backlight by the detecting ambient light usually; so that the keyboard back light source only just can be unlocked under the environment for use of darkness; so design often also needs additionally to arrange ambient light sensor.Although the above-mentioned user that is designed to provides larger convenience, yet, whole hardware cost indirectly promoted also.

Summary of the invention

The technical matters that the present invention mainly solves is, for the prior art above shortcomings, a kind of image processing method and the device that just can analyze environment light source for the extra ambient light detector of the portable electronic product configuration that possesses video cameras of need not is provided, can processes by image and realize the sensing effect identical with ambient light source sensor.

The technical solution adopted for the present invention to solve the technical problems provides a kind of image processing method, and this image processing method includes: according to the institute of a plurality of pixels in a plurality of blocks in the image in the input image stream respectively a plurality of brightness values of correspondence produce a plurality of block brightness values that correspond respectively to these a plurality of blocks; Decide one first brightness value that should image according to the relation between critical value in these a plurality of block brightness values and the brightness and a brightness lower critical value respectively; According to these a plurality of pixels in these a plurality of blocks in this image respectively corresponding these a plurality of brightness values produce one second brightness value that should image; And come according to this first, second brightness value to determine an ambient brightness value with a decision circuitry.

The present invention also provides a kind of image processing method, this image processing method includes: a plurality of pixel according to a plurality of the first blocks in one first image in the input image stream is distinguished corresponding a plurality of the first brightness values, produces a plurality of the first block brightness values that correspond respectively to these a plurality of the first blocks; Distinguish corresponding a plurality of the second brightness values according to a plurality of pixel of a plurality of the second blocks in one second image in this input image stream, produce a plurality of Second Region Block Brightness values that correspond respectively to these a plurality of the second blocks; Produce respectively a plurality of block luminance difference values according to these a plurality of first block brightness values and these a plurality of Second Region Block Brightness values; According to this a plurality of block luminance difference values and at least one dynamic reference value, each block in these a plurality of first blocks is judged as static blocks or dynamic block; Decide a prospect brightness value according to the corresponding block brightness value of at least one dynamic block, and decide a background luminance value according to the corresponding block brightness value of at least one static blocks; Produce a brightness value that should the first image according to these a plurality of first brightness values; And come according to this brightness value, this prospect brightness value and this background luminance value to determine an ambient brightness value with a decision circuitry.

The present invention also provides a kind of image processing method, this image processing method includes: distinguish corresponding a plurality of brightness values according to a plurality of pixel of a plurality of blocks in the image of an input image stream, produce a plurality of block brightness values that correspond respectively to these a plurality of blocks; Utilize a judgment value backlight and these a plurality of block brightness values, determine whether the block in these a plurality of blocks is set as block backlight; And when the number that is set to block backlight in these a plurality of blocks during greater than a particular value, utilize the corresponding block brightness value of a plurality of blocks backlight to decide an ambient brightness value.

The present invention also provides a kind of image processing apparatus, and this image processing apparatus comprises: the block brightness value produces circuit, the first brightness value computing circuit, the second brightness value computing circuit and decision circuitry.This block brightness value produce circuit in order to according to the institute of a plurality of pixels in a plurality of blocks in the image in the input image stream respectively a plurality of brightness values of correspondence produce a plurality of block brightness values that correspond respectively to these a plurality of blocks.This first brightness value computing circuit is coupled to this block brightness value and produces circuit, and in order to decide one first brightness value that should image according to the relation between critical value and a brightness lower critical value in these a plurality of block brightness values and the brightness respectively.This second brightness value computing circuit in order to according to these a plurality of pixels in these a plurality of blocks in this image respectively corresponding these a plurality of brightness values produce one second brightness value that should image.This decision circuitry is coupled to this first brightness value computing circuit and this second brightness value computing circuit, and in order to decide an ambient brightness value according to this first, second brightness value.

The present invention also provides a kind of image processing apparatus, and this image processing apparatus comprises: the first block brightness value produces circuit, Second Region Block Brightness value produces circuit, difference value computing circuit, dynamic block decision circuitry, prospect brightness value computing circuit, background luminance value computing circuit, brightness value computing circuit and decision circuitry.This first block brightness value produces circuit in order to distinguish corresponding a plurality of the first brightness values according to a plurality of pixel of a plurality of the first blocks in one first image in the input image stream, produces a plurality of the first block brightness values that correspond respectively to these a plurality of the first blocks.This Second Region Block Brightness value produces circuit in order to distinguish corresponding a plurality of the second brightness values according to a plurality of pixel of a plurality of the second blocks in one second image in this input image stream, produces a plurality of Second Region Block Brightness values that correspond respectively to these a plurality of the second blocks.This difference value computing circuit is coupled to this first block brightness value and produces circuit and this first block brightness value generation circuit, and in order to produce respectively a plurality of block luminance difference values according to these a plurality of first block brightness values and these a plurality of Second Region Block Brightness values.This dynamic block decision circuitry is coupled to this difference value computing circuit, and in order to foundation this a plurality of block luminance difference values and at least one dynamic reference value, each block in these a plurality of first blocks is judged as static blocks or dynamic block, and temporary judged result and each block brightness value.This prospect brightness value computing circuit is coupled to dynamic block decision circuitry, and in order to decide a prospect brightness value according to the corresponding block brightness value of at least one dynamic block.This background luminance value computing circuit is coupled to dynamic block decision circuitry, and in order to decide a background luminance value according to the corresponding block brightness value of at least one static blocks.This brightness value computing circuit is coupled to this first block brightness value and produces circuit, and in order to produce according to these a plurality of first brightness values a brightness value that should the first image.This decision circuitry is in order to decide an ambient brightness value according to this brightness value, this prospect brightness value and this background luminance value.

The present invention also provides a kind of image processing apparatus, and this image processing apparatus comprises: the block brightness value produces circuit, block decision circuitry backlight and backlight brightness values computing circuit.This block brightness value produces circuit in order to distinguish corresponding a plurality of brightness values according to a plurality of pixel of a plurality of blocks in the image of an input image stream, produces a plurality of block brightness values that correspond respectively to these a plurality of blocks.This block decision circuitry backlight is coupled to this block brightness value and produces circuit, and in order to utilize a judgment value backlight and these a plurality of block brightness values, determines whether the block in these a plurality of blocks is set as block backlight.This backlight brightness values computing circuit is coupled to this block decision circuitry backlight and this block brightness value produces circuit, and in order to when the number that is set to block backlight in these a plurality of blocks during greater than a particular value, utilize the corresponding block brightness value of a plurality of blocks backlight to decide an ambient brightness value.

The invention provides a kind of sensing apparatus that does not need ambient light sensor or the special use of detecting ambient light, can analyze the state of ambient light, and obtain the technical scheme of ambient brightness value.The present invention mainly is that the image collecting device (as: video cameras) that utilizes portable electronic product gathers image, and utilizes its image that gathers to analyze, and further therefrom obtains the relevant information of ambient light.Therefore, utilize image processing method of the present invention and device, can need not configure extra ambient light detector so that possess the portable electronic product of video cameras, just can analyze environment light source by image processing techniques, to obtain the sensing effect identical with ambient light source sensor.

Description of drawings

Fig. 1 is the process flow diagram of the first embodiment of image processing method of the present invention.

Fig. 2 is the process flow diagram of the second embodiment of image processing method of the present invention.

Fig. 3 is the process flow diagram of the 3rd embodiment of image processing method of the present invention.

Fig. 4 is the function block schematic diagram of the first embodiment of image processing apparatus of the present invention.

Fig. 5 is the function block schematic diagram of the second embodiment of image processing apparatus of the present invention.

Fig. 6 is the function block schematic diagram of the dynamic block decision circuitry in the image processing apparatus shown in Figure 5.

Fig. 7 is the function block schematic diagram of the 3rd embodiment of image processing apparatus of the present invention.

Fig. 8 is the function block schematic diagram of the 4th embodiment of image processing apparatus of the present invention.

Fig. 9 is the function block schematic diagram of the original brightness value Circuit tuning in the image processing apparatus shown in Figure 8.

Figure 10 is the function block schematic diagram of the step control circuit in the image processing apparatus shown in Figure 8.

Embodiment

The main concept of image processing techniques of the present invention is to see through three kinds of different angles to come analysis environments brightness, be respectively: the static environment light source is analyzed, the dynamic environment light source is analyzed and environment light source analysis backlight, yet, any mechanism of carrying out ambient brightness detecting based at least a analysis result in the analysis of static environment light source, the analysis of dynamic environment light source and the environment light source analysis backlight is spirit according to the invention all, and fall within category of the present invention in.

The analysis of so-called static environment light source refers to not exist in the environment situation of any dynamic light source or object, and therefore, in this case, the present invention only analyzes with regard to the monochrome information that the pixel in the single image (pixel) records.In addition, the analysis of dynamic environment light source then represents the situation that may not have dynamic object (object can cause light reflection) or light source in the environment, therefore, in this case the present invention monochrome information that will record according to the pixel (pixel) in the two different images (having temporal precedence relationship) is analyzed.What environment light source analysis backlight represented is the situation of light source crested, that is to say in the image that image collecting device gathers, have object to block light source, forms so-called environment backlight.In the process of analyzing, be the burden that the operand that reduces the image processing causes system, can utilize block (including a plurality of pixels) to process and the ambient brightness analysis for unit carries out image.In addition, the present invention is not limited the size of block, and for instance, the size of block can be to include 4 pixels in the 2x2(block), or include 9 pixels in the 3x3(block), include 20 pixels in the 4x5(block) etc.In other words, have the knack of the people in the technology of the present invention field, should after reading instructions of the present invention, utilize the block of various different sizes to realize all technology contents of the present invention.

Therefore, the first embodiment of the present invention provides the image processing method under the situation that the static environment light source is analyzed.At first, according to the institute of a plurality of pixels in a plurality of blocks in the image in the input image stream respectively a plurality of brightness values of correspondence produce a plurality of block brightness values that correspond respectively to these a plurality of blocks.In the present embodiment, produce the mode of block brightness value for the corresponding brightness value of the pixel in the block is added up.Yet such as according to the corresponding brightness value of the pixel in the block, the mode of the computing outside adding up should also belong to category of the present invention.Then, behind each block brightness value of generation, with analyzing these block brightness values.

Please refer to Fig. 1, it is the process flow diagram of the first embodiment of image processing method of the present invention.As shown in Figure 1, in step 110, produce first corresponding all the block brightness values of this image.Then, step 120 can produce one first brightness value, and it is to determine according to the relation between critical value and a brightness lower critical value in these a plurality of block brightness values and the brightness respectively.The preferably includes again several substeps in the step 120: the block brightness value is set as a highlights block greater than each block of dividing value in this brightness in (120a) will these a plurality of blocks; The block brightness value is set as a dark section block less than each block of this brightness floor value in (120b) will these a plurality of blocks; And (120c) the corresponding block brightness value of at least one highlights block and the corresponding block brightness value of at least one dark section block are weighted average calculating operation to produce this first brightness value.In step 120a, all block brightness values can compare with dividing value in this brightness, then, if the corresponding block brightness value of a block greater than in this brightness during dividing value, then this block can be set to the highlights block; Otherwise then this block can not be carried out any setting; When each block all with this brightness on dividing value more complete after, then enter step 120b, each block brightness value can be again with this brightness floor value relatively, and determine according to this have which block can be configured to dark section block; When all blocks all by one by one with this brightness on dividing value and this brightness floor value more complete after, then can enter step 120c, the corresponding block brightness value of block of the bright/dark section block that utilizes all to be configured in first two steps are rapid is weighted average calculating operation, finally can calculate this first brightness value.In brief, in these a plurality of blocks, only there is the corresponding block brightness value of the bright or to a certain degree dark block that acquires a certain degree to be used to produce this first brightness value, can gets rid of thus the impact that the unconspicuous block of bright dark degree is analyzed ambient brightness.

Please return Fig. 1, when step 120 finishes, when entering step 130, can according to these a plurality of pixels in this a plurality of blocks in this image respectively these a plurality of brightness values of correspondence produce one second brightness value that should image.In the present embodiment, the operation of step 130 be according to this a plurality of pixels institutes respectively these a plurality of brightness values of correspondence carry out an average calculating operation with generation to this second brightness value that should image.Yet, note that the mode of this second brightness value generation also can be carried out after the block brightness value produces, that is to say, this second brightness value can see through all block brightness values are averaged rear the generation; Or, as above-mentioned, directly should average to produce by corresponding these a plurality of brightness values of a plurality of pixels.When step 120 finishes with 130, after producing respectively this first, second brightness value, then enter step 140, determine an ambient brightness value with a decision circuitry according to this first, second brightness value, wherein, seeing through the maximal value of getting among both in the present embodiment comes directly as this ambient brightness value, yet, in other embodiment, the calculation mode that also can see through other decides this ambient brightness value, therefore, so long as decide the technological means of ambient brightness value based on first, second brightness value, all belong to category of the present invention.In addition, in above stated specification, step 120c in the present embodiment can utilize all to be configured to, and bright/dark corresponding block brightness value of section's block is weighted average calculating operation and produces this first brightness value, but in a better embodiment, then can only utilize the corresponding block brightness value of highlights block adjacent and continuous in these a plurality of blocks and the adjacent and continuous corresponding block brightness value of dark section block to be weighted average calculating operation and produce this first brightness value.Thus, can neglect in this image scattered existence bright/dark section block, because scattered existence is bright/dark section block scope is less, in fact little on the impact of ambient brightness, therefore on analyzing, can ignore these scattered bright/monochrome information of dark section block.

In the above-mentioned explanation, clearly set forth the static environment brightness analysis mode that static light source is only arranged in environment, then, below will utilize the second embodiment of the present invention that dynamic environment brightness analysis mode when having dynamic light source or object in the environment is described.

Please refer to Fig. 2, it is the process flow diagram of the second embodiment of image processing method of the present invention.As shown in Figure 2, the step of this image processing method includes: step 210, its a plurality of pixel according to a plurality of the first blocks in one first image in the input image stream is distinguished corresponding a plurality of the first brightness values, produces a plurality of the first block brightness values that correspond respectively to these a plurality of the first blocks; Step 220, its a plurality of pixel according to a plurality of the second blocks in one second image in this input image stream are distinguished corresponding a plurality of the second brightness values, produce a plurality of Second Region Block Brightness values that correspond respectively to these a plurality of the second blocks; Step 230, it produces respectively a plurality of block luminance difference values according to these a plurality of first block brightness values and these a plurality of Second Region Block Brightness values; Step 240, it is judged as static blocks or dynamic block according to this a plurality of block luminance difference values and at least one dynamic reference value with each block in these a plurality of first blocks; Step 250, it decides a prospect brightness value according to the corresponding block brightness value of at least one dynamic block, and decides a background luminance value according to the corresponding block brightness value of at least one static blocks; Step 260, it produces a brightness value that should the first image according to these a plurality of first brightness values; Step 270, it determines an ambient brightness value with a decision circuitry according to this brightness value, this prospect brightness value and this background luminance value.

At first, because the image processing method wish of the second embodiment is analyzed the dynamic environment light source, therefore, whether top priority is to understand to have dynamically to be present in the environment, so, must tranmittance than whether producing between the different images in the image stream change to judge whether have dynamic object or light source in the environment.Therefore, first and second of the present embodiment step (that is step 210 and 220) is just calculated respectively two images and is distinguished corresponding a plurality of block brightness values, and in step 230, based on the corresponding block brightness value of one second block that is positioned at same position in the corresponding block brightness value of each first block and another image in the image, calculate a plurality of block in these two images and distinguish corresponding a plurality of block luminance difference values.When block luminance difference value is non-vanishing, obviously represents two images and change to some extent, thereby learn to have dynamic object or light source to be present in the environment.First and second image that special attention should be that step 210 and 220 indications is not defined as the consecutive image in this input image stream, and both only need possess temporal precedence relationship and get final product.Then, after producing these a plurality of block luminance difference values, step 240 can be according to this a plurality of block luminance difference values and at least one dynamic reference value, each block in these a plurality of first blocks is judged as static blocks or dynamic block, wherein, when the corresponding block luminance difference of block value during more than or equal to this dynamic reference value, this block is set as dynamic block; And when corresponding this block luminance difference value of block during less than this dynamic reference value, this block is set as static blocks.

Yet, in a better embodiment, the present invention can utilize a plurality of dynamic reference value carry out step 240 described moving/static blocks judges, in other words, these a plurality of first blocks may correspond to a plurality of different candidate's judged results based on these a plurality of dynamic reference value, then, in the present embodiment, can these a plurality of candidate's judged results of recycling decide one group of dynamic block judged result and one group of static blocks judged result, and utilize this dynamic block judged result and this static blocks judged result select step 240 described moving/static blocks, thereby carry out follow-up ambient brightness analysis.Therefore, in the present embodiment, can produce respectively a plurality of candidate's judged results from a plurality of different dynamic reference value according to these a plurality of block luminance difference values, wherein, each candidate's judged result is based on a corresponding dynamic reference value and each block in will these a plurality of first blocks is judged as candidate's static blocks or the dynamic block of candidate.Moreover, the a block corresponding block luminance difference value of each candidate's judged result in these a plurality of first blocks is during more than or equal to this corresponding dynamic reference value, this block is set as the dynamic block of candidate, and the corresponding block luminance difference of the block value in these a plurality of first blocks is set as candidate's static blocks with this block during less than this corresponding dynamic reference value.

Then, present embodiment can be chosen a dynamic block judged result in these a plurality of candidate's judged results and a static blocks judged result is carried out follow-up ambient brightness analysis.The mode of choosing is to select this dynamic block judged result with reference to the adjacent and continuous dynamic block of all candidates corresponding one dynamic block average brightness value that each candidate's judged result in these a plurality of candidate's judged results has, it is to find out a maximal value from a plurality of dynamic block average brightness values, and corresponding to the dynamic block of judging in this peaked candidate's judged result be this dynamic block judged result of wanting to choose, therefore, the corresponding dynamic block of this dynamic block judged result is the dynamic block of step 240 indication.Similarly, present embodiment also can be chosen a static blocks judged result in these a plurality of candidate's judged results, and the mode of choosing is to select this static blocks judged result with reference to the corresponding static blocks average brightness value of all adjacent and continuous candidate's static blocks that each candidate's judged result in these a plurality of candidate's judged results has, it is to find out a maximal value from a plurality of static blocks average brightness values, the static blocks of judging corresponding to the candidate block judged result of this minimum value be this static blocks judged result of wanting to choose, therefore, the corresponding static blocks of this static blocks judged result is the static blocks of step 240 indication.

After selecting suitable this dynamic block judged result and this static blocks judged result in these a plurality of candidate result certainly, the follow-up the dynamic and stalic state block that can utilize this two result to determine calculates respectively this prospect brightness value and this background luminance value.Therefore, can decide this prospect brightness value according to the corresponding block brightness value of at least one dynamic block in step 250, and decide this background luminance value according to the corresponding block brightness value of at least one static blocks.Yet, in a better embodiment of the present embodiment, can further utilize all adjacent and continuous in these a plurality of first blocks dynamic blocks to calculate an average brightness value with as this prospect brightness value, but not adopt all dynamic blocks to calculate this prospect brightness value.In like manner, in this better embodiment, also utilize in these a plurality of first blocks all adjacent and continuous static blocks to calculate an average brightness value with as this background luminance value.Should be noted in the discussion above that selecting adjacent and continuous moving/static blocks to obtain the fore/background brightness value is not the unique restriction of the present invention, it only is better embodiment.Then, step 260 can be as the associative operation of the first embodiment, calculate corresponding a plurality of brightness values of this a plurality of pixels in all first blocks on average, to produce this brightness value.At last, in step 270, can be used as this ambient brightness value according to this brightness value, this prospect brightness value and this background luminance value maximal value wherein.

Among the 3rd embodiment of image processing method of the present invention, provide a kind of image processing method of analysis environments brightness in environment backlight.Please refer to Fig. 3, this image processing method includes: step 310, and its a plurality of pixel according to a plurality of blocks in the image of an input image stream is distinguished corresponding a plurality of brightness values, produces a plurality of block brightness values that correspond respectively to these a plurality of blocks; Step 320, it utilizes a judgment value backlight and these a plurality of block brightness values, determines whether the block in these a plurality of blocks is set as block backlight; And step 330, its number that is set to block backlight in these a plurality of blocks utilizes the corresponding block brightness value of a plurality of blocks backlight to decide an ambient brightness value during greater than a particular value.

In a better embodiment of the present invention, image processing method of the present invention has additionally comprised the step of the original brightness value of an adjustment pixel, and its Main Function is to revise depth of exposure for the impact of pixel true brightness value.Known to the people in the technology of the present invention field, most image collecting devices includes the function of automatic exposure (Auto-Exposure), and, the problem of luminance shortage when automatic exposure function can be unlocked to improve image acquisition under some particular condition, and then obtain better image acquisition quality, yet the function of this automatic exposure is but so that the image that gathers can't reflect ambient brightness truly.Therefore, the error that causes because automatic exposure function opens between the monochrome information in the image that gathers for the correction image harvester and true brightness, therefore, the present embodiment provides extra brightness correction operation in addition, distinguish corresponding a plurality of original brightness values (it is directly by image collecting device output) in order to this a plurality of pixel in these a plurality of blocks of adjusting respectively this image according to the depth of exposure of this image, and then the interference of removing automatic exposure function, and restore comparatively these a plurality of brightness values near time of day.This operation will be processed corresponding this a plurality of original brightness values of all pixels in this image one by one, and this brightness correction operation includes following substep: (a) difference and the corresponding weighted value of this pixel with the corresponding exposure value of this image and an exposure reference value multiply by generation one multiplied result mutually; (b) with this multiplied result and the corresponding original brightness value addition of this pixel, to determine the corresponding brightness value of this pixel.At first, in step (a), when automatic exposure function is opened, adopt an exposure value, and this exposure value and an exposure reference value are subtracted each other to produce a difference, wherein, this exposure reference value can decide according to actual demand, then, can according to the position of this pixel in image, decide a weighted value, it is the pixel owing to diverse location in the image, affected by exposure in various degree, therefore for can reflect this phenomenon, this difference is multiplied by this weighted value to produce a multiplied result.In step (b), this multiplied result can with the addition of the corresponding original brightness value of this pixel, can restore not by this brightness value that automatic exposure affected, and this brightness value that produces according to this just can be used to the aforementioned ambient brightness analysis carried out.

In addition, except analysis environments brightness, another purpose of image processing method of the present invention namely is that the ambient brightness value that based on analysis goes out decides a hardware controls value, and wherein, hardware may be the backlight of keyboard or the backlight module of liquid crystal panel etc.In brief, image processing method of the present invention more can be judged according to ambient brightness value the light and shade of environment except producing ambient brightness value, how to decide according to this control hardware.For example, the hardware of image processing method wish control of the present invention is a keyboard back light source, therefore when image processing method of the present invention is judged present environment and is in brighter situation, then this keyboard back light source can be closed, otherwise, then open this keyboard back light source, and then come effective control hardware according to ambient brightness.Yet the hardware controls value that image processing method of the present invention produces does not limit to some extent to the hardware that it was suitable for, and above-mentioned example is only done the usefulness of example explanation.

In the method that produces the hardware controls value, topmost concept is to avoid the transition of ambient brightness that the controlling value generation of these hardware is disturbed, in other words, the concept of hardware controls of the present invention is that hope can be got rid of the instantaneous variation of brightness and cause hardware to change too continually state (ON/OFF), for example, this keyboard back light source is because frequently ambient brightness transition and open continually or close.Therefore the present invention utilizes a step control operation (Step Increasing Control) in the hope of the stability of hardware controls.According to a better embodiment, this step control operation comprises following steps: (a ') ambient brightness value and a previous step control operating result that produces according to this input image stream are subtracted each other, produce one and subtract each other the result; (b ') subtracts each other the result according to this and one first group of critical value is carried out a clamp (clamping) operation, to produce one first Output rusults; (c ') with this first Output rusults and before step control operating result addition, to produce an addition result; (d ') carry out clamp operation according to this addition result and one second group of critical value, go on foot at present the control operating result to produce one.Being described in detail as follows of each step.At first, the scope of supposing the ambient brightness value of trying to achieve according to abovementioned steps is the integer in 0 ~ 255, in step (a '), can with current ambient brightness value of trying to achieve and previous step control operating result (be utilize image processing method of the present invention in acquisition time another image early, analyze and the previous environment brightness value, further see through step control operational processes gained, it may be the arbitrary integer in 0 to 255) subtract each other, with one subtract each other the result.Then, in step (b '), this can be subtracted each other the result and carry out the operation of one first clamp, first group of critical value (+1 of this first clamp operating basis wherein,-1) produces one first Output rusults, that is, step control operating result subtracts each other greater than+1 if current ambient brightness value is with being somebody's turn to do before, meeting output numerical value is this first Output rusults of 1, step control operating result subtracted each other less than-1 o'clock and if current ambient brightness value is with being somebody's turn to do before, then can export numerical value and be this first Output rusults of-1, otherwise, then directly this be subtracted each other the result as this first Output rusults.Like this, in step (b '), can judge current ambient brightness value is that the more previous luminance state of accumulating (this had before gone on foot the control operating result) increases or reduces, thus, see through the impact that variation that the action subtract each other just can slow down current ambient brightness value effectively causes the control of hardware.In step (c '), this first Output rusults will before go on foot the addition of control operating result with this, to produce an addition result, then, step (d ') second group of critical value (100 of middle meeting foundation, 50) this final addition result is carried out the operation of one second clamp, to produce at present step control operating result.Similarly, when this addition result greater than 100, then at present step control operating result be 100, and work as this addition result less than 50, then step control operating result is 50 at present, otherwise, directly this addition result is output as this at present step control operating result.At last, can be with reference to going on foot at present the operation that the control operating result comes control hardware (for example backlight of keyboard or the backlight module of liquid crystal panel).

Take a broad view of it, step control operating result can be referenced with control hardware at present, therefore with regard to controlled hardware, if receive numerical value and be 100 present step control operating result, represent that namely current environment is in a bright state, just the according to this change of control hardware state, in like manner, be 50 present step control operating result when receiving numerical value, represent that namely current environment is in the state of a darkness, also the according to this change of control hardware state.See through the suitable setting of second group of critical value (100,50), can make hardware come to carry out state according to the ambient brightness variation with suitable speed and change, in addition.First group of critical value (1, + 1) setting then can affect above-mentioned step control operation how soon speed can reflect the light and shade change, for instance, if first group of critical value setting is (2, + 2) time, then at present step control operating result can be more quickly near second group of critical value (100,50), that is more responsive to the variation of ambient brightness.Note that numerical value mentioned above only does example explanation, is not limitation of the present invention.

What should pay special attention to is, several embodiment of aforesaid image processing method of the present invention, may be incorporated among other single embodiment of the present invention, in brief, in other embodiments of the invention, may have simultaneously the dynamic and stalic state or operator scheme dynamic, backlight and that static environment is analyzed, the follow-up functional block diagram of corresponding image processing apparatus of will utilizing illustrates such embodiment.

Please refer to Fig. 4, it is the function block schematic diagram of the first embodiment of image processing apparatus of the present invention.Image processing apparatus 400 is used for carrying out the static environment brightness analysis, as shown in Figure 4, image processing apparatus 400 includes (but being not limited to): a block brightness value produces circuit 410, one first brightness value computing circuit 420, one second brightness value computing circuit 430 and a decision circuitry 440.Image processing apparatus 400 be based on image processing method of the present invention the first embodiment concept and design, so the detailed principle of operation of each circuit component can be with reference to the related description of the first embodiment of above-mentioned image processing method, below only does the summary introduction.The block brightness value produce circuit 410 in order to according to the institute of a plurality of pixels in a plurality of blocks in the image in the input image stream respectively a plurality of brightness values of correspondence produce a plurality of block brightness values that correspond respectively to these a plurality of blocks.The first brightness value computing circuit 420 is coupled to the block brightness value and produces circuit 410, in order to decide one first brightness value that should image according to the relation between critical value and a brightness lower critical value in these a plurality of block brightness values and the brightness respectively.The second brightness value computing circuit 430, in order to according to these a plurality of pixels in these a plurality of blocks in this image respectively corresponding these a plurality of brightness values produce one second brightness value that should image.Decision circuitry 440 is coupled to the first brightness value computing circuit 420 and the second brightness value computing circuit 430, in order to decide an ambient brightness value according to this first, second brightness value.Special attention should be that, because this second brightness value is the brightness value of all pixels in this image to be averaged produce, therefore the second brightness value computing circuit 430 can directly receive image in this image stream, average to carry out brightness value with reference to each pixel, and then try to achieve this second brightness value, or, can average to produce this second brightness value to these a plurality of block brightness values that block brightness value generation circuit 410 produces.It is above that both all belong to category of the present invention.

Second embodiment that then, below will introduce according to above-mentioned image processing method is the designed image processing apparatus in basis.Please refer to Fig. 5, it is the function block schematic diagram of the second embodiment of image processing apparatus of the present invention.As shown in Figure 5, image processing apparatus 500 includes (but being not limited to): one first block brightness value produces circuit 510, a Second Region Block Brightness value produces circuit 520, a difference value computing circuit 530, a dynamic block decision circuitry 540, a prospect brightness value computing circuit 550, a background luminance value computing circuit 560, a brightness value computing circuit 570 and a decision circuitry 580.The first block brightness value produces circuit 510 in order to distinguish corresponding a plurality of the first brightness values according to a plurality of pixel of a plurality of the first blocks in one first image in the input image stream, produces a plurality of the first block brightness values that correspond respectively to these a plurality of the first blocks.Second Region Block Brightness value produces circuit 520 in order to distinguish corresponding a plurality of the second brightness values according to a plurality of pixel of a plurality of the second blocks in one second image in this input image stream, produces a plurality of Second Region Block Brightness values that correspond respectively to these a plurality of the second blocks.Difference value computing circuit 530 is coupled to the first block brightness value and produces circuit 510 and Second Region Block Brightness value generation circuit 520, and in order to produce respectively a plurality of block luminance difference values according to these a plurality of first block brightness values and these a plurality of Second Region Block Brightness values.Dynamically block decision circuitry 540 is coupled to difference value computing circuit 530, and in order to foundation this a plurality of block luminance difference values and at least one dynamic reference value, each block in these a plurality of first blocks is judged as static blocks or dynamic block, and temporary judged result and each the first block brightness value.Prospect brightness value computing circuit 550 is coupled to dynamic block decision circuitry 540, and in order to decide a prospect brightness value according to the corresponding block brightness value of at least one dynamic block.Background luminance value computing circuit 560 is coupled to dynamic block decision circuitry 540, in order to decide a background luminance value according to the corresponding block brightness value of at least one static blocks.Brightness value computing circuit 570 is in order to produce according to these a plurality of first brightness values a brightness value that should the first image.Decision circuitry 580 is coupled to prospect brightness value computing circuit 550, background luminance value computing circuit 560 and brightness value computing circuit 570, and in order to decide an ambient brightness value according to this brightness value, this prospect brightness value and this background luminance value.Because it is designed that image processing apparatus of the present invention is based on the principle of the second embodiment of aforesaid image processing method, but the therefore related description of the second embodiment of the thin section principle of operation reference picture disposal route of each circuit in the image processing apparatus 500 is not therefore give unnecessary details in addition at this.

Special attention should be that, in a better embodiment, dynamically block decision circuitry 540 can utilize a plurality of dynamic reference value to carry out foregoing moving/static blocks judgement, in other words, so the operation meeting has a plurality of different candidate's judged results based on these a plurality of dynamic reference value, then, can these a plurality of candidate's judged results of recycling decide one group of dynamic block judged result and one group of static blocks judged result, and recycle this organize dynamic block judged result and this group static blocks judged result select described moving/static blocks, thereby carry out follow-up analysis environments brightness.According to this, Fig. 6 has illustrated in this better embodiment, the function block schematic diagram of dynamic block decision circuitry 540 shown in Figure 5.As shown in Figure 6, dynamically block decision circuitry 540 includes (but being not limited to) comparing unit 541, storage element 543 and chooses unit 545.Comparing unit 541 can produce a plurality of candidate's judged results from a plurality of different dynamic reference value according to these a plurality of luminance difference values, and wherein, each candidate's judged result may include different moving/static blocks combination.543 of storage elements can store this a plurality of candidate's judged results, choose unit 545 and then can in these a plurality of candidate's judged results, select dynamic block judged result and a static blocks judged result, and utilize this dynamic block judged result and this static blocks judged result, set respectively each first block for moving/static blocks.Wherein, storage element 543 also may store the corresponding a plurality of block brightness values of each first block simultaneously, thus, when follow-up prospect brightness value arithmetic element 550 and background luminance value arithmetic element 560 from choose 545 places, unit learn correct moving/the static blocks judged result after, just can from storage element 543, take out move/the corresponding block brightness value of static blocks produces prospect brightness value and background luminance value.In addition, choose judgment criterion how in these a plurality of candidate's judged results, to select this dynamic block judged result and this static blocks judged result in unit 545 and see in the above stated specification, therefore just do not give unnecessary details in addition at this.

It is designed that the 3rd embodiment of image processing apparatus of the present invention is based on the 3rd embodiment of above-mentioned image processing method, thereby can analysis environments brightness in environment backlight.Please refer to Fig. 7, it is the function block schematic diagram of the 3rd embodiment of image processing apparatus of the present invention.As shown in Figure 7, image processing apparatus 700 includes (but being not limited to): a block brightness value produces circuit 710, a block decision circuitry 720 backlight and a backlight brightness values computing circuit 730.Image processing apparatus 700 is mainly used in analyzing the ambient brightness value when environment light source is covered by object and then causes environment backlight, wherein, the block brightness value produces circuit 710 in order to distinguish corresponding a plurality of brightness values according to a plurality of pixel of a plurality of blocks in the image of an input image stream, produces a plurality of block brightness values that correspond respectively to these a plurality of blocks; Block decision circuitry 720 backlight is coupled to the block brightness value and produces circuit 710, and in order to utilize a judgment value backlight and these a plurality of block brightness values, determines whether the block in these a plurality of blocks is set as block backlight; Background luminance value computing circuit 730 is coupled to block decision circuitry 720 backlight and the block brightness value produces circuit 710, in order to when the number that is set to block backlight in these a plurality of blocks during greater than a particular value, utilize the corresponding block brightness value of a plurality of blocks backlight to decide an ambient brightness value.

Although each embodiment of above-described image processing apparatus of the present invention is applied to respectively carry out the ambient brightness analysis under static environment, dynamic environment and the environment backlight, yet, in other embodiments of the invention, may adopt simultaneously multiple ambient brightness analytical technology, that is, in a design variation, image processing apparatus is applicable to more than one environment, and is not limited to only be applied to that one carries out the ambient brightness analysis in static environment, dynamic environment and the environment backlight.Therefore, next will provide among the present invention and can analyze simultaneously the embodiment of the image processing apparatus of static environment, dynamic environment and environment backlight, and please refer to Fig. 8, it is the function block schematic diagram of the 4th embodiment of image processing apparatus of the present invention.

As shown in Figure 8, image processing apparatus 800 includes (but being not limited to): an original brightness value Circuit tuning 801, one block brightness value produces circuit 802, one difference value computing circuit 803, one block decision circuitry 804 backlight, one backlight brightness values computing circuit 805, one dynamic block decision circuitry 806, one prospect brightness value computing circuit 807, one background luminance value computing circuit 808, one first brightness value computing circuit 809, one second brightness value computing circuit 810, one decision circuitry 811, one ambient brightness value is selected circuit 812, one step control circuit 813 and a hardware control circuit 814.Because most of circuit component has been known its principle of elaboration and associative operation in the image processing apparatus 800 in previous explanation, therefore seldom give unnecessary details at this.Below only just in the previous explanation NM part and difference locate describe.

At first, image in the input image stream in the present embodiment can be transferred into first original brightness value Circuit tuning 801 and adjust, and original brightness value Circuit tuning 801 can be exported the brightness value of each pixel in each image to block brightness value generation circuit 802.The block brightness value produces circuit 802 can be according to the subsequent conditioning circuit demand, export respectively block brightness value corresponding to different images to difference value computing circuit 803, the first brightness value computing circuit 809, the second brightness value computing circuit 810 and block decision circuitry 804 backlight, wherein, for difference value computing circuit 803, the block brightness value produce a plurality of block brightness values that circuit 802 can corresponding two images of output to difference value computing circuit 803 to produce a plurality of block luminance difference values, and for the first brightness value computing circuit, the block brightness value produces a plurality of block brightness values that circuit 802 only can be exported a corresponding image.

When prospect brightness value computing circuit 807, background luminance value computing circuit 808, the first brightness value computing circuit 809 and after the second brightness value computing circuit 810 calculated respectively different brightness values and brightness value, which value whether decision circuitry 811 utilized as output valve according to there being dynamic existence to decide in the environment.Therefore, dynamically block decision circuitry 806 also can be coupled to decision circuitry 811, and decision circuitry 811 can determine whether dynamically according to the information of dynamic block and be present in the environment.When having when dynamically existing, decision circuitry 811 can select a maximal value as output valve in this prospect brightness value, this background luminance value and this second brightness value (directly the brightness value of all pixels being averaged gained), otherwise, if do not exist when dynamic, then can utilize the maximal value in this first brightness value and this second brightness value to be used as output valve.Then, ambient brightness value selects circuit 812(to realize with a multiplexer simply), can from both output valves of decision circuitry 811 and backlight brightness values computing circuit 805, select one to export with as this ambient brightness value, wherein, the condition of selecting is the number of block backlight, in other words, when the number of blocks that is judged as block backlight in this image during greater than a certain threshold, ambient brightness value selects circuit 812 to be used as this ambient brightness value with the output valve of backlight brightness values computing circuit 805, otherwise then the output valve with decision circuitry 811 is used as this ambient brightness value.Then, this ambient brightness value of selecting circuit 812 to export can be transferred into step control circuit 813, and step control circuit 813 will be exported step control operating result according to this to hardware control circuit 814, at last, hardware control circuit 814 can produce a controlling value according to received step control operating result, wherein, if this controlling value that hardware control circuit 814 produces is to control the backlight of a keyboard, then this controlling value may be logic " 0 " or logic " 1 ", be used for opening or closing the backlight of this keyboard.

As previously mentioned, the impact of ambient brightness value being analyzed in order to revise the automatic exposure operation, image processing apparatus 800 just includes original brightness value Circuit tuning 801, and its functional block diagram sees also Fig. 9.As shown in Figure 9, original brightness value Circuit tuning 801 includes (but being not limited to) subtrator 8011, a multiplication unit 8012 and an adder unit 8013, and wherein subtrator 8011 all can be implemented through totalizer with adder unit 8013.Original brightness value Circuit tuning 801 is for one by one adjustment of the corresponding original brightness value of each pixel (directly by image collecting device output), wherein, subtrator 8011 is in order to subtract each other to produce a difference with the corresponding exposure value of this image and an exposure reference value; Multiplication unit 8012 is coupled to subtrator 8011, and produces a multiplied result in order to the corresponding weighted value of this difference and a pixel be multiply by mutually.Adder unit 8013 is coupled to multiplication unit 8012, and in order to this multiplied result and the corresponding original brightness value addition of this pixel, to determine the corresponding brightness value of this pixel.Thus, by the calculation process of original brightness value Circuit tuning 801, can be when automatic exposure function be opened, the monochrome information in the image that the correction image harvester gathers and the error between true brightness.In addition, original brightness value Circuit tuning 801 also can be applicable in other embodiments of the invention, for instance, original brightness value Circuit tuning 801 produces circuit (for example first/Second Region Block Brightness value shown in Figure 5 produces circuit 510/520) prior to first/Second Region Block Brightness value and receives input image stream, and the image of institute's wish analysis is obtained the original brightness value of each pixel in input image stream, after passing through again above-mentioned calculation process, at last the corresponding brightness value of each pixel is exported to this first/Second Region Block Brightness value and produce circuit.

The principle of operation of step control circuit 813 is asked for an interview before the related description about step control operation, below only describes its functional block diagram in Figure 10, and underdraws.Step control circuit 813 includes (but being not limited to): a subtrator 1010, a temporary storage location 1020, one first clamp units 1030, an adder unit 1040 and one second clamp units 1050.Step control circuit 813 mainly produces one in order to the foundation ambient brightness value and goes on foot at present the control operating result.Temporary storage location 1020 is coupled to the second clamp units 1050, produces a previous step control operating result in order to temporary according to this input image stream.Subtrator 1010 is coupled to ambient brightness value and selects circuit 812 and temporary storage location 1020, in order to step control operating result subtracts each other with being somebody's turn to do before with this ambient brightness value, produces one and subtracts each other the result.The first clamp units 1030 is coupled to subtrator 1010, carries out clamp operation in order to subtract each other result and one first group of critical value according to this, to produce one first Output rusults.Adder unit 1040 is coupled to temporary storage location 1020 and the first clamp units 1030, in order to this first Output rusults and this had before been gone on foot the addition of control operating result, to produce an addition result.The second clamp units 1050 is coupled to adder unit 1040, in order to carry out clamp operation according to this addition result and one second group of critical value, goes on foot at present the control operating result to produce one.Special attention should be that, although in the present embodiment, subtrator 1010 is coupled to ambient brightness value and selects circuit 812, yet, in the embodiment that does not possess ambient brightness value selection circuit 812, subtrator 1010 is to be coupled to decision circuitry to receive this ambient brightness value.

The above only is preferred embodiment of the present invention, and all equalizations of doing according to claim scope of the present invention change and modify, and all should belong to covering scope of the present invention.

Claims

1. an image processing method is characterized in that, comprises:

A plurality of pixel according to a plurality of the first blocks in one first image in the input image stream is distinguished corresponding a plurality of the first brightness values, produces a plurality of the first block brightness values that correspond respectively to these a plurality of the first blocks;

Distinguish corresponding a plurality of the second brightness values according to a plurality of pixel of a plurality of the second blocks in one second image in this input image stream, produce a plurality of Second Region Block Brightness values that correspond respectively to these a plurality of the second blocks;

Produce respectively a plurality of block luminance difference values according to these a plurality of first block brightness values and these a plurality of Second Region Block Brightness values;

According to this a plurality of block luminance difference values and at least one dynamic reference value, each block in these a plurality of first blocks is judged as static blocks or dynamic block;

Decide a prospect brightness value according to the corresponding block brightness value of at least one dynamic block, and decide a background luminance value according to the corresponding block brightness value of at least one static blocks;

Produce a brightness value that should the first image according to these a plurality of first brightness values; And

Come according to this brightness value, this prospect brightness value and this background luminance value to determine an ambient brightness value with a decision circuitry.

2. image processing method as claimed in claim 1 is characterized in that, this each block in will these a plurality of first blocks be judged as static blocks or dynamically the step of block include:

When the corresponding block luminance difference value of this block during more than or equal to this dynamic reference value, this block is set as dynamic block; And

When corresponding this block luminance difference value of this block during less than this dynamic reference value, this block is set as static blocks.

3. image processing method as claimed in claim 1 is characterized in that, this each block in will these a plurality of first blocks be judged as static blocks or dynamically the step of block include:

Produce respectively a plurality of candidate's judged results from a plurality of different dynamic reference value according to these a plurality of block luminance difference values, wherein each candidate's judged result is based on a corresponding dynamic reference value and each block in will these a plurality of first blocks is judged as candidate's static blocks or the dynamic block of candidate;

In these a plurality of candidate's judged results, choose dynamic block judged result and a static blocks judged result;

This dynamic block judged result of foundation decides the dynamic block in these a plurality of first blocks; And

Decide static blocks in these a plurality of first blocks according to this static blocks judged result.

4. image processing method as claimed in claim 3, it is characterized in that, each candidate's judged result is that the corresponding block luminance difference value of the block in these a plurality of first blocks is set as the dynamic block of candidate with this block during more than or equal to this corresponding dynamic reference value, and corresponding this block luminance difference value of this block in these a plurality of first blocks is set as candidate's static blocks with this block during less than this corresponding dynamic reference value.

5. image processing method as claimed in claim 3 is characterized in that, this step of choosing this dynamic block judged result includes:

The dynamic block average brightness value of the adjacent and continuous dynamic block of all candidates that each candidate's judged result has in these a plurality of candidate's judged results of foundation selects this dynamic block judged result, and wherein this dynamic block judged result has maximum dynamically block average brightness value in these a plurality of candidate's judged results.

6. image processing method as claimed in claim 3 is characterized in that, this step of choosing this static blocks judged result includes:

The static blocks average brightness value of all adjacent and continuous candidate's static blocks that each candidate's judged result has in these a plurality of candidate's judged results of foundation selects this static blocks judged result, and wherein this static blocks judged result has minimum static blocks average brightness value in these a plurality of candidate's judged results.

7. image processing method as claimed in claim 1 is characterized in that, this step that determines this prospect brightness value includes:

The average brightness value that calculates all adjacent and continuous in these a plurality of first blocks dynamic blocks is used as this prospect brightness value.

8. image processing method as claimed in claim 1 is characterized in that, this step that determines this background luminance value includes:

The average brightness value that calculates all adjacent and continuous in these a plurality of first blocks static blocks is used as this background luminance value.

9. image processing method as claimed in claim 1 is characterized in that, this includes with the step that determines this ambient brightness value according to this brightness value, this prospect brightness value and this background luminance value:

Select the maximal value in this brightness value, this prospect brightness value and this background luminance value to be used as this ambient brightness value.

10. image processing method as claimed in claim 1 is characterized in that, also includes:

Adjust respectively this a plurality of pixel of these a plurality of the first blocks according to the depth of exposure of this first image and distinguish corresponding a plurality of original brightness values to produce these a plurality of first brightness values; And

Adjust respectively this a plurality of pixel of these a plurality of the second blocks according to the depth of exposure of this second image and distinguish corresponding a plurality of original brightness values to produce these a plurality of second brightness values.

11. image processing method as claimed in claim 10 is characterized in that,

This step that produces these a plurality of the first brightness values includes:

For each pixel in each block in this first image:

The difference of the corresponding exposure value of this first image and an exposure reference value and the corresponding weighted value of this pixel be multiply by mutually produce one first multiplied result; And

With this first multiplied result and the addition of the corresponding original brightness value of this pixel, to determine corresponding one first brightness value of this pixel;

This step that produces these a plurality of the second brightness values includes:

For each pixel in each block in this second image:

The difference of the corresponding exposure value of this second image and this exposure reference value and the corresponding weighted value of this pixel be multiply by mutually produce one second multiplied result; And

With this second multiplied result and the addition of the corresponding original brightness value of this pixel, to determine corresponding one second brightness value of this pixel.

12. image processing method as claimed in claim 1 is characterized in that, also includes:

This ambient brightness value and a previous step control operating result that produces according to this input image stream are subtracted each other, produce one and subtract each other the result;

Subtract each other the result and one first group of critical value is carried out clamp operation according to this, to produce one first Output rusults;

With this first Output rusults and before step control operating result addition, to produce an addition result; And

Carry out clamp operation according to this addition result and one second group of critical value, go on foot at present the control operating result to produce one.

13. an image processing apparatus is characterized in that, comprises:

The first block brightness value produces circuit, in order to distinguish corresponding a plurality of the first brightness values according to a plurality of pixel of a plurality of the first blocks in one first image in the input image stream, produces a plurality of the first block brightness values that correspond respectively to these a plurality of the first blocks;

Second Region Block Brightness value produces circuit, in order to distinguish corresponding a plurality of the second brightness values according to a plurality of pixel of a plurality of the second blocks in one second image in this input image stream, produces a plurality of Second Region Block Brightness values that correspond respectively to these a plurality of the second blocks;

The difference value computing circuit is coupled to this first block brightness value and produces circuit and this Second Region Block Brightness value generation circuit, in order to produce respectively a plurality of block luminance difference values according to these a plurality of first block brightness values and these a plurality of Second Region Block Brightness values;

Dynamic block decision circuitry, be coupled to this difference value computing circuit, in order to according to this a plurality of block luminance difference values and at least one dynamic reference value, each block in these a plurality of first blocks is judged as static blocks or dynamic block, and temporary judged result and each block brightness value;

Prospect brightness value computing circuit is coupled to this dynamic block decision circuitry, in order to decide a prospect brightness value according to the corresponding block brightness value of at least one dynamic block;

Background luminance value computing circuit is coupled to this dynamic block decision circuitry, in order to decide a background luminance value according to the corresponding block brightness value of at least one static blocks;

Brightness value computing circuit is in order to produce according to these a plurality of first brightness values a brightness value that should the first image; And

Decision circuitry is coupled to prospect brightness value computing circuit, background luminance value computing circuit and brightness value computing circuit, in order to decide an ambient brightness value according to this brightness value, this prospect brightness value and this background luminance value.

14. image processing apparatus as claimed in claim 13 is characterized in that, when the corresponding block luminance difference value of this block during more than or equal to this dynamic reference value, this dynamic block decision circuitry is set as dynamic block with this block; When corresponding this block luminance difference value of this block during less than this dynamic reference value, this dynamic block decision circuitry is set as static blocks with this block.

15. image processing apparatus as claimed in claim 13 is characterized in that, this dynamic block decision circuitry includes:

Comparing unit, in order to produce respectively a plurality of candidate's judged results from a plurality of different dynamic reference value according to these a plurality of block luminance difference values, wherein each candidate's judged result is based on a corresponding dynamic reference value and each block in will these a plurality of first blocks is judged as candidate's static blocks or the dynamic block of candidate;

Storage element is coupled to this comparing unit, in order to store these a plurality of candidate's judged results and this a plurality of the first block brightness values;

Choose the unit, couple from this storage element, in order in candidate's judged result, choose a dynamic block judged result and a static blocks judged result, in order to according to this dynamic block judged result decide in these a plurality of first blocks dynamic block and in order to decide the static blocks in these a plurality of first blocks according to this static blocks judged result.

16. image processing apparatus as claimed in claim 15, it is characterized in that, each candidate's judged result that this comparing unit produces is that the corresponding block luminance difference value of the block in these a plurality of first blocks is judged as the dynamic block of candidate with this block during more than or equal to this corresponding dynamic reference value, and corresponding this block luminance difference value of this block in these a plurality of first blocks is set as candidate's static blocks with this block during less than this corresponding dynamic reference value.

17. image processing apparatus as claimed in claim 15, it is characterized in that, this dynamic block average brightness value of choosing the adjacent and continuous dynamic block of all candidates that each candidate's judged result has in unit these a plurality of candidate's judged results of foundation selects this dynamic block judged result, and wherein this dynamic block judged result has maximum dynamically block average brightness value in these a plurality of candidate's judged results.

18. image processing apparatus as claimed in claim 15, it is characterized in that, this static blocks average brightness value of choosing all adjacent and continuous candidate's static blocks that each candidate's judged result has in unit these a plurality of candidate's judged results of foundation selects this static blocks judged result, and wherein this static blocks judged result has minimum static blocks average brightness value in these a plurality of candidate's judged results.

19. image processing apparatus as claimed in claim 13 is characterized in that, the average brightness value that this prospect brightness value computing circuit calculates all adjacent and continuous in these a plurality of first blocks dynamic blocks is used as this prospect brightness value.

20. image processing apparatus as claimed in claim 13 is characterized in that, the average brightness value that this background luminance value computing circuit calculates all adjacent and continuous in these a plurality of first blocks static blocks is used as this background luminance value.

21. image processing apparatus as claimed in claim 13 is characterized in that, this decision circuitry selects the maximal value in this brightness value, this prospect brightness value and this background luminance value to be used as this ambient brightness value.

22. image processing apparatus as claimed in claim 13 is characterized in that, also includes:

Original brightness value Circuit tuning, be coupled to this block brightness value and produce circuit, in order to this a plurality of pixels institute of adjusting respectively these a plurality of the first blocks according to the depth of exposure of this first image respectively corresponding a plurality of original brightness values with a plurality of original brightness values of producing these a plurality of first brightness values and being distinguished correspondence in order to this a plurality of pixel of adjusting respectively these a plurality of the second blocks according to the depth of exposure of this second image with these a plurality of second brightness values of generation.

23. image processing apparatus as claimed in claim 22, it is characterized in that, this original brightness value Circuit tuning carries out the brightness value adjustment for each pixel in each block in this first, second image respectively, wherein this original brightness value Circuit tuning includes: subtrator, the adder unit that is coupled to the multiplication unit of this subtrator and is coupled to this multiplication unit, wherein

For each pixel in each block in this first image:

This subtrator is in order to subtract each other to produce one first difference with the corresponding exposure value of this first image and an exposure reference value; This multiplication unit produces one first multiplied result in order to this first difference and the corresponding weighted value of this pixel be multiply by mutually; And this adder unit is in order to this first multiplied result and the corresponding original brightness value addition of this pixel, to determine the corresponding brightness value of this pixel;

For each pixel in each block in this second image:

This subtrator is in order to subtract each other to produce one second difference with the corresponding exposure value of this second image and an exposure reference value; This multiplication unit system produces one second multiplied result in order to this second difference and the corresponding weighted value of this pixel be multiply by mutually; And this adder unit is in order to this second multiplied result and the corresponding original brightness value addition of this pixel, to determine the corresponding brightness value of this pixel.

24. image processing apparatus as claimed in claim 13 is characterized in that, also includes:

Step control circuit goes on foot the control operating result at present in order to produce one according to this ambient brightness value, comprises:

Temporary storage location is coupled to one second clamp units, produces a previous step control operating result in order to temporary according to this input image stream;

Subtrator is coupled to this decision circuitry and this temporary storage location, in order to this ambient brightness value with should previous step control operating result, produce one and subtract each other the result;

The first clamp units is coupled to this subtrator, carries out clamp operation in order to subtract each other result and one first group of critical value according to this, to produce one first Output rusults;

Adder unit is coupled to this temporary storage location and this first clamp units, in order to this first Output rusults and this had before been gone on foot the addition of control operating result, to produce an addition result; And

The second clamp units is coupled to this adder unit and this temporary storage location, in order to carry out clamp operation according to this addition result and one second group of critical value, goes on foot at present the control operating result to produce one.