CN109462745B - White balance processing method and mobile terminal - Google Patents

Abstract

The embodiment of the invention provides a white balance processing method and a mobile terminal, wherein the method comprises the following steps: acquiring picture pixel-by-pixel information of a target image, shooting physical parameters and a first white balance gain coefficient of n frames before the target image; determining a second white balance gain coefficient and an updating reference coefficient based on the picture pixel-by-pixel information and the shooting physical parameter; under the condition that the second white balance gain coefficient needs to be updated, updating the second white balance gain coefficient by adopting the updating reference coefficient; performing white balance processing on the target image by adopting the updated second white balance gain coefficient; wherein the target image is a current frame image; n is a positive integer greater than or equal to 1. By applying the embodiment of the invention, the picture jitter caused by overlarge white balance coefficient change of the target image can be avoided, and the picture quality is stabilized.

Description

A kind of white balance processing method and mobile terminal

technical field

Embodiments of the present invention relate to the field of communications technologies, and in particular, to a white balance processing method and a mobile terminal.

Background technique

With the development of information technology, mobile terminals have more and more functions, such as camera functions. At present, although the Selfie technology using the camera has become common and mature in the existing mobile terminals, with the continuous upgrading of the camera configuration, the ISP (Image Signal Processing, image signal processing) technology has developed rapidly, and the image captured by the mobile terminal has become The picture quality is also constantly put forward higher requirements.

The color of the object under different light sources is different, which is determined by the different color temperature of the light source, which makes the reflection spectrum of the object have a certain deviation from the real color. For example, under the low color temperature of indoor tungsten lighting, white objects will look orange-yellow, and the scene captured in this lighting condition will be yellowish, if it is illuminated by the high color temperature of the blue sky down, it will have a blue tint. In order to enable mobile terminals with imaging functions such as cameras to have visual adjustment capabilities similar to the human eye, in different lighting conditions, the color of the obtained image can be kept consistent, and the processing of the obtained image is called white balance. .

The current AWB (Automatic white balance, automatic white balance) technology based on picture color components has been able to stably restore the color of the shooting scene. However, the AWB technology based on picture color components has shortcomings. For example, when the camera of the mobile terminal is displaced and the picture changes, but the ambient color temperature does not actually change, the AWB algorithm may calculate a different ambient color temperature from the one before the displacement based on the change of the picture, resulting in inaccurate AWB results, resulting in images The picture quality and stability of the degraded.

SUMMARY OF THE INVENTION

Embodiments of the present invention provide a white balance processing method and a mobile terminal, so as to solve the problem of inaccurate white balance calculation results, resulting in unstable image quality.

In order to solve the above-mentioned technical problems, the present invention is achieved in this way:

In a first aspect, a white balance processing method is provided, applied to a mobile terminal, and the method includes:

Obtain the picture-by-pixel information of the target image, the shooting physical parameters and the first white balance gain coefficient of the first n frames of the target image;

determining a second white balance gain coefficient and an update reference coefficient based on the pixel-by-pixel information of the picture and the shooting physical parameters;

When the second white balance gain coefficient needs to be updated, the update reference coefficient is used to update the second white balance gain coefficient;

Using the updated second white balance gain coefficient to perform white balance processing on the target image;

Wherein, the target image is the current frame image; n is a positive integer greater than or equal to 1.

In a second aspect, an embodiment of the present invention provides a white balance processing method, which is applied to a mobile terminal, and the method includes:

Obtain the pixel-by-pixel information of the first picture of the target image, the pixel-by-pixel information of the second picture of the first n frames of the target image, and the first white balance gain coefficient of the first n frames; the n is a positive integer greater than or equal to 1 ;

determining a second white balance gain coefficient and determining an update reference coefficient based on the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture;

When the second white balance gain coefficient needs to be updated, the update reference coefficient is used to update the second white balance gain coefficient;

Using the updated second white balance gain coefficient to perform white balance processing on the target image;

Wherein, the target image is the current frame image.

In a third aspect, an embodiment of the present invention provides a mobile terminal, where the mobile terminal includes:

a first data acquisition module, used for acquiring the picture-by-pixel information of the target image, the physical parameters of shooting, and the first white balance gain coefficient of the first n frames of the target image;

a first data determination module, configured to determine a second white balance gain coefficient and an update reference coefficient based on the picture-by-pixel information and the shooting physical parameters;

a first update module, configured to use the update reference coefficient to update the second white balance gain coefficient when the second white balance gain coefficient needs to be updated;

a first white balance processing module, configured to perform white balance processing on the target image by using the updated second white balance gain coefficient;

Wherein, the target image is the current frame image; n is a positive integer greater than or equal to 1.

In a fourth aspect, an embodiment of the present invention provides a mobile terminal, where the mobile terminal includes:

The second data acquisition module is used to acquire the pixel-by-pixel information of the first picture of the target image, the pixel-by-pixel information of the second picture of the first n frames of the target image, and the first white balance gain coefficient of the first n frames; the n is a positive integer greater than or equal to 1;

a second data determination module, configured to determine a second white balance gain coefficient and determine an update reference coefficient based on the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture;

a second update module, configured to use the update reference coefficient to update the second white balance gain coefficient when the second white balance gain coefficient needs to be updated;

A second white balance processing module, configured to use the updated second white balance gain coefficient to perform white balance processing on the target image;

Wherein, the target image is the current frame image.

In a fifth aspect, an embodiment of the present invention provides a mobile terminal, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program is executed by the processor When implementing the steps of the above-mentioned white balance processing method.

In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above white balance processing method are implemented.

In this embodiment of the present invention, when shooting a target image, the update reference coefficient is determined according to the shooting physical parameters of the target image, and the second white balance gain coefficient is calculated according to the pixel-by-pixel information of the target image. When updating, the update reference coefficient is used to update the second white balance gain coefficient, and finally the updated second white balance gain coefficient is used to perform white balance processing on the target image. The white balance gain coefficient of the image white balance is in a relatively stable state. Therefore, by applying the embodiments of the present invention, a stable white balance gain coefficient can be obtained under the condition that the lens of the mobile terminal is displaced, causing the screen to change but the ambient color temperature does not change. The large change of the white balance coefficient of the target image causes the picture to shake and stabilize the picture quality.

Description of drawings

FIG. 1 is a flowchart of steps in an embodiment of a white balance processing method according to an embodiment of the present invention;

2 is a schematic diagram of an acceleration according to an embodiment of the present invention;

3 is a schematic diagram of a rotation angle according to an embodiment of the present invention;

4 is a flowchart of steps of another embodiment of a white balance processing method according to an embodiment of the present invention;

5 is a structural block diagram of an embodiment of a mobile terminal according to an embodiment of the present invention;

6 is a structural block diagram of another embodiment of a mobile terminal according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of a hardware structure of a mobile terminal according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

Referring to FIG. 1, there is shown a flowchart of steps of an embodiment of a white balance processing method according to an embodiment of the present invention. The white balance processing method is applied to a mobile terminal, and may specifically include the following steps:

Step 101: Acquire picture-by-pixel information of the target image, shooting physical parameters, and first white balance gain coefficients of the first n frames of the target image.

In specific implementation, the embodiments of the present invention may be applied to mobile terminals, for example, mobile phones, tablet computers, personal digital assistants, wearable devices (such as bracelets, glasses, watches, etc.) and the like. The target image is the current frame image (current frame) currently captured by the mobile terminal.

The pixel-by-pixel information of the picture is the pixel information of all the pixels on the picture of the current frame. Wherein, the pixel-by-pixel information of the picture may be valued at an interval of m(0-i) pixels, and the value of m is determined according to conditions and requirements, and m and i are positive integers.

The shooting physical parameters are the relevant physical parameters when shooting the current frame, including but not limited to acceleration, rotation angle, and focus distance. The acceleration can be collected by an acceleration sensor, and the acceleration sensor can collect the accelerations A _x , A _y , and A _z on the x, y, and z axes of the mobile terminal. Referring to FIG. 2 , the x and y axes are located on the plane where the screen of the mobile terminal is located, and the z axis is perpendicular to the screen of the mobile terminal. The rotation angle can be collected by a gyroscope, and the gyroscope can collect the rotation angles A _xz , A _xy , and A _yz of the mobile terminal in the three-dimensional space. For details, please refer to FIG. 3 . The focusing distance, also called the object distance H, refers to the distance from the object to be photographed to the optical center of the lens of the mobile terminal lens.

n is a positive integer greater than or equal to 1. In this embodiment of the present invention, the first white balance gain coefficient of the first n frames before the target image, that is, the AWB Gain, is also obtained. Of course, in practical applications, only the first white balance gain coefficient can be obtained AWB Gain for 1 frame.

Step 102: Determine a second white balance gain coefficient and an update reference coefficient based on the picture pixel-by-pixel information and the shooting physical parameters.

In this embodiment of the present invention, the second white balance gain coefficient will be determined based on the pixel-by-pixel information of the picture, and the update reference coefficient will be determined based on the shooting physical parameters.

In a preferred embodiment of the present invention, the step 102 may include the following sub-steps:

In sub-step S11, the shooting physical parameters are used to determine the continuous change amount of the picture.

The embodiment of the present invention can calculate the continuous change of the picture according to the collected shooting physical parameters, and the continuous change of the picture can reflect the change of the picture. In one embodiment, the sub-step S11 may include the following sub-steps:

Using the acceleration, calculate the screen translation amount;

Using the rotation angle, calculate the screen offset;

Using the translation amount and the offset amount, the continuous change amount of the picture is calculated.

In the specific implementation, the screen translation is related to the acceleration of the mobile terminal lens in three-dimensional space, and the screen offset is related to the rotation angle of the mobile terminal lens in three-dimensional space, which can be further calculated according to the screen translation and screen offset. Displays the continuous change of the screen.

In a preferred embodiment of the present invention, using the acceleration calculation, the screen translation amount may include the following steps:

In the case that the focusing distance is greater than or equal to a preset distance, set the translation amount to a preset value;

When the focus distance is less than the preset distance, the acceleration is used to calculate the screen translation amount.

其中，A_x、A_y、A_z为各方向的加速度，W_x、W_y、W_z为各方向权重。If considering the focusing distance H, when H is greater than a certain distance threshold, it is considered that the translation of the mobile terminal has no effect on the screen translation amount, and the screen translation amount T can be set to a preset value, such as T=0; when H is less than a certain distance threshold value hour,

Among them, A _x , A _y , and A _z are accelerations in each direction, and W _x , W _y , and W _z are weights in each direction.

In another preferred embodiment of the present invention, the acceleration includes a z-axis acceleration perpendicular to the mobile terminal, and an x-axis acceleration and a y-axis acceleration parallel to the mobile terminal, and using the acceleration, Calculating the screen shift amount may include the following sub-steps:

When the focusing distance is greater than or equal to a preset distance, the x-axis acceleration and the y-axis acceleration are used to calculate the screen translation amount;

When the focus distance is less than the preset distance, the screen translation amount is calculated by using the x-axis acceleration, the y-axis acceleration, and the z-axis acceleration.

当H小于一定距离阈值时，其中，A_x、A_y、A_z为各方向的加速度，W_x、W_y、W_z为各方向权重。If the focusing distance H is considered, when H is greater than a certain distance threshold, the movement of the lens in the z-axis direction basically does not affect the change of the picture, so the movement in the z-axis direction can be ignored, then

When H is less than a certain distance threshold, Among them, A _x , A _y , and A _z are accelerations in each direction, and W _x , W _y , and W _z are weights in each direction.

In a preferred embodiment of the present invention, the calculation of the screen offset using the rotation angle may include the following sub-steps:

Using the rotation angle, the screen offset is calculated.

其中，A_xz、A_xy、A_yz为三维空间各方向上旋转角度，W_xy、W_xz、W_yz为各方向权重。If the focus distance H is not considered, the offset R can be calculated directly by the rotation angle,

Among them, A _xz , A _xy , and A _yz are rotation angles in each direction of the three-dimensional space, and W _xy , W _xz , and W _yz are the weights of each direction.

In another preferred embodiment of the present invention, using the rotation angle to calculate the screen offset may include the following sub-steps:

When the focus distance is greater than or equal to the preset distance, the rotation angle is used to calculate the screen offset;

In the case that the focus distance is less than a preset distance, the screen offset is set to a preset value.

其中，A_xz、A_xy、A_yz为三维空间各方向上旋转角度，W_xy、W_xz、W_yz为各方向权重。If the focusing distance H is considered, when H is less than a certain distance threshold, it can be considered that the mobile terminal is currently moving at a macro distance, and the actual screen shift is not large. In this case, the offset R is set to a preset value, for example, R=0 ; When H is greater than a certain distance threshold,

Among them, A _xz , A _xy , and A _yz are rotation angles in each direction of the three-dimensional space, and W _xy , W _xz , and W _yz are the weights of each direction.

In this embodiment of the present invention, after T and R are calculated, the screen change amount C can be calculated according to the two data, C=W _r *R+W _t *T, where W _r is the weight of the offset R, and W _t is the weight of the translation amount T.

Further, after the picture change amount C obtained by the weighted calculation of T and R, the picture continuous change amount Cn can be obtained after recording C of several consecutive frames, that is, Cn=ΣCi.

Sub-step S12, calculating the second white balance gain coefficient of the target image by using the pixel-by-pixel information of the picture.

In this embodiment of the present invention, the white balance gain value (AWB Gain) of the current frame may be calculated according to the pixel-by-pixel information of the current frame.

In a preferred embodiment of the present invention, the sub-step S12 may include the following sub-steps:

dividing the current frame into at least one picture block;

The picture statistical information is extracted from the picture pixel-by-pixel information; the picture statistical information includes the mean value of the R component, the mean value of the G component and the mean value of the B component of each picture block;

Calculate the ratio of the mean value of the G component to the mean value of the R component as the first coefficient;

Calculate the ratio of the mean value of the G component to the mean value of the B component as a second coefficient;

The first coefficient and the second coefficient are used as the second white balance gain coefficient of the current frame.

In this embodiment of the present invention, the current frame is divided into multiple picture blocks, for example, the current frame can be divided into M*N blocks, where M and N are positive integers, and then the average value of the R component and the G component of each picture block are counted The mean value and the B component mean value are obtained to obtain the picture statistics of the picture block.

In practical applications, the calculation of AWB Gain is generally based on the gray-scale world theory. The gray-scale world theory is: for any image, when there are enough color changes, the average value of its R, G, and B components will tend to balance (ie, RGB). The three values are equal, that is to say, it should be black, white and gray. According to the grayscale world theory, the average result of R/G and B/G in the picture statistics of the current frame should be 1. If the result is not 1 is the influence of the color temperature of the ambient light source, so for the influence of the color temperature of the ambient light source, it is only necessary to multiply the R and B channels of the picture by G/R and G/B to restore the color of the picture. That is to say, in the embodiment of the present invention, the ratio of the average value of the G component to the average value of the R component is used as the first coefficient (G/R), the ratio of the average value of the G component to the average value of the B component is used as the second coefficient (G/B), and the The first coefficient and the second coefficient are the AWB Gain of the current frame.

In a preferred embodiment of the present invention, after the picture statistical information is extracted from the picture pixel-by-pixel information, the following steps may be further included:

Screen out a priori white picture blocks from the picture blocks of the current frame;

Obtain the mean value of the R component, the mean value of the G component and the mean value of the B component of the prior white picture block.

However, the grayscale world theory is not always established, such as when there are relatively large color blocks in the environment, so the embodiment of the present invention can realize grayscale on the basis of the prior white image block (prior white area) of the current frame According to the world theory, the transcendental white area is to describe the drop point of a white object in the R/G and B/G coordinate spaces under different color temperature light sources, and to describe an area based on the drop point. After determining the transcendental white area of the current frame Then, the AWB Gain can be calculated according to the gray-scale world theory based on the mean value of the R component, the mean value of the G component, and the mean value of the B component in the prior white area.

In sub-step S13, the reference coefficient for updating is determined according to the continuous change of the picture.

In specific implementation, the continuous change of the picture can reflect the change of the picture. Therefore, in this embodiment of the present invention, an update reference coefficient can be determined according to the continuous change of the picture, which is used to adjust the change range of the white balance gain coefficient of the current frame.

In a preferred embodiment of the present invention, the sub-step S13 may include the following sub-steps:

In the case that the amount of continuous picture change is greater than or equal to a preset threshold, setting the update reference coefficient as a first preset update reference coefficient;

In the case that the amount of continuous picture change is smaller than a preset threshold, the update reference coefficient is set as a second preset update reference coefficient; the second preset update reference coefficient is greater than the first preset update reference coefficient .

If Cn is greater than a certain threshold, it is considered that the amount of screen change is large. At this time, the AWB Gain is likely to be the AWB fluctuation caused by the color change of the scene object. At this time, a smaller update reference coefficient is set to update the AWB Gain. Otherwise, set a larger update reference coefficient to update AWB Gain.

If the camera of the mobile terminal is at a stable color temperature, constantly moving the picture may cause the calculated AWB Gain to fluctuate around the real value, and the update reference coefficient is obtained by detecting the change of the picture, and by updating the reference coefficient for the current frame. AWB Gain is adjusted to suppress this fluctuation; and if the real color temperature changes, it can be quickly switched to the correct AWB Gain when the amount of picture change is small, and can also be gradually switched when the amount of picture change is large. to the exact AWB Gain.

Step 103 , when the second white balance gain coefficient needs to be updated, the update reference coefficient is used to update the second white balance gain coefficient.

In a specific implementation process, whether it is necessary to update the second white balance gain coefficient, that is, the AWB Gain of the current frame, may be determined according to the first white balance gain coefficient and the second white balance gain coefficient. Specifically, whether the second white balance gain coefficient needs to be updated may be determined in the following manner:

calculating the difference between the first white balance gain coefficient and the second white balance gain coefficient;

In the case where the difference between the first white balance gain coefficient and the second white balance gain coefficient is greater than or equal to a preset difference, determine that the second white balance gain coefficient needs to be updated;

In the case that the difference between the first white balance gain coefficient and the second white balance gain coefficient is smaller than a preset difference value, it is determined that the second white balance gain coefficient does not need to be updated.

If the difference between the AWB Gain of the current frame and the AWB Gain of the previous frame or the previous nth frame is greater than a certain difference, the AWB Gain of the current frame needs to be updated.

If the difference between the AWB Gain of the current frame and the AWB Gain of the previous frame or the previous nth frame is less than a certain difference, it is not necessary to update the AWB Gain of the current frame.

Step 104 , using the updated second white balance gain coefficient to perform white balance processing on the target image, wherein the target image is the current frame image.

When it is determined that the AWB Gain of the current frame needs to be updated, a new AWB Gain of the current frame is calculated by combining the update reference coefficient and the AWB Gain of the current frame, and the AWB Gain of the current frame is used to perform white balance processing on the current frame. Wherein, the AWB Gain recalculated every other frame or multiple frames is close to the update reference coefficient (step).

In a preferred embodiment of the present invention, the method may further include the following steps:

When the second white balance gain coefficient does not need to be updated, the second white balance gain coefficient is used to perform white balance processing on the target image.

When it is determined that the AWB Gain of the current frame does not need to be updated, the AWB Gain of the current frame may be directly used to perform white balance processing on the current frame.

In this embodiment of the present invention, when shooting a target image, the update reference coefficient is determined according to the shooting physical parameters of the target image, and the second white balance gain coefficient is calculated according to the pixel-by-pixel information of the target image. When updating, the update reference coefficient is used to update the second white balance gain coefficient, and finally the updated second white balance gain coefficient is used to perform white balance processing on the target image. The white balance gain coefficient of the image white balance is in a relatively stable state. Therefore, by applying the embodiments of the present invention, a stable white balance gain coefficient can be obtained under the condition that the lens of the mobile terminal is displaced, causing the screen to change but the ambient color temperature does not change. The large change of the white balance coefficient of the target image causes the picture to shake and stabilize the picture quality.

Referring to FIG. 4 , a flowchart of steps of another embodiment of a white balance processing method according to an embodiment of the present invention is shown. The white balance processing method is applied to a mobile terminal, and may specifically include the following steps:

Step 201: Acquire the pixel-by-pixel information of the first picture of the target image, the pixel-by-pixel information of the second picture of the first n frames of the target image, and the first white balance gain coefficient of the first n frames.

n is a positive integer greater than or equal to 1. In this embodiment of the present invention, when the mobile terminal captures the current frame (target image), the pixel-by-pixel information of the first picture of the current frame and the pixel-by-pixel information of the second picture corresponding to the previous n frames are obtained. The first white balance gain coefficients corresponding to the first n frames respectively. It should be noted that, in this embodiment of the present invention, the pixel-by-pixel information and the first white balance gain coefficient of the second picture of the first n frames can be obtained, and the pixel-by-pixel information and the first white balance gain coefficient of the second picture of a certain frame of the first n frames can also be obtained. For the first white balance gain coefficient, corresponding data may be obtained according to actual needs, which is not limited in this embodiment of the present invention.

Step 202: Determine a second white balance gain coefficient and determine an update reference coefficient based on the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture.

In this embodiment of the present invention, the second white balance gain coefficient is determined based on the pixel-by-pixel information of the first picture, and the update reference coefficient is determined based on the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture.

In a preferred embodiment of the present invention, the step 202 may include the following sub-steps:

Sub-step S21, dividing the target image into at least one first picture block, and dividing the first n frames into at least one second picture block.

In the specific implementation process, the entire current frame and the picture of the previous n frames can be divided into W*H regions (picture blocks), where W and H are positive integers, and the values are determined according to conditions or requirements.

Sub-step S22 selects a moving picture block from the first picture blocks according to the pixel-by-pixel information of the first picture of each of the first picture blocks and the pixel-by-pixel information of the second picture of each of the second picture blocks.

In this embodiment of the present invention, a moving picture block may be screened out from the first picture block of the current frame according to the picture-by-pixel information corresponding to the picture block of the current frame and the picture blocks of the previous n frames respectively. The moving picture block is the picture area of the current frame where the picture changes greatly.

In a preferred embodiment of the present invention, the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture have pixel information of each pixel, and the sub-step S22 may include the following sub-steps:

performing differential processing on the pixel point information of the first picture block and the pixel point information of the second picture block at the same position to obtain a difference component;

In the case that the difference component exceeds the first preset threshold, the corresponding pixel in the first picture block is used as a motion pixel;

separately count the number of motion pixels in each of the first picture blocks;

When the number of the motion pixels exceeds a second preset threshold, the first picture block is regarded as a motion picture block.

Both the current frame and the previous n frames are divided into a plurality of picture blocks. In this embodiment of the present invention, the average value of the R component, the average value of the G component, and the average value of the B component of each picture block of the current frame and the previous n frames will be counted respectively to obtain the picture statistical information. .

In one embodiment, the frame difference method is used for each picture block to determine whether it is a moving picture block. Specifically, each pixel is obtained by performing differential processing on the picture statistics information of each picture block of the current frame and the previous n frames at the same position. The difference component between the points, and thresholding to extract the moving picture block in the current frame, that is, when the difference component between the pixels in the picture block exceeds a certain motion threshold, it is considered to be a moving pixel, and when the motion in the picture block When the number of pixels is greater than a certain threshold, it is considered as a moving picture block; otherwise, if the above conditions are not met, it is not a moving picture block.

In another preferred embodiment of the present invention, the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture have pixel information of each pixel, and the sub-step S22 may include the following sub-steps :

Counting the pixel point information of the second picture block at the same position, and calculating the average pixel point information;

performing differential processing between the pixel point information of the first picture block at the same position and the average pixel point information to obtain a difference component;

In the case that the difference component exceeds a third preset threshold, the corresponding pixel in the first picture block is used as a motion pixel;

separately count the number of motion pixels in each of the first picture blocks;

In the case that the number of the motion pixels exceeds a fourth preset threshold, the first picture block is regarded as a motion picture block.

In another embodiment, the background subtraction method is used for each picture block to determine whether it is a moving picture block. Specifically, for the same position, the average pixel point information m is obtained according to the picture statistical information of each picture block of the previous n frames. (The pixels at the same position in the previous n frames are averaged), and the difference between each pixel is obtained by subtracting m from the picture statistics of the picture block of the current frame. When the difference is greater than a certain motion threshold, it is considered to be a motion pixel. , and then count the number n of motion pixels in each picture block. If n is greater than a certain threshold, it is considered a motion picture block and counted in the number of motion picture blocks; otherwise, if the above conditions are not met, it is not a motion picture block.

Sub-step S23, count the number of the moving picture blocks in the target image.

After the moving picture blocks are filtered out from the current frame, the number of moving picture blocks is counted.

Sub-step S24, using the pixel-by-pixel information of the first picture to calculate the second white balance gain coefficient of the target image.

In this embodiment of the present invention, the white balance gain value (AWB Gain) of the current frame may be calculated according to the pixel-by-pixel information of the current frame.

In a preferred embodiment of the present invention, the sub-step S24 may include the following sub-steps:

The picture statistics information is extracted from the pixel-by-pixel point information of the first picture; the picture statistics information includes the mean value of the R component, the mean value of the G component and the mean value of the B component of each first picture block;

Calculate the ratio of the mean value of the G component to the mean value of the R component as the first coefficient;

Calculate the ratio of the mean value of the G component to the mean value of the B component as a second coefficient;

The first coefficient and the second coefficient are used as the second white balance gain coefficient of the current frame.

In this embodiment of the present invention, the current frame is divided into multiple picture blocks, for example, the current frame can be divided into M*N blocks, where M and N are positive integers, and then the average value of the R component and the G component of each picture block are counted mean and B component mean.

In practical applications, the calculation of AWB Gain is generally based on the gray-scale world theory. The gray-scale world theory is: for any image, when there are enough color changes, the average value of its R, G, and B components will tend to balance (ie, RGB). The three values are equal, that is to say, it should be black, white and gray. According to the grayscale world theory, the average result of R/G and B/G in the picture statistics of the current frame should be 1. If the result is not 1 is the influence of the color temperature of the ambient light source, so for the influence of the color temperature of the ambient light source, it is only necessary to multiply the R and B channels of the picture by G/R and G/B to restore the color of the picture. That is to say, in the embodiment of the present invention, the ratio of the average value of the G component to the average value of the R component is used as the first coefficient (G/R), the ratio of the average value of the G component to the average value of the B component is used as the second coefficient (G/B), and the The first coefficient and the second coefficient are the AWB Gain of the current frame.

In a preferred embodiment of the present invention, after the picture statistical information is extracted from the pixel-by-pixel information of the first picture, the method further includes:

Screen out a priori white picture block from the first picture block of the current frame;

Obtain the mean value of the R component, the mean value of the G component and the mean value of the B component of the prior white picture block.

However, the grayscale world theory is not always established, such as when there are relatively large color blocks in the environment, so the embodiment of the present invention can realize grayscale on the basis of the prior white image block (prior white area) of the current frame According to the world theory, the transcendental white area is to describe the drop point of a white object in the R/G and B/G coordinate spaces under different color temperature light sources, and to describe an area based on the drop point. After determining the transcendental white area of the current frame Then, the AWB Gain can be calculated according to the gray-scale world theory based on the mean value of the R component, the mean value of the G component, and the mean value of the B component in the prior white area.

Sub-step S25, according to the quantity, determine the update reference coefficient.

In specific implementation, the number of moving picture blocks (C) can reflect the change of the picture. The more moving picture blocks, the larger the amount of picture change, the less the number of moving picture blocks, the smaller the amount of picture change, so the present invention implements For example, an update reference coefficient is determined according to the number of moving picture blocks, which is used to adjust the variation range of the white balance gain coefficient of the current frame.

In a preferred embodiment of the present invention, the sub-step S25 may include the following sub-steps:

in the case that the number is greater than or equal to a fifth preset threshold, setting the update reference coefficient as a first preset update reference coefficient;

In the case that the number is less than a sixth preset threshold, setting the update reference coefficient as a second preset update reference coefficient;

Wherein, the second preset update reference coefficient is greater than the first preset update reference coefficient. If C is greater than a certain threshold, it is considered that the amount of screen change is too large. At this time, the AWB Gain is likely to be the AWB fluctuation caused by the color change of the scene object. At this time, a smaller update reference coefficient is set to update the AWB Gain. Otherwise, set a larger update reference coefficient to update AWB Gain.

If the camera of the mobile terminal is at a stable color temperature, constantly moving the picture may cause the calculated AWB color temperature to fluctuate around the real value, and the number of detected moving picture blocks can determine the amount of picture change, and then get based on the amount of picture change. Update the reference coefficient, and then adjust the AWB Gain of the current frame by updating the reference coefficient to suppress this fluctuation; and if the real color temperature changes, you can quickly switch to the correct AWB Gain when the amount of change in the picture is not large. , and in the case of large screen changes, you can gradually switch to the accurate AWB Gain.

Step 203 , when the second white balance gain coefficient needs to be updated, the second white balance gain coefficient is updated by using the update reference coefficient.

In a specific implementation process, whether it is necessary to update the second white balance gain coefficient, that is, the AWB Gain of the current frame, may be determined according to the first white balance gain coefficient and the second white balance gain coefficient.

In a preferred embodiment of the present invention, the step 207 may include the following sub-steps:

calculating the difference between the first white balance gain coefficient and the second white balance gain coefficient;

In the case where the difference between the first white balance gain coefficient and the second white balance gain coefficient is greater than or equal to a preset difference, determine that the second white balance gain coefficient needs to be updated;

In the case that the difference between the first white balance gain coefficient and the second white balance gain coefficient is smaller than a preset difference value, it is determined that the second white balance gain coefficient does not need to be updated.

If the difference between the AWB Gain of the current frame and the AWB Gain of the previous frame or the previous nth frame is greater than a certain difference, the AWB Gain of the current frame needs to be updated.

If the difference between the AWB Gain of the current frame and the AWB Gain of the previous frame or the previous nth frame is less than a certain difference, it is not necessary to update the AWB Gain of the current frame.

Step 204, using the updated second white balance gain coefficient to perform white balance processing on the target image.

When it is determined that the AWB Gain of the current frame needs to be updated, a new AWB Gain of the current frame is calculated by combining the update reference coefficient and the AWB Gain of the current frame, and the AWB Gain of the current frame is used to perform white balance processing on the current frame. Wherein, the AWB Gain recalculated every other frame or multiple frames is close to the update reference coefficient (step).

In a preferred embodiment of the present invention, the method may further include the following steps:

When the second white balance gain coefficient does not need to be updated, the second white balance gain coefficient is used to perform white balance processing on the target image.

When it is determined that the AWB Gain of the current frame does not need to be updated, the AWB Gain of the current frame may be directly used to perform white balance processing on the current frame.

The implementation of the present invention is to determine the picture change amount by identifying the picture change between the current frame and the previous n frames. Compared with the previous embodiment, it is not necessary to obtain the physical shooting parameters of the current frame, and the obtained picture change amount The accuracy is higher and it is more beneficial to stabilize the AWB Gain.

It should be noted that, for the sake of simple description, the method embodiments are described as a series of action combinations, but those skilled in the art should know that the embodiments of the present invention are not limited by the described action sequences, because According to embodiments of the present invention, certain steps may be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

Referring to FIG. 5 , a structural block diagram of an embodiment of a mobile terminal according to an embodiment of the present invention is shown, and the mobile terminal 300 may specifically include the following modules:

The first data acquisition module 301 is used to acquire the picture-by-pixel information of the target image, the physical parameters of shooting and the first white balance gain coefficient of the first n frames of the target image;

a first data determination module 302, configured to determine a second white balance gain coefficient and an update reference coefficient based on the pixel-by-pixel information of the picture and the shooting physical parameters;

a first update module 303, configured to update the second white balance gain coefficient by using the update reference coefficient when the second white balance gain coefficient needs to be updated;

a first white balance processing module 304, configured to perform white balance processing on the target image by using the updated second white balance gain coefficient;

Wherein, the target image is the current frame image; n is a positive integer greater than or equal to 1.

In a preferred embodiment of the present invention, the first data determination module 302 may include:

Using the shooting physical parameters to determine the continuous change amount of the picture;

Calculate the second white balance gain coefficient of the target image by using the pixel-by-pixel information of the picture;

According to the continuous change amount of the picture, the update reference coefficient is determined.

In a preferred embodiment of the present invention, the shooting physical parameters include acceleration and rotation angle; and determining the continuous change amount of the picture by using the shooting physical parameters includes:

Using the acceleration, calculate the screen translation amount;

Using the rotation angle, calculate the screen offset;

Using the translation amount and the offset amount, the continuous change amount of the picture is calculated.

In a preferred embodiment of the present invention, the shooting physical parameter further includes a focus distance;

The using the acceleration to calculate the screen translation includes:

In the case that the focusing distance is greater than or equal to a preset distance, set the translation amount to a preset value;

When the focus distance is less than the preset distance, the acceleration is used to calculate the screen translation amount.

In a preferred embodiment of the present invention, the shooting physical parameter further includes a focus distance; the acceleration includes a z-axis acceleration perpendicular to the mobile terminal and an x-axis acceleration and a y-axis acceleration parallel to the mobile terminal ;

The using the acceleration to calculate the screen translation includes:

When the focusing distance is greater than or equal to a preset distance, the x-axis acceleration and the y-axis acceleration are used to calculate the screen translation amount;

When the focus distance is less than the preset distance, the screen translation amount is calculated by using the x-axis acceleration, the y-axis acceleration, and the z-axis acceleration.

In a preferred embodiment of the present invention, calculating the screen offset by using the rotation angle includes:

Using the rotation angle, the screen offset is calculated.

In a preferred embodiment of the present invention, the shooting physical parameter further includes a focus distance;

The using the rotation angle to calculate the screen offset includes:

When the focus distance is greater than or equal to the preset distance, the rotation angle is used to calculate the screen offset;

In the case that the focus distance is less than a preset distance, the screen offset is set to a preset value.

In a preferred embodiment of the present invention, the mobile terminal further includes:

calculating the difference between the first white balance gain coefficient and the second white balance gain coefficient;

In the case where the difference between the first white balance gain coefficient and the second white balance gain coefficient is greater than or equal to a preset difference, determine that the second white balance gain coefficient needs to be updated;

In the case that the difference between the first white balance gain coefficient and the second white balance gain coefficient is smaller than a preset difference value, it is determined that the second white balance gain coefficient does not need to be updated.

In a preferred embodiment of the present invention, the mobile terminal further includes:

When the second white balance gain coefficient does not need to be updated, the second white balance gain coefficient is used to perform white balance processing on the target image.

In a preferred embodiment of the present invention, the determining the update reference coefficient according to the continuous change of the picture includes:

In the case that the amount of continuous picture change is greater than or equal to a preset threshold, setting the update reference coefficient as a first preset update reference coefficient;

In the case that the amount of continuous picture change is less than a preset threshold, setting the update reference coefficient as a second preset update reference coefficient;

Wherein, the second preset update reference coefficient is greater than the first preset update reference coefficient.

Referring to FIG. 6 , a structural block diagram of another embodiment of a mobile terminal according to an embodiment of the present invention is shown. The mobile terminal 400 may specifically include the following modules:

The second data acquisition module 401 is configured to acquire the pixel-by-pixel information of the first picture of the target image, the pixel-by-pixel information of the second picture of the first n frames of the target image, and the first white balance gain coefficient of the first n frames; the n is a positive integer greater than or equal to 1;

A second data determination module 402, configured to determine a second white balance gain coefficient and determine an update reference coefficient based on the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture;

A second update module 403, configured to use the update reference coefficient to update the second white balance gain coefficient when the second white balance gain coefficient needs to be updated;

The second white balance processing module 404 is configured to use the updated second white balance gain coefficient to perform white balance processing on the target image, wherein the target image is the current frame image.

In a preferred embodiment of the present invention, the second data determination module 402 includes:

dividing the target image into at least one first picture block, and dividing the first n frames into at least one second picture block;

According to the pixel-by-pixel information of the first picture of each of the first picture blocks and the pixel-by-pixel information of the second picture of each of the second picture blocks, from the first picture blocks, screen out the moving picture blocks;

Counting the number of the moving picture blocks in the target image;

Calculate the second white balance gain coefficient of the target image by using the pixel-by-pixel information of the first picture;

Based on the number, an update reference coefficient is determined.

In a preferred embodiment of the present invention, the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture have pixel information of each pixel;

The moving picture is filtered out from the first picture block according to the pixel-by-pixel information of the first picture of each of the first picture blocks and the pixel-by-pixel information of the second picture of each of the second picture blocks blocks, including:

performing differential processing on the pixel point information of the first picture block and the pixel point information of the second picture block at the same position to obtain a difference component;

In the case that the difference component exceeds the first preset threshold, the corresponding pixel in the first picture block is used as a motion pixel;

separately count the number of motion pixels in each of the first picture blocks;

When the number of the motion pixels exceeds a second preset threshold, the first picture block is regarded as a motion picture block.

In a preferred embodiment of the present invention, the pixel-by-pixel information of the first picture and the pixel-by-pixel information of the second picture have pixel information of each pixel;

The moving picture is filtered out from the first picture block according to the pixel-by-pixel information of the first picture of each of the first picture blocks and the pixel-by-pixel information of the second picture of each of the second picture blocks blocks, including:

Counting the pixel point information of the second picture block at the same position, and calculating the average pixel point information;

performing differential processing between the pixel point information of the first picture block at the same position and the average pixel point information to obtain a difference component;

In the case that the difference component exceeds a third preset threshold, the corresponding pixel in the first picture block is used as a motion pixel;

separately count the number of motion pixels in each of the first picture blocks;

In the case that the number of the motion pixels exceeds a fourth preset threshold, the first picture block is regarded as a motion picture block.

In a preferred embodiment of the present invention, the mobile terminal further includes:

calculating the difference between the first white balance gain coefficient and the second white balance gain coefficient;

In the case where the difference between the first white balance gain coefficient and the second white balance gain coefficient is greater than or equal to a preset difference, determine that the second white balance gain coefficient needs to be updated;

When the difference between the first white balance gain coefficient and the second white balance gain coefficient is smaller than a preset difference, it is determined that the second white balance gain coefficient needs to be updated.

In a preferred embodiment of the present invention, the mobile terminal further includes:

Under the condition that the second white balance gain coefficient does not need to be updated, white balance processing is performed on the target image by using the second white balance gain coefficient.

In a preferred embodiment of the present invention, the determining and updating the reference coefficient according to the quantity includes:

in the case that the number is greater than or equal to a fifth preset threshold, setting the update reference coefficient as a first preset update reference coefficient;

In the case that the number is less than a sixth preset threshold, setting the update reference coefficient as a second preset update reference coefficient;

Wherein, the second preset update reference coefficient is greater than the first preset update reference coefficient.

As for the apparatus embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and reference may be made to the partial description of the method embodiment for related parts.

7 is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present invention. The mobile terminal 70 includes but is not limited to: a radio frequency unit 71, a network module 72, an audio output unit 73, an input unit 74, a sensor 75, and a display unit 76. User input unit 77, interface unit 78, memory 79, processor 710, power supply 711 and other components. Those skilled in the art can understand that the structure of the mobile terminal shown in FIG. 7 does not constitute a limitation on the mobile terminal, and the mobile terminal may include more or less components than the one shown, or combine some components, or different components layout. In this embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

The processor 710 is configured to obtain the picture-by-pixel information of the target image, the shooting physical parameters, and the first white balance gain coefficient of the first n frames of the target image; based on the picture-by-pixel information and the shooting physical parameters parameters, determine the second white balance gain coefficient and update the reference coefficient; when the second white balance gain coefficient needs to be updated, use the update reference coefficient to update the second white balance gain coefficient; use the updated The second white balance gain coefficient performs white balance processing on the target image; wherein, the target image is the current frame image; n is a positive integer greater than or equal to 1.

The processor 710 is further configured to obtain the pixel-by-pixel information of the first picture of the target image, the pixel-by-pixel information of the second picture of the first n frames of the target image, and the first white balance gain coefficient of the first n frames; The pixel-by-pixel information of a picture and the pixel-by-pixel information of the second picture, determine the second white balance gain coefficient and determine the update reference coefficient; when the second white balance gain coefficient needs to be updated, use the update reference coefficient, update the second white balance gain coefficient; use the updated second white balance gain coefficient to perform white balance processing on the target image; wherein, the target image is the current frame image; n is greater than or A positive integer equal to 1.

In this embodiment of the present invention, when shooting a target image, the update reference coefficient is determined according to the shooting physical parameters of the target image, and the second white balance gain coefficient is calculated according to the pixel-by-pixel information of the target image. When updating, the update reference coefficient is used to update the second white balance gain coefficient, and finally the updated second white balance gain coefficient is used to perform white balance processing on the target image. The white balance gain coefficient of the image white balance is in a relatively stable state. Therefore, by applying the embodiments of the present invention, a stable white balance gain coefficient can be obtained under the condition that the lens of the mobile terminal is displaced, causing the screen to change but the ambient color temperature does not change. The large change of the white balance coefficient of the target image causes the picture to shake and stabilize the picture quality.

It should be understood that, in this embodiment of the present invention, the radio frequency unit 71 can be used for receiving and sending signals during sending and receiving of information or during a call. Specifically, after receiving the downlink data from the base station, it is processed by the processor 710; The uplink data is sent to the base station. Typically, the radio frequency unit 71 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 71 can also communicate with the network and other devices through a wireless communication system.

The mobile terminal provides the user with wireless broadband Internet access through the network module 72, such as helping the user to send and receive emails, browse web pages, and access streaming media.

The audio output unit 73 may convert audio data received by the radio frequency unit 71 or the network module 72 or stored in the memory 79 into audio signals and output as sound. Also, the audio output unit 73 may also provide audio output related to a specific function performed by the mobile terminal 70 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 73 includes a speaker, a buzzer, a receiver, and the like.

The input unit 74 is used to receive audio or video signals. The input unit 74 may include a graphics processor (Graphics Processing Unit, GPU) 741 and a microphone 742, and the graphics processor 741 captures still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 76 . The image frames processed by the graphics processor 741 may be stored in the memory 79 (or other storage medium) or transmitted via the radio frequency unit 71 or the network module 72 . The microphone 742 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 71 for output in the case of a telephone call mode.

The mobile terminal 70 also includes at least one type of sensor 75, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 761 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 761 and the display panel 761 when the mobile terminal 70 is moved to the ear. / or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of mobile terminals (such as horizontal and vertical screen switching, related games , magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 75 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, Infrared sensors, etc., are not repeated here.

The display unit 76 is used to display information input by the user or information provided to the user. The display unit 76 may include a display panel 761, and the display panel 761 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 77 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the mobile terminal. Specifically, the user input unit 77 includes a touch panel 771 and other input devices 772 . The touch panel 771, also referred to as a touch screen, can collect touch operations by the user on or near it (such as the user's finger, stylus, etc., any suitable object or accessory on or near the touch panel 771). operate). The touch panel 771 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 710, the command sent by the processor 710 is received and executed. In addition, the touch panel 771 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 771 , the user input unit 77 may also include other input devices 772 . Specifically, other input devices 772 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.

Further, the touch panel 771 can be covered on the display panel 761. When the touch panel 771 detects a touch operation on or near it, it transmits it to the processor 710 to determine the type of the touch event, and then the processor 710 determines the type of the touch event according to the touch The type of event provides corresponding visual output on display panel 761 . Although in FIG. 7 , the touch panel 771 and the display panel 761 are used as two independent components to realize the input and output functions of the mobile terminal, but in some embodiments, the touch panel 771 and the display panel 761 may be integrated The input and output functions of the mobile terminal are implemented, which is not specifically limited here.

The interface unit 78 is an interface for connecting an external device to the mobile terminal 70 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 78 may be used to receive input (eg, data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 70 or may be used to communicate between the mobile terminal 70 and the external Transfer data between devices.

The memory 79 may be used to store software programs as well as various data. The memory 79 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required for at least one function, and the like; Data created by the use of the mobile phone (such as audio data, phone book, etc.), etc. Additionally, memory 79 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 710 is the control center of the mobile terminal, using various interfaces and lines to connect various parts of the entire mobile terminal, by running or executing the software programs and/or modules stored in the memory 79, and calling the data stored in the memory 79. , perform various functions of the mobile terminal and process data, so as to monitor the mobile terminal as a whole. The processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem The processor mainly handles wireless communication. It can be understood that, the above-mentioned modulation and demodulation processor may not be integrated into the processor 710.

The mobile terminal 70 may also include a power source 711 (such as a battery) for supplying power to various components. Preferably, the power source 711 may be logically connected to the processor 710 through a power management system, so as to manage charging, discharging, and power consumption management through the power management system. and other functions.

In addition, the mobile terminal 70 includes some unshown functional modules, which will not be repeated here.

Preferably, an embodiment of the present invention further provides a mobile terminal, including a processor 710 , a memory 79 , a computer program stored in the memory 79 and running on the processor 710 , when the computer program is executed by the processor 710 Each process of the above embodiments of the white balance processing method is implemented, and the same technical effect can be achieved. To avoid repetition, details are not described here.

Embodiments of the present invention further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, each process of the above-mentioned white balance processing method embodiment can be achieved, and can achieve the same The technical effect, in order to avoid repetition, will not be repeated here. The computer-readable storage medium is, for example, a read-only memory (Read-Only Memory, ROM for short), a random access memory (Random Access Memory, RAM for short), a magnetic disk, or an optical disk.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present invention can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, CD), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of the present invention, without departing from the spirit of the present invention and the scope protected by the claims, many forms can be made, which all belong to the protection of the present invention.

Claims (19)

1. A white balance processing method is applied to a mobile terminal, and is characterized by comprising the following steps:

acquiring picture pixel-by-pixel information of a target image, shooting physical parameters and a first white balance gain coefficient of n frames before the target image;

determining a second white balance gain coefficient based on the picture pixel-by-pixel information; determining an update reference coefficient based on the shooting physical parameters;

under the condition that the second white balance gain coefficient needs to be updated, updating the second white balance gain coefficient by adopting the updating reference coefficient;

performing white balance processing on the target image by adopting the updated second white balance gain coefficient;

wherein the target image is a current frame image; n is a positive integer greater than or equal to 1.

2. The method of claim 1, wherein determining a second white balance gain coefficient and updating a reference coefficient based on the picture pixel-by-pixel information and the shooting physical parameter comprises:

determining continuous variable quantity of the picture by adopting the shooting physical parameters;

calculating a second white balance gain coefficient of the target image by adopting the picture pixel-by-pixel information;

and determining an updating reference coefficient according to the continuous variation of the picture.

3. The method according to claim 2, wherein the shooting physical parameters include acceleration, rotation angle;

the determining the continuous variation of the picture by using the shooting physical parameters comprises:

calculating the translation amount of the picture by adopting the acceleration;

calculating the frame offset by adopting the rotation angle;

and calculating the continuous variable quantity of the picture by adopting the translation quantity and the offset quantity.

4. The method of claim 3, wherein the shooting physical parameters further include a focus distance;

the calculating the picture translation amount by adopting the acceleration comprises the following steps:

setting the translation amount as a preset numerical value under the condition that the focusing distance is greater than or equal to a preset distance;

and under the condition that the focusing distance is smaller than a preset distance, calculating the picture translation amount by adopting the acceleration.

5. The method of claim 3, wherein the shooting physical parameters further include a focus distance; the acceleration comprises a z-axis acceleration perpendicular to the mobile terminal and an x-axis acceleration and a y-axis acceleration parallel to the mobile terminal;

the calculating the picture translation amount by adopting the acceleration comprises the following steps:

under the condition that the focusing distance is larger than or equal to a preset distance, calculating the image translation amount by adopting the x-axis acceleration and the y-axis acceleration;

and under the condition that the focusing distance is smaller than a preset distance, calculating the picture translation amount by adopting the x-axis acceleration, the y-axis acceleration and the z-axis acceleration.

6. The method according to claim 3, wherein said calculating a picture shift amount using said rotation angle comprises:

and calculating the picture offset by adopting the rotation angle.

7. The method of claim 3, wherein the shooting physical parameters further include a focus distance;

the calculating the picture offset by adopting the rotation angle comprises the following steps:

under the condition that the focusing distance is larger than or equal to a preset distance, calculating the image offset by adopting the rotation angle;

and setting the picture offset as a preset numerical value under the condition that the focusing distance is smaller than a preset distance.

8. The method of claim 1, wherein determining a second white balance gain factor based on the picture pixel-by-pixel information; after determining the updated reference coefficient based on the shooting physical parameters, the method further includes:

calculating a difference between the first white balance gain factor and the second white balance gain factor;

determining that the second white balance gain coefficient needs to be updated in the case that the difference between the first white balance gain coefficient and the second white balance gain coefficient is greater than or equal to a preset difference;

determining that the second white balance gain factor does not need to be updated in a case where a difference between the first white balance gain factor and the second white balance gain factor is smaller than a preset difference.

9. The method according to claim 1 or 8, wherein said determining a second white balance gain factor based on said picture pixel-by-pixel information; after determining the updated reference coefficient based on the shooting physical parameters, the method further includes:

and under the condition that the second white balance gain coefficient is not required to be updated, carrying out white balance processing on the target image by adopting the second white balance gain coefficient.

10. The method according to claim 2, wherein the determining an updated reference coefficient according to the picture continuous variation comprises:

setting the updating reference coefficient as a first preset updating reference coefficient under the condition that the continuous variation of the picture is greater than or equal to a preset threshold value;

setting the updating reference coefficient as a second preset updating reference coefficient under the condition that the continuous variation of the picture is smaller than a preset threshold value;

wherein the second preset updating reference coefficient is larger than the first preset updating reference coefficient.

11. A white balance processing method is applied to a mobile terminal, and is characterized by comprising the following steps:

acquiring first picture pixel-by-pixel information of a target image, second picture pixel-by-pixel information of the first n frames of the target image and a first white balance gain coefficient of the first n frames;

determining a second white balance gain coefficient based on the first picture pixel-by-pixel information; determining an updating reference coefficient based on the first picture pixel-by-pixel information and the second picture pixel-by-pixel information;

under the condition that the second white balance gain coefficient needs to be updated, updating the second white balance gain coefficient by adopting the updating reference coefficient;

performing white balance processing on the target image by adopting the updated second white balance gain coefficient;

wherein the target image is a current frame image; n is a positive integer greater than or equal to 1.

12. The method of claim 11, wherein determining a second white balance gain factor based on the first picture pixel-by-pixel information; determining an update reference coefficient based on the first picture pixel-by-pixel information and the second picture pixel-by-pixel information, including:

dividing the target image into at least one first picture block, and dividing the first n frames into at least one second picture block;

screening out the moving picture blocks from the first picture blocks according to the first picture pixel-by-pixel information of each first picture block and the second picture pixel-by-pixel information of each second picture block;

counting the number of the motion picture surface blocks in the target image;

calculating a second white balance gain coefficient of the target image by adopting the pixel point-by-pixel point information of the first picture;

and determining an updated reference coefficient according to the number.

13. The method according to claim 12, wherein the first picture pixel-by-pixel information and the second picture pixel-by-pixel information have pixel information of each pixel;

the screening out the moving picture blocks from the first picture blocks according to the first picture pixel-by-pixel information of each first picture block and the second picture pixel-by-pixel information of each second picture block comprises the following steps:

carrying out difference processing on the pixel point information of the first picture block and the pixel point information of the second picture block at the same position to obtain a difference component;

taking a corresponding pixel point in the first picture block as a moving pixel point under the condition that the difference component exceeds a first preset threshold value;

respectively counting the number of the motion pixel points in each first picture block;

and under the condition that the number of the motion pixel points exceeds a second preset threshold value, taking the first picture block as a motion picture block.

14. The method according to claim 12, wherein the first picture pixel-by-pixel information and the second picture pixel-by-pixel information have pixel information of each pixel;

the screening out the moving picture blocks from the first picture blocks according to the first picture pixel-by-pixel information of each first picture block and the second picture pixel-by-pixel information of each second picture block comprises the following steps:

counting pixel point information of the second picture block at the same position, and calculating average pixel point information;

carrying out difference processing on the pixel point information of the first picture block at the same position and the average pixel point information to obtain a difference component;

taking a corresponding pixel point in the first picture block as a moving pixel point under the condition that the difference component exceeds a third preset threshold value;

respectively counting the number of the motion pixel points in each first picture block;

and under the condition that the number of the motion pixel points exceeds a fourth preset threshold value, taking the first picture block as a motion picture block.

15. The method of claim 12, wherein determining a second white balance gain factor based on said first picture pixel-by-pixel information; after determining the updated reference coefficient based on the first picture pixel-by-pixel information and the second picture pixel-by-pixel information, the method further includes:

calculating a difference between the first white balance gain factor and the second white balance gain factor;

determining that the second white balance gain coefficient needs to be updated in the case that the difference between the first white balance gain coefficient and the second white balance gain coefficient is greater than or equal to a preset difference;

determining that the second white balance gain factor does not need to be updated in a case where a difference between the first white balance gain factor and the second white balance gain factor is smaller than a preset difference.

16. The method according to claim 11 or 15, wherein a second white balance gain factor is determined based on the first picture pixel-by-pixel information; after determining the updated reference coefficient based on the first picture pixel-by-pixel information and the second picture pixel-by-pixel information, the method further includes:

and under the condition that the second white balance gain coefficient is not required to be updated, performing white balance processing on the target image by adopting the second white balance gain coefficient.

17. The method of claim 12, wherein determining the updated reference coefficients based on the number comprises:

setting the update reference coefficient to a first preset update reference coefficient if the number is greater than or equal to a fifth preset threshold;

setting the update reference coefficient to a second preset update reference coefficient when the number is smaller than a sixth preset threshold;

wherein the second preset updating reference coefficient is larger than the first preset updating reference coefficient.

18. A mobile terminal, characterized in that the mobile terminal comprises:

the first data acquisition module is used for acquiring picture pixel-by-pixel information of a target image, shooting physical parameters and a first white balance gain coefficient of n frames before the target image;

the first data determining module is used for determining a second white balance gain coefficient based on the picture pixel-by-pixel information; determining an update reference coefficient based on the shooting physical parameters;

a first updating module, configured to update the second white balance gain coefficient by using the update reference coefficient when the second white balance gain coefficient needs to be updated;

the first white balance processing module is used for carrying out white balance processing on the target image by adopting the updated second white balance gain coefficient;

wherein the target image is a current frame image; n is a positive integer greater than or equal to 1.

19. A mobile terminal, characterized in that the mobile terminal comprises:

the second data acquisition module is used for acquiring pixel point-by-pixel point information of a first picture of a target image, pixel point-by-pixel point information of a second picture of the previous n frames of the target image and a first white balance gain coefficient of the previous n frames; n is a positive integer greater than or equal to 1;

the second data determination module is used for determining a second white balance gain coefficient based on the pixel point-by-pixel point information of the first picture; determining an updating reference coefficient based on the first picture pixel-by-pixel information and the second picture pixel-by-pixel information;

a second updating module, configured to update the second white balance gain coefficient by using the updated reference coefficient when the second white balance gain coefficient needs to be updated;

the second white balance processing module is used for carrying out white balance processing on the target image by adopting the updated second white balance gain coefficient;

and the target image is a current frame image.

Images