WO2019019904A1

WO2019019904A1 - White balance processing method and apparatus, and terminal

Info

Publication number: WO2019019904A1
Application number: PCT/CN2018/094971
Authority: WO
Inventors: 袁全
Original assignee: Oppo广东移动通信有限公司
Priority date: 2017-07-25
Filing date: 2018-07-09
Publication date: 2019-01-31
Also published as: CN107371007A

Abstract

Disclosed by the present application are a white balance processing method and apparatus, and a terminal, said method being applied to a terminal comprising at least two different types of cameras, the method comprising: during the process of photographing, determining the current weight of each camera corresponding to current photographing environment parameters; and carrying out white balance processing on a currently acquired image according to the current weight of each camera. Hence, by means of adjusting the weight of each camera according to changes in photographing environment parameters, not only is it ensured that an image which suits current environment parameters may be obtained, but auto white balance (AWB) jump that is brought about by switching cameras is also prevented, thus improving user experience.

Description

White balance processing method, device and terminal

Cross-reference to related applications

This application claims the priority of the Chinese patent application number "201710612896.2" filed on July 25, 2017 by Guangdong Opal Mobile Communications Co., Ltd., which is entitled "White Balance Processing Method, Apparatus and Terminal".

Technical field

The present application relates to the field of camera technologies, and in particular, to a white balance processing method, apparatus, and terminal.

Background technique

With the development of technology, camera devices, cameras and other camera devices are widely used in people's daily life, work, and learning, and the role played in people's lives is becoming more and more important. When taking pictures with the camera, in order to ensure the true reproduction of colors in the image scene, the white balance must be controlled.

Related art, when two cameras are included in the terminal, the two cameras can be switched according to the shooting environment parameters. For example, when the zoom ratio is zoomed from 1x to 2x, the wide-angle lens is switched to the telephoto lens.

However, due to the difference in the Auto White Balance (AWB) settings of different cameras, this causes an AWB jump and a poor user experience when switching from one camera to another.

Summary of the invention

The object of the present invention is to solve at least one of the above technical problems to some extent.

To this end, the present application proposes a white balance processing method, which adjusts the weight of each camera according to changes in the shooting environment parameters, thereby ensuring that an image suitable for the current environmental parameters can be obtained, and AWB due to camera switching is avoided. Jumping phenomenon improves the user experience.

The present application also proposes a white balance processing device.

The application also proposes a terminal.

The application also proposes a computer readable storage medium.

The application also proposes a computer program product.

An embodiment of the present application provides a white balance processing method for a terminal that includes at least two different types of cameras. The method includes:

During the shooting process, determining the current weight of each camera corresponding to the current shooting environment parameter;

The currently acquired image is subjected to white balance processing according to the current weight of each camera.

The white balance processing method provided by the embodiment of the present application first determines the current weight of each camera corresponding to the current shooting environment parameter during the shooting process, and then performs white balance processing on the currently acquired image according to the current weight of each camera. Therefore, by adjusting the weight of each camera according to the change of the shooting environment parameter, it is ensured that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

A further embodiment of the present application provides a white balance processing apparatus, wherein the white balance processing apparatus is applied to a terminal including at least two different types of cameras, the apparatus comprising:

The first determining module determines the current weight of each camera corresponding to the current shooting environment parameter during the shooting process;

The processing module performs white balance processing on the currently acquired image according to the current weight of each camera.

The white balance processing device provided by the embodiment of the present application first determines the current weight of each camera corresponding to the current shooting environment parameter during the shooting process, and then performs white balance processing on the currently acquired image according to the current weight of each camera. Therefore, by adjusting the weight of each camera according to the change of the shooting environment parameter, it is ensured that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

A further aspect of the present application provides a terminal, including: a housing, a processor, a memory, a circuit board, a power supply circuit, and at least two different types of cameras, wherein the circuit board is disposed in the housing Internally, the processor and the memory are disposed on the circuit board; the power supply circuit is configured to supply power to each circuit or device of the terminal; the memory is configured to store executable program code; The processor runs a program corresponding to the executable program code by reading executable program code stored in the memory for executing the white balance processing method as described in the above embodiments.

The terminal provided by the embodiment of the present application first determines the current weight of each camera corresponding to the current shooting environment parameter during the shooting process, and then performs white balance processing on the currently acquired image according to the current weight of each camera. Therefore, by adjusting the weight of each camera according to the change of the shooting environment parameter, it is ensured that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

A further aspect of the present application provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the white balance processing method as described in the above embodiments.

The computer readable storage medium provided by the embodiment of the present application may be disposed in any terminal that includes at least two different types of cameras and needs white balance processing, and performs white balance processing method stored thereon when performing white balance processing. The weight of each camera can be adjusted according to the change of the shooting environment parameters, thereby ensuring that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

A further aspect of the present application provides a computer program product for performing a white balance processing method as described in the foregoing embodiments when instructions in the computer program product are executed by a processor.

The computer program product provided by the embodiment of the present application can be set in any terminal that includes at least two different types of cameras, and needs to perform white balance adjustment. When performing white balance adjustment, the program corresponding to the white balance processing method can be implemented. According to the change of the shooting environment parameters, the weight of each camera is adjusted, thereby ensuring that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

The aspects and advantages of the present invention will be set forth in part in the description which follows.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present application, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a flow chart of a white balance processing method according to an embodiment of the present application;

2 is a flow chart of a white balance processing method according to another embodiment of the present application;

3 is a structural diagram of a white balance processing apparatus according to an embodiment of the present application;

4 is a structural diagram of a white balance processing apparatus according to another embodiment of the present application;

FIG. 5 is a structural diagram of a terminal according to an embodiment of the present application.

Detailed ways

A method and apparatus for controlling a dual camera according to an embodiment of the present application will be described in detail below with reference to the accompanying drawings.

It should be understood that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

A white balance processing method, apparatus, and terminal according to an embodiment of the present application will be described below with reference to the accompanying drawings.

Embodiments of the present application are directed to the related art. When two cameras are included in the terminal, the AWB settings of different cameras may be different, which causes an AWB jump to occur when switching from one camera to another. A problem of poor user experience, a white balance processing method is proposed.

In the white balance processing method proposed by the embodiment of the present application, during the shooting process, the current weight of each camera corresponding to the current shooting environment parameter may be determined, so that the currently acquired image is white balanced according to the current weight of each camera. Therefore, by adjusting the weight of each camera according to the change of the shooting environment parameter, it is ensured that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

The white balance processing method of the embodiment of the present application will be described below with reference to FIG.

1 is a flow chart of a white balance processing method according to an embodiment of the present application.

As shown in Figure 1, the method includes:

In step 101, during the shooting, the current weight of each camera corresponding to the current shooting environment parameter is determined.

Specifically, the white balance processing method provided by the embodiment of the present application may be performed by the white balance processing apparatus provided by the embodiment of the present application. Specifically, the white balance processing device can be configured in any terminal having at least two different types of cameras. Among them, there are many types of terminals, which can be selected according to application needs, such as mobile phones, computers, cameras, and the like.

The shooting environment parameter may include any one or more of a zoom factor, an object distance, a light source condition, and the like.

The sum of the current weights of each camera is 1.

Correspondingly, step 101 can be implemented in the following manner:

The current weight of each camera is determined based on the current zoom factor, object distance, and/or light source conditions.

Among them, the light source condition refers to the intensity, angle, color and the like of the light.

In the specific implementation, the shooting environment parameters such as the zoom magnification, the object distance and/or the light source condition suitable for each camera may be determined according to the type of each camera in advance, and then the current shooting environment parameters and each are set according to the suitable shooting environment parameters of each camera. The mapping relationship of the weight of the camera. Therefore, after the current shooting environment parameter is determined during the shooting process, the current weight of each camera corresponding to the current shooting environment parameter may be determined according to the preset mapping relationship.

For example, assuming that the camera includes the camera A and the camera B, the determined camera A suitable shooting environment parameters are: 1-6 times zoom magnification, and the camera B suitable shooting environment parameter is: 6 times or more zoom magnification. According to the above shooting environment parameters, the current zoom factor can be set between 1-6 times, and when there is a large difference from the zoom factor of 6 times, for example, when the speed is less than 4.5 times, the weight of the camera A is 1, and the weight of the camera B is 0, and set the current zoom factor between 4.5-6 times, from low to high, the weight of camera B gradually increases, the weight of camera A gradually decreases until the weight of camera A is 0, the camera B's The weight is 1.

For example, when the zoom magnification is 1-4.5 times, the weights corresponding to the camera A and the camera B are 1, 0 respectively; when the zoom magnification is 4.5-5 times, the weights corresponding to the camera A and the camera B are 0.8 and 0.2, respectively; When the zoom magnification is 5-5.5 times, the weights corresponding to camera A and camera B are 0.5 and 0.5 respectively; when the zoom magnification is 5.5-6 times, the weights corresponding to camera A and camera B are 0.2 and 0.8 respectively; When the multiple is 6 times or more, the weights corresponding to the camera A and the camera B are 0 and 1, respectively. Therefore, if the current shooting environment parameter is: 5.8 times the zoom magnification, it can be determined that the current weights of the camera A and the camera B corresponding to the current shooting environment parameters are 0.2 and 0.8, respectively.

Similarly, according to the suitable shooting environment parameters of the cameras A and B respectively, the current zoom factor is set to be more than 6 times, and when there is a large difference with the zoom factor of 6 times, for example, when the signal is more than 8 times, the weight of the camera B is 1 The weight of the camera A is 0, and the current zoom factor is set between 6-8 times. When changing from high to low, the weight of the camera A gradually increases, and the weight of the camera B gradually decreases until the weight of the camera A is 1. The weight of camera B is 0.

It should be noted that the weights of the camera A and the camera B gradually increase or decrease the range of the shooting environment parameters corresponding to the process, and can be set as needed. For example, it can be set to a zoom ratio of 4.5-6 times, or a zoom factor of 6-8 times, or a zoom factor of 4.5-8 times. That is, it may be within the range of the shooting environment parameters suitable for the camera A, or may be within the range of the shooting environment parameters suitable for the camera B, or may be within the range of the shooting environment parameters suitable for the camera A and the camera B at the same time.

In addition, as the current shooting environment parameters change, the process of increasing or decreasing the current weight of each camera may be linearly changed, or may be changed in a stepwise manner or other regular manner, and is not limited herein.

Moreover, the process of increasing or decreasing the current weight of each camera, the slope when changing linearly, or the step size when changing stepwise, can be set as needed. For example, if the zoom magnification is increased by 0.5 times, the weight corresponding to the camera A is decreased by 0.1, and the weight corresponding to the camera B is increased by 0.1; or, for every 0.5 times increase of the zoom magnification, the weight corresponding to the camera A is decreased by 0.2, and the corresponding to the camera B The weight is increased by 0.2, and so on.

It can be understood that before determining the current weight of each camera according to the current zoom factor, object distance and/or light source condition, it is also necessary to determine the current zoom factor, object distance and/or light source condition. That is, before step 101, the method may further include:

Determining the current zoom factor according to the obtained zoom instruction or image adjustment instruction;

And/or determining the current object distance according to the output value of the distance sensor or the depth information included in the currently acquired image;

And/or, the current light source condition is determined according to the aperture size, shutter time, and sensitivity of each camera.

The zoom command and the image adjustment command may be automatically triggered by the terminal according to the shooting requirement, or may be manually triggered by the user according to the need, and is not limited herein.

Specifically, during the shooting process, the user performs an operation such as adjusting the magnification of the subject in the image according to the need, so that when the image adjustment instruction is triggered, the camera can adjust the current zoom factor according to the image adjustment instruction; Or, when the zoom command is acquired, the camera can adjust the current zoom factor according to the zoom command. Therefore, in the embodiment of the present application, the current zoom factor can be determined according to the zoom instruction or the image adjustment instruction.

If the object distance is different during the shooting, the distance value of the distance sensor or the depth information contained in the currently acquired image will be different. Then, in the embodiment of the present application, the current object distance may be determined according to the output value of the distance sensor or the depth information included in the currently acquired image.

If the light source conditions are different during shooting, such as when the current light is dark or bright, the aperture size, shutter time and sensitivity of each camera will be different. Then, in the embodiment of the present application, the current light source condition can be determined according to the aperture size, the shutter time, and the sensitivity of each camera.

Specifically, after determining the current zoom factor, object distance, and/or light source condition, the current weight of each camera can be determined according to the current zoom factor, object distance, and/or light source condition.

In a possible implementation form of the embodiment of the present application, the light source condition may be an angle of the light. The light in the current shooting scene may be from any direction in the three-dimensional space where the subject is the center of the sphere. In this embodiment, the angle of the light can be roughly divided into a smooth light, a back light, a side light, a side light, a side backlight, a top light, a bottom light, and the like.

Specifically, the current ray angle can be determined in various ways.

method one

The current ray angle is determined according to the color channel histogram corresponding to the currently acquired picture.

First, it is possible to first determine the currently collected picture, that is, the color channel histogram corresponding to the preview picture.

In practical applications, color channel histograms are usually acquired using RGB data. Therefore, in this embodiment, if the original image data of the currently acquired picture is not RGB data, it is necessary to first convert the non-RGB data into RGB data. Then, according to the RGB data, the color channel histogram corresponding to the currently collected picture is determined, which is not described in detail in this embodiment.

It should be noted that if the RGB data acquired in this embodiment includes red (R), green (G), and blue (B) three color channels, the corresponding determined color channel histograms are three, respectively. It is a red channel histogram, a green channel histogram, and a blue channel histogram.

Further, the three color channel histograms determined above. Wherein, in each color channel histogram, the horizontal axis represents the image brightness, and the vertical axis represents the pixel ratio of each pixel in the image at the brightness.

If the RGB data acquired in this embodiment includes four color channels of R, Gr, Gb, and B, then the corresponding determined color channel histogram is four, which are a red channel histogram and a green (Gr) channel histogram. , green (Gb) channel histogram and blue channel histogram.

It can be understood that the color channel histogram corresponding to the currently collected picture may include the correspondence between different brightness and pixel ratio under each color channel. Due to the different angles of light in the shooting scene, the proportions of pixels of different brightness in the currently acquired picture are different. Therefore, in the embodiment of the present application, the current ray angle can be determined according to the color channel histogram corresponding to the currently collected picture.

Specifically, the brightness information of the current shooting scene may be obtained first, and then the pixel ratio threshold and the brightness threshold corresponding to the current shooting scene are determined according to the brightness information, and then according to the pixel ratio threshold, the brightness threshold, and the color channel histogram corresponding to the current shooting scene, Determine the angle of light in the current shooting scene.

In the specific implementation, the brightness information corresponding to the current shooting scene may be acquired from the automatic exposure control system.

Since the automatic exposure control system (Auto Exposure Control, AEC for short) can perform automatic exposure compensation processing on the captured image according to the brightness of the shooting scene, in actual application, when the terminal performs a shooting operation on the shooting area. Therefore, in this embodiment, the brightness information corresponding to the current shooting scene can be directly obtained from the AEC, so that the detection error of the shooting environment can be reduced, and the quality of the captured image can be improved.

Alternatively, the terminal may detect the shooting environment based on a color coding space (YUV). However, the YUV data is acquired after a series of processing by the Image Processor Processor (ISP), which causes the data in the YUV to not completely reflect the current shooting environment, resulting in The detection of the shooting environment has an error, which affects the quality of the captured image. Therefore, in this embodiment, the original image data in the ISP may be used, such as the number of grids included in the image, the average brightness of each grid, and the grid. The number of pixels included, the ratio of overexposed pixels included in each grid, and the like are used to determine the brightness information corresponding to the current environment.

Then, the pixel ratio threshold and the brightness threshold corresponding to the current shooting scene may be determined according to the brightness information corresponding to the current shooting scene.

It should be noted that, due to the same object, the same light angle has different features in different brightness shooting scenes, such as outdoor backlight scenes, and the preview picture mainly shows that the dark part of the image is dark, the bright part is overexposed, and the night scene preview picture mainly shows Pixels are mainly concentrated in the dark part, and the overexposed area is small. Therefore, in order to make the pixel ratio threshold and the brightness threshold corresponding to the determined current shooting scene more accurate, the present application may perform a rough division of the shooting scene in advance, and respectively set the pixel ratio threshold and the brightness threshold for the divided scenes.

For example, the shooting scene can be divided into three according to the brightness of the shooting scene, which are a high-brightness scene, a medium-brightness scene, and a low-brightness scene.

The high-brightness scene may be an area with good light such as outdoor, the medium-brightness scene may be a region with better indoor light, and the low-brightness scene may be a dark light or a region with poor night light, etc., which is not specifically limited in this application. .

After dividing the different scenarios, the embodiment may further set the pixel ratio threshold and the brightness threshold for each scene.

The pixel ratio threshold and the brightness threshold of each of the above scenarios may be adaptively set according to actual usage requirements, which is not specifically limited in this application.

Further, after the scene segmentation is performed on the shooting scene, and the corresponding pixel ratio threshold and the brightness threshold are set for each scene, the embodiment may match the brightness information corresponding to the current shooting scene with each of the divided scenes. The pixel ratio threshold and the brightness threshold corresponding to the current shooting scene are determined.

In a specific implementation, the target brightness range corresponding to the current shooting scene may be determined according to the corresponding relationship between the brightness threshold and the brightness range preset by each scene; and then the correspondence between the preset brightness range and the pixel ratio threshold and the brightness threshold is determined according to the preset brightness range. And determining a pixel ratio threshold and a brightness threshold corresponding to the target brightness range.

That is to say, in this embodiment, according to the acquired current shooting scene brightness information, matching is performed in the brightness range of different scenes, and the target scene to which the current shooting scene belongs is determined according to the brightness range of the matching success, and then according to the target target. The scene acquires a corresponding pixel ratio threshold and a brightness threshold. Thereby, the determined pixel ratio threshold and brightness threshold are made more accurate.

Further, after determining the pixel ratio threshold and the brightness threshold corresponding to the current shooting scene, the current ray angle may be determined according to the pixel ratio threshold, the brightness threshold, and the color channel histogram of the current preview scene.

It should be noted that, due to the backlight scene, the pixels in the histogram of each color channel are mostly concentrated in a position of high brightness or low brightness, and appear in a "double peak" form.

As an example, the angle of the light includes both forward and backlight. In a specific implementation, the pixel ratio threshold may include two, which are a first pixel ratio threshold and a second pixel ratio threshold, respectively. Correspondingly, the brightness threshold also includes two, which are a first brightness threshold and a second brightness threshold, respectively.

Moreover, the pixel ratio threshold and the brightness threshold are mutually corresponding, that is, the first pixel ratio threshold corresponds to the first brightness threshold, and the second pixel ratio threshold corresponds to the second brightness threshold.

Therefore, after the histogram of the current preview image is acquired, the histogram of the current preview image can be used to determine whether the light angle in the current shooting scene is backlit. Specifically, it can be judged by the following methods:

The sum of the pixel ratio values in the histograms of the respective color channels is sequentially counted according to the direction of the brightness from low to high and from high to low;

Determining, according to the brightness from the low to high pixel ratio value, reaching the first pixel ratio threshold, each color channel corresponding to each first brightness value;

Determining, according to the brightness from the sum of the high to low pixel ratio values, reaching the second pixel ratio threshold, each color channel corresponding to each second brightness value;

If the first brightness value corresponding to any color channel is smaller than the first brightness threshold, and the second brightness value is greater than the second brightness threshold, it is determined that the angle of the light in the shooting scene is back light. Otherwise, it is determined to be smooth.

The angle of the light may also include: side light, side back light, top light, etc., in order to make the angle of the determined light more accurate, for the same scene, the number and size of the pixel scale thresholds and the corresponding brightness threshold may be set as needed. , thereby determining the angle of the light in the current shooting scene according to the set pixel ratio threshold and the brightness threshold.

Way two

Determine the angle of light in the current shooting scene based on the current shooting time and position.

Specifically, since the backlight is due to a situation in which the subject is just between the light source and the terminal, for example, the subject is between the sun and the terminal. Therefore, as an example of determining the angle of the light in the current shooting scene, the angle of the light in the current shooting scene can be determined according to the current shooting time, position, and the like.

The location includes the geographic location where the terminal is located, the orientation of the terminal (refer to the shooting direction of the terminal), and the like. For example, at 12 noon in Beijing, the mobile phone is shooting towards the south. Because the sun is at the south at 12 o'clock in Beijing, the direction of the mobile phone is south, that is, the subject is between the sun and the terminal, that is, the light angle of the preview image of the camera is Backlighting.

The location of the terminal can be obtained according to a positioning system in the terminal, such as a Global Positioning System (GPS). The shooting time can be obtained from the clock on the terminal, and the orientation of the terminal can be based on the terminal. The compass, or the orientation of the current terminal acquired by other applications on the terminal.

Way three

Determines the angle of the light in the current shooting scene based on the direction of the shadow in the current preview image.

In actual use, since the shadow in the preview picture is formed by the object being occluded by the light source being irradiated onto the object, the angle of the light is determined according to the direction of the shadow of the object to be photographed in the preview image, that is, the direction of the shadow.

Since the shadow is generally located in the lower half of the preview image and is similar to the contour of the captured object, in the specific implementation, the shadow in the preview image can be determined according to the contour extracted from the preview image and the position of the contour in the preview image. The direction of the shadow. Then, based on the direction of the shadow, the angle of the light in the current shooting scene is determined.

Specifically, after determining the angle of the light, the current weight of each camera can be determined according to the angle of the light.

Step 102: Perform white balance processing on the currently acquired image according to the current weight of each camera.

It can be understood that, in the embodiment of the present application, each camera can be set to be in an open state during the shooting process, so that each camera can acquire an image. After each camera acquires the current image, white balance adjustment can be performed on each image, and each processed image is combined according to the current weight of each camera to generate a current captured image.

Or, in order to avoid waste of resources, in a preferred implementation form, a camera with a weight of 0 may be set to be in a closed state, and a camera with a weight of not 0 may be in an activated state. Therefore, white balance adjustment is performed only on the image currently acquired by the camera whose weight is not 0, and each processed image is combined to generate a current captured image according to the current weight of each camera whose weight is not 0.

Specifically, after acquiring the current image, each camera can determine each target white balance gain value corresponding to each camera according to each color temperature value corresponding to each image, thereby performing white balance processing on each image according to each target white balance gain value. Finally, according to the current weight of each camera, the processed images are combined to generate the current captured image.

It can be understood that, by using the white balance processing method provided by the embodiment of the present application, the weight of each camera is adjusted according to the change of the shooting environment parameter, thereby ensuring that an image suitable for the current environmental parameter can be obtained, and the camera switching is avoided. The AWB hopping phenomenon has improved the user experience.

It can be seen from the above analysis that during the shooting process, the current weight of each camera corresponding to the current shooting environment parameter can be determined, so that the currently acquired image is white balanced according to the current weight of each camera. The process of performing white balance processing on the currently acquired image according to the current weight of each camera will be specifically described below with reference to FIG. 2 .

2 is a flow chart of a white balance processing method according to another embodiment of the present application.

As shown in FIG. 2, the white balance processing method is applied to a terminal including at least two different types of cameras, and the method includes:

Step 201: During the shooting process, determine the current weight of each camera corresponding to the current shooting environment parameter.

For the specific implementation process and the principle of the foregoing step 201, refer to the detailed description of step 101 in the foregoing embodiment, and details are not described herein again.

Step 202: Determine color temperature values corresponding to respective images currently acquired by each camera.

Specifically, the color temperature values corresponding to the respective images currently acquired by each camera may be determined by using various methods.

For example, the color temperature value corresponding to the currently acquired image may be determined according to the color temperature value corresponding to each white block in the image currently acquired by each camera; or, according to the image currently acquired by each camera, the area corresponding to the target shooting object The color temperature value determines the color temperature value corresponding to the currently acquired image, and so on.

Step 203: Determine, according to each color temperature value, a target white balance gain value corresponding to each camera.

The target white balance gain value is used to adjust the currently acquired image to the color in the image to be reproduced. Specifically, the target white balance gain value may include a target white balance gain value of three channels R, G, and B in the image acquired by the image sensor.

Specifically, after obtaining the color temperature values corresponding to the images currently acquired by the cameras, the color cast directions of the respective images can be determined, thereby calculating the target white balance gain values.

In the specific implementation, according to the obtained color temperature values, calculation, table lookup or iteration method may be used to calculate the target white balance gain values corresponding to the respective cameras.

As a possible implementation, when the color in the image has sufficient color change, the average of the three components R, G, and B in the color vector of all the pixels tends to be balanced (1:1:1), using weighting. The grayscale algorithm can obtain a more accurate target white balance gain value.

Specifically, the image currently acquired by each camera may be divided into several sub-blocks, and the color vector of all the pixels in each sub-block is obtained, and each pixel is represented by a (R, G, B) color vector, and then each sub-calculation is calculated. The average and standard deviation of the three channels R, G, and B in the block, and then weight the standard deviation of each sub-block (abandon the sub-block with low correlation and retain the sub-block with high correlation) to reduce the large block. The effect of a single color makes the image colorful. Then, the average values of the three channels R, G, and B weighted by the standard deviation are calculated, and the gain coefficients of the three channels R, G, and B are finally calculated, that is, the target white balance gain value corresponding to the camera is obtained.

Step 204: Perform white balance processing on each image by using each target white balance value, and acquire each processed image.

Specifically, after determining the target white balance gain value corresponding to each camera, the R value and the B value data of each pixel after the image adjustment currently obtained by each camera are calculated according to the calculated target white balance gain values, thereby realizing Color correction for each image.

It should be noted that since the human eye has the highest sensitivity to light (480 nm-600 nm) belonging to the green wavelength in the spectrum, and the Bayer array has the largest number of green pixels collected, the current camera usually adopts green. The gain value of the component is fixed, and then the gain values of the red component and the blue component are respectively adjusted to achieve adjustment of the red component and the blue component.

Step 205: Synthesize each processed image to generate a current captured image according to the current weight of each camera.

It can be understood that, after each image currently acquired by each camera is processed by using the target white balance value, the color saturation of each image after processing may be different, and then, in the embodiment of the present application, according to the processed Different color saturation of the image, using different synthesis modes, the processed images are combined to generate the current captured image.

That is, the target composition mode can be determined based on the color saturation of each of the processed images, and the processed images can be combined to generate the current captured image based on the current weight of each camera based on the target composition mode.

The target synthesis mode is used to indicate a specific manner when the processed images are combined to generate a current captured image.

Specifically, the color saturation threshold may be preset, so that the corresponding target synthesis mode is determined according to the relationship between the processed color saturation of each image and the preset color saturation threshold, based on the target synthesis mode, according to each camera current The weight of each of the processed images is combined.

For example, the color saturation threshold may be preset to a value that is infinitely close to 0, so that each processed image is divided into a gray image and a color image, and when the color saturation of each image after the processing is determined to be less than a threshold, that is, each image In the case of a grayscale image, the processed images may be combined to generate a current captured image by using a grayscale weighted average method according to the current weight of each camera.

Specifically, assuming that the M is the size of the processed image I * J _{_{N 1, N 2, ... N}} M synthesized, the synthesized image is F, it is possible, the image synthesized by the following equation.

F(i,j)=w ₁ (i,j)N ₁ (i,j)+w ₂ (i,j)N ₂ (i,j)+...+w _M (i,j)N _M (i , j)

Where i is the row position of the pixels in each image, i=1, 2, 3, ..., I;

j is the column position of the pixel in each image, j=1, 2, 3, ..., J;

w _x (i, j), x=1, 2, 3, ... M is the current weight of the camera corresponding to each image, and

N _x (i, j), x = 1, 2, 3, ... M is the pixel gray value of the (i, j)th point of the xth image.

Correspondingly, when it is determined that the color saturation of each processed image is greater than a threshold, that is, when each image is a color image, each image may be regarded as three monochrome images (red, green, blue) according to the three primary color models. Superimposed, respectively, according to the current weight of each camera, the color images are synthesized, and finally the three red, green and blue monochrome images are synthesized, and then superimposed by three monochrome images to generate the current captured image.

F _R (i,j)=w ₁ (i,j)N _1R (i,j)+w ₂ (i,j)N _2R (i,j)+...+w _M (i,j)N _MR ( i,j);

F _G (i,j)=w ₁ (i,j)N _1G (i,j)+w ₂ (i,j)N _2G (i,j)+...+w _M (i,j)N _MG ( i,j);

F _B (i,j)=w ₁ (i,j)N _1B (i,j)+w ₂ (i,j)N _2B (i,j)+...+w _M (i,j)N _MB ( i, j).

Wherein, R, G, and B respectively represent three primary colors of red, green, and blue;

i is the row position of the pixel in each image, i=1, 2, 3, ..., I;

j is the column position of the pixel in each image, j=1, 2, 3, ..., J;

F _R (i, j), F _G (i, j), F _B (i, j) are the values of the R, G, and B channels of the (i, j)th point of the synthesized image, respectively;

N _xR (i, j), x = 1, 2, 3, ... M is the value of the R channel of the (i, j)th point of the xth image;

N _xG (i, j), x = 1, 2, 3, ... M is the value of the G channel of the (i, j)th point of the xth image;

N _xB (i, j), x = 1, 2, 3, ... M is the value of the B channel of the (i, j)th point of the xth image.

It should be noted that, when the color saturation of each image after processing is greater than a threshold, that is, when each image is a color image, each image may be first converted into a grayscale image, and then gray weighted according to the current weight of each camera. The averaging method combines the processed images to generate a current captured image.

The white balance processing method provided by the embodiment of the present application first determines the current weight of each camera corresponding to the current shooting environment parameter, and then determines the color temperature values corresponding to the respective images currently acquired by each camera, and then according to each The color temperature value determines the target white balance gain value corresponding to each camera, and then performs white balance processing on each image by using each target white balance value, acquires each processed image, and finally processes each processed image according to the current weight of each camera. The image is synthesized to generate the current captured image. Therefore, by adjusting the weight of each camera according to the change of the shooting environment parameter, it is ensured that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

Fig. 3 is a structural diagram of a white balance processing apparatus according to an embodiment of the present application.

As shown in FIG. 3, the white balance processing apparatus is applied to a terminal including at least two different types of cameras, and the apparatus includes:

The first determining module 31 determines the current weight of each camera corresponding to the current shooting environment parameter during the shooting process;

The processing module 32 performs white balance processing on the currently acquired image according to the current weight of each camera.

The white balance processing apparatus provided in this embodiment can perform the white balance processing method provided by the embodiment of the present application. Specifically, the white balance processing device can be configured in any terminal having at least two different types of cameras. Among them, there are many types of terminals, which can be selected according to application needs, such as mobile phones, computers, cameras, and the like.

In a possible implementation form of the embodiment, the first determining module 31 is specifically configured to:

In another possible implementation manner of the embodiment, the processing module 32 includes:

a first determining unit, configured to determine color temperature values corresponding to each image currently acquired by each camera;

a second determining unit, configured to determine, according to the color temperature values, respective target white balance gain values corresponding to the cameras;

An acquiring unit, configured to perform white balance processing on each image by using each target white balance value, and acquire each processed image;

The synthesizing unit is configured to synthesize the processed images to generate a current captured image according to the current weight of each camera.

In another possible implementation manner of the embodiment, the foregoing first determining unit is specifically configured to:

Determining, according to a color temperature value corresponding to the white block in each image currently acquired by each camera, a color temperature value corresponding to each image currently acquired by each camera;

or,

And determining a color temperature value corresponding to the image currently acquired by each camera according to a color temperature value corresponding to an area where the target object is located in the image currently acquired by each camera.

In another possible implementation manner of the embodiment, the processing module 32 further includes:

a third determining unit, configured to determine a target synthesis mode according to the color saturation of each processed image;

Correspondingly, the above synthesizing unit is specifically used for:

Based on the target composition mode, the processed images are combined to generate a current captured image according to the current weight of each camera.

In another possible implementation manner of the embodiment, the foregoing third determining unit is specifically configured to:

When it is determined that the color saturation of each of the processed images is less than a threshold, the processed images are combined to generate a current captured image by using a gray weighted average method according to the current weight of each camera;

When it is determined that the color saturation of each of the processed images is greater than a threshold, respectively, according to the current weight of each camera, each monochrome image is synthesized according to the three primary color models; and the combined three monochrome images are superimposed Generate the current captured image.

It should be noted that the explanation of the embodiment of the white balance processing method in the foregoing embodiment is also applicable to the white balance processing apparatus of the embodiment, and details are not described herein again.

Fig. 4 is a structural diagram of a white balance processing apparatus according to another embodiment of the present application.

As shown in FIG. 4, the white balance processing apparatus further includes:

a second determining module 41, configured to determine the current zoom factor according to the acquired zoom instruction or image adjustment instruction;

And/or, configured to determine a current object distance according to an output value of the distance sensor or depth information included in the currently acquired image;

And/or, for determining the current light source condition according to the aperture size, shutter time, and sensitivity of each camera.

In a possible implementation form of the embodiment, the light source condition is an angle of the light;

Correspondingly, the foregoing second determining module 41 is further configured to:

Determining the current ray angle according to each color channel histogram corresponding to the currently acquired picture;

or,

Determining the angle of light in the current shooting scene according to the current shooting time and position;

or,

A further embodiment of the present application further provides a terminal.

Among them, there are many types of terminals, which can be selected according to application needs, such as mobile phones, computers, cameras, and the like. Figure 5 shows the terminal as a mobile phone.

As shown in FIG. 5, the terminal includes a housing 501, a processor 502, a memory 503, a circuit board 504, a power supply circuit 505, and at least two different types of cameras, which are illustrated by including two

cameras

506 and 507.

Wherein, the circuit board 504 is disposed inside the space enclosed by the housing 501, the processor 502 and the memory 503 are disposed on the circuit board 504; the power supply circuit 505 is used to supply power to each circuit or device of the terminal; and the memory 503 is used for storing The program code is executed by the processor 502 by executing the executable program code stored in the memory 503 to execute a program corresponding to the executable program code for performing the white balance processing method as in the foregoing embodiment, the white balance processing Methods include:

It should be noted that the foregoing description of the embodiment of the white balance processing method is also applicable to the terminal of the embodiment, and the implementation principle is similar, and details are not described herein again.

Still another embodiment of the present application proposes a computer readable storage medium having stored thereon a computer program that, when executed by the processor, implements a white balance processing method as in the foregoing embodiments.

The computer readable storage medium provided by the embodiment of the present application may be disposed in any terminal that includes at least two different types of cameras and needs white balance adjustment, and performs white balance processing method stored thereon when performing white balance adjustment. The weight of each camera can be adjusted according to the change of the shooting environment parameters, thereby ensuring that an image suitable for the current environmental parameters can be obtained, and the AWB jump phenomenon caused by the camera switching is avoided, and the user experience is improved.

A further aspect of the present application is directed to a computer program product that, when executed by a processor, executes a white balance processing method as in the previous embodiments.

It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities or operations. There is any such actual relationship or order between them. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), Read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the application can be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

It should be noted that in the description of the specification, the descriptions of the terms "one embodiment", "some embodiments", "example", "specific examples", or "some examples" and the like are meant to be combined with the embodiments or The specific features, structures, materials, or characteristics described in the examples are included in at least one embodiment or example of the application. In the present specification, the illustrative expressions of the above terms are not necessarily directed to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification and features of various embodiments or examples may be combined and combined without departing from the scope of the invention.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the application. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification and features of various embodiments or examples may be combined and combined without departing from the scope of the invention.

While the embodiments of the present application have been shown and described above, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the present application. The embodiments are subject to variations, modifications, substitutions and variations.

Claims

A white balance processing method is applied to a terminal including at least two different types of cameras, and includes:

During the shooting process, determining the current weight of each camera corresponding to the current shooting environment parameter;

The currently acquired image is subjected to white balance processing according to the current weight of each camera.
The method according to claim 1, wherein the determining the current weight of each camera corresponding to the current shooting environment parameter comprises:

The current weight of each camera is determined based on the current zoom factor, object distance, and/or light source conditions.
The method of claim 1, wherein before determining the current white balance adjustment weight of each camera corresponding to the current shooting environment parameter, the method further includes:

Determining the current zoom factor according to the obtained zoom instruction or image adjustment instruction;

And/or determining the current object distance according to the output value of the distance sensor or the depth information included in the currently acquired image;

And/or, the current light source condition is determined according to the aperture size, shutter time, and sensitivity of each camera.
The method according to claim 2 or 3, wherein said light source condition is an angle of light;

Before determining the current white balance adjustment weight of each camera corresponding to the current shooting environment parameter, the method further includes:

Determining the current ray angle according to each color channel histogram corresponding to the currently acquired picture;

or,

Determining the angle of light in the current shooting scene according to the current shooting time and position;

or,

Determines the angle of the light in the current shooting scene based on the direction of the shadow in the current preview image.
The method according to any one of claims 1-4, wherein the performing white balance processing on the currently acquired image according to the current weight of each camera comprises:

Determining, for each color temperature value corresponding to each image currently acquired by each camera;

Determining, according to the color temperature values, respective target white balance gain values corresponding to the respective cameras;

Performing white balance processing on each of the images by using the target white balance values, and acquiring the processed images;

The processed images are combined to generate a current captured image based on the current weight of each camera.
The method according to claim 5, wherein the determining the color temperature values corresponding to the images currently acquired by the cameras comprises:

Determining, according to a color temperature value corresponding to the white block in each image currently acquired by each camera, a color temperature value corresponding to each image currently acquired by each camera;

or,

And determining a color temperature value corresponding to the image currently acquired by each camera according to a color temperature value corresponding to an area where the target object is located in the image currently acquired by each camera.
The method according to claim 5 or claim 6, wherein before the synthesizing the processed images to generate the current captured image according to the current weight of each camera, the method further includes:

Determining a target synthesis mode according to color saturation of each of the processed images;

And synthesizing the processed images to generate a current captured image according to the current weight of each camera, including:

Based on the target composition mode, the processed images are combined to generate a current captured image according to the current weight of each camera.
The method according to claim 7, wherein the determining the target synthesis mode according to the color saturation of the processed images comprises:

When it is determined that the color saturation of each of the processed images is less than a threshold, the processed images are combined to generate a current captured image by using a gray weighted average method according to the current weight of each camera;

When it is determined that the color saturation of each of the processed images is greater than a threshold, respectively, according to the current weight of each camera, each monochrome image is synthesized according to the three primary color models; and the combined three monochrome images are superimposed Generate the current captured image.
A white balance processing device is applied to a terminal including at least two different types of cameras, and includes:

The first determining module determines the current weight of each camera corresponding to the current shooting environment parameter during the shooting process;

The processing module performs white balance processing on the currently acquired image according to the current weight of each camera.
The device according to claim 9, wherein the first determining module is specifically configured to:

The current weight of each camera is determined based on the current zoom factor, object distance, and/or light source conditions.
The device of claim 9 further comprising:

a second determining module, configured to determine the current zoom factor according to the acquired zoom instruction or image adjustment instruction;

And/or, configured to determine a current object distance according to an output value of the distance sensor or depth information included in the currently acquired image;

And/or, for determining the current light source condition according to the aperture size, shutter time, and sensitivity of each camera.
The device according to claim 10 or 11, wherein said light source condition is an angle of light;

The second determining module is further configured to:

Determining the current ray angle according to each color channel histogram corresponding to the currently acquired picture;

or,

Determining the angle of light in the current shooting scene according to the current shooting time and position;

or,

Determines the angle of the light in the current shooting scene based on the direction of the shadow in the current preview image.
The device of any of claims 9-12, wherein the processing module comprises:

a first determining unit, configured to determine color temperature values corresponding to each image currently acquired by each camera;

a second determining unit, configured to determine, according to the color temperature values, respective target white balance gain values corresponding to the cameras;

An acquiring unit, configured to perform white balance processing on each image by using each target white balance value, and acquire each processed image;

The synthesizing unit is configured to synthesize the processed images to generate a current captured image according to the current weight of each camera.
The device according to claim 13, wherein the first determining unit is specifically configured to:

Determining, according to a color temperature value corresponding to the white block in each image currently acquired by each camera, a color temperature value corresponding to each image currently acquired by each camera;

or,

And determining a color temperature value corresponding to the image currently acquired by each camera according to a color temperature value corresponding to an area where the target object is located in the image currently acquired by each camera.
The device according to claim 13 or 14, wherein the processing module further comprises:

a third determining unit, configured to determine a target synthesis mode according to the color saturation of each processed image;

The synthesizing unit is specifically configured to:

Based on the target composition mode, the processed images are combined to generate a current captured image according to the current weight of each camera.
The device according to claim 15, wherein the third determining unit is specifically configured to:

When it is determined that the color saturation of each of the processed images is less than a threshold, the processed images are combined to generate a current captured image by using a gray weighted average method according to the current weight of each camera;

When it is determined that the color saturation of each of the processed images is greater than a threshold, respectively, according to the current weight of each camera, each monochrome image is synthesized according to the three primary color models; and the combined three monochrome images are superimposed Generate the current captured image.
A terminal, comprising: a housing, a processor, a memory, a circuit board, a power supply circuit, and at least two different types of cameras, wherein the circuit board is disposed inside a space enclosed by the housing, The processor and the memory are disposed on the circuit board; the power circuit is configured to supply power to each circuit or device of the terminal; the memory is configured to store executable program code; The executable program code stored in the memory is read to execute a program corresponding to the executable program code for performing the white balance processing method according to any one of claims 1-8.
A computer readable storage medium having stored thereon a computer program, characterized in that the program is executed by a processor to implement the white balance processing method according to any one of claims 1-8.
A computer program product, wherein the white balance processing method according to any one of claims 1-8 is performed when an instruction in the computer program product is executed by a processor.