WO2019076027A1

WO2019076027A1 - White balance information synchronization method and device, and computer readable medium

Info

Publication number: WO2019076027A1
Application number: PCT/CN2018/085735
Authority: WO
Inventors: 左坤隆
Original assignee: 华为技术有限公司
Priority date: 2017-10-17
Filing date: 2018-05-04
Publication date: 2019-04-25
Also published as: CN109672871A; CN109672871B

Abstract

Disclosed are a white balance information synchronization method and device, and a computer readable medium. The method comprises: obtaining a first image and a second image, the first image being an image acquired by a first camera and the second image being an image acquired by a second camera; determining a first coordinate point, in a target coordinate system, corresponding to a white balance gain of the first image, and first reference coordinate points, the first reference coordinate points being N coordinate points, in the target coordinate system, corresponding to the first camera; and determining a second coordinate point according to the first coordinate point, the first reference coordinate points, and second reference coordinate points, and determining a white balance gain of the second image according to the second coordinate point, the second coordinate point being a coordinate point, in the target coordinate system, corresponding to the white balance gain of the second image. Embodiments of the present invention can quickly implement the synchronization of white balance information, and feature simple computation and high precision.

Description

White balance information synchronization method, device and computer readable medium

Technical field

The present invention relates to the field of image processing technologies, and in particular, to a white balance information synchronization method, apparatus, and computer readable medium.

Background technique

In order to get a better camera experience, more and more cameras are used on the camera device. Since multiple cameras on the same camera device often use sensors and lens modules of different models and even different manufacturers, this may result in significant differences in the photographic characteristics of different cameras. According to the application requirements of multiple cameras, it is necessary to synchronize the photographing effects between multiple cameras. Whether the effects of Automatic White Balance (AWB) are consistent largely determines whether the colors of images captured by multiple cameras are consistent. Therefore, there is a need to deal with the synchronization problem of multi-camera automatic white balance. The AWB algorithm determines the light source of the current scene based on the content of the image, and corrects the color of the image according to the characteristics of the light source so that the white object appears white.

The currently adopted scheme is to perform white balance processing on images taken by multiple cameras. In practical applications, due to the difference in the lens, sensor chip and other devices of different cameras, the images captured by multiple cameras are subjected to white balance processing, and the colors of the obtained images may be different, which directly affects the image effect after stitching. Therefore, it is necessary to solve the problem of synchronization of white balance information between different cameras.

Summary of the invention

The embodiment of the invention provides a white balance information synchronization method, which can quickly solve the synchronization problem of white balance information between different cameras, with low computational complexity and high precision.

In a first aspect, an embodiment of the present invention provides a white balance information synchronization method, where the method includes:

Obtaining a first image and a second image; the first image is an image acquired by a first camera, and the second image is an image captured by a second camera;

Obtaining a white balance gain of the first image, and determining a white coordinate gain of the first image in a first coordinate point corresponding to the target coordinate system and a first reference coordinate point; the first reference coordinate point is the first a camera at N coordinate points corresponding to the target coordinate system;

Determining a second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, and determining a white balance gain of the second image according to the second coordinate point; the second coordinate The point is a coordinate point corresponding to the white balance gain of the second image in the target coordinate system; and the second reference coordinate point is N coordinate points corresponding to the second camera in the target coordinate system.

In the embodiment of the present invention, by converting the synchronization problem of white balance information into a mapping problem between coordinate points, the white balance gain of the first image can be accurately mapped to the white balance gain of the second image, and the white balance information can be quickly realized. Synchronization; simple calculation and high precision.

In an optional implementation manner, the first reference coordinate point and the N reference combinations correspond to N white balance gains corresponding to the first camera; the second reference coordinate point and the N reference points The reference combination corresponds to the N white balance gains corresponding to the second camera.

The first reference coordinate point is N coordinate points corresponding to the N white balance gains of the N reference combinations in the target coordinate system; the second reference coordinate points are the N reference points The N white balance gains corresponding to the second camera are combined at N coordinate points corresponding to the target coordinate system.

In the embodiment of the present invention, the first reference coordinate point and the second reference coordinate point correspond to the same reference combination, and the second coordinate point can be accurately determined, thereby determining the white balance gain of the second image.

In an optional implementation manner, the first coordinate point is located at a closed area of the first reference coordinate point corresponding to the target coordinate system, and the N is greater than or equal to 3.

It can be understood that the first reference coordinate point includes the first coordinate point in a closed region corresponding to the target coordinate system. The closed area corresponding to the target coordinate system is a closed area composed of a connection line of each coordinate point in the first reference coordinate point. The first reference coordinate point may be understood as N coordinate points adjacent to the first coordinate point; each coordinate point in the first reference coordinate point is closer to the first coordinate point, and the first A reference coordinate point can be accurately mapped to the first coordinate point.

The embodiment of the invention defines the positional relationship between the first coordinate point and the first reference coordinate point in the target coordinate system, and can improve the accuracy of white balance information synchronization.

In an optional implementation manner, the N is 3;

The first reference coordinate point is three vertices of a triangle in the first Delauna network; the first Delauna network corresponds to the first point set, and the first point set is the first point set a set of coordinate points corresponding to a camera in the target coordinate system; the first reference coordinate point is included in the first point set;

The second reference coordinate point is three vertices of a triangle in the second Delauna network, the second Delauna network corresponds to the second point set, and the second point set is the a set of coordinate points corresponding to the target coordinate system of the two cameras; the second reference coordinate points being included in the second set of points.

In the embodiment of the present invention, the first reference coordinate point and the second reference coordinate point are all three vertices of a triangle in the Delaunay triangulation; it can be ensured that the first reference coordinate point and the second reference coordinate point are both unique. In addition, the first reference coordinate point and the second reference coordinate point each include three coordinate points, and the calculation complexity is low, and the white balance gain of the second image can be accurately performed.

In an optional implementation manner, the first point set and the M reference combinations correspond to M white balance gains corresponding to the first camera, and the second point set is combined with the M reference sets. Corresponding to the M white balance gains corresponding to the second camera, the M is greater than or equal to the N;

The corresponding light source and/or color block between any two of the M reference combinations is different.

In an optional implementation manner, the M coordinate points included in the first point set and the M coordinate points included in the second point set respectively correspond to M target serial numbers, and the M target serial numbers and One-to-one correspondence of M reference combinations;

The method further includes: before determining the second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, the method further includes:

Determining three target serial numbers corresponding to the first reference coordinate point;

Obtaining three coordinate points corresponding to the three target serial numbers from the second point set to obtain the second reference coordinate point.

By performing the above operation, the second reference coordinate point can be quickly determined, and the operation is simple.

In an optional implementation manner, the determining the white balance gain of the first image in the target coordinate system corresponding to the first coordinate point and the first reference coordinate point includes:

Determining, that the white balance gain of the first image is at the first coordinate point corresponding to the target coordinate system;

Determining that three vertices of the first triangle in the first Delauna network are the first reference coordinate points, and the first triangle includes the first coordinate point in a region corresponding to the target coordinate system.

By performing the above operations, the first reference coordinate point corresponding to the first coordinate point can be quickly and accurately determined, which is simple to implement.

In an optional implementation manner, before the determining the second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, the method further includes:

Determining that three vertices of the second triangle in the second Delauna network are the second reference coordinate points, three reference combinations corresponding to three vertices of the second triangle, and three of the first triangles The three reference combinations corresponding to the vertices are the same, and the reference combinations corresponding to the first Delauna network and the second Delauna network are the same.

By performing the above operation, the second reference coordinate point corresponding to the first reference coordinate point can be quickly and accurately determined.

In an optional implementation manner, the determining the second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point includes:

Calculate the intermediate parameters according to the following formula:

D00=sum(V0.*V0);

D01=sum(V0.*V1);

D02=sum(V0.*V2);

D11=sum(V1.*V1);

D12=sum(V1.*V2);

u=(D11*D02-D01*D12)/(D00*D11-D01*D01);

v=(D00*D12-D01*D02)/(D00*D11-D01*D01);

Wherein, V0=CA, V1=BA, V2=PA, the P is the first coordinate point, and the C, the B, and the A are respectively three coordinates included in the first reference coordinate point. Point; sum means summation, .* symbol means multiplication of corresponding elements between vectors; u and v are intermediate parameters;

Calculating the second coordinate point according to the following formula:

Q.x=(1-u-v)*A’.x+u*B’.x+v*C’.x;

Q.y=(1-u-v)*A’.y+u*B’.y+v*C’.y;

Wherein, the C', the B', and the A' are respectively three coordinate points included in the second reference coordinate point, and the A' and the A correspond to the same reference combination, the B' Corresponding to the same reference combination as the B, the C' corresponding to the same reference combination; the .x represents the coordinates of the first coordinate axis, and the .y represents the coordinates of the second coordinate axis; The second coordinate point is (Qx, Qy).

By performing the above calculation, the second coordinate point can be calculated quickly and accurately, and the computational complexity is low.

In an optional implementation manner, the pixel points of the first image, the pixel points of the second image, and the white balance gain all adopt three color channels; the corresponding value of the first coordinate axis is a ratio of the first color channel to the second color channel, and the value corresponding to the second coordinate axis is a ratio of the third color channel to the second color channel.

The first color channel may be an R channel, the second color channel may be a G channel, and the third channel may be a B channel. Each coordinate point in the target coordinate system corresponds to a white balance gain.

In the embodiment of the present invention, the target coordinate system is a two-dimensional coordinate system, and each coordinate point corresponds to a white balance gain, and the mapping problem of the white balance gain is converted into a mapping problem of coordinate points, and the white balance information can be accurately synchronized. .

In a second aspect, the embodiment of the present invention provides a white balance information synchronization device, where the white balance information synchronization device can include:

An acquiring unit, configured to acquire a first image and a second image; the first image is an image captured by a first camera, and the second image is an image captured by a second camera;

The acquiring unit is further configured to obtain a white balance gain of the first image;

a determining unit, configured to determine a first coordinate point corresponding to a white coordinate gain of the first image and a first reference coordinate point; the first reference coordinate point is a target coordinate of the first camera at the target Corresponding N coordinate points;

The determining unit is further configured to determine a second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, and determine white of the second image according to the second coordinate point Balanced gain; the second coordinate point is a coordinate point corresponding to the white balance gain of the second image in the target coordinate system; and the second reference coordinate point is a correspondence of the second camera in the target coordinate system N coordinate points.

In an optional implementation manner, the N is 3;

The determining unit is further configured to determine three target serial numbers corresponding to the first reference coordinate point;

The acquiring unit is further configured to acquire three coordinate points corresponding to the three target serial numbers from the second point set to obtain the second reference coordinate point.

In an optional implementation manner, the determining unit is specifically configured to determine that the white balance gain of the first image is in the first coordinate point corresponding to the target coordinate system; determining the first Delaine triangle The three vertices of the first triangle in the net are the first reference coordinate points, and the first triangle includes the first coordinate point in a region corresponding to the target coordinate system.

In an optional implementation, the determining unit is further configured to determine that three vertices of the second triangle in the second Delauna network are the second reference coordinate point, and the second triangle The three reference combinations corresponding to the three vertices are the same as the three reference combinations corresponding to the three vertices of the first triangle, and the reference of the first Delauna network and the second Delauna network The combination is the same.

In an optional implementation manner, the determining unit is further configured to calculate an intermediate parameter according to the following formula:

D00=sum(V0.*V0);

D01=sum(V0.*V1);

D02=sum(V0.*V2);

D11=sum(V1.*V1);

D12=sum(V1.*V2);

u=(D11*D02-D01*D12)/(D00*D11-D01*D01);

v=(D00*D12-D01*D02)/(D00*D11-D01*D01);

The determining unit is further configured to calculate the second coordinate point according to the following formula:

Q.x=(1-u-v)*A’.x+u*B’.x+v*C’.x;

Q.y=(1-u-v)*A’.y+u*B’.y+v*C’.y;

In a third aspect, an embodiment of the present invention provides another white balance information synchronization apparatus, including a processor and a memory, wherein the processor and the memory are connected to each other, wherein the memory is used to store a computer program, and the computer program includes Program instructions, the processor being configured to invoke the program instructions to perform the method of the first aspect above.

In a fourth aspect, an embodiment of the present invention provides a computer readable storage medium, where the computer storage medium stores a computer program, where the computer program includes program instructions, and the program instructions, when executed by a processor, cause the processing The method of the first aspect described above is performed.

DRAWINGS

The drawings that need to be used in the embodiments of the present application will be described below.

1 is a schematic flow chart of a white balance information synchronization method according to an embodiment of the present invention;

2 is a schematic structural diagram of a white balance information synchronization apparatus according to an embodiment of the present invention;

3 is a schematic diagram of a first Delauna network and a second Delauna network according to an embodiment of the present invention;

FIG. 4 is a schematic flowchart of a method for synchronizing white balance information according to another embodiment of the present invention; FIG.

FIG. 5 is a schematic structural diagram of a white balance information synchronization apparatus according to another embodiment of the present invention; FIG.

FIG. 6 is a schematic flowchart of a white balance information synchronization method according to another embodiment of the present invention; FIG.

FIG. 7 is a schematic structural diagram of a white balance information synchronization apparatus according to another embodiment of the present invention; FIG.

FIG. 8 is a schematic structural diagram of a white balance information synchronization apparatus according to another embodiment of the present invention; FIG.

FIG. 9 is a schematic structural diagram of a white balance information synchronization apparatus according to another embodiment of the present invention.

Detailed ways

An embodiment of the present invention provides a schematic flowchart of a white balance information synchronization method, as shown in FIG. 1 , including:

101. Acquire a first image and a second image; the first image is an image captured by a first camera, and the second image is an image captured by a second camera;

The first camera and the second camera are cameras in the same white balance information synchronization device. The white balance information synchronization device may be a mobile phone, a tablet computer, a video camera, a camera, a notebook computer, and other imaging devices including at least two cameras. The first image and the second image are images obtained by capturing the same scene at the same time by the first camera and the second camera, respectively. The distance between the first camera and the second camera is very close, and it can be understood that the light source information corresponding to the first camera and the second camera is the same. For example, the first camera and the second camera are two cameras on the mobile phone. As shown in FIG. 2, two circular areas on the upper left side of the figure represent two cameras.

102. Obtain a white balance gain of the first image, and determine a white coordinate gain of the first image in a first coordinate point corresponding to the target coordinate system and a first reference coordinate point; the first reference coordinate point is the first camera. N coordinate points corresponding to the above target coordinate system;

Currently, commonly used white balance gain calculation methods include gray world method, perfect reflection method, white point method, white area method and the like. In the embodiment of the present invention, the white balance information synchronization device may calculate the white balance gain of the first image by using any white balance gain calculation method to obtain the white balance gain of the first image. Embodiments of the present invention do not limit a method of calculating a white balance gain of the first image described above. For example, the white balance information synchronization device calculates the white balance gain of the first image by using the gray world method, and the specific calculation steps are as follows:

1) calculating an average value of color components of each pixel point R (red) in the first image, an average value of G (green) color components, and an average value of B (green) color components;

It is assumed that the first image contains N*M pixels, each pixel point corresponds to one coordinate point, and (x, y) represents a coordinate point of one pixel point in the first image. The R color component, the G color component, and the B color component of the pixel point whose coordinate point is (x, y) in the first image are represented as Rsensor(x, y), Gsensor(x, y), and Bsensor(x, y, respectively. ), you can use the following formula to calculate the average of the R color components:

Wherein, Ravg represents an average value of the R color components, that is, an average value of the color components of the respective pixel points R in the first image. Similarly, the average value Gavg of the G color component and the average value Bavg of the B color component can be calculated.

2) Calculate the gain of the R color component and the gain of the B color component, and calculate the formula as follows:

Where α is the gain of the R color component and β is the gain of the B color component. The gain of the G color component is 1. The white balance gain of the first image described above can be expressed as the gain of the R color component: the gain of the G color component: the gain of the B color component, that is, α:1:β. In the embodiment of the present invention, the AWB controller in the white balance information synchronization device may perform white balance processing on the first image to obtain a white balance gain of the first image.

Optionally, the target coordinate system includes a first coordinate axis and a second coordinate axis, where the value corresponding to the first coordinate axis is a ratio of the first color channel to the second color channel, and the value corresponding to the second coordinate axis is The ratio of the three color channels to the second color channel described above. The first color channel is an R channel, the second color channel is a G channel, and the third color channel is a B channel. The value corresponding to the first coordinate axis is R/G, and the value corresponding to the second coordinate axis is B/G. R/G is the ratio of the gain of the G channel to the gain of the R channel, that is, the ratio of the gain of the G color component to the gain of the R color component and the ratio of the average of the R color component to the average of the G color component; B/G The ratio of the gain of the G channel to the gain of the B channel, that is, the ratio of the gain of the G color component to the gain of the B color component and the ratio of the average of the B color component to the average of the G color component. The white balance gain of the first image may be expressed as the gain of the R channel: the gain of the G channel: the gain of the B channel, and the white balance gain of the first image is the first coordinate point corresponding to the target coordinate system (R/G , B / G), R / G is the gain of the G channel: the gain of the R channel, B / G is the gain of the G channel: the gain of the B channel. In practical applications, R/G and B/G are usually calculated first, that is, the ratio of the average value of the R color components of each pixel in the image to the average value of the G color components and the average value of the color components of each pixel B in the image. The ratio of the average value of the G color component; recalculate the gain of the R channel: the gain of the G channel: the gain of the B channel, and the calculated (R/G, B/G) is the white balance gain corresponding to the target coordinate system. A coordinate point. For example, after acquiring the first image, the white balance information synchronization device may calculate an average value Ravg of the color components of each pixel point R in the first image, an average value Gavg of the G color component, and an average value Bavg of the B color component; Calculate Bavg/Gavg to obtain B/G, calculate Ravg/Gavg to obtain R/G; determine the white balance gain of the first image according to the B/G and the R/G as G/R: 1: G/B, ie R Channel gain: G channel gain: B channel gain is G/R: 1: G/B. It can be understood that R/G and B/G have been determined before determining the white balance gain of the first image described above. After determining the white balance gain of the first image, the white balance information synchronization device may acquire R/G and B/G corresponding to the white balance gain of the first image to obtain the first coordinate point. Assume that the white balance gain of the first image is 2:1:2, that is, the gain of the R channel: the gain of the G channel: the gain of the B channel is 2:1:2; then the white balance gain of the first image corresponds to the target coordinate system. The first coordinate point is (R/G, B/G), which is (0.5, 0.5). The target coordinate system in the embodiment of the present invention includes but is not limited to the above coordinate system, and may be other coordinate systems.

The white balance information synchronizing device may pre-store information of the first reference coordinates. Specifically, the white balance information synchronization device may pre-store the position information of each coordinate point included in the first reference coordinate and the white balance gain corresponding to each coordinate point. The above N is an integer greater than or equal to 1. The first reference coordinate point may be one coordinate point, two coordinate points, three coordinate points, four coordinate points, and the like corresponding to the target coordinate system of the first camera. The first reference coordinate point corresponds to N white balance gains, and each of the coordinate points included in the first reference coordinate point corresponds to a white balance gain.

103. Determine a second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, and determine a white balance gain of the second image according to the second coordinate point; the second coordinate point is the foregoing The white balance gain of the second image is a coordinate point corresponding to the target coordinate system; and the second reference coordinate point is N coordinate points corresponding to the target coordinate system of the second camera.

The white balance information synchronizing device may pre-store information of the second reference coordinates. Specifically, the white balance information synchronization device may prestore the position information of each coordinate point included in the second reference coordinate and the white balance gain corresponding to each coordinate point. The white balance information synchronizing device may pre-store the coordinate point corresponding to the target coordinate system of the first camera and the coordinate point corresponding to the second camera in the target coordinate system, wherein the first reference coordinate point is the target coordinate of the first camera And a part of the corresponding coordinate points, wherein the second reference coordinate point is a part of the coordinate points corresponding to the second camera in the target coordinate system. As shown in FIG. 3, each point in the left half is a coordinate point corresponding to the target coordinate system of the first camera, and the first reference coordinate point is a partial coordinate point in the left half of the figure; each point in the right half is the first The two cameras are at coordinate points corresponding to the target coordinate system, and the second reference coordinate points are partial coordinate points in the right half of the figure. Optionally, the first reference coordinate point and the N reference combinations correspond to N white balance gains corresponding to the first camera; and the second reference coordinate point and the N reference combinations are combined with the N corresponding to the second camera. The white balance gain corresponds.

The reference combination is a combination of a light source and a color patch. The corresponding light source and/or color block between any two of the above N reference combinations is different. For example, the light source corresponding to a reference combination may be any one of a plurality of standard light sources such as D75, D65, D55, D50, CWF, TL84, U30, H, A; and the color block corresponding to one reference combination may be any Any color block in the standard color card can also be other color blocks. For example, one reference combination corresponds to one of the X-Rite standard color block cards under the D65 standard light source. The light source and color block corresponding to the reference combination are not limited to the above examples; the above examples should not be construed as limiting the uniqueness of the embodiments of the present invention.

The white balance synchronization device may preset a correspondence between the N reference combinations and the first reference coordinate point, and each of the N reference combinations corresponds to one of the first reference coordinate points. The white balance synchronization device may preset a correspondence between the N reference combinations and the second reference coordinate point, and each of the N reference combinations corresponds to one of the second reference coordinate points. The white balance gain corresponding to the first camera in a reference combination can be understood as the white balance gain corresponding to the image obtained by the first camera capturing the color block corresponding to the reference combination under the light source corresponding to the reference combination. Similarly, the white balance gain corresponding to the second camera in a reference combination can be understood as the white balance gain corresponding to the image obtained by the second camera capturing the color block corresponding to the reference combination under the light source corresponding to the reference combination. Assuming that the image obtained by the first camera shooting a certain color block under the standard light source D65 performs white balance processing, the white balance gain is 2:1:2, and the first reference combination corresponds to the standard light source D65 and the color block; The reference combination has a white balance gain of 2:1:2 corresponding to the first camera. An embodiment of the present invention provides a specific example of determining a white balance gain corresponding to a reference combination in a first camera:

1) Using the first camera to shoot the X-Rite standard color card under standard light sources such as D75, D65, D55, D50, CWF, TL84, U30, H, A, etc., to obtain Q images;

Typically, the X-Rite standard color card contains 24 color patches, each of which corresponds to a rectangular area in the standard color card. Assuming that the first camera shoots the X-Rite standard color card under five standard light sources, five images are obtained.

2) determining an image region corresponding to each of the Q images, and calculating an average value Ravg of the R component of each pixel in each image region, an average value Gavg of the G color component, and an average value Bavg of the B color component ;

Suppose the first camera shoots 5 colors of the X-Rite standard color card under 5 standard light sources. The X-Rite standard color card contains 24 color blocks, and 24 images can be determined for each of the obtained 5 images. region. Each image area corresponds to a combination of a standard light source and a color block, that is, each image area corresponds to one reference combination. Assuming that an image area is an image area corresponding to the first color block in the image obtained by the first camera shooting the X-Rite standard color card under the D75 light source, the image area corresponds to the combination of D75 and the first color block. The Gavg of each image area can be calculated using the formula (1). Similarly, Ravg of each image area and Bavg of each image area can be calculated.

Optionally, an image region corresponding to a partial color block of the Q images may be determined, and an average value Ravg of the color components of each pixel point R in the image region corresponding to the partial color block, an average value Gagg of the G color component, and B are calculated. The average value of the color components is Bavg.

3) Calculate Bavg/Gavg of each image area to obtain B/G corresponding to each image area, calculate Ravg/Gavg of each image area to obtain R/G corresponding to each image area; determine each image area in the above a white balance gain corresponding to a camera;

Assuming an image area corresponds to R/G and B/G, the white balance gain corresponding to the image area is G/R: 1: G/B, ie R channel gain: G channel gain: B channel gain is G/R: 1: G/B.

4) Determining a white balance gain corresponding to the first camera in a reference combination is a white balance gain corresponding to the image area corresponding to the reference combination in the first camera.

For example, the first camera captures 7 colors of the X-Rite standard color card under 7 standard light sources, and the X-Rite standard color card contains 24 color blocks, and each of the obtained 7 images can be determined 24 168 image areas, each image area corresponding to a combination of a standard light source and a color block, that is, a reference combination; calculating a white balance gain of each of the 168 image areas to obtain the 168 images The area corresponds to 168 white balance gains of the first camera; the white balance gain corresponding to the first camera in the reference camera is the white balance gain corresponding to the image area corresponding to the reference combination in the first camera. In this way, the white balance gain corresponding to the first camera in each of the 168 reference combinations corresponding to the 7 standard light sources and the 24 color patches can be determined. Similarly, the white balance gain corresponding to the reference camera in the second camera can be determined.

In the above manner, the white balance gain corresponding to the first camera and the white balance gain corresponding to the second camera can be quickly determined. The coordinate point corresponding to the white balance gain corresponding to the first camera in the target camera is the coordinate point corresponding to the first camera in the target coordinate system; the white balance gain corresponding to the second camera in the reference camera corresponds to the target coordinate system. The coordinate point is the coordinate point corresponding to the second camera in the target coordinate system. The N reference balances of the N reference combinations in the first camera are N coordinate points corresponding to the target coordinate system, and are the first reference coordinate points. The N reference balances of the N reference combinations in the second camera are N coordinate points corresponding to the target coordinate system, and are the second reference coordinate points. That is, the first reference coordinate points may be determined by the N reference balances corresponding to the N first white balance gains of the first camera; the N white balance gains corresponding to the second camera by the N reference combinations may be The above second reference coordinate point is determined.

Since the first camera and the second camera capture the same scene, and the first camera and the second camera are in the same area, it can be understood that the light source information corresponding to the first image and the second image is the same; each light source The information corresponds to a reference combination, that is, a reference combination can represent a kind of light source information. A reference combination The white balance gain corresponding to the second camera described above can be understood as the white balance gain corresponding to the image captured by the second camera under the light source information corresponding to the reference combination. Similarly, the white balance gain corresponding to the first camera in a reference combination can be understood as the white balance gain corresponding to the image captured by the first camera under the light source information corresponding to the reference combination. Assuming that the light source information corresponding to the first image and the second image corresponds to the first color block, the first coordinate point may be regarded as a white balance gain corresponding to the first color block of the first color block, and the second coordinate The point is the white balance gain corresponding to the first color block in the second camera.

The first coordinate point and the second coordinate point can be understood as the coordinate points corresponding to the first reference camera and the second camera respectively. The first reference coordinate point and the second reference coordinate point are respectively coordinate points corresponding to the N reference combinations in the first camera and the second camera. The first coordinate point corresponds to the first reference coordinate point; the second reference coordinate point corresponds to the first reference coordinate point. The mapping relationship between the first coordinate point and the first reference coordinate point is the same as or similar to the mapping relationship between the second coordinate point and the second reference coordinate point. It can be understood that there is at least one mapping relationship between the first coordinate point and the first reference coordinate point; the first coordinate point can be calculated by using the at least one mapping relationship and the first reference coordinate point; A mapping relationship and the second reference coordinate point may calculate the second coordinate point, that is, the white balance gain of the second image is a coordinate point corresponding to the target coordinate system. The specific mapping relationship and the method for determining the second coordinate point will be described in detail in the following embodiments.

In the embodiment of the present invention, after obtaining the white balance gain of the first image, the first coordinate point corresponding to the target coordinate system, the first reference coordinate point, and the second reference coordinate according to the white balance gain of the first image The point determines the white balance gain of the second image; the white balance gain of the second image can be accurately determined, and the computational complexity is low.

The embodiment of the present invention further provides a relationship between the first coordinate point and the first reference coordinate point: the first coordinate point is located in the closed region corresponding to the first reference coordinate point in the target coordinate system, and the N is greater than or equal to 3 .

The first reference coordinate point includes the first coordinate point in a closed region corresponding to the target coordinate system. The closed area corresponding to the first reference coordinate point in the target coordinate system is a closed area composed of a line connecting the coordinate points in the first reference coordinate point. Optionally, the closed area is a minimum area in the target coordinate system that includes the first coordinate point, that is, a closed area with the smallest area. In the embodiment of the present invention, the second reference coordinate is utilized according to the mapping relationship between the first coordinate point and the first reference coordinate point and the same or similar mapping relationship between the second coordinate point and the second reference coordinate point. The point and target mapping relationship determines the second coordinate point, and the target mapping relationship is a mapping relationship between the first coordinate point and the first reference coordinate point. It can be understood that the closer the coordinate points in the first reference coordinate point are to the first coordinate point, the more similar the first mapping relationship is to the second mapping relationship, and the more accurate the obtained second coordinate point is, the first mapping relationship is a mapping relationship between the first coordinate point and the first reference coordinate point, wherein the second mapping relationship is a mapping relationship between the second coordinate point and the second reference coordinate point. The first reference coordinate point is closer to the first coordinate point. Therefore, the second coordinate point can be accurately determined by the first reference coordinate point described above.

The embodiment of the invention defines the positional relationship between the first coordinate point and the first reference coordinate point in the target coordinate system, and the second coordinate point can be accurately determined, and the calculation is simple.

The embodiment of the present invention further provides a specific example of the first reference coordinate point and the second reference coordinate point: the above N is 3;

The first reference coordinate point is three vertices of a triangle in the first Delauna network; the first Delauna network corresponds to the first point set, and the first point set is the first camera a set of coordinate points corresponding to the target coordinate system; the first reference coordinate point is included in the first point set;

The second reference coordinate point is three vertices of a triangle in the second Delauna network, the second Delauna network corresponds to the second point set, and the second point set is the second camera A set of coordinate points corresponding to the target coordinate system; the second reference coordinate point is included in the second set of points.

There is a triangulation relationship between coordinate points included in the first point set; and a triangulation relationship exists between the coordinate points included in the second point set. The first Delaughan triangulation corresponding to the first point set may be that the coordinate point included in the first point set is a vertex in the first Delaunay triangulation; the second Delon triangulation and the second The point set correspondingly may be that the coordinate points included in the second point set are the vertices in the second Delauna network. It can be understood that the first coordinate point is unique in the three coordinate points corresponding to the first point set, that is, the first reference coordinate point is unique; and the second coordinate point is corresponding to the third point set. The coordinate points are unique, that is, the second reference coordinate point described above is unique. As shown in Fig. 3, the left half is the first Delauna triangulation, the first coordinate point is located in the first triangle, that is, the gray triangle in the left half of the figure; the right half is the second Delonian triangle, right The three vertices of the gray triangle in the half graph are the second reference coordinate points.

In the embodiment of the present invention, the triangular region including the first coordinate point in the first Delauna network may be determined; and the three vertices corresponding to the triangular region are determined as the first reference coordinate point.

It can be understood that the first reference coordinate point can be quickly determined by the first coordinate point described above, and the determined first reference coordinate point is unique. The three coordinate points included in the first reference coordinate point can be accurately mapped to the first coordinate point, and the calculation is simple.

In the embodiment of the present invention, the first reference coordinate point and the second reference coordinate point each include three coordinate points, which can reduce the computational complexity.

The embodiment of the present invention further provides a specific example of the first point set and the second point set, where the first point set and the M reference combinations correspond to the M white balance gains corresponding to the first camera, and the foregoing The second point set and the M reference combinations correspond to the M white balance gains corresponding to the second camera, and the M is greater than or equal to the above N;

The corresponding light source and/or color block between any two of the above M reference combinations is different.

The first point set includes the M coordinate balances corresponding to the M cameras corresponding to the M coordinate points corresponding to the target coordinate system; the second point set includes the M reference combinations in the second The M white balance gains corresponding to the camera are M coordinate points corresponding to the target coordinate system. The white balance synchronizing device may preset information of each coordinate point in the first point set and a triangulation relationship between the coordinate points in the first point set; or may preset preset coordinates included in the second point set The information of the points and the triangulation relationship between the coordinate points in the second point set above. According to the preset information, the white balance synchronization device can quickly determine the first reference coordinate point and the second reference coordinate point corresponding to the first coordinate point.

It can be understood that the coordinate points included in the first point set and the coordinate points included in the second point set may be one-to-one correspondence. In the embodiment of the present invention, the first point set and the second point set correspond to the same reference combination; the second reference coordinate point corresponding to the first reference coordinate point may be accurately and quickly determined.

Further, the embodiment of the present invention further provides a method for determining a second reference coordinate point, which is specifically as follows: the M coordinate points included in the first point set and the M coordinate points included in the second point set correspond to M Target numbers, the above M target numbers are in one-to-one correspondence with the above M reference combinations;

The three coordinate points corresponding to the three target numbers are acquired from the second point set to obtain the second reference coordinate point.

It can be understood that the M coordinate points included in the first point set and the M coordinate points included in the second point set correspond to the M reference combinations. The M target numbers corresponding to the M reference combinations are in one-to-one correspondence, and the M target numbers corresponding to the M coordinate points included in the first point set and the M target points corresponding to the M coordinate points included in the second point set are respectively The serial number is the same. For example, the first point set and the second point set each include 28 coordinate points, and the 28 target numbers corresponding to the 28 coordinate points included in the first point set correspond to the 28 coordinate points included in the second point set. The 28 target numbers are all 1 to 28. Assuming that the three target numbers corresponding to the first reference coordinate point are 1, 3, and 5, it is determined that the coordinate point of the target number of the second point set is 1, 3, and 5 is the coordinate point corresponding to the second reference coordinate point.

In the embodiment of the present invention, the second reference coordinate point corresponding to the first reference coordinate point can be quickly determined, which is simple to implement.

The embodiment of the present invention further provides a method for determining a first reference coordinate point, which is specifically as follows: determining that the white balance gain of the first image in the first coordinate point and the first reference coordinate point corresponding to the target coordinate system include:

Determining that the three vertices of the first triangle in the first Delauna network are the first reference coordinate points, and the first triangle includes the first coordinate point in a region corresponding to the target coordinate system.

The determining that the three vertices of the first triangle in the first Delauna network are the first reference coordinate point may be a triangle region in which the first coordinate point is determined; determining three vertices corresponding to the triangular region is the foregoing First reference coordinate point. The white balance information synchronization device may preset information of vertices corresponding to the respective triangle regions in the first Delauna network, that is, three vertices corresponding to each triangle region; or the first Delauna triangle may be preset Information about the coordinate points contained in each triangle area in the net. The white balance information synchronizing device may determine the triangular region corresponding to the first coordinate point according to the position information of the first coordinate point, and further determine that the three vertices corresponding to the triangular region are the first reference coordinate point. Assuming that the first Delauna network includes 24 triangular regions, and the first coordinate point is in the third triangular region, it is determined that the three vertices corresponding to the third triangular region are the first reference coordinate points.

In the embodiment of the present invention, the first reference coordinate point corresponding to the first coordinate point can be quickly and accurately determined, and the implementation is simple.

The embodiment of the present invention further provides a method for determining a second reference coordinate point, which is specifically as follows: before the determining the second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, the foregoing method Also includes:

Determining that the three vertices of the second triangle in the second Delauna network are the second reference coordinate points, and the three reference combinations corresponding to the three vertices of the second triangle correspond to the three vertices of the first triangle The three reference combinations are the same, and the reference combinations corresponding to the first Delonian triangulation and the second Delaughan triangulation are the same.

Specifically, the three reference combinations corresponding to the first reference coordinate point may be determined first; and then the corresponding three reference vertices in the second Delauna network are determined as the second reference coordinate point. It is assumed that each point in the second Delauna network corresponds to the first color block to the twentieth color block in each point in the first Delauna network, and the second reference coordinate point corresponds to the first color block and the second The color block and the fifth color block, the second reference coordinate point is the first color block, the second color block, and the three vertices corresponding to the fifth color block in the second Delauna network.

In the embodiment of the present invention, the second reference coordinate point corresponding to the first reference coordinate point can be quickly and accurately determined.

The embodiment of the present invention further provides a method for determining a second coordinate point according to a first coordinate point, a first reference coordinate point, and a second reference coordinate point, which is specifically as follows: according to the first coordinate point, the first reference coordinate The point and the second reference coordinate point determine the second coordinate point including:

Calculate the intermediate parameters according to the following formula:

D00=sum(V0.*V0);(4)

D01=sum(V0.*V1);(5)

D02=sum(V0.*V2);(6)

D11=sum(V1.*V1);(7)

D12=sum(V1.*V2);(8)

u=(D11*D02-D01*D12)/(D00*D11-D01*D01);(9)

v=(D00*D12-D01*D02)/(D00*D11-D01*D01);(10)

Wherein, V0=CA, V1=BA, V2=PA, the P is the first coordinate point, and the C, the B, and the A are respectively three coordinate points included in the first reference coordinate point; , .* symbol indicates the multiplication of the corresponding elements between the vectors; the above u and the above v are intermediate parameters;

Calculate the above second coordinate point according to the following formula:

Q.x=(1-u-v)*A’.x+u*B’.x+v*C’.x;(11)

Q.y=(1-u-v)*A’.y+u*B’.y+v*C’.y;(12)

The C', the B', and the A' are respectively three coordinate points included in the second reference coordinate point, and the A' corresponds to the same reference combination as the A, and the B' corresponds to the same reference as the B. In combination, the above C' corresponds to the same reference combination as the above C; the above x represents the coordinates of the first coordinate axis, the above y represents the coordinates of the second coordinate axis, and the second coordinate point is (Qx, Qy).

The above u and the above v are intermediate parameters calculated by the first coordinate point and the first reference coordinate point. It can be seen from the formula (8) and the formula (9) that the above u, the above v, and the above (1-u-v) can be understood as the weighting coefficients respectively corresponding to the three coordinate points included in the second reference coordinate point. The implementation of the present invention may further determine the weighting coefficient corresponding to the second reference coordinate point by using other methods, that is, determining the weighting coefficient corresponding to the second reference coordinate point by using another algorithm by using the first reference coordinate point and the first coordinate point. The calculation method is a triangular interpolation method, and the second coordinate point may be determined by other algorithms according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point. In the embodiment of the present invention, the mapping relationship between the first coordinate point and the first reference coordinate point may be determined by using another algorithm to determine a mapping relationship between the second coordinate point and the second reference coordinate point, and further The second coordinate point is determined. The above method for calculating the second coordinate point is only an example, and the above examples are not to be construed as limiting the uniqueness of the embodiments of the present application. The number of coordinate points included in the first reference coordinate point and the number of coordinate points included in the second reference coordinate point are not limited to three, and may be four or two. It is assumed that the first reference coordinate point includes four coordinate points, and the four coordinate points correspond to four weighting coefficients; then the second reference coordinate point can obtain the second coordinate point by using the four weighting coefficients and the four coordinate points included therein. The specific calculation formula is the same as formula (8) and formula (9).

In the implementation of the invention, the second coordinate point can be calculated quickly and accurately, and the computational complexity is low.

An embodiment of the present invention provides a schematic flowchart of another method for synchronizing white balance information, as shown in FIG. 4, including:

401. The first camera and the second camera of the white balance information synchronization device respectively acquire the first image and the second image;

402. Obtain a white balance gain of the first image.

As shown in FIG. 5, the white balance information synchronization device may include a first camera, a first camera, and an image signal processor. The image signal processor includes an AWB controller and a cache; the first camera and the second camera in the figure are in the same scene. Shooting, respectively obtaining a first image and a second image; the AWB controller performs white balance processing on the first image to obtain a white balance gain of the first image; and the buffer stores parameters required for performing white balance processing.

403. Determine a white balance gain of the first image in a first coordinate point corresponding to the target coordinate system;

The white balance gain of the first image may be expressed as the gain of the R channel: the gain of the G channel: the gain of the B channel, and the white balance gain of the first image is the first coordinate point corresponding to the target coordinate system (R/G , B / G), R / G is the gain of the G channel: the gain of the R channel, B / G is the gain of the G channel: the gain of the B channel. In practical applications, R/G and B/G are usually calculated first, that is, the ratio of the average value of the R color components of each pixel in the image to the average value of the G color components and the average value of the color components of each pixel B in the image. The ratio of the average value of the G color component; recalculate the gain of the R channel: the gain of the G channel: the gain of the B channel, and the calculated (R/G, B/G) is the white balance gain corresponding to the target coordinate system. A coordinate point. After determining the white balance gain of the first image, the white balance information synchronization device may acquire R/G and B/G corresponding to the white balance gain of the first image to obtain the first coordinate point.

404. Determine whether the first coordinate point is located in a target area in the target coordinate system.

If yes, execute 405; if no, execute 411. The white balance information synchronizing device may preset information of the target area. The target area may be a closed area corresponding to the target coordinate system of the F coordinate points, and the F coordinate points are F reference sets, and the F white balance gains corresponding to the first camera are at the coordinate points corresponding to the target coordinate system. . The white balance information synchronizing device may preset information of the F white reference gains corresponding to the first camera corresponding to the coordinate points corresponding to the target coordinate system, and the F reference combinations corresponding to the second camera. The information of the F white balance gains at the coordinate points corresponding to the above-mentioned target coordinate system. The above F is an integer greater than 1. It can be understood that the first coordinate point in the target area can be accurately mapped to the second coordinate point, that is, the coordinate point corresponding to the white balance gain of the second image. Through this step, the accuracy of white balance information synchronization can be ensured. In practical applications, the specific coordinate points that need to be selected to construct the above target area need to be determined by the commissioning personnel according to the actual situation. Specifically, the debugger can determine the target area through repeated experiments to ensure the accuracy of white balance information synchronization. Embodiments of the present invention do not limit the manner in which the target area is determined. As shown in FIG. 5, the area corresponding to the broken line in the left half is the target area.

405. Determine a first reference coordinate point corresponding to the first coordinate point.

The first reference coordinate point is three vertices of a triangle in the first Delauna network; the first Delauna network corresponds to the first point set, and the first point set is the first camera A set of coordinate points corresponding to the target coordinate system; the first reference coordinate point is included in the first set of points. The first coordinate point is located at a closed region corresponding to the target coordinate system in the first reference coordinate point.

406. Calculate an intermediate parameter according to the first coordinate point and the first reference coordinate point.

Specifically, the above intermediate parameters can be calculated using equations (4)-(10).

407. Determine a second reference coordinate point corresponding to the first reference coordinate point.

408. Determine a second coordinate point according to the second reference coordinate point and the intermediate parameter.

Specifically, the second coordinate point described above can be calculated using equations (11) and (12).

409. Determine a white balance gain of the second image according to the second coordinate point.

410. Perform white balance processing on the first image and the second image.

411. Determine a white balance gain of the second image by using a target manner.

The target mode may be the same as the manner of determining the white balance gain of the first image; or may be another way of mapping the white balance gain of the first image to the white balance gain of the second image.

In the embodiment of the present invention, different methods are adaptively selected, and the white balance gain of the first image is mapped to the white balance gain of the second image; the accuracy of the white balance information synchronization is ensured.

An embodiment of the present invention provides a schematic flowchart of another method for synchronizing white balance information, as shown in FIG. 6, including:

601. Determine whether a distance between the first coordinate point and the target reference coordinate point is less than a target threshold.

If yes, execute 602; if no, execute 604. The above target threshold may be set in advance by a value greater than zero. Before executing 601, 401-403 may be performed to obtain the first coordinate point described above.

The target reference coordinate point is a coordinate point that is closest to the first coordinate point among the H coordinate points, and the H coordinate points are H reference balances. The H white balance gains corresponding to the first camera are in the target coordinate system. Corresponding coordinate points. The white balance information synchronizing device may preset information of the H white balance gains corresponding to the first camera corresponding to the coordinate points corresponding to the target coordinate system, and the H reference combinations corresponding to the second camera The H white balance gains information on the coordinate points corresponding to the target coordinate system.

602. Determine a target reference combination corresponding to the target reference coordinate point.

The target reference combination is one of the H reference combinations, and the target reference coordinate point is a coordinate point corresponding to the H target gain of the target reference combination in the first camera. The above H is an integer greater than one.

603. Determine a white balance gain corresponding to the second camera in the target reference combination as the white balance gain of the second image.

604. Determine G coordinate points in the target coordinate system that are closest to the first coordinate point.

The above-mentioned G coordinate points are partial coordinate points among the above H coordinate points. The above G is an integer smaller than the above H.

605. Calculate G weights corresponding to the G coordinate points.

The closer the coordinate point of the above G coordinate points is to the first coordinate point, the larger the weight corresponding to the coordinate point. Assuming that the distance between the four coordinate points closest to the first coordinate point and the distance before the first coordinate point are 0.1, 0.2, 0.3, and 04, respectively, the weights corresponding to the four coordinate points are 0.4, 0.3, 0.2, and 01, respectively. . The G weights corresponding to the G coordinate points may be calculated by a method such as inverse distance weighted interpolation. Embodiments of the invention are not limited to the above methods.

606. Determine G reference combinations corresponding to the G coordinate points.

The above G reference combinations are partial reference combinations among the above H reference combinations.

607. Calculate a second coordinate point according to the G reference combinations and the G weights.

Specifically, it may be determined that the G white balance gains corresponding to the G cameras in the second camera are in the G coordinate points corresponding to the target coordinate system; and the second coordinates are calculated according to the G coordinate points and the G weights. point. The second coordinate point described above can be calculated using equations (8) and (9).

608. Determine a white balance gain of the second image according to the second coordinate point.

In the embodiment of the invention, the white balance gain of the second image can be quickly determined, and the calculation is simple.

An embodiment of the present invention further provides a white balance information synchronization apparatus, the apparatus comprising means for performing the method described above. Specifically, referring to FIG. 7, is a schematic block diagram of a white balance information synchronization apparatus according to an embodiment of the present invention. The white balance information synchronizing apparatus of this embodiment includes an obtaining unit and a determining unit, and a detailed description of each unit is as follows.

The acquiring unit 701 is configured to acquire the first image and the second image; the first image is an image captured by the first camera, and the second image is an image captured by the second camera;

The obtaining unit 701 is further configured to obtain a white balance gain of the first image.

a determining unit 702, configured to determine a first coordinate point corresponding to the white balance gain of the first image in the target coordinate system and a first reference coordinate point; the first reference coordinate point is a correspondence between the first camera and the target coordinate system N coordinate points;

The determining unit 702 is further configured to determine a second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, and determine a white balance gain of the second image according to the second coordinate point; The second coordinate point is a coordinate point corresponding to the white balance gain of the second image in the target coordinate system; and the second reference coordinate point is N coordinate points corresponding to the target coordinate system of the second camera.

For the embodiment, reference may be made to the foregoing method embodiments, and the description of the method embodiments in the content of the invention, which will not be further described herein. In the device embodiment after the embodiment, the content of the method embodiment may also be referred to. . In this embodiment, the obtaining unit 701 may correspond to the function of acquiring the image captured by the first camera and the second camera and the function of acquiring other information by the image signal processor in FIG. 5; the determining unit 702 may correspond to the image in FIG. Image signal processor.

In an optional implementation manner, the first reference coordinate point and the N reference combinations correspond to N white balance gains corresponding to the first camera; the second reference coordinate point and the N reference combinations are in the foregoing The N white balance gains corresponding to the second camera correspond.

In an optional implementation manner, the first coordinate point is located at a closed area corresponding to the first reference coordinate point in the target coordinate system, and the N is greater than or equal to 3.

In an optional implementation manner, the above N is 3;

In the embodiment of the invention, the first reference coordinate point and the second reference coordinate point are all three vertices of a triangle in the Delonian triangulation; it can be ensured that the first reference coordinate point and the second reference coordinate point are both unique.

In an optional implementation manner, the first point set and the M reference combinations correspond to M white balance gains corresponding to the first camera, and the second point set and the M reference combinations are in the second The corresponding white balance gains of the camera correspond to the above, M is greater than or equal to the above N;

In an optional implementation manner, the M coordinate points included in the first point set and the M coordinate points included in the second point set respectively correspond to M target numbers, and the M target numbers and the M references are One-to-one correspondence

The determining unit 702 is further configured to determine three target serial numbers corresponding to the first reference coordinate point;

The acquiring unit 701 is further configured to acquire three coordinate points corresponding to the three target numbers from the second point set to obtain the second reference coordinate point.

In the embodiment of the present invention, the second reference coordinate point can be quickly determined, and the operation is simple.

In an optional implementation manner, the determining unit 702 is specifically configured to determine that the white balance gain of the first image is in the first coordinate point corresponding to the target coordinate system; and determine that the first Delauna network is in the first The three vertices of a triangle are the first reference coordinate points, and the first triangle includes the first coordinate point in a region corresponding to the target coordinate system.

In an optional implementation manner, the determining unit 702 is further configured to determine that three vertices of the second triangle in the second Delauna network are the second reference coordinate point, and three of the second triangles The three reference combinations corresponding to the vertices are the same as the three reference combinations corresponding to the three vertices of the first triangle, and the reference combinations corresponding to the first Delauna network and the second Delauna network are the same.

In an optional implementation manner, the determining unit 702 is further configured to calculate an intermediate parameter according to the following formula:

D00=sum(V0.*V0);

D01=sum(V0.*V1);

D02=sum(V0.*V2);

D11=sum(V1.*V1);

D12=sum(V1.*V2);

u=(D11*D02-D01*D12)/(D00*D11-D01*D01);

v=(D00*D12-D01*D02)/(D00*D11-D01*D01);

The determining unit 702 is further configured to calculate the second coordinate point according to the following formula:

Q.x=(1-u-v)*A’.x+u*B’.x+v*C’.x;

Q.y=(1-u-v)*A’.y+u*B’.y+v*C’.y;

In the embodiment of the present invention, the second coordinate point can be calculated quickly and accurately, and the calculation complexity is low.

In an optional implementation, the pixel of the first image, the pixel of the second image, and the white balance gain all use three color channels; the value corresponding to the first coordinate axis is the first color channel. The ratio corresponding to the second color channel is a ratio of the third color channel to the second color channel.

Referring to FIG. 8, FIG. 8 is a white balance information synchronization apparatus according to an embodiment of the present disclosure. The white balance information synchronization apparatus includes: a cache 801, a processor 802, and an input device 803. The cache 801 may be included in the memory. It can also be integrated in the processor 802, and the parameter data is included in the cache 801; the executable code can be stored in the memory, and the processor 802 has the above-mentioned executable executable code or the hardware to implement the embodiment of the present application. The functionality of the provided method. The functions of the method in this embodiment are not described herein again. The cache 801, the processor 802, and the input device 803 can be connected to each other through a bus.

If the cache is included in the memory, the memory includes, but is not limited to, a random access memory (RAM), a read-only memory (ROM), and an erasable programmable read-only memory (Erasable Programmable Read). Only Memory (EPROM), or Compact Disc Read-Only Memory (CD-ROM), which can be used to store related instructions and data. The input device 803 is used to acquire image data.

It should be understood that, in the embodiment of the present invention, the processor 802 may be a central processing unit (CPU), and the processor may also be another general-purpose processor, a digital signal processor (DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component, etc. Graphics Processing Unit (GPU). The general purpose processor may be a microprocessor or the processor or any conventional processor or the like.

In a specific implementation, the processor 801, the input device 803, and the cache 801, which are described in the embodiments of the present invention, may be implemented in the foregoing embodiments provided by the embodiments of the present invention, and may also be implemented in the embodiments of the present invention. The implementation manner of the white balance information synchronization device will not be described here.

In another embodiment of the present invention, a computer readable storage medium is provided. The computer readable storage medium stores a computer program, where the computer program includes program instructions, and when the program instructions are executed by a processor, the first image is acquired. And the second image; the first image is an image acquired by the first camera, the second image is an image captured by the second camera; and the white balance gain of the first image is determined at a first coordinate point corresponding to the target coordinate system and a reference coordinate point; the first reference coordinate point is N coordinate points corresponding to the first camera in the target coordinate system; determining the second according to the first coordinate point, the first reference coordinate point and the second reference coordinate point a coordinate point, determining a white balance gain of the second image according to the second coordinate point; wherein the second coordinate point is a coordinate point corresponding to the white balance gain of the second image in the target coordinate system; and the second reference coordinate point is The second camera is located at N coordinate points corresponding to the target coordinate system.

The above computer readable storage medium may be an internal storage unit of the above-described apparatus of any of the foregoing embodiments, such as a hard disk or a memory of the device. The computer readable storage medium may also be an external storage device of the above device, such as a plug-in hard disk equipped with the above device, a smart memory card (SMC), a Secure Digital (SD) card, a flash memory card. (Flash Card), etc. Further, the above computer readable storage medium may also include both an internal storage unit of the above device and an external storage device. The computer readable storage medium described above is for storing the above computer program and other programs and data required by the above apparatus. The computer readable storage medium described above can also be used to temporarily store data that has been output or is about to be output.

FIG. 9 is a schematic structural diagram of a terminal provided by the present application. The terminal may be the white balance information synchronizing device in the foregoing embodiment. As shown in FIG. 9, terminal 200 can include a baseband chip 210, a memory 215 (one or more computer readable storage media), a radio frequency (RF) module 216, and a peripheral system 217. These components can communicate over one or more communication buses 214.

The peripheral system 217 is mainly used to implement the interaction function between the terminal 210 and the user/external environment, and mainly includes the input and output devices of the terminal 200. In a specific implementation, the peripheral system 217 can include: a touch screen controller 218, a camera controller 219, an audio controller 220, and a sensor management module 221. Each controller may be coupled to a respective peripheral device such as touch screen 223, camera 224, audio circuit 225, and sensor 226. It should be noted that the peripheral system 217 may also include other I/O peripherals.

The baseband chip 210 can be integrated to include one or more processors 211, a clock module 222, and a power management module 213. The clock module 222 integrated in the baseband chip 210 is primarily used to generate the clocks required for data transfer and timing control for the processor 211. The power management module 213 integrated in the baseband chip 210 is mainly used to provide a stable, high-accuracy voltage for the processor 211, the radio frequency module 216, and the peripheral system.

A radio frequency (RF) module 216 is used to receive and transmit radio frequency signals, primarily integrating the receiver and transmitter of terminal 200. A radio frequency (RF) module 216 communicates with the communication network and other communication devices via radio frequency signals. In a specific implementation, the radio frequency (RF) module 216 can include, but is not limited to: an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chip, a SIM card, and Storage media, etc. In some embodiments, a radio frequency (RF) module 216 can be implemented on a separate chip.

Memory 215 is coupled to processor 211 for storing various software programs and/or sets of instructions. In particular implementations, memory 215 can include high speed random access memory, and can also include non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state storage devices. The memory 215 can store an operating system (hereinafter referred to as a system) such as an embedded operating system such as ANDROID, IOS, WINDOWS, or LINUX. The memory 215 can also store a network communication program that can be used to communicate with one or more additional devices, one or more terminal devices, one or more network devices. The memory 215 can also store a user interface program, which can realistically display the content of the application through a graphical operation interface, and receive user control operations on the application through input controls such as menus, dialog boxes, and keys. .

The memory 215 can also store one or more applications. As shown in FIG. 9, these applications may include: social applications (such as Facebook), image management applications (such as photo albums), map applications (such as Google Maps), browsers (such as Safari, Google Chrome), etc. .

In the present application, processor 211 can be used to read and execute computer readable instructions. Specifically, the processor 211 can be used to call a program stored in the memory 215 and execute instructions included in the program.

It should be understood that the terminal 200 is only an example provided by an embodiment of the present invention, and that the terminal 200 may have more or less components than the illustrated components, may combine two or more components, or may have components. Different configurations are implemented.

The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any equivalent person can be easily conceived within the technical scope of the present invention by any person skilled in the art. Modifications or substitutions are intended to be included within the scope of the invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

A white balance information synchronization method, comprising:

Obtaining a first image and a second image; the first image is an image acquired by a first camera, and the second image is an image captured by a second camera;

Obtaining a white balance gain of the first image, and determining a white coordinate gain of the first image in a first coordinate point corresponding to the target coordinate system and a first reference coordinate point; the first reference coordinate point is the first a camera at N coordinate points corresponding to the target coordinate system;

Determining a second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, and determining a white balance gain of the second image according to the second coordinate point; the second coordinate The point is a coordinate point corresponding to the white balance gain of the second image in the target coordinate system; and the second reference coordinate point is N coordinate points corresponding to the second camera in the target coordinate system.
The method according to claim 1, wherein the first reference coordinate point and the N reference combinations correspond to N white balance gains corresponding to the first camera; the second reference coordinate point and the The N reference combinations correspond to N white balance gains corresponding to the second camera, and the reference combination is a combination of a light source and a color block.
The method according to claim 2, wherein the first coordinate point is located in a closed region of the first reference coordinate point corresponding to the target coordinate system, and the N is greater than or equal to 3.
The method according to any one of claims 1 to 3, wherein the N is 3;

The first reference coordinate point is three vertices of a triangle in the first Delauna network; the first Delauna network corresponds to the first point set, and the first point set is the first point set a set of coordinate points corresponding to a camera in the target coordinate system; the first reference coordinate point is included in the first point set;

The second reference coordinate point is three vertices of a triangle in the second Delauna network, the second Delauna network corresponds to the second point set, and the second point set is the a set of coordinate points corresponding to the target coordinate system of the two cameras; the second reference coordinate points being included in the second set of points.
The method of claim 4 wherein:

The first point set and the M reference combinations correspond to M white balance gains corresponding to the first camera, and the second point set and the M reference combinations are M corresponding to the second camera. Corresponding to a white balance gain, the M being greater than or equal to the N, and the reference combination being a combination of a light source and a color patch;

The corresponding light source and/or color block between any two of the M reference combinations is different.
The method according to claim 5, wherein the M coordinate points included in the first point set and the M coordinate points included in the second point set correspond to M target numbers, the M targets The serial number corresponds to the M reference combinations one by one;

The method further includes: before determining the second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, the method further includes:

Determining three target serial numbers corresponding to the first reference coordinate point;

Obtaining three coordinate points corresponding to the three target serial numbers from the second point set to obtain the second reference coordinate point.
The method according to claim 4, wherein the determining the white balance gain of the first image in the target coordinate system corresponding to the first coordinate point and the first reference coordinate point comprises:

Determining, that the white balance gain of the first image is at the first coordinate point corresponding to the target coordinate system;

Determining that three vertices of the first triangle in the first Delauna network are the first reference coordinate points, and the first triangle includes the first coordinate point in a region corresponding to the target coordinate system.
The method according to claim 4, wherein the method further comprises: before determining the second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, the method further comprising:

Determining that three vertices of the second triangle in the second Delauna network are the second reference coordinate points, three reference combinations corresponding to three vertices of the second triangle, and three of the first triangles The three reference combinations corresponding to the vertices are the same, and the reference combinations corresponding to the first Delauna network and the second Delauna network are the same.
The method according to claim 4, wherein the determining the second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point comprises:

Calculate the intermediate parameters according to the following formula:

D00=sum(V0.*V0);

D01=sum(V0.*V1);

D02=sum(V0.*V2);

D11=sum(V1.*V1);

D12=sum(V1.*V2);

u=(D11*D02-D01*D12)/(D00*D11-D01*D01);

v=(D00*D12-D01*D02)/(D00*D11-D01*D01);

Wherein, V0=CA, V1=BA, V2=PA, the P is the first coordinate point, and the C, the B, and the A are respectively three coordinates included in the first reference coordinate point. Point; sum means summation, .* symbol means multiplication of corresponding elements between vectors; u and v are intermediate parameters;

Calculating the second coordinate point according to the following formula:

Q.x=(1-u-v)*A’.x+u*B’.x+v*C’.x;

Q.y=(1-u-v)*A’.y+u*B’.y+v*C’.y;

Wherein, the C', the B', and the A' are respectively three coordinate points included in the second reference coordinate point, and the A' and the A correspond to the same reference combination, the B' Corresponding to the same reference combination as the B, the C' corresponding to the same reference combination; the .x represents the coordinates of the first coordinate axis, and the .y represents the coordinates of the second coordinate axis; The second coordinate point is (Qx, Qy).
The method according to claim 9, wherein the pixel points of the first image, the pixel points of the second image, and the white balance gain each adopt three color channels; the first coordinate axis corresponds to The value is the ratio of the first color channel to the second color channel, and the value corresponding to the second coordinate axis is the ratio of the third color channel to the second color channel.
A white balance information synchronization device, comprising:

An acquiring unit, configured to acquire a first image and a second image; the first image is an image captured by a first camera, and the second image is an image captured by a second camera;

The acquiring unit is further configured to obtain a white balance gain of the first image;

a determining unit, configured to determine a first coordinate point corresponding to a white coordinate gain of the first image and a first reference coordinate point; the first reference coordinate point is a target coordinate of the first camera at the target Corresponding N coordinate points;

The determining unit is further configured to determine a second coordinate point according to the first coordinate point, the first reference coordinate point, and the second reference coordinate point, and determine white of the second image according to the second coordinate point Balanced gain; the second coordinate point is a coordinate point corresponding to the white balance gain of the second image in the target coordinate system; and the second reference coordinate point is a correspondence of the second camera in the target coordinate system N coordinate points.
The white balance information synchronization apparatus according to claim 11, wherein the first reference coordinate point and the N reference combinations correspond to N white balance gains corresponding to the first camera; the second reference The coordinate points correspond to the N reference balances corresponding to the N white balance gains of the second camera.
The white balance information synchronizing apparatus according to claim 12, wherein the first coordinate point is located at a closed area corresponding to the target coordinate system of the first reference coordinate point, and the N is greater than or equal to 3.
The white balance information synchronization device according to any one of claims 11 to 13, wherein the N is 3;

The first reference coordinate point is three vertices of a triangle in the first Delauna network; the first Delauna network corresponds to the first point set, and the first point set is the first point set a set of coordinate points corresponding to a camera in the target coordinate system; the first reference coordinate point is included in the first point set;

The second reference coordinate point is three vertices of a triangle in the second Delauna network, the second Delauna network corresponds to the second point set, and the second point set is the a set of coordinate points corresponding to the target coordinate system of the two cameras; the second reference coordinate points being included in the second set of points.
The white balance information synchronizing apparatus according to claim 14, wherein the first point set and the M reference combinations correspond to M white balance gains corresponding to the first camera, and the second point set Corresponding to the M white balance gains corresponding to the M cameras in the second reference combination, the M is greater than or equal to the N;

The corresponding light source and/or color block between any two of the M reference combinations is different.
The white balance information synchronization device according to claim 15, wherein the M coordinate points included in the first point set and the M coordinate points included in the second point set correspond to M target numbers, The M target numbers are in one-to-one correspondence with the M reference combinations;

The determining unit is further configured to determine three target serial numbers corresponding to the first reference coordinate point;

The acquiring unit is further configured to acquire three coordinate points corresponding to the three target serial numbers from the second point set to obtain the second reference coordinate point.
A white balance information synchronizing apparatus according to claim 14, wherein

The determining unit is specifically configured to determine that the white balance gain of the first image is in the first coordinate point corresponding to the target coordinate system; and determine that the three vertices of the first triangle in the first Delauna network are The first reference coordinate point, the first triangle includes the first coordinate point in a region corresponding to the target coordinate system.
A white balance information synchronizing apparatus according to claim 14, wherein

The determining unit is further configured to determine that three vertices of the second triangle in the second Delauna network are the second reference coordinate points, and three reference combinations corresponding to three vertices of the second triangle The three reference combinations corresponding to the three vertices of the first triangle are the same, and the reference combinations corresponding to the first Delauna network and the second Delauna network are the same.
The apparatus for synchronizing white balance information according to claim 14, wherein the determining unit is further configured to calculate an intermediate parameter according to the following formula:

D00=sum(V0.*V0);

D01=sum(V0.*V1);

D02=sum(V0.*V2);

D11=sum(V1.*V1);

D12=sum(V1.*V2);

u=(D11*D02-D01*D12)/(D00*D11-D01*D01);

v=(D00*D12-D01*D02)/(D00*D11-D01*D01);

Wherein, V0=CA, V1=BA, V2=PA, the P is the first coordinate point, and the C, the B, and the A are respectively three coordinates included in the first reference coordinate point. Point; sum means summation, .* symbol means multiplication of corresponding elements between vectors; u and v are intermediate parameters;

The determining unit is further configured to calculate the second coordinate point according to the following formula:

Q.x=(1-u-v)*A’.x+u*B’.x+v*C’.x;

Q.y=(1-u-v)*A’.y+u*B’.y+v*C’.y;

Wherein, the C', the B', and the A' are respectively three coordinate points included in the second reference coordinate point, and the A' and the A correspond to the same reference combination, the B' Corresponding to the same reference combination as the B, the C' corresponding to the same reference combination; the .x represents the coordinates of the first coordinate axis, and the .y represents the coordinates of the second coordinate axis; The second coordinate point is (Qx, Qy).
The white balance information synchronizing apparatus according to claim 19, wherein the pixel points of the first image, the pixel points of the second image, and the white balance gain each adopt three color channels; The value corresponding to one coordinate axis is the ratio of the first color channel to the second color channel, and the value corresponding to the second coordinate axis is the ratio of the third color channel to the second color channel.
A white balance information synchronizing apparatus, comprising: a processor and a memory, wherein the processor and the memory are connected to each other, wherein the memory is used to store a computer program, the computer program comprises program instructions, the processor It is configured to invoke the program instructions to perform the method of any of claims 1-10.
A computer readable storage medium, characterized in that the computer storage medium stores a computer program, the computer program comprising program instructions, the program instructions, when executed by a processor, causing the processor to execute as claimed in claim 1. The method of any of ten.